Difference between revisions of "Benchmarking 2010"

From OSGeo
Jump to navigation Jump to search
m
Line 1: Line 1:
== Basic Premise ==
+
== Basic Premise ==
  
Following up on [[Benchmarking_2009|last year's exercise]], the performance shoot-out presentation at [[FOSS4G2010]] will test how long each Web mapping server takes to generate a map image, from a common set of spatial data, on a common platform. The data will be served by each Web mapping server through the WMS standard, which will serve exactly the same set of LAYERS. A JMeter load will be run on the testing box to measure various aspects of those layers.
+
Following up on [[Benchmarking 2009|last year's exercise]], the performance shoot-out presentation at [[FOSS4G2010]] will test how long each Web mapping server takes to generate a map image, from a common set of spatial data, on a common platform. The data will be served by each Web mapping server through the WMS standard, which will serve exactly the same set of LAYERS. A JMeter load will be run on the testing box to measure various aspects of those layers.  
  
== Timeline ==
+
== Timeline ==
  
 
{| border="1"
 
{| border="1"
|January 1st, 2010
 
|begin contacting all mapping servers
 
 
|-
 
|-
|April 1st, 2010
+
| January 1st, 2010  
|commitment due by all interested mapping servers
+
| begin contacting all mapping servers
 
|-
 
|-
|April 1st, 2010
+
| April 1st, 2010  
|exercise begins (and weekly meetings)
+
| commitment due by all interested mapping servers
 
|-
 
|-
|August 1st, 2010
+
| April 1st, 2010  
|final testing begins
+
| exercise begins (and weekly meetings)
 
|-
 
|-
|August 23rd, 2010
+
| August 1st, 2010  
|no further testing
+
| final testing begins
 
|-
 
|-
|September 6-9, 2010
+
| August 23rd, 2010
|present results at FOSS4G2010
+
| no further testing
 
+
|-
 +
| September 6-9, 2010  
 +
| present results at FOSS4G2010
 
|}
 
|}
  
== Communication ==
+
== Communication ==
  
Coordination/communication is primarily via the Benchmarking mailing list: http://lists.osgeo.org/mailman/listinfo/benchmarking
+
Coordination/communication is primarily via the Benchmarking mailing list: http://lists.osgeo.org/mailman/listinfo/benchmarking  
  
Weekly meetings will occur through IRC chat in the #foss4g channel on irc.freenode.net
+
Weekly meetings will occur through IRC chat in the #foss4g channel on irc.freenode.net  
  
 
== Potential Participants  ==
 
== Potential Participants  ==
Line 42: Line 42:
 
| '''Development Team Leader'''
 
| '''Development Team Leader'''
 
|-
 
|-
| Constellation-SDI
+
| Constellation-SDI  
| [[User:Acuster |Adrian Custer]]
+
| [[User:Acuster|Adrian Custer]]  
| yes
+
| yes  
| yes
+
| yes  
| [mailto:cedric.briancon--@--geomatys.fr Cédric Briançon]
+
| [mailto:cedric.briancon--@--geomatys.fr Cédric Briançon]
 
|-
 
|-
 
| Deegree  
 
| Deegree  
 
| Simone Giannecchini  
 
| Simone Giannecchini  
 
| yes  
 
| yes  
|  
+
| <br>
|  
+
| <br>
 
|-
 
|-
 
| Erdas Apollo  
 
| Erdas Apollo  
|  
+
| [[User:Ascollignon|Anne-Sophie Collignon]]<br>
|  
+
| yes<br>
|  
+
| yes<br>
|  
+
| [mailto:dimitri.monie@erdas.com Dimitri Monie]<br>
 
|-
 
|-
 
| ESRI ArcGIS Server  
 
| ESRI ArcGIS Server  
| Joel Schlagel
+
| Joel Schlagel  
|  
+
| <br>
|  
+
| <br>
|  
+
| <br>
 
|-
 
|-
 
| GeoServer  
 
| GeoServer  
Line 74: Line 74:
 
| MapGuide Open Source  
 
| MapGuide Open Source  
 
| DanickVenne?  
 
| DanickVenne?  
|  
+
| <br>
|  
+
| <br>
|  
+
| <br>
 
|-
 
|-
 
| Luciad Web Services Suite  
 
| Luciad Web Services Suite  
| [[User:LeifGruenwoldt|Leif Gruenwoldt]]
+
| [[User:LeifGruenwoldt|Leif Gruenwoldt]]  
| yes
+
| yes  
|  
+
| <br>
|  
+
| <br>
 
|-
 
|-
 
| Mapnik  
 
| Mapnik  
Line 98: Line 98:
 
| Oracle MapViewer  
 
| Oracle MapViewer  
 
| Mike Smith  
 
| Mike Smith  
|  
+
| <br>
|  
+
| <br>
|  
+
| <br>
 
|}
 
|}
  
== Links ==
+
== Links ==
 +
 
 +
*[[FOSS4G Benchmark|FOSS4G WMS Benchmark]]
 +
*[http://sourceforge.net/projects/wmstester/ WMSTester - tool for testing not from OSGeo]
  
* [[FOSS4G_Benchmark | FOSS4G WMS Benchmark]]
 
* [http://sourceforge.net/projects/wmstester/ WMSTester - tool for testing not from OSGeo]
 
 
----
 
----
  
 
[[Category:FOSS4G2010]] [[Category:FOSS4G]]
 
[[Category:FOSS4G2010]] [[Category:FOSS4G]]

Revision as of 06:16, 20 April 2010

Basic Premise

Following up on last year's exercise, the performance shoot-out presentation at FOSS4G2010 will test how long each Web mapping server takes to generate a map image, from a common set of spatial data, on a common platform. The data will be served by each Web mapping server through the WMS standard, which will serve exactly the same set of LAYERS. A JMeter load will be run on the testing box to measure various aspects of those layers.

Timeline

January 1st, 2010 begin contacting all mapping servers
April 1st, 2010 commitment due by all interested mapping servers
April 1st, 2010 exercise begins (and weekly meetings)
August 1st, 2010 final testing begins
August 23rd, 2010 no further testing
September 6-9, 2010 present results at FOSS4G2010

Communication

Coordination/communication is primarily via the Benchmarking mailing list: http://lists.osgeo.org/mailman/listinfo/benchmarking

Weekly meetings will occur through IRC chat in the #foss4g channel on irc.freenode.net

Potential Participants

Mapping Server Volunteer to contact Dev Team Contacted Server's Development Team Confirmed by Server's Development Team Development Team Leader
Constellation-SDI Adrian Custer yes yes Cédric Briançon
Deegree Simone Giannecchini yes

Erdas Apollo Anne-Sophie Collignon
yes
yes
Dimitri Monie
ESRI ArcGIS Server Joel Schlagel


GeoServer Andrea Aime yes yes Andrea Aime
MapGuide Open Source DanickVenne?


Luciad Web Services Suite Leif Gruenwoldt yes

Mapnik Dane Springmeyer yes yes Dane Springmeyer
MapServer Jeff McKenna yes yes Jeff McKenna
Oracle MapViewer Mike Smith


Links