Benchmarking 2010

From OSGeo
Revision as of 06:58, 8 March 2010 by Sourcepole (talk | contribs) (FOSS4G_Benchmark link)
Jump to navigation Jump to search

Basic Premise

Following up on last year's exercise, the performance shoot-out presentation at FOSS4G2010 will test how long each Web mapping server takes to generate a map image, from a common set of spatial data, on a common platform. The data will be served by each Web mapping server through the WMS standard, which will serve exactly the same set of LAYERS. A JMeter load will be run on the testing box to measure various aspects of those layers.


January 1st, 2010 begin contacting all mapping servers
April 1st, 2010 commitment due by all interested mapping servers
April 1st, 2010 exercise begins (and weekly meetings)
August 1st, 2010 final testing begins
August 23rd, 2010 no further testing
September 6-9, 2010 present results at FOSS4G2010


Coordination/communication is primarily via the Benchmarking mailing list:

Weekly meetings will occur through IRC chat in the #foss4g channel on

Potential Participants

Mapping Server Volunteer to contact Dev Team Contacted Server's Development Team Confirmed by Server's Development Team Development Team Leader
GeoServer Andrea Aime yes yes Andrea Aime
MapServer Jeff McKenna yes yes Jeff McKenna
ESRI ArcGIS Server Joel Schlagel
Erdas Apollo
MapGuide Open Source DanickVenne?
Deegree Simone Giannecchini yes
Oracle MapViewer Mike Smith
Mapnik Dane Springmeyer yes yes Dane Springmeyer
Luciad Web Services Suite Leif Gruenwoldt