Benchmarking 2010

Basic Premise
Following up on last year's exercise, the performance shoot-out presentation at FOSS4G2010 will test how long each Web mapping server takes to generate a map image, from a common set of spatial data, on a common platform. The data will be served by each Web mapping server through the WMS standard, which will serve exactly the same set of LAYERS. A JMeter load will be run on the testing box to measure various aspects of those layers.

Communication
Coordination/communication is primarily via the Benchmarking mailing list: http://lists.osgeo.org/mailman/listinfo/benchmarking

Weekly meetings will occur through IRC chat in the #foss4g channel on irc.freenode.net

Next IRC meeting

 * Wed June 2nd @ 15:00:00 UTC
 * Agenda:
 * team representative introductions
 * Establish this year's 'Rules of Engagement' (previous RoE)
 * Discuss dataset to be used (including how to share the large dataset, for running local tests)
 * Discuss server infrastructure
 * Discuss possible changes to the test script parameters
 * Set next meeting date

External Related Links

 * FOSS4G WMS Benchmark
 * WMSTester - tool for testing not from OSGeo