Benchmarking 2010/Constellation-SDI

This page describes the experience of the Constellation-SDI team during the FOSS4G 2010 Benchmarking effort.

How to benchmark

We expended a great deal of effort attempting to understand how a benchmarking effort could be designed properly. The 2009 and 2010 efforts were undertaken in the naive belief that one simply sets up different servers on the same data and makes requests of the servers to compare response times. Belately, the 2010 effort is demonstrating that a proper benchmark is more complex and that it takes a well considered design to ensure that the benchmarking allows comparison of software servers rather than merely reflecting hardware limits.

Enhancements

This section describes enhancements due to the work during the benchmarking 2010 effort, including improved understanding and workflow by the Constellation-SDI team and ameliorations to the code bases of the Geotoolkit.org library and to the server itself.

Performance Results

This section details our understanding of the performance of the server.