WPS benchmark 2014
WPS Benchmark 2014
This page contains informations about the (possible) WPS Benchmarking session for the FOSS4G@PDX in 2014.
Plan (Draft)
- Call for project, call for testing proposition, scénarios and designation of one contact user (for providing private informations, mainly ip, logins and passwords)
- Setup a host that we will call the "test server" and give access to one user per project involved (server specification to come, if there is any specific requirement for your solution to be setup please let us know)
- Call project for installing their solutions on the test server
- Vote then define testing procedures / method / scenarios
- Run the tests on each instances setup on the test server and publish results (at any time a team may modify the setup they made initialy and then ask that a test shlould be run against their setup again)
- Have a WPS Benchmarking web site providing detailed informations about the tests, displaying results in fancy ways ...
Projects and people
- ZOO-Project, Gerald Fenoy, Nicolas Bozon, Venkatesh Raghavan
- 52°North, Benjamin Pross
- GeoServer, Jody Garnett
- PyWPS, Jachym Cepicky, Jorge de Jesus
Available infrastructure
A dedicated server was started on april 15th and contain hosts configured for different projects, it have the following specs:
* Processor: Intel Xeon E3 1245v2 (4 cores/ 8 threads) 3.4 GHz+ * RAM: 32 GB DDR3 * Disks: 2 x 2 TB SATA (raid hard) * Network connection: 1Gbps * Bandwidth: 200 Mbps
The server ip address is the following : 37.187.89.64.
By now, there is no failover IP available (this can be modified if required) so we need to share ports between each environments. Here are the port definitions for each environment:
| Team | User Names | SSH Port | HTTP port | WPS Endpoint | Echo Service Name |
|---|---|---|---|---|---|
| All | gerald.fenoy,nicolas.bozon,benjamin.prosss,jody.garnett,jachym.cepicky,jorge.jesus | 1046 | 80 | ||
| ZOO-Project | gerald.fenoy,nicolas.bozon | 1047 | 2007 | ZOO-Kernel | |
| 52° North WPS | benjamin.prosss | 1048 | 2008 | 52°North WPS GetCapabilities | |
| GeoServer | jody,garnett | 1049 | 8082 | GeoServer WPS GetCapabilities | |
| PyWPS-WSGI | jachym.cepicky, jorge.jesus | 1050 | 2010 | PyWPS-WSGI WPS GetCapabilities | |
| PyWPS-CGI | jachym.cepicky, jorge.jesus | 1050 | 2010 | PyWPS-CGI WPS GetCapabilities | |
| Constellation | olivier.nouguier | 1051 | 2011 |
Testing procedures
There is a first draft description of tests available for the WPS Benchmarking here : http://wiki.osgeo.org/wiki/WPS_benchmark_2014/Test.
Mailing list
Deadlines (Draft)
- 2014.04.04 - Call for projects / testing proposals start
- 2014.04.15 - FOSS4G call for abstract close
- 2014.04.15 - Server available for installing solutions
- 2014.06.03 - First test can start
- 2014.06.15 - Call for projects closed
- 2014.06.23 - Call for testing closed
- 2014.06.30 - Definition of testing procedures for FOSS4G-Europe
- 2014.07.04 - Extract final results and inclusions in presentation for FOSS4G-Europe
- 2014.07.07 - Discuss final results and define what should be included in presentation at FOSS4G
- 2014.07.15 - Procedure and Results presentation at FOSS4G-Europe
- 2014.08.01 - Definition of testing procedures for FOSS4G
- 2014.08.15 - Installation and verification of testing procedures on the dedicated server end
- 2014.08.22 - Extract final results and inclusions in presentation
- 2014.08.22 - Discuss final results and define what should be included in presentation at FOSS4G
- 2014.09.08 - FOSS4G start
- 2015.04.15 - End of test server availability