WPS benchmark 2014

From OSGeo
Jump to navigation Jump to search

WPS Benchmark 2014

This page contains informations about the (possible) WPS Benchmarking session for the FOSS4G@PDX in 2014.

Plan (Draft)

  • Call for project, call for testing proposition, scénarios and designation of one contact user (for providing private informations, mainly ip, logins and passwords)
  • Setup a host that we will call the "test server" and give access to one user per project involved (server specification to come, if there is any specific requirement for your solution to be setup please let us know)
  • Call project for installing their solutions on the test server
  • Vote then define testing procedures / method / scenarios
  • Run the tests on each instances setup on the test server and publish results (at any time a team may modify the setup they made initialy and then ask that a test shlould be run against their setup again)
  • Have a WPS Benchmarking web site providing detailed informations about the tests, displaying results in fancy ways ...

Projects and people

  • ZOO-Project, Gerald Fenoy, Nicolas Bozon, Venkatesh Raghavan
  • 52°North, Benjamin Pross
  • GeoServer, Jody Garnett
  • PyWPS, Jachym Cepicky, Jorge de Jesus

Available infrastructure

A dedicated server was started on april 15th and contain hosts configured for different projects, it have the following specs:

* Processor: Intel Xeon E3 1245v2 (4 cores/ 8 threads) 3.4 GHz+
* RAM: 32 GB DDR3
* Disks: 2 x 2 TB SATA (raid hard)
* Network connection: 1Gbps
* Bandwidth: 200 Mbps

The server ip address is the following :

By now, there is no failover IP available (this can be modified if required) so we need to share ports between each environments. Here are the port definitions for each environment:

Team User Names SSH Port HTTP port WPS Endpoint Echo Service Name
All gerald.fenoy,nicolas.bozon,benjamin.prosss,jody.garnett,jachym.cepicky,jorge.jesus 1046 80
ZOO-Project gerald.fenoy,nicolas.bozon 1047 2007 ZOO-Kernel
52° North WPS benjamin.prosss 1048 2008 52°North WPS GetCapabilities
GeoServer jody,garnett 1049 8082 GeoServer WPS GetCapabilities
PyWPS-WSGI jachym.cepicky, jorge.jesus 1050 2010 PyWPS-WSGI WPS GetCapabilities
PyWPS-CGI jachym.cepicky, jorge.jesus 1050 2010 PyWPS-CGI WPS GetCapabilities
Constellation olivier.nouguier 1051 2011

Testing procedures

There is a first draft description of tests available for the WPS Benchmarking here : http://wiki.osgeo.org/wiki/WPS_benchmark_2014/Test.


Results from september 11th:

Mailing list

Deadlines (Draft)

  • 2014.04.04 - Call for projects / testing proposals start
  • 2014.04.15 - FOSS4G call for abstract close
  • 2014.04.15 - Server available for installing solutions
  • 2014.06.03 - First test can start
  • 2014.06.15 - Call for projects closed
  • 2014.06.23 - Call for testing closed
  • 2014.06.30 - Definition of testing procedures for FOSS4G-Europe
  • 2014.07.04 - Extract final results and inclusions in presentation for FOSS4G-Europe
  • 2014.07.07 - Discuss final results and define what should be included in presentation at FOSS4G
  • 2014.07.15 - Procedure and Results presentation at FOSS4G-Europe
  • 2014.08.01 - Definition of testing procedures for FOSS4G
  • 2014.08.15 - Installation and verification of testing procedures on the dedicated server end
  • 2014.08.22 - Extract final results and inclusions in presentation
  • 2014.08.22 - Discuss final results and define what should be included in presentation at FOSS4G
  • 2014.09.08 - FOSS4G start
  • 2015.04.15 - End of test server availability