View source for WPS benchmark 2014

== WPS Benchmark 2014 ==

This page contains informations about the (possible) WPS Benchmarking session for the FOSS4G@PDX in 2014.

=== Plan (Draft) ===


* Call for project, call for testing proposition, scénarios and designation of one contact user (for providing private informations, mainly ip, logins and passwords)
* Setup a host that we will call the "test server" and give access to one user per project involved (server specification to come, if there is any specific requirement for your solution to be setup please let us know)
* Call project for installing their solutions on the test server
* Vote then define testing procedures / method / scenarios
* Run the tests on each instances setup on the test server and publish results (at any time a team may modify the setup they made initialy and then ask that a test shlould be run against their setup again)
* Have a WPS Benchmarking web site providing detailed informations about the tests, displaying results in fancy ways ...

=== Projects and people ===

* ZOO-Project, Gerald Fenoy, Nicolas Bozon, Venkatesh Raghavan
* 52°North, Benjamin Pross
* GeoServer, Jody Garnett
* PyWPS, Jachym Cepicky, Jorge de Jesus

=== Available infrastructure ===

A dedicated server was started on april 15th and contain hosts configured for different projects, it have the following specs:

 * Processor: Intel Xeon E3 1245v2 (4 cores/ 8 threads) 3.4 GHz+
 * RAM: 32 GB DDR3
 * Disks: 2 x 2 TB SATA (raid hard)
 * Network connection: 1Gbps
 * Bandwidth: 200 Mbps

The server ip address is the following : 37.187.89.64.

By now, there is no failover IP available (this can be modified if required) so we need to share ports between each environments. Here are the port definitions for each environment:

{|class="wikitable sortable"   border="2" cellspacing="0" cellpadding="6" rules="all" style="margin:1em 1em 1em 0; border:solid 1px #AAAAAAAA; border-collapse:collapse; background-color:#edf9c7; font-size:95%; empty-cells:show;" 
! Team
! User Names
! SSH Port
! HTTP port
! WPS Endpoint
! Echo Service Name
|-
| All
| gerald.fenoy,nicolas.bozon,benjamin.prosss,jody.garnett,jachym.cepicky,jorge.jesus
| 1046
| [http://37.187.89.64 80]
| 
| 
|-
| [http://www.zoo-project.org ZOO-Project]
| gerald.fenoy,nicolas.bozon
| 1047
| [http://37.187.89.64:2007 2007]
| [http://37.187.89.64:2007/cgi-bin/zoo_loader.cgi ZOO-Kernel]
| 
|-
| [http://52north.org/communities/geoprocessing/wps/ 52° North WPS]
| benjamin.prosss
| 1048
| [http://37.187.89.64:2008 2008]
| [http://37.187.89.64:2008/52nWPS/WebProcessingService 52°North WPS] [http://37.187.89.64:2008/52nWPS/WebProcessingService?request=GetCapabilities&service=WPS GetCapabilities]
|
|-
| [http://geoserver.org/ GeoServer]
| jody,garnett
| 1049
| [http://37.187.89.64:8082 8082]
| [http://37.187.89.64:8082/geoserver/wps GeoServer WPS] [http://37.187.89.64:8082/geoserver/ows?service=wps&version=1.0.0&request=GetCapabilities GetCapabilities]
| 
|-
| [http://pywps.wald.intevation.org/ PyWPS-WSGI]
| jachym.cepicky, jorge.jesus
| 1050
| [http://37.187.89.64:2010 2010]
| [http://37.187.89.64:2010/pywpswsgi PyWPS-WSGI WPS] [http://37.187.89.64:2010/pywpswsgi?request=GetCapabilities&service=WPS GetCapabilities]
| 
|-
| [http://pywps.wald.intevation.org/ PyWPS-CGI]
| jachym.cepicky, jorge.jesus
| 1050
| [http://37.187.89.64:2010 2010]
| [http://37.187.89.64:2010/cgi-bin/pywps.cgi PyWPS-CGI WPS] [http://37.187.89.64:2010/cgi-bin/pywps.cgi?request=GetCapabilities&service=WPS GetCapabilities]
| 
|-
| [http://constellation.codehaus.org/ Constellation]
| olivier.nouguier
| 1051
| [http://37.187.89.64:2010 2011]
|
| 
|}

=== Testing procedures ===

There is a first draft description of tests available for the WPS Benchmarking here : http://wiki.osgeo.org/wiki/WPS_benchmark_2014/Test.

=== Mailing list ===

* http://lists.osgeo.org/mailman/listinfo/wps-discuss

=== Deadlines (Draft) ===

* 2014.04.04 - Call for projects / testing proposals start
* 2014.04.15 - FOSS4G call for abstract close
* 2014.04.15 - Server available for installing solutions
* 2014.06.03 - First test can start
* 2014.06.15 - Call for projects closed
* '''2014.06.23''' - Call for testing closed
* '''2014.06.30''' - Definition of testing procedures for FOSS4G-Europe
* '''2014.07.04''' - Extract final results and inclusions in presentation for FOSS4G-Europe
* '''2014.07.07''' - Discuss final results and define what should be included in presentation at FOSS4G
* 2014.07.15 - Procedure and Results presentation at FOSS4G-Europe
* 2014.08.01 - Definition of testing procedures for FOSS4G
* 2014.08.15 - Installation and verification of testing procedures on the dedicated server end
* 2014.08.22 - Extract final results and inclusions in presentation
* 2014.08.22 - Discuss final results and define what should be included in presentation at FOSS4G
* 2014.09.08 - FOSS4G start
* 2015.04.15 - End of test server availability