Difference between revisions of "WPS benchmark 2014"

From OSGeo
Jump to navigation Jump to search
 
(9 intermediate revisions by 4 users not shown)
Line 40: Line 40:
 
! HTTP port
 
! HTTP port
 
! WPS Endpoint
 
! WPS Endpoint
 +
! Echo Service Name
 
|-
 
|-
 
| All
 
| All
Line 45: Line 46:
 
| 1046
 
| 1046
 
| [http://37.187.89.64 80]
 
| [http://37.187.89.64 80]
−
|
+
|
 +
|  
 
|-
 
|-
 
| [http://www.zoo-project.org ZOO-Project]
 
| [http://www.zoo-project.org ZOO-Project]
Line 51: Line 53:
 
| 1047
 
| 1047
 
| [http://37.187.89.64:2007 2007]
 
| [http://37.187.89.64:2007 2007]
−
|
+
| [http://37.187.89.64:2007/cgi-bin/zoo_loader.cgi ZOO-Kernel]
 +
|  
 
|-
 
|-
 
| [http://52north.org/communities/geoprocessing/wps/ 52° North WPS]
 
| [http://52north.org/communities/geoprocessing/wps/ 52° North WPS]
Line 57: Line 60:
 
| 1048
 
| 1048
 
| [http://37.187.89.64:2008 2008]
 
| [http://37.187.89.64:2008 2008]
 +
| [http://37.187.89.64:2008/52nWPS/WebProcessingService 52°North WPS] [http://37.187.89.64:2008/52nWPS/WebProcessingService?request=GetCapabilities&service=WPS GetCapabilities]
 
|
 
|
 
|-
 
|-
Line 62: Line 66:
 
| jody,garnett
 
| jody,garnett
 
| 1049
 
| 1049
−
| [http://37.187.89.64:2009 2009]
+
| [http://37.187.89.64:8082 8082]
−
|
+
| [http://37.187.89.64:8082/geoserver/wps GeoServer WPS] [http://37.187.89.64:8082/geoserver/ows?service=wps&version=1.0.0&request=GetCapabilities GetCapabilities]
 +
|
 +
|-
 +
| [http://pywps.wald.intevation.org/ PyWPS-WSGI]
 +
| jachym.cepicky, jorge.jesus
 +
| 1050
 +
| [http://37.187.89.64:2010 2010]
 +
| [http://37.187.89.64:2010/pywpswsgi PyWPS-WSGI WPS] [http://37.187.89.64:2010/pywpswsgi?request=GetCapabilities&service=WPS GetCapabilities]
 +
|  
 
|-
 
|-
−
| [http://pywps.wald.intevation.org/ PyWPS]
+
| [http://pywps.wald.intevation.org/ PyWPS-CGI]
 
| jachym.cepicky, jorge.jesus
 
| jachym.cepicky, jorge.jesus
 
| 1050
 
| 1050
 
| [http://37.187.89.64:2010 2010]
 
| [http://37.187.89.64:2010 2010]
−
|
+
| [http://37.187.89.64:2010/cgi-bin/pywps.cgi PyWPS-CGI WPS] [http://37.187.89.64:2010/cgi-bin/pywps.cgi?request=GetCapabilities&service=WPS GetCapabilities]
 +
|  
 
|-
 
|-
 
| [http://constellation.codehaus.org/ Constellation]
 
| [http://constellation.codehaus.org/ Constellation]
Line 76: Line 89:
 
| [http://37.187.89.64:2010 2011]
 
| [http://37.187.89.64:2010 2011]
 
|
 
|
 +
|
 
|}
 
|}
 +
 +
=== Testing procedures ===
 +
 +
There is a first draft description of tests available for the WPS Benchmarking here : http://wiki.osgeo.org/wiki/WPS_benchmark_2014/Test.
 +
 +
=== Results ===
 +
 +
Results from september 11th: http://37.187.89.64:2007/testing/OSGeoLive-presentation-master/WPS_BenchmarkAF.html
  
 
=== Mailing list ===
 
=== Mailing list ===
Line 87: Line 109:
 
* 2014.04.15 - FOSS4G call for abstract close
 
* 2014.04.15 - FOSS4G call for abstract close
 
* 2014.04.15 - Server available for installing solutions
 
* 2014.04.15 - Server available for installing solutions
−
* 2014.04.30 - First test can start
+
* 2014.06.03 - First test can start
−
* 2014.05.15 - Call for projects closed
+
* 2014.06.15 - Call for projects closed
−
* 2014.05.26 - Call for testing closed
+
* '''2014.06.23''' - Call for testing closed
−
* 2014.06.23 - Definition of testing procedure
+
* '''2014.06.30''' - Definition of testing procedures for FOSS4G-Europe
−
* 2014.06.30 - Installation and verification of testing procedure on the test server end
+
* '''2014.07.04''' - Extract final results and inclusions in presentation for FOSS4G-Europe
−
* 2014.08.15 - Extract final results and inclusions in presentation
+
* '''2014.07.07''' - Discuss final results and define what should be included in presentation at FOSS4G
−
* 2014.9.8 - FOSS4G start
+
* 2014.07.15 - Procedure and Results presentation at FOSS4G-Europe
 +
* 2014.08.01 - Definition of testing procedures for FOSS4G
 +
* 2014.08.15 - Installation and verification of testing procedures on the dedicated server end
 +
* 2014.08.22 - Extract final results and inclusions in presentation
 +
* 2014.08.22 - Discuss final results and define what should be included in presentation at FOSS4G
 +
* 2014.09.08 - FOSS4G start
 
* 2015.04.15 - End of test server availability
 
* 2015.04.15 - End of test server availability

Latest revision as of 13:33, 12 September 2014

WPS Benchmark 2014

This page contains informations about the (possible) WPS Benchmarking session for the FOSS4G@PDX in 2014.

Plan (Draft)

  • Call for project, call for testing proposition, scénarios and designation of one contact user (for providing private informations, mainly ip, logins and passwords)
  • Setup a host that we will call the "test server" and give access to one user per project involved (server specification to come, if there is any specific requirement for your solution to be setup please let us know)
  • Call project for installing their solutions on the test server
  • Vote then define testing procedures / method / scenarios
  • Run the tests on each instances setup on the test server and publish results (at any time a team may modify the setup they made initialy and then ask that a test shlould be run against their setup again)
  • Have a WPS Benchmarking web site providing detailed informations about the tests, displaying results in fancy ways ...

Projects and people

  • ZOO-Project, Gerald Fenoy, Nicolas Bozon, Venkatesh Raghavan
  • 52°North, Benjamin Pross
  • GeoServer, Jody Garnett
  • PyWPS, Jachym Cepicky, Jorge de Jesus

Available infrastructure

A dedicated server was started on april 15th and contain hosts configured for different projects, it have the following specs: 

* Processor: Intel Xeon E3 1245v2 (4 cores/ 8 threads) 3.4 GHz+
* RAM: 32 GB DDR3
* Disks: 2 x 2 TB SATA (raid hard)
* Network connection: 1Gbps
* Bandwidth: 200 Mbps

The server ip address is the following : 37.187.89.64.

By now, there is no failover IP available (this can be modified if required) so we need to share ports between each environments. Here are the port definitions for each environment:

Team User Names SSH Port HTTP port WPS Endpoint Echo Service Name
All gerald.fenoy,nicolas.bozon,benjamin.prosss,jody.garnett,jachym.cepicky,jorge.jesus 1046 80
ZOO-Project gerald.fenoy,nicolas.bozon 1047 2007 ZOO-Kernel
52° North WPS benjamin.prosss 1048 2008 52°North WPS GetCapabilities
GeoServer jody,garnett 1049 8082 GeoServer WPS GetCapabilities
PyWPS-WSGI jachym.cepicky, jorge.jesus 1050 2010 PyWPS-WSGI WPS GetCapabilities
PyWPS-CGI jachym.cepicky, jorge.jesus 1050 2010 PyWPS-CGI WPS GetCapabilities
Constellation olivier.nouguier 1051 2011

Testing procedures

There is a first draft description of tests available for the WPS Benchmarking here : http://wiki.osgeo.org/wiki/WPS_benchmark_2014/Test.

Results

Results from september 11th: http://37.187.89.64:2007/testing/OSGeoLive-presentation-master/WPS_BenchmarkAF.html

Mailing list

Deadlines (Draft)

  • 2014.04.04 - Call for projects / testing proposals start
  • 2014.04.15 - FOSS4G call for abstract close
  • 2014.04.15 - Server available for installing solutions
  • 2014.06.03 - First test can start
  • 2014.06.15 - Call for projects closed
  • 2014.06.23 - Call for testing closed
  • 2014.06.30 - Definition of testing procedures for FOSS4G-Europe
  • 2014.07.04 - Extract final results and inclusions in presentation for FOSS4G-Europe
  • 2014.07.07 - Discuss final results and define what should be included in presentation at FOSS4G
  • 2014.07.15 - Procedure and Results presentation at FOSS4G-Europe
  • 2014.08.01 - Definition of testing procedures for FOSS4G
  • 2014.08.15 - Installation and verification of testing procedures on the dedicated server end
  • 2014.08.22 - Extract final results and inclusions in presentation
  • 2014.08.22 - Discuss final results and define what should be included in presentation at FOSS4G
  • 2014.09.08 - FOSS4G start
  • 2015.04.15 - End of test server availability
Retrieved from "http://wiki.osgeo.org/w/index.php?title=WPS_benchmark_2014&oldid=79965"