Difference between revisions of "Geodata Discovery Working Group"

From OSGeo
Jump to navigation Jump to search
(→‎Participants: Brylie Christopher Oxley)
 
(37 intermediate revisions by 12 users not shown)
Line 1: Line 1:
 
This is a [[Working Group]] started by the [[Public Geospatial Data Committee]].  
 
This is a [[Working Group]] started by the [[Public Geospatial Data Committee]].  
 +
 +
''NOTICE'': There are two BOFs on this topic at [[OSGeo_at_FOSS4G2006#BOFs|FOSS4G2006]] on ''Geodata'' and about ''Geodata Discovery and Metadata Models''.
  
 
While OSGeo can consider hosting sets of public geodata, (and for the purposes of offering maintained [[Geodata Packaging Working Group|packages]] of high-quality data for education and demonstration, it probably will), we can compile a set of best practises and references to good prior art for building and maintaining collections of data and metadata.  
 
While OSGeo can consider hosting sets of public geodata, (and for the purposes of offering maintained [[Geodata Packaging Working Group|packages]] of high-quality data for education and demonstration, it probably will), we can compile a set of best practises and references to good prior art for building and maintaining collections of data and metadata.  
Line 21: Line 23:
 
* [[User:Ocantan|Oscar Cantán]]
 
* [[User:Ocantan|Oscar Cantán]]
 
* [[User:Sfkeller|Stefan Keller]]
 
* [[User:Sfkeller|Stefan Keller]]
 +
* [[User:candrsn|Carl Anderson]]
 +
* [[User:K1_Kabiri|Keivan Kabiri]]
 +
* [[User:kgjenkins|Keith Jenkins]]
 +
* [[USER:gjlawan|Greg Lawrance]]
 +
* [[User:brylie|Brylie Christopher Oxley]]
 
* ''please add yourself''
 
* ''please add yourself''
  
 
== Existing (Meta) Search Projects and Related Efforts ==
 
== Existing (Meta) Search Projects and Related Efforts ==
  
−
Search Services:
+
More on metadata models at [[Geodata_Metadata_Requirements]]
 +
 
 +
Search services:
 +
* See [[Geodata_Metadata_Requirements#Discovery]]
 
* (Meta) Data Catalogues / Data Repositories
 
* (Meta) Data Catalogues / Data Repositories
−
** [http://www.mapdex.org/search/ Mapdex] is "a global Index of 2,018 servers, serving 37,168 map services, containing over 400,000 GIS Layers, covering more than 4,000,000 columns!"
 
 
** [http://www.geotorrent.org/ GeoTorrent] hosts BitTorrents of shapefile/TIFF format data.
 
** [http://www.geotorrent.org/ GeoTorrent] hosts BitTorrents of shapefile/TIFF format data.
 
** [http://www.fao.org/geonetwork/ GeoNetwork] "Find Interactive Maps, GIS datasets, Satellite Imagery and Related Applications"
 
** [http://www.fao.org/geonetwork/ GeoNetwork] "Find Interactive Maps, GIS datasets, Satellite Imagery and Related Applications"
−
** [http://www.dlese.org/libdev/dcs_overview.html DLESE Collection System] offers a metadata repository and editor
+
** [http://www.dlese.org/libdev/dcs_overview.html DLESE Collection System] offers a metadata repository and editor and supports OAI-PMH as data provider and harvester
−
** [http://www.geometa.info/gmdb/ Geo Meta Data Base (GMDB)] metadata repository and editor based on ISO 19115 Metadata Core with XML export to ISO 19115 CH-Profile/GM03 (german only)
+
** [http://gis.hsr.ch/gmdb/ Geo Meta Data Base (GMDB)] - Metadata repository and editor based on ISO 19115/119 Metadata and Dublin Core with XML export and OAI-PMH data provider support (german only)
−
** GDI Portals (country specific): [http://www.geodata.gov US], [http://www.gogeo.ac.uk UK], [http://www.geoportal.bund.de D], [http://www.geoland.at/ A], [http://www.geocat.ch CH], [http://geodaten.llv.li/geoshop/public.html LI], [http://www.geoportail.fr/ F], ...
+
** GDI Portals (country specific): [http://www.geodata.gov US], [http://www.gogeo.ac.uk UK], [http://www.geoportal.bund.de D], [http://www.geoland.at/ A], [http://www.geocat.ch CH], [http://geodaten.llv.li/geoshop/public.html LI], [http://www.geoportail.fr/ FR], [http://www.icde.org.co/ CO]...
−
* (Meta) Search Engines:
+
* (Meta) Search engines:
 
** [http://geometa.info/ geometa.info] - search engine for geospatial services, data and documents combining structured and unstructured data (currently german only)
 
** [http://geometa.info/ geometa.info] - search engine for geospatial services, data and documents combining structured and unstructured data (currently german only)
 
** [http://www.google.com/search?q=allinurl%3A+getcapabilities Google search] using 'allinurl' parameter
 
** [http://www.google.com/search?q=allinurl%3A+getcapabilities Google search] using 'allinurl' parameter
  
−
Lists:
+
Lists about data sources and services:
−
* Web Services lists:
+
* Lists on web services:
 
** http://www.skylab-mobilesystems.com/ger/wms_serverlist.html simple WMS service URL list
 
** http://www.skylab-mobilesystems.com/ger/wms_serverlist.html simple WMS service URL list
 
** http://www.refractions.net/white_papers/ogcsurvey/ Automated OGC Survey on the Web (WMF, WFS, ...)
 
** http://www.refractions.net/white_papers/ogcsurvey/ Automated OGC Survey on the Web (WMF, WFS, ...)
 
** http://geometa.info/search.jsp?query=type%3Awms WMS search engine
 
** http://geometa.info/search.jsp?query=type%3Awms WMS search engine
−
* US data servers:
+
** http://exploreourpla.net/maps/
−
** http://datagateway.nrcs.usda.gov/
+
 +
** [[Orthophotography]] Annotated list of Orthophotography WMS Services
 +
* Lists on data services:
 +
** http://datagateway.nrcs.usda.gov/ US data servers
 +
** [http://geopole.org/ Geopole.org - WMS server list]
  
 
== Public Datasets for Possible Mirroring or Distribution ==
 
== Public Datasets for Possible Mirroring or Distribution ==
 +
 +
=== Regional data sets ===
 +
 +
These data sets comprise raster and vector data (with permittive license):
 +
 +
* [http://www.so.ch/de/pub/departemente/bjd/gis/daten.htm SO!GIS® data of Kanton Solothurn] (Switzerland)
 +
* [[Edu Data Package North Carolina]] (USA)
 +
* [http://www.findgis.com FindGIS - Florida City, County & Goverment Agency GIS Data Download & FTP Sites]
  
 
=== Gazetteer Data ===
 
=== Gazetteer Data ===
 
... basically placenames with coordinates ...
 
... basically placenames with coordinates ...
  
−
* [http://earth-info.nga.mil/gns/html/ NGA GNS Gazetteer]
+
* [http://www.geonames.org/ Geonames.org] gazetteer (includes [http://earth-info.nga.mil/gns/html/ NGA GNS Gazetteer])
 
* [http://prdownloads.sourceforge.net/nasa-exp/BlueMarble-Placenames.zip?download WorldWind Placenames] (markusN can provide PERL to read this)
 
* [http://prdownloads.sourceforge.net/nasa-exp/BlueMarble-Placenames.zip?download WorldWind Placenames] (markusN can provide PERL to read this)
−
* [http://www.geonames.org/ Geonames.org] gazetteer
+
* [http://lists.burri.to/pipermail/geowanking/2007-March/003772.html Geowanking-List: Toponymic accurracy of Google and Yahoo Maps] => a very good example why  releasing this data is useful for public authorities and the society
  
 
=== Vector data ===
 
=== Vector data ===
−
* VMAP0 - 1:1Mio, very generalised vector data for many features, around 70 layers
+
* VMAP0 - 1:1Mio, very generalised vector data for many features, around 70 [http://www.terragear.org/docs/vmap0/coverage.html layers] (already at telascience) - see also [http://www.mapability.com/info/vmap0_index.html here] for docs
 +
* [http://aprsworld.net/gisdata/world/ World map for APRS], 1:1.1mio
 
* [http://www.soest.hawaii.edu/wessel/gshhs/gshhs.html GSHHS] - world coastlines, different scales available
 
* [http://www.soest.hawaii.edu/wessel/gshhs/gshhs.html GSHHS] - world coastlines, different scales available
 
* TIGER/Line (USA) - street and addressing data for the US
 
* TIGER/Line (USA) - street and addressing data for the US
 
* RNF (Canada) - street and addressing data for Canada
 
* RNF (Canada) - street and addressing data for Canada
 
* [http://www.openstreetmap.org OpenStreetMap] - data available through a [http://wiki.openstreetmap.org/index.php/REST HTTP based XML interface]. They've also been getting requests for shapefile and GML output of their data.
 
* [http://www.openstreetmap.org OpenStreetMap] - data available through a [http://wiki.openstreetmap.org/index.php/REST HTTP based XML interface]. They've also been getting requests for shapefile and GML output of their data.
 +
* [http://www.maplibrary.org/stacks/Africa_lite.asp African geodata]
  
 
=== Raster data ===
 
=== Raster data ===
Line 68: Line 91:
 
** [http://ekman.csc.noaa.gov/TCM/ NOAA TCM] LIDAR / IfSAR
 
** [http://ekman.csc.noaa.gov/TCM/ NOAA TCM] LIDAR / IfSAR
 
* Satellite Data
 
* Satellite Data
−
** Landsat ([http://onearth.jpl.nasa.gov/ OnEarth mirror already at telascience])
+
** Landsat ([http://onearth.jpl.nasa.gov/ OnEarth]  - [http://telascience.sdsc.edu/tela_data/onearth/ mirror already at telascience])
 
** [http://earthobservatory.nasa.gov/Newsroom/BlueMarble/ Blue Marble] / [http://www.iac.ethz.ch/staff/stockli/bmng/ Blue Marble Next Generation] (mirror already at telascience)
 
** [http://earthobservatory.nasa.gov/Newsroom/BlueMarble/ Blue Marble] / [http://www.iac.ethz.ch/staff/stockli/bmng/ Blue Marble Next Generation] (mirror already at telascience)
 
** ASTER (from GLCF)
 
** ASTER (from GLCF)
Line 79: Line 102:
 
** [http://dmsp.ngdc.noaa.gov/html/projects/lights.html City lights]
 
** [http://dmsp.ngdc.noaa.gov/html/projects/lights.html City lights]
 
** [http://www.worldwildlife.org/freshwater/hydrosheds.cfm HydroSHEDS] - Hydrological data and maps based on SHuttle Elevation Derivatives at multiple Scales
 
** [http://www.worldwildlife.org/freshwater/hydrosheds.cfm HydroSHEDS] - Hydrological data and maps based on SHuttle Elevation Derivatives at multiple Scales
 +
** [http://unosat.web.cern.ch/unosat/ UNOSAT imagery] http://unosat.web.cern.ch/unosat/asp/prod_free.asp
  
 
== Wishlist for Public Datasets ==
 
== Wishlist for Public Datasets ==
Line 86: Line 110:
 
** http://www.fgdl.org/download/index.html  
 
** http://www.fgdl.org/download/index.html  
 
** http://datagateway.nrcs.usda.gov/
 
** http://datagateway.nrcs.usda.gov/
 +
 +
== Search Protocols ==
 +
 +
* GIS-specific:
 +
** OGC's CSW 2.0 (work in progress...)
 +
*** [http://www.opengeospatial.org/standards/requests/29 OpenGIS Catalogue Services - ebRIM (ISO/TS 15000-3) profile of CSW]
 +
*** (ISO/OGC's "ISO19115/ISO19119 Application Profile for CSW 2.0")
 +
*** See a comparison between [http://www.gis.hsr.ch/wiki/OAI-PMH CSW and OAI-PMH]
 +
** OGC's WFS (profile) serving (profiled) ISO 19115/19119 metadata format...?
 +
** 'Lean and mean' proposals on project level...
 +
*** [[Simple Catalog Interface]]
 +
* Related search/harvest protocols - possibly to be profiled or specialized by geoinformation requirements:
 +
** [http://www.openarchives.org/OAI/openarchivesprotocol.html OAI-PMH] (Open Archives Initiative Protocol for Metadata Harvesting 2.0)
 +
*** See also [http://www.modoai.org/ mod_oai], an Apache module under development
 +
** [http://www.loc.gov/standards/sru/ Search/Retrieve via URL] (SRU/SRW)
 +
** [http://en.wikipedia.org/wiki/OpenSearch OpenSearch] proposal from A9
 +
** [http://lcweb.loc.gov/z3950/agency/document.html Z39.50 ANSI/NISO standard protocol]
 +
** [http://www.ebxml.org/ ebXML]/ebRIM Messaging Service 2.0
  
 
== Hosting Plan ==
 
== Hosting Plan ==
Line 96: Line 138:
 
* [[Geodata Licensing Working Group]]
 
* [[Geodata Licensing Working Group]]
 
* [[WMS Tile Caching]] proposal
 
* [[WMS Tile Caching]] proposal
 +
* [[Geodata processing at telascience.org]]
 +
 +
[[Category:Public Geospatial Data Committee]]

Latest revision as of 04:31, 13 June 2014

This is a Working Group started by the Public Geospatial Data Committee.

NOTICE: There are two BOFs on this topic at FOSS4G2006 on Geodata and about Geodata Discovery and Metadata Models.

While OSGeo can consider hosting sets of public geodata, (and for the purposes of offering maintained packages of high-quality data for education and demonstration, it probably will), we can compile a set of best practises and references to good prior art for building and maintaining collections of data and metadata.

Focus

  • Metadata for collections of geographic information.
  • Providing best practise and prototypes for geodata search facilities
  • Help with providing input into the OSGeo repository/services at http://osgeo.telascience.org/
  • Providing 'catalog'/discovery/search services as part of OSGeo activities in promoting access to public domain and open licensed bodies of data.

Participants

Existing (Meta) Search Projects and Related Efforts

More on metadata models at Geodata_Metadata_Requirements

Search services:

  • See Geodata_Metadata_Requirements#Discovery
  • (Meta) Data Catalogues / Data Repositories
    • GeoTorrent hosts BitTorrents of shapefile/TIFF format data.
    • GeoNetwork "Find Interactive Maps, GIS datasets, Satellite Imagery and Related Applications"
    • DLESE Collection System offers a metadata repository and editor and supports OAI-PMH as data provider and harvester
    • Geo Meta Data Base (GMDB) - Metadata repository and editor based on ISO 19115/119 Metadata and Dublin Core with XML export and OAI-PMH data provider support (german only)
    • GDI Portals (country specific): US, UK, D, A, CH, LI, FR, CO...
  • (Meta) Search engines:
    • geometa.info - search engine for geospatial services, data and documents combining structured and unstructured data (currently german only)
    • Google search using 'allinurl' parameter

Lists about data sources and services:

Public Datasets for Possible Mirroring or Distribution

Regional data sets

These data sets comprise raster and vector data (with permittive license):

Gazetteer Data

... basically placenames with coordinates ...

Vector data

  • VMAP0 - 1:1Mio, very generalised vector data for many features, around 70 layers (already at telascience) - see also here for docs
  • World map for APRS, 1:1.1mio
  • GSHHS - world coastlines, different scales available
  • TIGER/Line (USA) - street and addressing data for the US
  • RNF (Canada) - street and addressing data for Canada
  • OpenStreetMap - data available through a HTTP based XML interface. They've also been getting requests for shapefile and GML output of their data.
  • African geodata

Raster data

Wishlist for Public Datasets

Search Protocols

Hosting Plan

(placeholder for an initial hosting plan sketch)

See Also

Retrieved from "http://wiki.osgeo.org/w/index.php?title=Geodata_Discovery_Working_Group&oldid=78209"