Difference between revisions of "Osgeolive misc repos"

From OSGeo
Jump to navigation Jump to search
 
(14 intermediate revisions by the same user not shown)
Line 1: Line 1:
Open Issues from the Mailing List  May 2022
+
All Things Repo for Content Edits '''ol15'''
  
<hr/>
 
from: jenriquesoriano@guadaltel.com
 
cc: Marco.MINGHINI@ec.europa.eu;  portele@interactive-instruments.de;  herrmann@interactive-instruments.de;
 
michael.lutz@ec.europa.eu;  josebarrero@guadaltel.com
 
 
Dear OSGeoLive team,  we contact you to kindly propose the inclusion of the '''ETF testing framework''' in the OSGeoLive distribution. Following the requirements, please find below the answer to the required questions. Please let us know if any additional clarification is needed.  [0] [https://www.openhub.net/p/etf-validator -VLINK-] [https://github.com/etf-validator/etf-webapp/releases/tag/2.0.0 -GITHUB-]
 
 
<br/>
 
Reply: Angelos  4/28
 
Thank you for your application. ; We will process during our next project meeting and provide feedback.
 
<hr/>
 
 
<hr/>
 
from: Jim Klassen  4/11
 
I'd suggest looking at the '''live-build debian package''' (which is also available in Ubuntu).  It can build an iso/usb hybrid boot image (with optional installer), supports a persistence file on USB, and doesn't seem to have a 4GB limit on the squashfs root.
 
<br/>
 
Reply: Angelos  4/28
 
Yes, this has been a nice option since Ubuntu switched to using live-build officially some years ago.
 
I think we need a demo script to see how it would work before deciding if this is the way forward.
 
In the meantime, there is an option to use xorriso package (I need to find some time to test)
 
<hr/>
 
 
<hr/>
 
'''Java Version''' 5/14 
 
darkblueb: Deegree Code Sprint -- the take-away from the email was.. Deegree v3.4x will work with Java 8;  Deegree v3.5x will require Java 11 and a newer Tomcat..
 
<hr/>
 
 
 
<hr/>
 
 
=== QEMU Convert Disk Image ===
 
 
    $ qemu-img convert -f vmdk -O qcow2 osgeolive-14.0-amd64.vmdk ol14.qcow2
 
 
=== Remove Snapd ===
 
    ## Steps to remove snapd from base build16
 
    $ sudo snap list
 
    $ sudo snap remove firefox
 
    $ sudo snap remove gnome-3-38-2004
 
    $ sudo snap remove gtk-common-themes
 
    $ sudo snap remove core20
 
    $ sudo snap remove bare
 
    $ sudo snap remove snapd
 
    ## next, stop the systemd service, disable
 
    $ sudo systemctl stop snapd && sudo systemctl disable snapd
 
    $ sudo apt purge snapd
 
    ## manually remove caches
 
    $ rm -rf ~/snap
 
    $ sudo rm -rf /snap /var/snap /var/lib/snapd /var/cache/snapd /usr/lib/snapd /root/snap
 
 
<hr/>
 
 
=== jammy Initial Updates ===
 
ol15nightly install, first pass updates
 
<pre>
 
  $ sudo apt update
 
  .. packages list here ...
 
</pre>
 
 
<pre>
 
  UPDATE build38 -- Firefox by dot-deb
 
  $ wget https://download.osgeo.org/livedvd/data/browser/google-chrome-stable_current_amd64.deb
 
  $ wget https://download.osgeo.org/livedvd/data/browser/google-chrome-stable.md5sum
 
 
  $ md5sum -c google-chrome-stable.md5sum
 
</pre>
 
 
Editing and installer setup scratch
 
<pre>
 
$ git clone --depth=1 https://git.osgeo.org/gitea/osgeolive/OSGeoLive
 
</pre>
 
  
 
=== Repos ===
 
=== Repos ===
Line 143: Line 72:
  
 
rasterio                https://github.com/mapbox/rasterio.git
 
rasterio                https://github.com/mapbox/rasterio.git
 +
rio-plugins              https://github.com/rasterio/rasterio/wiki/Rio-plugin-registry
 
rio-tiler                https://github.com/cogeotiff/rio-tiler.git
 
rio-tiler                https://github.com/cogeotiff/rio-tiler.git
 
rindcalc_github          https://github.com/darkblue-b/rindcalc.git
 
rindcalc_github          https://github.com/darkblue-b/rindcalc.git
  
 
satproc                  https://github.com/dymaxionlabs/satproc.git
 
satproc                  https://github.com/dymaxionlabs/satproc.git
 +
sentinelsat              https://github.com/sentinelsat/sentinelsat
 
scikit-image            https://github.com/scikit-image/scikit-image.git
 
scikit-image            https://github.com/scikit-image/scikit-image.git
 
scikit-learn            https://github.com/scikit-learn/scikit-learn.git
 
scikit-learn            https://github.com/scikit-learn/scikit-learn.git
Line 171: Line 102:
 
</pre>
 
</pre>
  
    pip install odc-geo==0.2.0 # kirill on #open-data-cube 02jun22
+
<hr/>
    pip install odc-stac==0.3.0rc1  # kirill on #open-data-cube 25may22
+
 
    https://github.com/opendatacube/odc-stac/wiki#may-26-2022
+
Note:
 +
 
 +
[0]  adhoc.osgeo.osuosl.org/livedvd/docs/en/metrics.html  <--- this is in the Project application material?  current url should be :
 +
 
 +
https://live.osgeo.org/en/metrics.html
 +
 
 +
 
 +
<hr/>
 +
  UN Task Force on Satellites / EO in National Statistics  2018
 +
Dr Hannes I. Reuter (Eurostat)
 +
Dr Arnold Dekker, Flora Kerblat, Dr Alex Held and Dr Robert Woodcock
 +
  (Commonwealth Science and Industrial Research Organisation)
 +
Alexis McIntyre (Geoscience Australia),
 +
Professor Kerrie Mengersen and James McBroom (Queensland University of Technology),
 +
Sandra Yaneth Rodriquez (Departamento Administrativo Nacional de Estadistica)
 +
Jacinta Holloway (Australian Bureau of Statistics).
 +
 
 +
Patrick Dunagan (Google)
 +
Ronaldo Ocampo and Jose De La Torre (Instituto Nacional de Estadistica Geografica e Informatica)
 +
Jennifer Marley, Ryan Defina, Kate Traeger, Daniel Elazar, Anura Amarasinghe, Gareth Biggs
 +
  (Australian Bureau of Statistics)
 +
Ben Fitzpatrick and Brigitte Colin (Queensland University of Technology)
 +
 
 +
Statistics Canada
 +
 
 +
Sybille McKeown, Daniel Elazar, Martin Brady and Thomas Walter
 +
  (Australian Bureau of Statistics)
 +
Alexis McIntyre (Geoscience Australia)
 +
Dr Andries Potgieter (University of Queensland)
 +
Dr Matthew Pringle and Dr Michael Schmidt
 +
  (Queensland Department of Science, Information Technology and Innovation)
 +
Dr Giulia Conchedda and Jacques Delince (Food and Agriculture Organization of the United Nations)
 +
Javier Gallego (Joint Research Center - European Commission)
 +
 
 +
 
 +
=== eodag misc ===
 +
 
 +
    $ grep -h ' import ' $(find $DDIR -name '*py*') | sed -e 's#"##g' -e 's#\\n,##'| sort -u
 +
    from botocore.handlers import disable_signing
 +
    from eodag.api.core import EODataAccessGateway
 +
    # from eodag.api.search_result import SearchResult
 +
    from eodag.crunch import FilterDate
 +
    from eodag.crunch import FilterLatestIntersect
 +
    from eodag.crunch import FilterOverlap
 +
    from eodag.crunch import FilterProperty
 +
    from eodag import EODataAccessGateway
 +
    from eodag import EODataAccessGateway, setup_logging
 +
    from eodag import EOProduct
 +
    from eodag import SearchResult
 +
    from eodag import setup_logging
 +
    from eodag.plugins.crunch.filter_property import FilterProperty
 +
    from eodag.utils import ProgressCallback
 +
    from folium.plugins import TimestampedGeoJson
 +
    from folium.raster_layers import ImageOverlay
 +
    from IPython.display import display, Image
 +
    from itertools import islice
 +
    from PIL import Image as PIL_Image
 +
    from shapely.geometry import Polygon
 +
    from shapely import geometry
 +
    from snappy import GPF, HashMap, Rectangle
 +
    from snappy import ProductIO
 +
    from snappy import ProgressMonitor, ProductUtils
 +
    from zipfile import ZipFile
 +
    dbb@asus30:/home/shared/OSGEO_asus30/odc-misc-ol15$ echo $DDIR
 +
    /tshiba100/nxtcld_gallery/cloudy-geo/eodag.readthedocs.io
  
    https://www.opendatacube.org/installation
 
    https://github.com/opendatacube/cube-in-a-box
 
    https://datacube-core.readthedocs.io/en/latest/installation/indexing-data/step-guide.html
 
  
    Note:  
+
=== other ===
    with standard repos and Universe and Multiverse, an `apt search datacube`
+
https://osgeo.github.io/OSGeoLive-doc/en/presentation.html#/
    returns no results. If `datacube` is packaged, where might it be?
+
https://github.com/pgRouting/pgrouting/pull/2345
 +
https://github.com/OSGeo/OSGeoLive-doc/actions/runs/2602634951
 +
 
 +
https://github.com/OSGeo/OSGeoLive-doc/blob/master/doc/images/projects/osgeolive/osgeolive_menu.png
 +
 
 +
https://www.twitch.tv/videos/1516523650  ## cvvergara twitch
  
 
<hr/>
 
<hr/>
 +
'''Java Version''' 5/14 
 +
darkblueb: Deegree Code Sprint -- the take-away from the email was.. Deegree v3.4x will work with Java 8;  Deegree v3.5x will require Java 11 and a newer Tomcat..
 +
  
Note:
+
<hr/>
 +
from: Jim Klassen  4/11
 +
I'd suggest looking at the '''live-build debian package''' (which is also available in Ubuntu).  It can build an iso/usb hybrid boot image (with optional installer), supports a persistence file on USB, and doesn't seem to have a 4GB limit on the squashfs root.
 +
<br/>
 +
Reply: Angelos  4/28
 +
Yes, this has been a nice option since Ubuntu switched to using live-build officially some years ago.
 +
I think we need a demo script to see how it would work before deciding if this is the way forward.
 +
In the meantime, there is an option to use xorriso package (I need to find some time to test)
 +
<hr/>
 +
 
 +
=== QEMU Convert Disk Image ===
 +
 
 +
    $ qemu-img convert -f vmdk -O qcow2 osgeolive-14.0-amd64.vmdk ol14.qcow2
 +
 
 +
<hr/>
  
[0]  adhoc.osgeo.osuosl.org/livedvd/docs/en/metrics.html  <---  this is in the Project application material?  current url should be :
+
=== Remove Snapd ===
 +
    ## Steps to remove snapd from base build16
 +
    $ sudo snap list
 +
    $ sudo snap remove firefox
 +
    $ sudo snap remove gnome-3-38-2004
 +
    $ sudo snap remove gtk-common-themes
 +
    $ sudo snap remove core20
 +
    $ sudo snap remove bare
 +
    $ sudo snap remove snapd
 +
    ## next, stop the systemd service, disable
 +
    $ sudo systemctl stop snapd && sudo systemctl disable snapd
 +
    $ sudo apt purge snapd
 +
    ## manually remove caches
 +
    $ rm -rf ~/snap
 +
    $ sudo rm -rf /snap /var/snap /var/lib/snapd /var/cache/snapd /usr/lib/snapd /root/snap
  
https://live.osgeo.org/en/metrics.html
 
  
 
[[Category: live-demo]]
 
[[Category: live-demo]]

Latest revision as of 16:10, 20 August 2022

All Things Repo for Content Edits ol15


Repos

ArcRasterRescue          https://github.com/r-barnes/ArcRasterRescue.git
batyr                    https://github.com/nmandery/batyr.git
BONAI                    https://github.com/jwwangchn/BONAI.git
conflator                https://github.com/robsavoye/conflator
csv2sqlite               https://github.com/psanford/csv2sqlite.git

cube-in-a-box            https://github.com/opendatacube/cube-in-a-box.git
datacube-core            https://github.com/opendatacube/datacube-core.git
odc-geo                  https://github.com/opendatacube/odc-geo.git
odc-stac                 https://github.com/opendatacube/odc-stac.git
odc-stats                https://github.com/opendatacube/odc-stats.git
stac-raster              https://github.com/stac-extensions/raster
rioxarray                https://github.com/corteva/rioxarray.git

docker-postgis           https://github.com/appropriate/docker-postgis.git
earthenterprise          https://github.com/google/earthenterprise
elegant-scipy            https://github.com/elegant-scipy/elegant-scipy.git
gdal-segment             https://github.com/cbalint13/gdal-segment.git
geographiclib-code       https://github.com/geographiclib/geographiclib
geonode                  https://github.com/GeoNode/geonode.git
geopandas                https://github.com/geopandas/geopandas.git
geos                     git@github_key:libgeos/geos.git
geos-performance         https://github.com/pramsey/geos-performance.git

imaptools_github         https://github.com/woodbri/imaptools.com.git
ipython                  https://github.com/ipython/ipython.git
jts_loctech              https://github.com/locationtech/jts.git
jupyter-cm               https://github.com/jupyter-incubator/contentmanagement.git
jupyter_notebook         https://github.com/jupyter/notebook.git
leehach_census           https://github.com/leehach/census-postgres.git
libgeotiff               https://github.com/OSGeo/libgeotiff.git
logbt                    https://github.com/mapbox/logbt.git
looking-glass-pub        https://github.com/developmentseed/looking-glass-pub.git
mapcache                 https://github.com/mapserver/mapcache.git
mapserv_basemaps         https://github.com/mapserver/basemaps.git
mapserver_github         https://github.com/mapserver/mapserver.git
narsc16                  https://github.com/sjsrey/narsc16.git

opencv-itseez            https://github.com/Itseez/opencv.git
opencv                   https://github.com/opencv/opencv.git
opengdp                  https://github.com/opengdp/opengdp.git

osm2pgsql_git            https://github.com/openstreetmap/osm2pgsql
osm-export-tool          https://github.com/hotosm/osm-export-tool-python
libosmium                https://github.com/osmcode/libosmium.git
geoTIFF.js               https://github.com/geotiffjs/geotiff.js.git
mod-tile                 https://github.com/openstreetmap/mod_tile.git
osmcode_osm-gis-export   https://github.com/osmcode/osm-gis-export
osmium-tool              https://github.com/osmcode/osmium-tool.git
osm-testdata             https://github.com/osmcode/osm-testdata
oss-fuzz                 https://github.com/rouault/oss-fuzz
OWSLib                   https://github.com/geopython/OWSLib.git
pandas_dev               https://github.com/pandas-dev/pandas.git
pandoc                   https://github.com/jgm/pandoc.git
perfecttin               https://github.com/OSGeo/perfecttin.git
perfecttin               https://github.com/phma/perfecttin
pgimportdoc              https://github.com/okbob/pgimportdoc.git
pgsql-ogr-fdw            https://github.com/pramsey/pgsql-ogr-fdw.git
proj_github              https://github.com/OSGeo/PROJ
protozero                https://github.com/mapbox/protozero
psycopg2_git             https://github.com/psycopg/psycopg2.git
pygeos                   https://github.com/pygeos/pygeos
pygit2                   https://github.com/libgit2/pygit2.git
pystac_github            https://github.com/azavea/pystac.git
qhull                    https://github.com/qhull/qhull.git
raster-vision            https://github.com/azavea/raster-vision.git

rasterio                 https://github.com/mapbox/rasterio.git
rio-plugins              https://github.com/rasterio/rasterio/wiki/Rio-plugin-registry
rio-tiler                https://github.com/cogeotiff/rio-tiler.git
rindcalc_github          https://github.com/darkblue-b/rindcalc.git

satproc                  https://github.com/dymaxionlabs/satproc.git
sentinelsat              https://github.com/sentinelsat/sentinelsat
scikit-image             https://github.com/scikit-image/scikit-image.git
scikit-learn             https://github.com/scikit-learn/scikit-learn.git
scipy_github             https://github.com/scipy/scipy.git
scitools_iris            https://github.com/SciTools/iris.git
Shapely                  https://github.com/Toblerity/Shapely.git
tile38                   https://github.com/tidwall/tile38.git
tea-tiler                https://github.com/developmentseed/titiler.git

apache_allura            https://github.com/apache/allura.git
containerd               https://github.com/docker/containerd
gitea                    https://github.com/go-gitea/gitea
gobby                    https://github.com/gobby/gobby.git
high_performance_python  https://github.com/mynameisfiber/high_performance_python.git
introduction_to_ml_with_python   https://github.com/amueller
kaggleScape              https://github.com/adgirish/kaggleScape.git
ML_for_Hackers_github    https://github.com/johnmyleswhite/ML_for_Hackers.git
modern-cpp-tutorial      https://github.com/changkun/modern-cpp-tutorial.git
ripgrep                  https://github.com/BurntSushi/ripgrep

cpdup                    https://github.com/DragonFlyBSD/cpdup.git
jdupes                   https://github.com/jbruchon/jdupes.git
rclone                   https://github.com/rclone/rclone.git

Note:

[0] adhoc.osgeo.osuosl.org/livedvd/docs/en/metrics.html <--- this is in the Project application material? current url should be :

https://live.osgeo.org/en/metrics.html



UN Task Force on Satellites / EO in National Statistics  2018
Dr Hannes I. Reuter (Eurostat)
Dr Arnold Dekker, Flora Kerblat, Dr Alex Held and Dr Robert Woodcock 
 (Commonwealth Science and Industrial Research Organisation) 
Alexis McIntyre (Geoscience Australia), 
Professor Kerrie Mengersen and James McBroom (Queensland University of Technology), 
Sandra Yaneth Rodriquez (Departamento Administrativo Nacional de Estadistica)
Jacinta Holloway (Australian Bureau of Statistics). 
Patrick Dunagan (Google)
Ronaldo Ocampo and Jose De La Torre (Instituto Nacional de Estadistica Geografica e Informatica)
Jennifer Marley, Ryan Defina, Kate Traeger, Daniel Elazar, Anura Amarasinghe, Gareth Biggs 
 (Australian Bureau of Statistics)
Ben Fitzpatrick and Brigitte Colin (Queensland University of Technology) 
Statistics Canada
Sybille McKeown, Daniel Elazar, Martin Brady and Thomas Walter
 (Australian Bureau of Statistics)
Alexis McIntyre (Geoscience Australia)
Dr Andries Potgieter (University of Queensland)
Dr Matthew Pringle and Dr Michael Schmidt 
 (Queensland Department of Science, Information Technology and Innovation)
Dr Giulia Conchedda and Jacques Delince (Food and Agriculture Organization of the United Nations) 
Javier Gallego (Joint Research Center - European Commission)


eodag misc

    $ grep -h ' import ' $(find $DDIR -name '*py*') | sed -e 's#"##g' -e 's#\\n,##'| sort -u
    from botocore.handlers import disable_signing
    from eodag.api.core import EODataAccessGateway
    # from eodag.api.search_result import SearchResult
    from eodag.crunch import FilterDate
    from eodag.crunch import FilterLatestIntersect
    from eodag.crunch import FilterOverlap
    from eodag.crunch import FilterProperty
    from eodag import EODataAccessGateway
    from eodag import EODataAccessGateway, setup_logging
    from eodag import EOProduct
    from eodag import SearchResult
    from eodag import setup_logging
    from eodag.plugins.crunch.filter_property import FilterProperty
    from eodag.utils import ProgressCallback
    from folium.plugins import TimestampedGeoJson
    from folium.raster_layers import ImageOverlay
    from IPython.display import display, Image
    from itertools import islice
    from PIL import Image as PIL_Image
    from shapely.geometry import Polygon
    from shapely import geometry
    from snappy import GPF, HashMap, Rectangle
    from snappy import ProductIO
    from snappy import ProgressMonitor, ProductUtils
    from zipfile import ZipFile
    dbb@asus30:/home/shared/OSGEO_asus30/odc-misc-ol15$ echo $DDIR
    /tshiba100/nxtcld_gallery/cloudy-geo/eodag.readthedocs.io


other

https://osgeo.github.io/OSGeoLive-doc/en/presentation.html#/ https://github.com/pgRouting/pgrouting/pull/2345 https://github.com/OSGeo/OSGeoLive-doc/actions/runs/2602634951

https://github.com/OSGeo/OSGeoLive-doc/blob/master/doc/images/projects/osgeolive/osgeolive_menu.png

https://www.twitch.tv/videos/1516523650 ## cvvergara twitch


Java Version 5/14 darkblueb: Deegree Code Sprint -- the take-away from the email was.. Deegree v3.4x will work with Java 8; Deegree v3.5x will require Java 11 and a newer Tomcat..



from: Jim Klassen 4/11 I'd suggest looking at the live-build debian package (which is also available in Ubuntu). It can build an iso/usb hybrid boot image (with optional installer), supports a persistence file on USB, and doesn't seem to have a 4GB limit on the squashfs root.
Reply: Angelos 4/28 Yes, this has been a nice option since Ubuntu switched to using live-build officially some years ago. I think we need a demo script to see how it would work before deciding if this is the way forward. In the meantime, there is an option to use xorriso package (I need to find some time to test)


QEMU Convert Disk Image

   $ qemu-img convert -f vmdk -O qcow2 osgeolive-14.0-amd64.vmdk ol14.qcow2

Remove Snapd

   ## Steps to remove snapd from base build16
   $ sudo snap list
   $ sudo snap remove firefox
   $ sudo snap remove gnome-3-38-2004
   $ sudo snap remove gtk-common-themes
   $ sudo snap remove core20
   $ sudo snap remove bare
   $ sudo snap remove snapd
   ## next, stop the systemd service, disable
   $ sudo systemctl stop snapd && sudo systemctl disable snapd
   $ sudo apt purge snapd
   ## manually remove caches
   $ rm -rf ~/snap
   $ sudo rm -rf /snap /var/snap /var/lib/snapd /var/cache/snapd /usr/lib/snapd /root/snap