Difference between revisions of "Osgeolive misc repos"

From OSGeo
Jump to navigation Jump to search
 
(55 intermediate revisions by the same user not shown)
Line 1: Line 1:
Open Issues from the Mailing List  May 2022
+
All Things Repo for Content Edits '''ol15'''
  
<hr/>
 
from: jenriquesoriano@guadaltel.com
 
cc: Marco.MINGHINI@ec.europa.eu;  portele@interactive-instruments.de;  herrmann@interactive-instruments.de;
 
michael.lutz@ec.europa.eu;  josebarrero@guadaltel.com
 
 
Dear OSGeoLive team,  we contact you to kindly propose the inclusion of the '''ETF testing framework''' in the OSGeoLive distribution. Following the requirements, please find below the answer to the required questions. Please let us know if any additional clarification is needed.  [0] [https://www.openhub.net/p/etf-validator -VLINK-] [https://github.com/etf-validator/etf-webapp/releases/tag/2.0.0 -GITHUB-]
 
 
<br/>
 
Reply: Angelos  4/28
 
Thank you for your application. ; We will process during our next project meeting and provide feedback.
 
<hr/>
 
 
<hr/>
 
from: Jim Klassen  4/11
 
I'd suggest looking at the '''live-build debian package''' (which is also available in Ubuntu).  It can build an iso/usb hybrid boot image (with optional installer), supports a persistence file on USB, and doesn't seem to have a 4GB limit on the squashfs root.
 
<br/>
 
Reply: Angelos  4/28
 
Yes, this has been a nice option since Ubuntu switched to using live-build officially some years ago.
 
I think we need a demo script to see how it would work before deciding if this is the way forward.
 
In the meantime, there is an option to use xorriso package (I need to find some time to test)
 
<hr/>
 
 
<hr/>
 
'''Java Version''' 5/14 
 
darkblueb: Deegree Code Sprint -- the take-away from the email was.. Deegree v3.4x will work with Java 8;  Deegree v3.5x will require Java 11 and a newer Tomcat..
 
<hr/>
 
 
=== PDAL Misc Notes ===
 
 
''Discussion of '''PDAL''', related source code projects, related technology, goals of the OSGeoLive project, goals of OSGeo dot org, general commentary.''
 
 
'''Technology''' --  Point clouds are a digital format of remote sensing data [0]. Intense advancement of digital geospatial technology in the modern era includes point clouds, for visualization structures [1], for situational awareness in security applications, measurement & modelling of remote sensing environments including ground water surfaces and forestry applications, and more.
 
 
The LAS file format [2] was invented by FOSS author Martin Isenburg and subsequently gained standing as an international standard. Using invention and out-of-the-box thinking, LAS represents true, original advancement in the open digital science field. Martin is widely regarded now, after his passing, as one of the great contributors to our field [3]. Subsequently, a system for compression on the data was devised, with associated IP rights. [4]  PDAL is an extensible software system implemented mostly in C++, as a project modeled directly on the vastly-influential GDAL project. Founder Howard Butler used ideas, community mechanisms and plug-in driver-model, based directly from GDAL.  [5]
 
 
Howard 'hobu' Butler and PDAL PSC Member Mike Smith have indicated that PDAL plus "all of Howard's projects" are affected by the recent diplomatic snafu.  This list is at least  '''PDAL''', '''liblas''', '''libspatialindex''', and '''python-rtree'''.[7] ''(python-rtree is a python wrapper for libspatialindex)''  Please note that dozens of prominent contributors have built these collected software libraries, not Howard Butler alone [8]. The contributor list, enginerring correctness, and market impact of these software libraries are built directly on the community and engineering reputation of GDAL.
 
 
[0]  [https://en.wikipedia.org/wiki/Point_cloud -WIKIPEDIA-]
 
[1]  [https://www.youtube.com/watch?v=udoSz_UBUdc  -GOOGLE-]
 
[2]  [https://en.wikipedia.org/wiki/LAS_file_format -LAS-]
 
[3]  [https://lidarmag.com/2021/09/14/martin-isenburg-open-data-advocate-passes/ -BIO-]
 
[4]  [https://laszip.org/ -ZIP-]
 
[5]  [https://pdal.io/ -PDAL-]
 
[6]  [https://git.osgeo.org/gitea/osgeolive/OSGeoLive/commit/ff4fde8a3fa6e40836dadb3883bc3f7d0e9db2a2 -LINK-] <br/>
 
https://trac.osgeo.org/osgeolive/ticket/2072  &nbsp;
 
https://trac.osgeo.org/osgeolive/ticket/2283
 
 
[7]
 
https://salsa.debian.org/debian-gis-team/libspatialindex
 
https://salsa.debian.org/debian-gis-team/python-rtree
 
https://salsa.debian.org/debian-gis-team/geographiclib
 
 
[8]
 
https://github.com/libLAS/libLAS/graphs/contributors
 
https://github.com/libspatialindex/libspatialindex/graphs/contributors
 
https://github.com/Toblerity/rtree/graphs/contributors
 
 
[9]  [https://distrowatch.com/table.php?distribution=osgeo -DISTRO-]
 
 
'''Goals of OSGeoLive'''
 
 
The OSGeoLive GNU-linux project exists to showcase the ecosystem of OSGeo dot org incubated projects with documentation in ten+ human languages, serves as a reference code implementation of installation and inter-operability of these software projects using OGC and open standards, and demonstrate using a curated showcase of examples to ''trial'' the software without undue burden on the user.  Current and developing technology stacks, on the server, in the browser, on the desktop, are updated and run in a modern, networked linux stack. OSGeoLive has been recognized by Distro-watch and other professional catalogs of modern linux. [9]
 
 
'''History''' -- past uses of PDAL on OSGeoLive:
 
 
PDAL binary has existed on OSGeoLive linux for some years. In June 2018, a short install script was added to the OSGeoLive repo. [6]
 
 
'''Conflict''' within the broader community
 
 
Some kind of interactions between Debian Devloper Sebastian Cowenburg and PDAL Developer Howard Butler, have led to protest and action by sebastic. The net effect is that from May 2022 onward, new revisions of PDAL will not be built and inluded in the "upstream" Debian GIS system of packaging. There is a complex and long-standing relationship between Debian GIS/sebastic and OSGeoLive/UbuntuGIS/kalxas.  Essentially, both Debian and UbuntuGIS opportunistically feed on the work products of the other. There is a general context of more work than any one or small group of people can do, to formalize and ingest new OSS software into Debian packages. [10]
 
 
Debian packaging is the standard for signed, authenticated software products to be integrated into linux OS computers, and include the most trusted sources of software available today, due to cryptographic immutability and integrity of the package contents.
 
 
[10]  [https://www.debian.org/distrib/packages -DEBIAN-]
 
 
    EMAIL Inquiry April 2022
 
    Hi Howard -
 
    thank you for presenting and organizing at Cloud-Native Geospatial Days this week.
 
    re: Debian  Can you help me understand this email ?  I do not have current context on this.
 
    https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1009625
 
    thank you  --Brian M Hamlin    /  MAPLABS  /  Berkeley, Calif.
 
 
    Howard Butler replies:
 
    The context is Bas is removing PDAL from Debian [1]. No other Debian
 
    maintainer has come forward to continue its inclusion.
 
    [1] https://lists.debian.org/debian-gis/2022/02/msg00004.html
 
 
The present author Brian M Hamlin, MAPLABS Berkeley, raised the issue to the Board of Directors of OSGeo dot org in April 2022, noting that some kind of clock is now ticking, marking the 'removal' of PDAL (and perhaps a small list of related software) from the Debian build pipeline. In fact, no packages will be 'removed' from Debian, it means that no new packages will be built and integrated, past that date, as things stand now. The details of this mechanism are complicated. Angelos has indicated that UbuntuGIS project has seperate standing, and may or may not be in a similar situation.
 
 
OSGeo Board Meeting  wiki "Board Meeting 2022-04-25"
 
  * Issues in Debian packaging of pdal (https://pdal.io/)
 
  * Conda can’t be used on OSGeoLive
 
  * What exactly is required from board? (considering PDAL is not an OSGeo affiliated project)
 
  * Considering it as a technical problem, a solution can be figured out internally for inclusion of PDAL in OSGeoLive  (ed. within the OSGeoLive project)
 
 
'''kalxas''' indicated a willingness to build bridges at the Board level to the PDAL project, considering that most everyone involved is an OSGeo member
 
 
How to Proceed
 
 
Wiki Notes on PDAL - darkblueb [https://wiki.osgeo.org/wiki/Osgeolive-jupyter#Python_Libraries_Strategy writes]:
 
 
  ""LiDAR "maybe?" : this is slightly painful since modern commercial GIS is flooded with this tech, delivered by advanced Western companies seeking something novel to sell. Changes to the LASzip licensing have enabled inclusion, but as of today, no Debian maintainer in place, and bas wants PDAL out at this time. -EMAIL- -EMAIL2-""
 
 
Online Chat meeting, partial notes:
 
 
 
 
[https://github.com/libLAS/libLAS/graphs/contributors libLAS-link-] &nbsp;
 
[https://github.com/libspatialindex/libspatialindex/graphs/contributors libspatialindex-link-] &nbsp;
 
[https://github.com/Toblerity/rtree/graphs/contributors python-rtree-link-]
 
 
    darkblueb writes:
 
    "Personalmente, no espero paquetes de Debian. Si creamos un script de instalación personalizado e incluimos etiquetas de versión de git y lo enviamos solo en OSGeoLive, está bien para mí.
 
 
    "Personally, I don't expect Debian packages. If we create a custom install script and include git version tags and push it only on OSGeoLive, that's fine with me.
 
 
 
After the short IRC meeting went badly:
 
 
    3:07:57 PM - darkblueb: robe2 - you are trusted by this org, you have successful clients and a book that sells a few copies, and at this point, you are a leader here. this disk serves this community.. that is my commitment
 
    of course I have opinions, I have three decades of real work in software in California.  My opinion
 
    includes getting access to high tech, to people who are not insiders, and not necessarily in a uniform
 
    thats what drives these PDAL etc talks.. GNU + open FAIR access.. it is my view
 
    darkblueb: very few people show up to do the work here.. I like it and do it enthusiastically.. not everyone is glad for that, apparently.. so it goes
 
    robe2: darkblueb:  That's one of the clearest things you've said today.  I have that opinion too.  Just not as convinced as you how to get there.  I have not much opinion on how to get there.  Just that the shortest path is not a straight line
 
 
<hr/>
 
 
=== Remove Snapd ===
 
    darkblueb@live:~$ sudo snap list
 
    Name    Version  Rev    Tracking      Publisher  Notes
 
    core20  20220329  1434  latest/stable  canonical✓  base
 
    snapd  2.55.3    15534  latest/stable  canonical✓  snapd
 
 
    darkblueb@live:~$ sudo snap remove core20
 
    core20 removed
 
    darkblueb@live:~$ sudo snap remove snapd
 
    snapd removed
 
 
    darkblueb@live:~$ sudo systemctl stop snapd && sudo systemctl disable snapd
 
    Warning: Stopping snapd.service, but it can still be activated by:
 
      snapd.socket
 
    Removed /etc/systemd/system/multi-user.target.wants/snapd.service.
 
 
    darkblueb@live:~$ sudo apt purge snapd
 
    Reading package lists... Done
 
    Building dependency tree     
 
    Reading state information... Done
 
    The following packages were automatically installed and are no longer required:
 
      libfwupdplugin1 squashfs-tools
 
    Use 'sudo apt autoremove' to remove them.
 
    The following packages will be REMOVED:
 
      snapd*
 
 
    darkblueb@live:~$ rm -rf ~/snap
 
    darkblueb@live:~$ sudo rm -rf /snap /var/snap /var/lib/snapd /var/cache/snapd /usr/lib/snapd /root/snap
 
 
<hr/>
 
  
 +
=== Repos ===
 
<pre>
 
<pre>
apache_allura            https://github.com/apache/allura.git
 
 
ArcRasterRescue          https://github.com/r-barnes/ArcRasterRescue.git
 
ArcRasterRescue          https://github.com/r-barnes/ArcRasterRescue.git
 
batyr                    https://github.com/nmandery/batyr.git
 
batyr                    https://github.com/nmandery/batyr.git
 
BONAI                    https://github.com/jwwangchn/BONAI.git
 
BONAI                    https://github.com/jwwangchn/BONAI.git
containerd              https://github.com/docker/containerd
+
conflator                https://github.com/robsavoye/conflator
cpdup                    https://github.com/DragonFlyBSD/cpdup.git
 
 
csv2sqlite              https://github.com/psanford/csv2sqlite.git
 
csv2sqlite              https://github.com/psanford/csv2sqlite.git
 +
 
cube-in-a-box            https://github.com/opendatacube/cube-in-a-box.git
 
cube-in-a-box            https://github.com/opendatacube/cube-in-a-box.git
 
datacube-core            https://github.com/opendatacube/datacube-core.git
 
datacube-core            https://github.com/opendatacube/datacube-core.git
 +
odc-geo                  https://github.com/opendatacube/odc-geo.git
 +
odc-stac                https://github.com/opendatacube/odc-stac.git
 +
odc-stats                https://github.com/opendatacube/odc-stats.git
 +
stac-raster              https://github.com/stac-extensions/raster
 +
rioxarray                https://github.com/corteva/rioxarray.git
 +
 
docker-postgis          https://github.com/appropriate/docker-postgis.git
 
docker-postgis          https://github.com/appropriate/docker-postgis.git
 
earthenterprise          https://github.com/google/earthenterprise
 
earthenterprise          https://github.com/google/earthenterprise
Line 179: Line 27:
 
geos                    git@github_key:libgeos/geos.git
 
geos                    git@github_key:libgeos/geos.git
 
geos-performance        https://github.com/pramsey/geos-performance.git
 
geos-performance        https://github.com/pramsey/geos-performance.git
gitea                    https://github.com/go-gitea/gitea
+
 
gobby                    https://github.com/gobby/gobby.git
 
high_performance_python  https://github.com/mynameisfiber/high_performance_python.git
 
 
imaptools_github        https://github.com/woodbri/imaptools.com.git
 
imaptools_github        https://github.com/woodbri/imaptools.com.git
introduction_to_ml_with_python  https://github.com/amueller
 
 
ipython                  https://github.com/ipython/ipython.git
 
ipython                  https://github.com/ipython/ipython.git
 
jts_loctech              https://github.com/locationtech/jts.git
 
jts_loctech              https://github.com/locationtech/jts.git
 
jupyter-cm              https://github.com/jupyter-incubator/contentmanagement.git
 
jupyter-cm              https://github.com/jupyter-incubator/contentmanagement.git
 
jupyter_notebook        https://github.com/jupyter/notebook.git
 
jupyter_notebook        https://github.com/jupyter/notebook.git
kaggleScape              https://github.com/adgirish/kaggleScape.git
 
 
leehach_census          https://github.com/leehach/census-postgres.git
 
leehach_census          https://github.com/leehach/census-postgres.git
 
libgeotiff              https://github.com/OSGeo/libgeotiff.git
 
libgeotiff              https://github.com/OSGeo/libgeotiff.git
libosmium                https://github.com/osmcode/libosmium.git
 
libosmium                https://github.com/osmcode/osm-testdata
 
 
logbt                    https://github.com/mapbox/logbt.git
 
logbt                    https://github.com/mapbox/logbt.git
 
looking-glass-pub        https://github.com/developmentseed/looking-glass-pub.git
 
looking-glass-pub        https://github.com/developmentseed/looking-glass-pub.git
mapcache                git://github.com/mapserver/mapcache.git
+
mapcache                https://github.com/mapserver/mapcache.git
 
mapserv_basemaps        https://github.com/mapserver/basemaps.git
 
mapserv_basemaps        https://github.com/mapserver/basemaps.git
 
mapserver_github        https://github.com/mapserver/mapserver.git
 
mapserver_github        https://github.com/mapserver/mapserver.git
ML_for_Hackers_github    https://github.com/johnmyleswhite/ML_for_Hackers.git
 
modern-cpp-tutorial      https://github.com/changkun/modern-cpp-tutorial.git
 
 
narsc16                  https://github.com/sjsrey/narsc16.git
 
narsc16                  https://github.com/sjsrey/narsc16.git
opencv                  https://github.com/opencv/opencv
+
 
 
opencv-itseez            https://github.com/Itseez/opencv.git
 
opencv-itseez            https://github.com/Itseez/opencv.git
 +
opencv                  https://github.com/opencv/opencv.git
 
opengdp                  https://github.com/opengdp/opengdp.git
 
opengdp                  https://github.com/opengdp/opengdp.git
 +
 
osm2pgsql_git            https://github.com/openstreetmap/osm2pgsql
 
osm2pgsql_git            https://github.com/openstreetmap/osm2pgsql
 +
osm-export-tool          https://github.com/hotosm/osm-export-tool-python
 +
libosmium                https://github.com/osmcode/libosmium.git
 +
geoTIFF.js              https://github.com/geotiffjs/geotiff.js.git
 +
mod-tile                https://github.com/openstreetmap/mod_tile.git
 
osmcode_osm-gis-export  https://github.com/osmcode/osm-gis-export
 
osmcode_osm-gis-export  https://github.com/osmcode/osm-gis-export
 
osmium-tool              https://github.com/osmcode/osmium-tool.git
 
osmium-tool              https://github.com/osmcode/osmium-tool.git
 
osm-testdata            https://github.com/osmcode/osm-testdata
 
osm-testdata            https://github.com/osmcode/osm-testdata
 
oss-fuzz                https://github.com/rouault/oss-fuzz
 
oss-fuzz                https://github.com/rouault/oss-fuzz
OWSLib                  git://github.com/geopython/OWSLib.git
+
OWSLib                  https://github.com/geopython/OWSLib.git
pandas_020               https://github.com/pandas-dev/pandas.git
+
pandas_dev               https://github.com/pandas-dev/pandas.git
pandoc                  git://github.com/jgm/pandoc.git
+
pandoc                  https://github.com/jgm/pandoc.git
 
perfecttin              https://github.com/OSGeo/perfecttin.git
 
perfecttin              https://github.com/OSGeo/perfecttin.git
 
perfecttin              https://github.com/phma/perfecttin
 
perfecttin              https://github.com/phma/perfecttin
Line 223: Line 69:
 
pystac_github            https://github.com/azavea/pystac.git
 
pystac_github            https://github.com/azavea/pystac.git
 
qhull                    https://github.com/qhull/qhull.git
 
qhull                    https://github.com/qhull/qhull.git
 +
raster-vision            https://github.com/azavea/raster-vision.git
 +
 
rasterio                https://github.com/mapbox/rasterio.git
 
rasterio                https://github.com/mapbox/rasterio.git
raster-vision            https://github.com/azavea/raster-vision.git
+
rio-plugins              https://github.com/rasterio/rasterio/wiki/Rio-plugin-registry
 +
rio-tiler                https://github.com/cogeotiff/rio-tiler.git
 
rindcalc_github          https://github.com/darkblue-b/rindcalc.git
 
rindcalc_github          https://github.com/darkblue-b/rindcalc.git
ripgrep                  git://github.com/BurntSushi/ripgrep
+
 
 
satproc                  https://github.com/dymaxionlabs/satproc.git
 
satproc                  https://github.com/dymaxionlabs/satproc.git
 +
sentinelsat              https://github.com/sentinelsat/sentinelsat
 
scikit-image            https://github.com/scikit-image/scikit-image.git
 
scikit-image            https://github.com/scikit-image/scikit-image.git
 
scikit-learn            https://github.com/scikit-learn/scikit-learn.git
 
scikit-learn            https://github.com/scikit-learn/scikit-learn.git
Line 234: Line 84:
 
Shapely                  https://github.com/Toblerity/Shapely.git
 
Shapely                  https://github.com/Toblerity/Shapely.git
 
tile38                  https://github.com/tidwall/tile38.git
 
tile38                  https://github.com/tidwall/tile38.git
 +
tea-tiler                https://github.com/developmentseed/titiler.git
 +
 +
apache_allura            https://github.com/apache/allura.git
 +
containerd              https://github.com/docker/containerd
 +
gitea                    https://github.com/go-gitea/gitea
 +
gobby                    https://github.com/gobby/gobby.git
 +
high_performance_python  https://github.com/mynameisfiber/high_performance_python.git
 +
introduction_to_ml_with_python  https://github.com/amueller
 +
kaggleScape              https://github.com/adgirish/kaggleScape.git
 +
ML_for_Hackers_github    https://github.com/johnmyleswhite/ML_for_Hackers.git
 +
modern-cpp-tutorial      https://github.com/changkun/modern-cpp-tutorial.git
 +
ripgrep                  https://github.com/BurntSushi/ripgrep
 +
 +
cpdup                    https://github.com/DragonFlyBSD/cpdup.git
 +
jdupes                  https://github.com/jbruchon/jdupes.git
 +
rclone                  https://github.com/rclone/rclone.git
 
</pre>
 
</pre>
  
Line 243: Line 109:
  
 
https://live.osgeo.org/en/metrics.html
 
https://live.osgeo.org/en/metrics.html
 +
 +
 +
<hr/>
 +
UN Task Force on Satellites / EO in National Statistics  2018
 +
Dr Hannes I. Reuter (Eurostat)
 +
Dr Arnold Dekker, Flora Kerblat, Dr Alex Held and Dr Robert Woodcock
 +
  (Commonwealth Science and Industrial Research Organisation)
 +
Alexis McIntyre (Geoscience Australia),
 +
Professor Kerrie Mengersen and James McBroom (Queensland University of Technology),
 +
Sandra Yaneth Rodriquez (Departamento Administrativo Nacional de Estadistica)
 +
Jacinta Holloway (Australian Bureau of Statistics).
 +
 +
Patrick Dunagan (Google)
 +
Ronaldo Ocampo and Jose De La Torre (Instituto Nacional de Estadistica Geografica e Informatica)
 +
Jennifer Marley, Ryan Defina, Kate Traeger, Daniel Elazar, Anura Amarasinghe, Gareth Biggs
 +
  (Australian Bureau of Statistics)
 +
Ben Fitzpatrick and Brigitte Colin (Queensland University of Technology)
 +
 +
Statistics Canada
 +
 +
Sybille McKeown, Daniel Elazar, Martin Brady and Thomas Walter
 +
  (Australian Bureau of Statistics)
 +
Alexis McIntyre (Geoscience Australia)
 +
Dr Andries Potgieter (University of Queensland)
 +
Dr Matthew Pringle and Dr Michael Schmidt
 +
  (Queensland Department of Science, Information Technology and Innovation)
 +
Dr Giulia Conchedda and Jacques Delince (Food and Agriculture Organization of the United Nations)
 +
Javier Gallego (Joint Research Center - European Commission)
 +
 +
 +
=== eodag misc ===
 +
 +
    $ grep -h ' import ' $(find $DDIR -name '*py*') | sed -e 's#"##g' -e 's#\\n,##'| sort -u
 +
    from botocore.handlers import disable_signing
 +
    from eodag.api.core import EODataAccessGateway
 +
    # from eodag.api.search_result import SearchResult
 +
    from eodag.crunch import FilterDate
 +
    from eodag.crunch import FilterLatestIntersect
 +
    from eodag.crunch import FilterOverlap
 +
    from eodag.crunch import FilterProperty
 +
    from eodag import EODataAccessGateway
 +
    from eodag import EODataAccessGateway, setup_logging
 +
    from eodag import EOProduct
 +
    from eodag import SearchResult
 +
    from eodag import setup_logging
 +
    from eodag.plugins.crunch.filter_property import FilterProperty
 +
    from eodag.utils import ProgressCallback
 +
    from folium.plugins import TimestampedGeoJson
 +
    from folium.raster_layers import ImageOverlay
 +
    from IPython.display import display, Image
 +
    from itertools import islice
 +
    from PIL import Image as PIL_Image
 +
    from shapely.geometry import Polygon
 +
    from shapely import geometry
 +
    from snappy import GPF, HashMap, Rectangle
 +
    from snappy import ProductIO
 +
    from snappy import ProgressMonitor, ProductUtils
 +
    from zipfile import ZipFile
 +
    dbb@asus30:/home/shared/OSGEO_asus30/odc-misc-ol15$ echo $DDIR
 +
    /tshiba100/nxtcld_gallery/cloudy-geo/eodag.readthedocs.io
 +
 +
 +
=== other ===
 +
https://osgeo.github.io/OSGeoLive-doc/en/presentation.html#/
 +
https://github.com/pgRouting/pgrouting/pull/2345
 +
https://github.com/OSGeo/OSGeoLive-doc/actions/runs/2602634951
 +
 +
https://github.com/OSGeo/OSGeoLive-doc/blob/master/doc/images/projects/osgeolive/osgeolive_menu.png
 +
 +
https://www.twitch.tv/videos/1516523650  ## cvvergara twitch
 +
 +
<hr/>
 +
'''Java Version''' 5/14 
 +
darkblueb: Deegree Code Sprint -- the take-away from the email was.. Deegree v3.4x will work with Java 8;  Deegree v3.5x will require Java 11 and a newer Tomcat..
 +
 +
 +
<hr/>
 +
from: Jim Klassen  4/11
 +
I'd suggest looking at the '''live-build debian package''' (which is also available in Ubuntu).  It can build an iso/usb hybrid boot image (with optional installer), supports a persistence file on USB, and doesn't seem to have a 4GB limit on the squashfs root.
 +
<br/>
 +
Reply: Angelos  4/28
 +
Yes, this has been a nice option since Ubuntu switched to using live-build officially some years ago.
 +
I think we need a demo script to see how it would work before deciding if this is the way forward.
 +
In the meantime, there is an option to use xorriso package (I need to find some time to test)
 +
<hr/>
 +
 +
=== QEMU Convert Disk Image ===
 +
 +
    $ qemu-img convert -f vmdk -O qcow2 osgeolive-14.0-amd64.vmdk ol14.qcow2
 +
 +
<hr/>
 +
 +
=== Remove Snapd ===
 +
    ## Steps to remove snapd from base build16
 +
    $ sudo snap list
 +
    $ sudo snap remove firefox
 +
    $ sudo snap remove gnome-3-38-2004
 +
    $ sudo snap remove gtk-common-themes
 +
    $ sudo snap remove core20
 +
    $ sudo snap remove bare
 +
    $ sudo snap remove snapd
 +
    ## next, stop the systemd service, disable
 +
    $ sudo systemctl stop snapd && sudo systemctl disable snapd
 +
    $ sudo apt purge snapd
 +
    ## manually remove caches
 +
    $ rm -rf ~/snap
 +
    $ sudo rm -rf /snap /var/snap /var/lib/snapd /var/cache/snapd /usr/lib/snapd /root/snap
 +
 +
 +
[[Category: live-demo]]

Latest revision as of 17:10, 20 August 2022

All Things Repo for Content Edits ol15


Repos

ArcRasterRescue          https://github.com/r-barnes/ArcRasterRescue.git
batyr                    https://github.com/nmandery/batyr.git
BONAI                    https://github.com/jwwangchn/BONAI.git
conflator                https://github.com/robsavoye/conflator
csv2sqlite               https://github.com/psanford/csv2sqlite.git

cube-in-a-box            https://github.com/opendatacube/cube-in-a-box.git
datacube-core            https://github.com/opendatacube/datacube-core.git
odc-geo                  https://github.com/opendatacube/odc-geo.git
odc-stac                 https://github.com/opendatacube/odc-stac.git
odc-stats                https://github.com/opendatacube/odc-stats.git
stac-raster              https://github.com/stac-extensions/raster
rioxarray                https://github.com/corteva/rioxarray.git

docker-postgis           https://github.com/appropriate/docker-postgis.git
earthenterprise          https://github.com/google/earthenterprise
elegant-scipy            https://github.com/elegant-scipy/elegant-scipy.git
gdal-segment             https://github.com/cbalint13/gdal-segment.git
geographiclib-code       https://github.com/geographiclib/geographiclib
geonode                  https://github.com/GeoNode/geonode.git
geopandas                https://github.com/geopandas/geopandas.git
geos                     git@github_key:libgeos/geos.git
geos-performance         https://github.com/pramsey/geos-performance.git

imaptools_github         https://github.com/woodbri/imaptools.com.git
ipython                  https://github.com/ipython/ipython.git
jts_loctech              https://github.com/locationtech/jts.git
jupyter-cm               https://github.com/jupyter-incubator/contentmanagement.git
jupyter_notebook         https://github.com/jupyter/notebook.git
leehach_census           https://github.com/leehach/census-postgres.git
libgeotiff               https://github.com/OSGeo/libgeotiff.git
logbt                    https://github.com/mapbox/logbt.git
looking-glass-pub        https://github.com/developmentseed/looking-glass-pub.git
mapcache                 https://github.com/mapserver/mapcache.git
mapserv_basemaps         https://github.com/mapserver/basemaps.git
mapserver_github         https://github.com/mapserver/mapserver.git
narsc16                  https://github.com/sjsrey/narsc16.git

opencv-itseez            https://github.com/Itseez/opencv.git
opencv                   https://github.com/opencv/opencv.git
opengdp                  https://github.com/opengdp/opengdp.git

osm2pgsql_git            https://github.com/openstreetmap/osm2pgsql
osm-export-tool          https://github.com/hotosm/osm-export-tool-python
libosmium                https://github.com/osmcode/libosmium.git
geoTIFF.js               https://github.com/geotiffjs/geotiff.js.git
mod-tile                 https://github.com/openstreetmap/mod_tile.git
osmcode_osm-gis-export   https://github.com/osmcode/osm-gis-export
osmium-tool              https://github.com/osmcode/osmium-tool.git
osm-testdata             https://github.com/osmcode/osm-testdata
oss-fuzz                 https://github.com/rouault/oss-fuzz
OWSLib                   https://github.com/geopython/OWSLib.git
pandas_dev               https://github.com/pandas-dev/pandas.git
pandoc                   https://github.com/jgm/pandoc.git
perfecttin               https://github.com/OSGeo/perfecttin.git
perfecttin               https://github.com/phma/perfecttin
pgimportdoc              https://github.com/okbob/pgimportdoc.git
pgsql-ogr-fdw            https://github.com/pramsey/pgsql-ogr-fdw.git
proj_github              https://github.com/OSGeo/PROJ
protozero                https://github.com/mapbox/protozero
psycopg2_git             https://github.com/psycopg/psycopg2.git
pygeos                   https://github.com/pygeos/pygeos
pygit2                   https://github.com/libgit2/pygit2.git
pystac_github            https://github.com/azavea/pystac.git
qhull                    https://github.com/qhull/qhull.git
raster-vision            https://github.com/azavea/raster-vision.git

rasterio                 https://github.com/mapbox/rasterio.git
rio-plugins              https://github.com/rasterio/rasterio/wiki/Rio-plugin-registry
rio-tiler                https://github.com/cogeotiff/rio-tiler.git
rindcalc_github          https://github.com/darkblue-b/rindcalc.git

satproc                  https://github.com/dymaxionlabs/satproc.git
sentinelsat              https://github.com/sentinelsat/sentinelsat
scikit-image             https://github.com/scikit-image/scikit-image.git
scikit-learn             https://github.com/scikit-learn/scikit-learn.git
scipy_github             https://github.com/scipy/scipy.git
scitools_iris            https://github.com/SciTools/iris.git
Shapely                  https://github.com/Toblerity/Shapely.git
tile38                   https://github.com/tidwall/tile38.git
tea-tiler                https://github.com/developmentseed/titiler.git

apache_allura            https://github.com/apache/allura.git
containerd               https://github.com/docker/containerd
gitea                    https://github.com/go-gitea/gitea
gobby                    https://github.com/gobby/gobby.git
high_performance_python  https://github.com/mynameisfiber/high_performance_python.git
introduction_to_ml_with_python   https://github.com/amueller
kaggleScape              https://github.com/adgirish/kaggleScape.git
ML_for_Hackers_github    https://github.com/johnmyleswhite/ML_for_Hackers.git
modern-cpp-tutorial      https://github.com/changkun/modern-cpp-tutorial.git
ripgrep                  https://github.com/BurntSushi/ripgrep

cpdup                    https://github.com/DragonFlyBSD/cpdup.git
jdupes                   https://github.com/jbruchon/jdupes.git
rclone                   https://github.com/rclone/rclone.git

Note:

[0] adhoc.osgeo.osuosl.org/livedvd/docs/en/metrics.html <--- this is in the Project application material? current url should be :

https://live.osgeo.org/en/metrics.html



UN Task Force on Satellites / EO in National Statistics  2018
Dr Hannes I. Reuter (Eurostat)
Dr Arnold Dekker, Flora Kerblat, Dr Alex Held and Dr Robert Woodcock 
 (Commonwealth Science and Industrial Research Organisation) 
Alexis McIntyre (Geoscience Australia), 
Professor Kerrie Mengersen and James McBroom (Queensland University of Technology), 
Sandra Yaneth Rodriquez (Departamento Administrativo Nacional de Estadistica)
Jacinta Holloway (Australian Bureau of Statistics). 
Patrick Dunagan (Google)
Ronaldo Ocampo and Jose De La Torre (Instituto Nacional de Estadistica Geografica e Informatica)
Jennifer Marley, Ryan Defina, Kate Traeger, Daniel Elazar, Anura Amarasinghe, Gareth Biggs 
 (Australian Bureau of Statistics)
Ben Fitzpatrick and Brigitte Colin (Queensland University of Technology) 
Statistics Canada
Sybille McKeown, Daniel Elazar, Martin Brady and Thomas Walter
 (Australian Bureau of Statistics)
Alexis McIntyre (Geoscience Australia)
Dr Andries Potgieter (University of Queensland)
Dr Matthew Pringle and Dr Michael Schmidt 
 (Queensland Department of Science, Information Technology and Innovation)
Dr Giulia Conchedda and Jacques Delince (Food and Agriculture Organization of the United Nations) 
Javier Gallego (Joint Research Center - European Commission)


eodag misc

    $ grep -h ' import ' $(find $DDIR -name '*py*') | sed -e 's#"##g' -e 's#\\n,##'| sort -u
    from botocore.handlers import disable_signing
    from eodag.api.core import EODataAccessGateway
    # from eodag.api.search_result import SearchResult
    from eodag.crunch import FilterDate
    from eodag.crunch import FilterLatestIntersect
    from eodag.crunch import FilterOverlap
    from eodag.crunch import FilterProperty
    from eodag import EODataAccessGateway
    from eodag import EODataAccessGateway, setup_logging
    from eodag import EOProduct
    from eodag import SearchResult
    from eodag import setup_logging
    from eodag.plugins.crunch.filter_property import FilterProperty
    from eodag.utils import ProgressCallback
    from folium.plugins import TimestampedGeoJson
    from folium.raster_layers import ImageOverlay
    from IPython.display import display, Image
    from itertools import islice
    from PIL import Image as PIL_Image
    from shapely.geometry import Polygon
    from shapely import geometry
    from snappy import GPF, HashMap, Rectangle
    from snappy import ProductIO
    from snappy import ProgressMonitor, ProductUtils
    from zipfile import ZipFile
    dbb@asus30:/home/shared/OSGEO_asus30/odc-misc-ol15$ echo $DDIR
    /tshiba100/nxtcld_gallery/cloudy-geo/eodag.readthedocs.io


other

https://osgeo.github.io/OSGeoLive-doc/en/presentation.html#/ https://github.com/pgRouting/pgrouting/pull/2345 https://github.com/OSGeo/OSGeoLive-doc/actions/runs/2602634951

https://github.com/OSGeo/OSGeoLive-doc/blob/master/doc/images/projects/osgeolive/osgeolive_menu.png

https://www.twitch.tv/videos/1516523650 ## cvvergara twitch


Java Version 5/14 darkblueb: Deegree Code Sprint -- the take-away from the email was.. Deegree v3.4x will work with Java 8; Deegree v3.5x will require Java 11 and a newer Tomcat..



from: Jim Klassen 4/11 I'd suggest looking at the live-build debian package (which is also available in Ubuntu). It can build an iso/usb hybrid boot image (with optional installer), supports a persistence file on USB, and doesn't seem to have a 4GB limit on the squashfs root.
Reply: Angelos 4/28 Yes, this has been a nice option since Ubuntu switched to using live-build officially some years ago. I think we need a demo script to see how it would work before deciding if this is the way forward. In the meantime, there is an option to use xorriso package (I need to find some time to test)


QEMU Convert Disk Image

   $ qemu-img convert -f vmdk -O qcow2 osgeolive-14.0-amd64.vmdk ol14.qcow2

Remove Snapd

   ## Steps to remove snapd from base build16
   $ sudo snap list
   $ sudo snap remove firefox
   $ sudo snap remove gnome-3-38-2004
   $ sudo snap remove gtk-common-themes
   $ sudo snap remove core20
   $ sudo snap remove bare
   $ sudo snap remove snapd
   ## next, stop the systemd service, disable
   $ sudo systemctl stop snapd && sudo systemctl disable snapd
   $ sudo apt purge snapd
   ## manually remove caches
   $ rm -rf ~/snap
   $ sudo rm -rf /snap /var/snap /var/lib/snapd /var/cache/snapd /usr/lib/snapd /root/snap