|
|
Line 28: |
Line 28: |
| <hr/> | | <hr/> |
| | | |
− | === PDAL Misc Notes ===
| |
− |
| |
− | ''Discussion of '''PDAL''', related source code projects, related technology, goals of the OSGeoLive project, goals of OSGeo dot org, general commentary.''
| |
− |
| |
− | '''Technology''' -- Point clouds are a digital format of remote sensing data [0]. Intense advancement of digital geospatial technology in the modern era includes point clouds, for visualization structures [1], for situational awareness in security applications, measurement & modelling of remote sensing environments including ground water surfaces and forestry applications, and more.
| |
− |
| |
− | The LAS file format [2] was invented by FOSS author Martin Isenburg and subsequently gained standing as an international standard. Using invention and out-of-the-box thinking, LAS represents true, original advancement in the open digital science field. Martin is widely regarded now, after his passing, as one of the great contributors to our field [3]. Subsequently, a system for compression on the data was devised, with associated IP rights. [4] PDAL is an extensible software system implemented mostly in C++, as a project modeled directly on the vastly-influential GDAL project. Founder Howard Butler used ideas, community mechanisms and plug-in driver-model, based directly from GDAL. [5]
| |
− |
| |
− | Howard 'hobu' Butler and PDAL PSC Member Mike Smith have indicated that PDAL plus "all of Howard's projects" are affected by the recent diplomatic snafu. This list is at least '''PDAL''', '''liblas''', '''libspatialindex''', and '''python-rtree'''.[7] ''(python-rtree is a python wrapper for libspatialindex)'' Please note that dozens of prominent contributors have built these collected software libraries, not Howard Butler alone [8]. The contributor list, enginerring correctness, and market impact of these software libraries are built directly on the community and engineering reputation of GDAL.
| |
− |
| |
− | [0] [https://en.wikipedia.org/wiki/Point_cloud -WIKIPEDIA-]
| |
− | [1] [https://www.youtube.com/watch?v=udoSz_UBUdc -GOOGLE-]
| |
− | [2] [https://en.wikipedia.org/wiki/LAS_file_format -LAS-]
| |
− | [3] [https://lidarmag.com/2021/09/14/martin-isenburg-open-data-advocate-passes/ -BIO-]
| |
− | [4] [https://laszip.org/ -ZIP-]
| |
− | [5] [https://pdal.io/ -PDAL-]
| |
− | [6] [https://git.osgeo.org/gitea/osgeolive/OSGeoLive/commit/ff4fde8a3fa6e40836dadb3883bc3f7d0e9db2a2 -LINK-] <br/>
| |
− | https://trac.osgeo.org/osgeolive/ticket/2072
| |
− | https://trac.osgeo.org/osgeolive/ticket/2283
| |
− |
| |
− | [7]
| |
− | https://salsa.debian.org/debian-gis-team/libspatialindex
| |
− | https://salsa.debian.org/debian-gis-team/python-rtree
| |
− | https://salsa.debian.org/debian-gis-team/geographiclib
| |
− |
| |
− | [8]
| |
− | https://github.com/libLAS/libLAS/graphs/contributors
| |
− | https://github.com/libspatialindex/libspatialindex/graphs/contributors
| |
− | https://github.com/Toblerity/rtree/graphs/contributors
| |
− |
| |
− | [9] [https://distrowatch.com/table.php?distribution=osgeo -DISTRO-]
| |
− |
| |
− | '''Goals of OSGeoLive'''
| |
− |
| |
− | The OSGeoLive GNU-linux project exists to showcase the ecosystem of OSGeo dot org incubated projects with documentation in ten+ human languages, serves as a reference code implementation of installation and inter-operability of these software projects using OGC and open standards, and demonstrate using a curated showcase of examples to ''trial'' the software without undue burden on the user. Current and developing technology stacks, on the server, in the browser, on the desktop, are updated and run in a modern, networked linux stack. OSGeoLive has been recognized by Distro-watch and other professional catalogs of modern linux. [9]
| |
− |
| |
− | '''History''' -- past uses of PDAL on OSGeoLive:
| |
− |
| |
− | PDAL binary has existed on OSGeoLive linux for some years. In June 2018, a short install script was added to the OSGeoLive repo. [6]
| |
− |
| |
− | '''Conflict''' within the broader community
| |
− |
| |
− | Some kind of interactions between Debian Devloper [10] Sebastian Cowenburg ('''sebastic''') and PDAL Developer Howard Butler ('''hobu'''), have led to protest and action by sebastic. The net effect is that from May 2022 onward, new revisions of PDAL will not be built and inluded in the "upstream" Debian GIS system of packaging. There is a complex and long-standing relationship between Debian GIS/sebastic and OSGeoLive/UbuntuGIS/kalxas. Essentially, both Debian and UbuntuGIS opportunistically feed on the work products of the other. There is a general context of more work than any one or small group of people can do, to formalize and ingest new OSS software into Debian packages. [11]
| |
− |
| |
− | Debian packaging is the standard for signed, authenticated software products to be integrated into linux OS computers, and include the most trusted sources of software available today, due to cryptographic immutability and integrity of the package contents.
| |
− |
| |
− | [10] [https://wiki.debian.org/DebianDeveloper#:~:text=Debian%20Developer%20(DD)%20is%20our,elect%20the%20Debian%20Project%20Leader. -DD-]
| |
− | [11] [https://www.debian.org/distrib/packages -DEBIAN-]
| |
− |
| |
− | EMAIL Inquiry April 2022
| |
− | Hi Howard -
| |
− | thank you for presenting and organizing at Cloud-Native Geospatial Days this week.
| |
− | re: Debian Can you help me understand this email ? I do not have current context on this.
| |
− | https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1009625
| |
− | thank you --Brian M Hamlin / MAPLABS / Berkeley, Calif.
| |
− |
| |
− | Howard Butler replies:
| |
− | The context is Bas is removing PDAL from Debian [1]. No other Debian
| |
− | maintainer has come forward to continue its inclusion.
| |
− | [1] https://lists.debian.org/debian-gis/2022/02/msg00004.html
| |
− |
| |
− | The present author Brian M Hamlin, MAPLABS Berkeley, raised the issue to the Board of Directors of OSGeo dot org in April 2022, noting that some kind of clock is now ticking, marking the 'removal' of PDAL (and perhaps a small list of related software) from the Debian build pipeline. In fact, no packages will be 'removed' from Debian, it means that no new packages will be built and integrated, past that date, as things stand now. The details of this mechanism are complicated. Angelos has indicated that UbuntuGIS project has seperate standing, and may or may not be in a similar situation.
| |
− |
| |
− | OSGeo Board Meeting wiki "Board Meeting 2022-04-25"
| |
− | * Issues in Debian packaging of pdal (https://pdal.io/)
| |
− | * Conda can’t be used on OSGeoLive
| |
− | * What exactly is required from board? (considering PDAL is not an OSGeo affiliated project)
| |
− | * Considering it as a technical problem, a solution can be figured out internally for inclusion of PDAL in OSGeoLive (ed. within the OSGeoLive project)
| |
− |
| |
− | '''kalxas''' indicated a willingness to build bridges at the Board level to the PDAL project, considering that most everyone involved is an OSGeo member
| |
− |
| |
− | How to Proceed
| |
− |
| |
− | Wiki Notes on PDAL - darkblueb [https://wiki.osgeo.org/wiki/Osgeolive-jupyter#Python_Libraries_Strategy writes]:
| |
− |
| |
− | ""LiDAR "maybe?" : this is slightly painful since modern commercial GIS is flooded with this tech, delivered by advanced Western companies seeking something novel to sell. Changes to the LASzip licensing have enabled inclusion, but as of today, no Debian maintainer in place, and bas wants PDAL out at this time. -EMAIL- -EMAIL2-""
| |
− |
| |
− | Online Chat meeting, partial notes:
| |
− |
| |
− |
| |
− |
| |
− | [https://github.com/libLAS/libLAS/graphs/contributors libLAS-link-]
| |
− | [https://github.com/libspatialindex/libspatialindex/graphs/contributors libspatialindex-link-]
| |
− | [https://github.com/Toblerity/rtree/graphs/contributors python-rtree-link-]
| |
− |
| |
− | darkblueb writes:
| |
− | "Personalmente, no espero paquetes de Debian. Si creamos un script de instalación personalizado e incluimos etiquetas de versión de git y lo enviamos solo en OSGeoLive, está bien para mí.
| |
− |
| |
− | "Personally, I don't expect Debian packages. If we create a custom install script and include git version tags and push it only on OSGeoLive, that's fine with me.
| |
− |
| |
− |
| |
− | After the short IRC meeting went badly:
| |
− |
| |
− | 3:07:57 PM - darkblueb: robe2 - you are trusted by this org, you have successful clients and a book that sells a few copies, and at this point, you are a leader here. this disk serves this community.. that is my commitment
| |
− | of course I have opinions, I have three decades of real work in software in California. My opinion
| |
− | includes getting access to high tech, to people who are not insiders, and not necessarily in a uniform
| |
− | thats what drives these PDAL etc talks.. GNU + open FAIR access.. it is my view
| |
− | darkblueb: very few people show up to do the work here.. I like it and do it enthusiastically.. not everyone is glad for that, apparently.. so it goes
| |
− | robe2: darkblueb: That's one of the clearest things you've said today. I have that opinion too. Just not as convinced as you how to get there. I have not much opinion on how to get there. Just that the shortest path is not a straight line
| |
| | | |
| <hr/> | | <hr/> |
Open Issues from the Mailing List May 2022
from: jenriquesoriano@guadaltel.com
cc: Marco.MINGHINI@ec.europa.eu; portele@interactive-instruments.de; herrmann@interactive-instruments.de;
michael.lutz@ec.europa.eu; josebarrero@guadaltel.com
Dear OSGeoLive team, we contact you to kindly propose the inclusion of the ETF testing framework in the OSGeoLive distribution. Following the requirements, please find below the answer to the required questions. Please let us know if any additional clarification is needed. [0] -VLINK- -GITHUB-
Reply: Angelos 4/28
Thank you for your application. ; We will process during our next project meeting and provide feedback.
from: Jim Klassen 4/11
I'd suggest looking at the live-build debian package (which is also available in Ubuntu). It can build an iso/usb hybrid boot image (with optional installer), supports a persistence file on USB, and doesn't seem to have a 4GB limit on the squashfs root.
Reply: Angelos 4/28
Yes, this has been a nice option since Ubuntu switched to using live-build officially some years ago.
I think we need a demo script to see how it would work before deciding if this is the way forward.
In the meantime, there is an option to use xorriso package (I need to find some time to test)
Java Version 5/14
darkblueb: Deegree Code Sprint -- the take-away from the email was.. Deegree v3.4x will work with Java 8; Deegree v3.5x will require Java 11 and a newer Tomcat..
Remove Snapd
darkblueb@live:~$ sudo snap list
Name Version Rev Tracking Publisher Notes
core20 20220329 1434 latest/stable canonical✓ base
snapd 2.55.3 15534 latest/stable canonical✓ snapd
darkblueb@live:~$ sudo snap remove core20
core20 removed
darkblueb@live:~$ sudo snap remove snapd
snapd removed
darkblueb@live:~$ sudo systemctl stop snapd && sudo systemctl disable snapd
Warning: Stopping snapd.service, but it can still be activated by:
snapd.socket
Removed /etc/systemd/system/multi-user.target.wants/snapd.service.
darkblueb@live:~$ sudo apt purge snapd
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
libfwupdplugin1 squashfs-tools
Use 'sudo apt autoremove' to remove them.
The following packages will be REMOVED:
snapd*
darkblueb@live:~$ rm -rf ~/snap
darkblueb@live:~$ sudo rm -rf /snap /var/snap /var/lib/snapd /var/cache/snapd /usr/lib/snapd /root/snap
apache_allura https://github.com/apache/allura.git
ArcRasterRescue https://github.com/r-barnes/ArcRasterRescue.git
batyr https://github.com/nmandery/batyr.git
BONAI https://github.com/jwwangchn/BONAI.git
containerd https://github.com/docker/containerd
cpdup https://github.com/DragonFlyBSD/cpdup.git
csv2sqlite https://github.com/psanford/csv2sqlite.git
cube-in-a-box https://github.com/opendatacube/cube-in-a-box.git
datacube-core https://github.com/opendatacube/datacube-core.git
docker-postgis https://github.com/appropriate/docker-postgis.git
earthenterprise https://github.com/google/earthenterprise
elegant-scipy https://github.com/elegant-scipy/elegant-scipy.git
gdal-segment https://github.com/cbalint13/gdal-segment.git
geographiclib-code https://github.com/geographiclib/geographiclib
geonode https://github.com/GeoNode/geonode.git
geopandas https://github.com/geopandas/geopandas.git
geos git@github_key:libgeos/geos.git
geos-performance https://github.com/pramsey/geos-performance.git
gitea https://github.com/go-gitea/gitea
gobby https://github.com/gobby/gobby.git
high_performance_python https://github.com/mynameisfiber/high_performance_python.git
imaptools_github https://github.com/woodbri/imaptools.com.git
introduction_to_ml_with_python https://github.com/amueller
ipython https://github.com/ipython/ipython.git
jts_loctech https://github.com/locationtech/jts.git
jupyter-cm https://github.com/jupyter-incubator/contentmanagement.git
jupyter_notebook https://github.com/jupyter/notebook.git
kaggleScape https://github.com/adgirish/kaggleScape.git
leehach_census https://github.com/leehach/census-postgres.git
libgeotiff https://github.com/OSGeo/libgeotiff.git
libosmium https://github.com/osmcode/libosmium.git
libosmium https://github.com/osmcode/osm-testdata
logbt https://github.com/mapbox/logbt.git
looking-glass-pub https://github.com/developmentseed/looking-glass-pub.git
mapcache git://github.com/mapserver/mapcache.git
mapserv_basemaps https://github.com/mapserver/basemaps.git
mapserver_github https://github.com/mapserver/mapserver.git
ML_for_Hackers_github https://github.com/johnmyleswhite/ML_for_Hackers.git
modern-cpp-tutorial https://github.com/changkun/modern-cpp-tutorial.git
narsc16 https://github.com/sjsrey/narsc16.git
opencv https://github.com/opencv/opencv
opencv-itseez https://github.com/Itseez/opencv.git
opengdp https://github.com/opengdp/opengdp.git
osm2pgsql_git https://github.com/openstreetmap/osm2pgsql
osmcode_osm-gis-export https://github.com/osmcode/osm-gis-export
osmium-tool https://github.com/osmcode/osmium-tool.git
osm-testdata https://github.com/osmcode/osm-testdata
oss-fuzz https://github.com/rouault/oss-fuzz
OWSLib git://github.com/geopython/OWSLib.git
pandas_020 https://github.com/pandas-dev/pandas.git
pandoc git://github.com/jgm/pandoc.git
perfecttin https://github.com/OSGeo/perfecttin.git
perfecttin https://github.com/phma/perfecttin
pgimportdoc https://github.com/okbob/pgimportdoc.git
pgsql-ogr-fdw https://github.com/pramsey/pgsql-ogr-fdw.git
proj_github https://github.com/OSGeo/PROJ
protozero https://github.com/mapbox/protozero
psycopg2_git https://github.com/psycopg/psycopg2.git
pygeos https://github.com/pygeos/pygeos
pygit2 https://github.com/libgit2/pygit2.git
pystac_github https://github.com/azavea/pystac.git
qhull https://github.com/qhull/qhull.git
rasterio https://github.com/mapbox/rasterio.git
raster-vision https://github.com/azavea/raster-vision.git
rindcalc_github https://github.com/darkblue-b/rindcalc.git
ripgrep git://github.com/BurntSushi/ripgrep
satproc https://github.com/dymaxionlabs/satproc.git
scikit-image https://github.com/scikit-image/scikit-image.git
scikit-learn https://github.com/scikit-learn/scikit-learn.git
scipy_github https://github.com/scipy/scipy.git
scitools_iris https://github.com/SciTools/iris.git
Shapely https://github.com/Toblerity/Shapely.git
tile38 https://github.com/tidwall/tile38.git
Note:
[0] adhoc.osgeo.osuosl.org/livedvd/docs/en/metrics.html <--- this is in the Project application material? current url should be :
https://live.osgeo.org/en/metrics.html