Open Letter about LIDAR format

March 2015.

We, the undersigned, are concerned that the current situation, where there is a defacto industry standard for storing LIDAR data, is being threatened by ESRI's introduction and promotion of an alternative closed format.

This is of concern as it reduces interoperability between applications and organisations, and introduces vendor lock-in.This has also wider implications in Geo education.

We request that:

The OGC initiate the formalisation of a open standard for storing LIDAR data.
Users and sponsors of LIDAR data, and the LAS Working Group (LWG) which is part of ASPRS, publicly state their preference for the use of an open format over closed when selecting software and services.
ESRI join efforts to support agreement around an open LIDAR format.

Signed

Name, Affiliation(s), Optional comment on interest in Open LIDAR format

1. Suchith Anand , Geo for All , committed to Open Principles in Geo Education and Policy. [More details at section 4]

Background

About LIDAR

LIDAR (Light Detection and Ranging) is a form of high precision range detection much like a radar system that uses laser light as the electromagnetic emission. One of LIDAR systems’ products is a “point cloud” data product that can be conceptualized as a series of point measurements representing distance from the sensor to a returned emission. A common storage format for these point cloud data is the LAS format.

To date, there has been common format for storing LIDAR data, the “LAS” format, and an open source library, libLAS, that can read and write the format. Rather than write their own format support, most vendors have simply used libLAS, and LAS has become an industry standard.

LAS limitations

Quoting Paul Ramsey:

LAS format is not without its drawbacks:

While it is a binary format and does not waste any space unnecessarily, neither does it apply any compression to the data it stores. That’s not good for archival use. Also, LAS stores points in scan order, so accessing any particular chunk of points involves reading the whole file. That’s not good for random access. Clearly there is a little more work to be done. Can LAS be improved? In fact, it already has been:

An open source compression library LASzip can apply 20:1 lossless compression to LAS files, making them great for archival purposes.
Other LAS users have experimented with re-ordering points in a LAS or LASzip file to allow random access to internal chunks of the LIDAR point cloud.

Basically, making LAS smaller and faster is not rocket science, and if the work were incorporated into libLAS then the whole LIDAR community could leverage it together, and the user community would only have one file type to interchange.

Closed "Optimized LAS" format from ESRI

ESRI has announced the release of an Optimized LAS format which is claimed to provide faster access and smaller file sizes. ESRI has also released a free tool which is claimed to convert LAS files to and from Optimized LAS.

However, the Optimized LAS format is not published, which locks out other applications being able to efficiently make use of the Optimized LAS format, effectively creating a vendor lock-in scenario.

Wider Implications

These kind of developments undermining Open Standarads also directly affect "Geo for All" and our Open Principles in Geo Education that OSGeo, ICA all stand for and are working together in our common mission of making geospatial education and opportunities accessible to all. These developments not only affects our Academic colleagues and students working in LIDAR research and teaching but will have long term impacts on Open Principles in Geo Education. It is important to focus on the bigger picture on bringing Open Standards firmly into Education and Policy for the future ( this particular issue which brought this to our immediate attention has provided the urgent need to do this). So let us all focus on the bigger aim of making sure Open Standards are firmly adhered to by all in the future and no proprietary vendor will use their monopoly to force the system. Everyone big or small will have to play by the rules and support Open standards to ensure value for taxpayers money and accelerate innovation opportunities.

This is important as looking at the past track record of this proprietery vendor , they have been doing these kinds of activities against Open principles many times in the past and have got away with it.There are so many other proprietary GIS companies and none of them are doing these kind of activities against Open Principles and interoperability. It is only because we now have organisations like OSGeo and OGC, we can at least have the confidence to highlight these things. There need to be also focus on policy needed for preventing Immoral business practices in the future. Even if it is privately owned business there has to be some accountability for all business practices . Otherwise this will keep happening in future also.

The bigger aim is also that for government procurement there is strong Open Standards policy in place , so that taxpayers money is not wasted . GIS procurement for both software and data will be billions of dollars every year so policy aspect on Open Standards is also very important to ensure cost reductions and efficiencies.

LIDAR Format Letter

Contents