osgeo / proj-datumgrid Goto Github PK

Available from https://www.geo.bremen.de/detail.php?template=20_search_d&search%5Bsend%5D=true&lang=de&search%5Bvt%5D=HBTa2010.gsb

https://www.geo.bremen.de/sixcms/media.php/13/Nutzungsbedingungen.pdf
https://www.geo.bremen.de/sixcms/media.php/13/Info_HBTa2010_komplett_140401.pdf

Hello,
While looking at OSGeo/PROJ#904 I noticed the ESRI file uses 102 times the NTv2 grid "OSTN02_NTv2.gsb".
I found it here.
The license seems OK:

The OSTN02 data in NTv2 format is licensed to users pursuant to the terms of the Open Source Initiative BSD Licence (see the opensource bsd license page).

The copyright notice which must be attached to the software under the terms of the BSD licence is as follows:

'© Crown copyright, Ordnance Survey and the Ministry of Defence (MOD) 2002. All rights reserved.

Should it be included in this package?

Available from https://www.ldbv.bayern.de/vermessung/utm_umstellung/trans_geofach.html

• See discussion in QGIS-Brazil forum: https://groups.google.com/d/msg/qgisbrasil/zdNGyfnoxKg/9a8xpU_2CQAJ

• Grid files provided by Brazil's national mapping agency, IBGE : ftp://geoftp.ibge.gov.br/informacoes_sobre_posicionamento_geodesico/sirgas/aplicativos/transformacao_coordenadas/progrid_compacto.zip

• Note that the archive seems to be for a 'ProGrid' software, but the grid files live in the archive at /ProGriD_compacto/program files/Progrid/GridFiles

• here are those 4 grid files: brazil-grids.zip

• I am unsure of the exact license : there is however a licence file for 'ProGrid', in Portuguese ProgridLic.pdf

Will try to get others from QGIS-Brazil to join this ticket discussion...

https://geodesy.noaa.gov/GEOID/GEOID18/downloads.shtml

Check if the grid from http://www.bev.gv.at/portal/page?_pageid=713,2103845&_dad=portal&_schema=PORTAL can be included

Available at https://www.globogis.it/grigliati-ntv2-Italia

Available from https://www.geobasis-bb.de/geodaten/dienst_progr.htm

For my grid_packages table in proj.db, I currently point to URLs like 'https://download.osgeo.org/proj/proj-datumgrid-1.8.zip'.
This has the potential to rot quite quickly, and I think that pointing to the latest available version would generally be better.
A solution would to create and update symbolic links on https://download.osgeo.org/proj/ like
ln -s proj-datumgrid-1.8.zip proj-datumgrid-latest.zip each time we release a new package.

If you agree, I can offer the needed updates to HOWTORELEASE

The other possibility would be to update HOWTORELEASE to mention updating grid_alternatives.sql (but that might be too late if PROJ is released before the grid packages)

There is a BWTA2017.gsb for Baden-Württemberg available from the Landesamt für Geoinformation

The license looks good

Hinweis: Die NTv2-Dateien BWTA2017 sind Open Data nach der "Datenlizenz Deutschland – Namensnennung – Version 2.0". Details unter https://www.govdata.de/dl-de/by-2-0.
Bezeichnung des Bereitstellers: "Datengrundlage: LGL, www.lgl-bw.de".
Verweis auf den Datensatz (URL): https://www.lgl-bw.de/lgl-internet/opencms/de/05_Geoinformation/Galerien/Dokumente/BWTA2017.zip

Note: the unzipped file is 375MB big

Should this be included in this package?

Available from https://lsbb.sachsen-anhalt.de/service/vermessung/

https://webapp.geod.nrcan.gc.ca/geod/data-donnees/transformations.php?locale=en mentions

In the province of Newfoundland and Labrador there is a grid shift file for transforming between NAD83(Original) and NAD83(CSRS) epoch 2010.
Coverage | From | To | Grid
-- | -- | -- | --
Newfoundland (Island only) | NAD83(Original) | NAD83(CSRS) 2010 | Download   										NLCSRSV4.GSB

Download link: https://webapp.geod.nrcan.gc.ca/geod/process/download-helper.php?file_id=NLCSRSV4
License: Open Government Licence - Canada

However there is no EPSG transformation for it

Some exchanges with Swiss folks have shown that Swisstopo might release in (not earlier than) 2020 some of its datasets, including the NTv2 grids that do CH1903 to CH1903+ or ETRS89, which are currently downloadable as cost free but with some restrictions, under an open data license.

Available from https://kvwmap.de/index.php/Verbesserte_towgs84-Parameter_f%c3%bcr_epsg_und_spatial_ref_sys

hello, everyone,

could you explain why would one need this package at all?
Is it a required component for PROJ or just an optional ?

Thank you very much

Hi there,
so nad2bin is not in proj 6.0 anymore, neither in datumgrid-1.8. Seems to be in datumgrid-world with a cmake which misses install directories. Would be nice if some clean-up and explanations could be provided somewhere!
Thanks,
Chris.

Got confirmation from lvgl.saarland.de that the Seta2016 dataset can be distributed under the terms of CC BY 4.0:
Home page: https://www.saarland.de/74918.htm
Download link: https://www.saarland.de/dokumente/thema_lkvk2/SeTa2016.zip

Received: from wexclsaar314.saarland.de ([fe80::bc25:e876:b5b3:46e6]) by
 wexclsaar314.saarland.de ([fe80::bc25:e876:b5b3:46e6%21]) with mapi id
 15.01.1779.002; Fri, 6 Dec 2019 13:25:49 +0100
Subject: AW: AW: Lizenz von SeTa2016.zip ?
Date: Fri, 6 Dec 2019 12:25:49 +0000

 <{redacted}@lvgl.saarland.de>
Dear Mr. Rouault,
as my colleague Ms. Schmitt has already answered, there are no formal licensing requirements for the Seta 2016 transformation parameters.
However, the naming of the license CC BY 4.0 can be applied analogously in case of a transfer.

Mit freundlichen Grüßen

{redacted}

Sachgebietsleiter
Sachgebiet 4.3 - Vertrieb, Gebühren -

- Zentrale -

Available at https://github.com/OSGeoLabBp/eov2etrs

I just had a IRC chat with @hobu and we discussed about future plans for the organization of proj-datumgrid. The 'regional' model is mostly a workaround to have packages of reasonable size and a structure of the repository, but it isn't perfect. For example, data for France is in europe/ but a number of grids in those grids are for overseas directories in North America, Carribeans and Indian ocean. Also the regional approach doesn't necessarily match the user needs: for Oceania, it is unlikely that a New Zealander will need Australian data given they have no common boundary.

I've done a quick experiment at converting all our NTv2 and GTX files into DEFLATE compressed TIFF: the result is 470 MB of compressed TIFF for the whole repository, vs 1.4 GB of uncompressed NTv2 and GTX files. So if RFC4 is implemented and libtiff a required dependency, we could just release one single proj-datumgrid-all.zip file. That would make life easier for us, and users (confused by which packages to install). People that would want more fine grained distribution could potentially use a future proj-datumgrid-install tool ( OSGeo/PROJ#1750 ) that would download (from the CDN?) the grids correponding to a producing agency. To have still some structure in the proj-datumgrid repository, we could have subdirectory by producers: ignfrance, linz, noaa, etc... We would just fold everything into a single package for release.

It would be nice to include in this repository two NTv2.0 grid shift files available for download from the Portuguese National Geodetic Authority (DGTerritorio) web site, and published under Creative Commons - Attribution 4.0 International.

I have all the relevant information, grids included, in the following GitHub repository:

https://github.com/lmikegeo/ntv2-pt

Available at http://www.ga.gov.au/ausgeoid/
Confirmed to be CCBY 4.0 https://creativecommons.org/licenses/by/4.0/ (see OSGeo/PROJ#1724 (comment))

The product NTv2_SN , to be downloaded at https://www.landesvermessung.sachsen.de/prod_fest_raum_fest/NTv2_SN_2014.zip (from http://www.landesvermessung.sachsen.de/download-5608.html?_cp=%7B%22accordion-content-4389%22%3A%7B%222%22%3Atrue%7D%2C%22previousOpen%22%3A%7B%22group%22%3A%22accordion-content-4389%22%2C%22idx%22%3A2%7D%7D ) , is the RD/83 -> ETRS89 transformation for East-Germany, and especially Saxony.

As an answer to my question to get licence information, [email protected] (GeoSN) answered on Dec 3rd 2019

Sehr geehrter Herr Rouault,
selbstverständlich dürfen Sie alle unsere Daten nutzen. 

Für die Nutzung der bereitgestellten Informationen des amtlichen
Vermessungswesens gelten die Bestimmungen der Datenlizenz Deutschland –
Namensnennung – Version 2.0 ([1]https://www.govdata.de/dl-de/by-2-0) unter
Angabe der Quelle (Namensnennung) „GeoSN“.

that is it is licensed under https://www.govdata.de/dl-de/by-2-0
"Data licence Germany – attribution – version 2.0" license listed by
https://opendefinition.org/licenses/ as a "Other conformant licenses", in the
same category as the license for the Canadian NTv2 grids we already have, and we must attribute it to the GeoSN source

@hobu @kbevers I've issued a benign pull request which fails with https://travis-ci.com/OSGeo/proj-datumgrid/builds/130801548

Error downloading object: world/egm08_25.gtx (c18f20d): Smudge error: Error downloading world/egm08_25.gtx (c18f20d1fe88616e3497a3eff993227371e1d9acc76f96253e8d84b475bbe6bf): batch response: This repository is over its data quota. Purchase more data packs to restore access.

Quick googling for that error message leads to nabla-c0d3/nassl#17

Going to https://github.com/organizations/OSGeo/settings/billing , I see we are at "167% bandwidth, 14% storage used ". I'm not sure if every Travis build or "git clone" for folks count for bandwidth usage, but if so then it would be 150 MB each time, so with 7 downloads a month we are out of bandwidth. Apparently for 5 USD / month, storage and bandwidth quota go to 50 GB.

Apparently gitlab.com offers 10 GB LFS storage and unlimited bandwidth : https://about.gitlab.com/2015/04/08/gitlab-dot-com-storage-limit-raised-to-10gb-per-repo/

What should we do ?

Grid specific to Catalonia for ED50 to ETRS89 : 100800401.gsb
File found in http://www.icgc.cat/content/download/48766/337962/version/1/file/Malla_NTv2_11_03.zip

Joel Grau Bellet, Head of the Geodesy Unit, Geodesy Unit, Institut Cartogràfic i Geològic de Catalunya pointed to me by email to https://www.icgc.cat/en/The-ICGC/Public-Information/Transparency/Re-use-of-the-information , which mentions https://creativecommons.org/licenses/by/4.0/

README.EUROPE mentions for example "Denmark: GRS80 ellipsoidal heights -> DVR90 heights", but the content of the dvr90.gtx file is the value to add to a DVR90 height to get a GRS80 ellipsoidal height, so I think it would be less confusing to name it "Denmark: DVR90 heights -> GRS80 ellipsoidal heights".
The same applies for most of other .gtx file descriptions

(Let me preface this by saying that I'm aware of PROJ-data for PROJ 7, but I'm trying to use PROJ 6.)

The instructions seem to only be:

The files in this package can be unpacked in the PROJ data directory. For an installed PROJ this may be /usr/local/share/proj or /usr/share/proj on unix style operating systems.

What is the recommended way of doing this if I want all grids? The options would seem to be:

• git clone with Git LFS
• wget/curl some compressed distribution
• install using a package manager

In the first case, once I've cloned, which files would I need to copy to the Proj data directory? Do I need to run Make as well?

In the second case, what is the URL to use?

If the third case is an option, the documentation doesn't make that clear.

What I expected the documentation to say:

To install all grids, you need to download all the grids and unpack them to the PROJ data directory:
wget https://example.com/proj-grids.zip -p /tmp/ && unzip /tmp/proj-grids.zip && mv /tmp/proj-grids $PROJ_DATA_DIR

i.e. a clear command to actually obtain and install the grids. At the moment the instructions are very vague, and other online documentation is confused since we're at the transition between v6 and v7.

What I'm doing:

RUN curl -L --output /tmp/proj-datumgrid-oceania-1.2.zip https://github.com/OSGeo/proj-datumgrid/releases/download/oceania-1.2/proj-datumgrid-oceania-1.2.zip \
&& unzip /tmp/proj-datumgrid-oceania-1.2.zip -d /usr/local/share/proj \
&& curl -L --output /tmp/proj-datumgrid-north-america-1.4.zip https://github.com/OSGeo/proj-datumgrid/releases/download/north-america-1.4/proj-datumgrid-north-america-1.4.zip \
&& unzip /tmp/proj-datumgrid-north-america-1.4.zip -d /usr/local/share/proj \
&& curl -L --output /tmp/proj-datumgrid-europe-1.6.zip https://github.com/OSGeo/proj-datumgrid/releases/download/europe-1.6/proj-datumgrid-europe-1.6.zip \
&& unzip /tmp/proj-datumgrid-europe-1.6.zip -d /usr/local/share/proj \
&& curl -L --output /tmp/proj-datumgrid-world-1.0.zip https://github.com/OSGeo/proj-datumgrid/releases/download/world-1.0/proj-datumgrid-world-1.0.zip \
&& unzip /tmp/proj-datumgrid-world-1.0.zip -d /usr/local/share/proj

It would be nice if this was documented clearly. (And, as an aside, distrubuted like all-latest rather than per-region and per-version.)

http://download.osgeo.org/proj/vdatum/ provides various grids that are used in the gie test suite for example (OSGeo/PROJ#769). Not having these grids available during the build of proj (5.0.0-rc1) causes the tests to fail.

These grids should probably be included in proj-datumgrid (if their licensing allows it) to not require manual download of these like in the proj Dockerfile. Such a process is not appropriate for packagers of proj.

None of the vdatum grids state the terms for their distribution, so including them as-is in proj-datumgrid is problematic.

@dalia2 Just to make sure if it is in your action items

Available at http://www.provincia.agrigento.it/flex/cm/pages/ServeBLOB.php/L/IT/IDPagina/309

The grids were created using the official conversion service made available by the Italian National Geoportal at http://www.pcn.minambiente.it/mattm/en/

The AT_GIS_GRID.gsb grid for MGI to ETRS89 is available at
http://www.bev.gv.at/portal/page?_pageid=713,2157075&_dad=portal&_schema=PORTAL :

http://www.bev.gv.at/pls/portal/docs/PAGE/BEV_PORTAL_CONTENT_ALLGEMEIN/0200_PRODUKTE/UNENTGELTLICHE_PRODUKTE_DES_BEV/GIS-Grid.zip

Got a hint that it is mentionned at https://www.data.gv.at/katalog/dataset/gis-grid that it is released under "Creative Commons Namensnennung 4.0 International ", that is CC-BY 4.0

Initially discussed on http://lists.maptools.org/pipermail/proj/2018-September/008387.html

Canada's NTV2_0.GSB can now be freely downloaded from https://open.canada.ca/data/en/dataset/b3534942-31ea-59cf-bcc3-f8dc4875081a

This file is a binary grid shift file (.gsb format) to transform coordinates between the NAD27 and NAD83 reference systems and vice-versa. It has a higher resolution to ntv1_can.dat, which is included to proj-datumgrid under public domain.

The newer grid shift file is licensed under Canada's Open Government Licence, which is nearly identical to UK's Open Government Licence, which has:

... terms [that] are compatible with the Creative Commons Attribution License 4.0 and the Open Data Commons Attribution License, both of which license copyright and database rights.

It looks fine from my perspective to be included in this package. Does anyone else see differently?

I'd advise keeping the older grid shift file (ntv1_can.dat, 1.06 MB), and adding the 13.8 MB to the north-america directory. Should we rename it from NTV2_0.GSB to (e.g.) ntv2_0.gsb?

Information page: https://sapos.thueringen.de/ThuT_dll.php (in German)
download link: https://sapos.thueringen.de/DOWNLOAD/ntv2gridth.ZIP

The recently included grids from Australia are quite big (80MB). Over time the grid collection will be larger and larger making the datum grid package unnecessarily big for most users. We should consider dividing the grids into several packages, for instance differentiating between horizontal and vertical grids. This could be subdivided even further in regional packages if necessary.

At first I think it makes sense to have two packages:

1. proj-horizontal-datumgrids-1.7.0.tar.gz
2. proj-vertical-datumgrids-1.70.0.tar.gz

Which eventually can be divided into

1a. proj-horizontal-datumgrids-europe-1.70.0.tar.gz
1b. proj-horizontal-datumgrids-northamerica-1.70.0.tar.gz
1c. ...
2a. proj-vertical-datumgrids-europe-1.70.0.tar.gz
2b. proj-vertical-datumgrids-northamerica-1.70.0.tar.gz
2c. ...

At some point it could also be necessary to create a package of deformation/velocity model grids, but so far not many of those exists.

Available from http://www.stadtentwicklung.berlin.de/geoinformation/bezugssysteme/software.shtml

We're refusing to eat our own dogfood (OSGeo/PROJ#822) because the size of proj-datumgrids-1.7RC1 is considered "just a waste of time and bandwith to download that.".

Removal of the GDA grids (added via #3) reduces the size of the archive significantly.

Perhaps we should only consider including grids of reasonable size (e.g. < 5 MB).

CC: @nyalldawson