Code Monkey home page Code Monkey logo

proj-datumgrid's Introduction

PROJ-DATUMGRID

NOTE: This repository is only to be used with PROJ < 7. For PROJ 7 or later, use the PROJ-data repository.

The files in this package can be unpacked in the PROJ data directory. For an installed PROJ this may be /usr/local/share/proj or /usr/share/proj on unix style operating systems.

Note that this package includes "CTable2" format grid shift files for NAD27 in the USA and require PROJ 4.8.0 or newer. On the plus side there is no need to compile ascii files into binary files with this version as CTable2 files are not system dependent (as distinct from the CTable files produced in PROJ 4.7.0 and older).

About the Datum Grid package

The datum grid package for PROJ is maintained on the OSGeo proj-datumgrid repository on GitHub. Anyone cloning it, or one of its forks, needs to install the Git Large File Storage (LFS) extension, due to the presence of files larger than 100 MB. Consult the GitHub introduction to LFS for more information.

All grids in the package are released under permissive licenses. New grids are accepted into the package as long as they are released under a license that is compatible with the Open Source Definition and the source of the grid is clearly stated and verifiable. Suitable licenses include:

  • Public domain
  • X/MIT
  • BSD 2/3/4 clause
  • CC0
  • CC-BY (v3.0 or later)
  • CC-BY-SA (v3.0 or later)

Consult CONTRIBUTING.md to submit a new grid.

Horizontal grids

2-dimensional transformation grids for horizontal datum shifts.

Canada: NAD27 -> NAD83

Source: Natural Resources Canada
Format NTv1
License: Public Domain

Grid conversion from NAD27 to NAD83 in Canada. This file is superseded by a higher resolution ntv2_0.gsb grid.

  • ntv1_can.dat

France: NTF -> RGF93

Grid transformation from NTF to RGF93 in France.

Source: IGN
Format: NTv2
License: License Ouverte (in French) / Open License (English translation)

  • ntf_r93.gsb

Germany: DE_DHDN -> ETRS89

Source: ADV, with direct link from BKG
Format: NTv2
License: Free redistribution is allowed and welcome

Grid transformation from DE_DHDN to ETRS89 in Germany.

  • BETA2007.gsb

Note: proj-datumgrid-europe includes the BWTA2017.gsb grid for Baden-Württemberg

New Zealand: NZGD49 -> NZGD2000

Source: LINZ
Format: NTv2
License: Creative Commons Attribution 3.0 New Zealand

This grid file was computed by Land Information New Zealand at approximately a 20 km interval for the conversion between NZGD49 and NZGD2000.

  • nzgd2kgrid0005.gsb

USA: NAD27 and older CRS -> NAD83

Source: .los/.las files coming from NOAA
Format: CTable2
License: Public Domain

  • alaska - Alaska
  • conus - Conterminous U.S.
  • hawaii - Hawaii. Old Hawaiian (EPSG:4135) to NAD83
  • prvi - Puerto Rico, Virgin Is. Puerto Rico (EPSG:4139) to NAD83
  • stgeorge - St. George Is, Alaska. St. George Island (EPSG:4138) to NAD83
  • stlrnc - St. Lawrence Is., Alaska. St. Lawrence Island (EPSG:4136) to NAD83
  • stpaul - St. Paul Is., Alaska. St. Paul Island (EPSG:4137) to NAD83

USA: NAD83 -> NAD83 (HARN/HPGN)

Source: .los/.las files coming from NOAA
Format: CTable2 License: Public Domain

Grid data for high precision conversion of geographic coordinates from the original NAD83 (1986) (EPSG:4269) to NAD83 High Precision Geodetic Networks (HPGNs) (EPSG:4152), also referred to as High Accuracy Reference Networks (HARNs). NAD 83 coordinates based on the HPGN/HARN surveys changed approximately 0.2 to 1.0 meter relative to the original NAD 83 (1986) adjustment.

  • FL - Florida
  • MD - Maryland
  • TN - Tennessee
  • WI - Wisconsin
  • WO - Washington, Oregon, N. California

Vertical grids

1-dimensional transformation grids for vertical datum shifts.

Worldwide: EGM96 geoid model

Source: NGA
Format: GTX
License: Public Domain

15 minute worldwide geoid undulation grid that transforms physical heights to WGS84 ellipsoidal heights.

  • egm96_15.gtx

Regional PROJ resource packages

In addition to the core proj-datumgrid package, regional collections of grids and init-files also exist. These includes grids and init-files that are not essential for the functionality of PROJ but still of general interest to PROJ-users in the package-specific regions.

The regional packages can be downloaded from the OSGeo download server.

World

This additional package with world scope contains files of big size.

More information about the included grids and init files can be found in README.WORLD

Europe

The regional package for Europe includes resources for the following countries:

  • Denmark
  • France
  • Ireland+Northern Ireland
  • Sweden
  • The Faroe Islands
  • The Nordic+Baltic countries

More information about the included grids and init files can be found in README.EUROPE

North America

The regional package for North America includes resources for the following countries:

  • Canada
  • Greenland
  • USA

More information about the included grids and init files can be found in README.NORTHAMERICA

Oceania

The regional package for Oceania includes resources for the following countries:

  • Australia
  • New Zealand

More information about the included grids can be found in README.OCEANIA

proj-datumgrid's People

Contributors

agiudiceandrea avatar alpha-beta-soup avatar ccrook avatar dalia2 avatar kbevers avatar mwtoews avatar nyalldawson avatar pedrovenancio avatar rouault avatar sebastic avatar wonder-sk avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

proj-datumgrid's Issues

AT_GIS_GRID.gsb (MGI to ETRS89 ) can be included

The AT_GIS_GRID.gsb grid for MGI to ETRS89 is available at
http://www.bev.gv.at/portal/page?_pageid=713,2157075&_dad=portal&_schema=PORTAL :

http://www.bev.gv.at/pls/portal/docs/PAGE/BEV_PORTAL_CONTENT_ALLGEMEIN/0200_PRODUKTE/UNENTGELTLICHE_PRODUKTE_DES_BEV/GIS-Grid.zip

Got a hint that it is mentionned at https://www.data.gv.at/katalog/dataset/gis-grid that it is released under "Creative Commons Namensnennung 4.0 International ", that is CC-BY 4.0

Include Canada's NTv2.0 grid shift file

Initially discussed on http://lists.maptools.org/pipermail/proj/2018-September/008387.html

Canada's NTV2_0.GSB can now be freely downloaded from https://open.canada.ca/data/en/dataset/b3534942-31ea-59cf-bcc3-f8dc4875081a

This file is a binary grid shift file (.gsb format) to transform coordinates between the NAD27 and NAD83 reference systems and vice-versa. It has a higher resolution to ntv1_can.dat, which is included to proj-datumgrid under public domain.

The newer grid shift file is licensed under Canada's Open Government Licence, which is nearly identical to UK's Open Government Licence, which has:

... terms [that] are compatible with the Creative Commons Attribution License 4.0 and the Open Data Commons Attribution License, both of which license copyright and database rights.

It looks fine from my perspective to be included in this package. Does anyone else see differently?

I'd advise keeping the older grid shift file (ntv1_can.dat, 1.06 MB), and adding the 13.8 MB to the north-america directory. Should we rename it from NTV2_0.GSB to (e.g.) ntv2_0.gsb?

How to install datumgrid with new proj 6.0?

Hi there,
so nad2bin is not in proj 6.0 anymore, neither in datumgrid-1.8. Seems to be in datumgrid-world with a cmake which misses install directories. Would be nice if some clean-up and explanations could be provided somewhere!
Thanks,
Chris.

Remove Australia GDA94 -> GDA2020 grids

We're refusing to eat our own dogfood (OSGeo/PROJ#822) because the size of proj-datumgrids-1.7RC1 is considered "just a waste of time and bandwith to download that.".

Removal of the GDA grids (added via #3) reduces the size of the archive significantly.

Perhaps we should only consider including grids of reasonable size (e.g. < 5 MB).

CC: @nyalldawson

Include vdatum grids?

http://download.osgeo.org/proj/vdatum/ provides various grids that are used in the gie test suite for example (OSGeo/PROJ#769). Not having these grids available during the build of proj (5.0.0-rc1) causes the tests to fail.

These grids should probably be included in proj-datumgrid (if their licensing allows it) to not require manual download of these like in the proj Dockerfile. Such a process is not appropriate for packagers of proj.

None of the vdatum grids state the terms for their distribution, so including them as-is in proj-datumgrid is problematic.

ED50 to ETRS89 for Catalonia (100800401.gsb) can be included

Grid specific to Catalonia for ED50 to ETRS89 : 100800401.gsb
File found in http://www.icgc.cat/content/download/48766/337962/version/1/file/Malla_NTv2_11_03.zip

Joel Grau Bellet, Head of the Geodesy Unit, Geodesy Unit, Institut Cartogràfic i Geològic de Catalunya pointed to me by email to https://www.icgc.cat/en/The-ICGC/Public-Information/Transparency/Re-use-of-the-information , which mentions https://creativecommons.org/licenses/by/4.0/

Include BWTA2017.gsb (Baden-Württemberg)

There is a BWTA2017.gsb for Baden-Württemberg available from the Landesamt für Geoinformation

The license looks good

Hinweis: Die NTv2-Dateien BWTA2017 sind Open Data nach der "Datenlizenz Deutschland – Namensnennung – Version 2.0". Details unter https://www.govdata.de/dl-de/by-2-0.
Bezeichnung des Bereitstellers: "Datengrundlage: LGL, www.lgl-bw.de".
Verweis auf den Datensatz (URL): https://www.lgl-bw.de/lgl-internet/opencms/de/05_Geoinformation/Galerien/Dokumente/BWTA2017.zip

Note: the unzipped file is 375MB big

Should this be included in this package?

Clearer instructions on how to download and include all grids

(Let me preface this by saying that I'm aware of PROJ-data for PROJ 7, but I'm trying to use PROJ 6.)

The instructions seem to only be:

The files in this package can be unpacked in the PROJ data directory. For an installed PROJ this may be /usr/local/share/proj or /usr/share/proj on unix style operating systems.

What is the recommended way of doing this if I want all grids? The options would seem to be:

  • git clone with Git LFS
  • wget/curl some compressed distribution
  • install using a package manager

In the first case, once I've cloned, which files would I need to copy to the Proj data directory? Do I need to run Make as well?

In the second case, what is the URL to use?

If the third case is an option, the documentation doesn't make that clear.


What I expected the documentation to say:

To install all grids, you need to download all the grids and unpack them to the PROJ data directory:
wget https://example.com/proj-grids.zip -p /tmp/ && unzip /tmp/proj-grids.zip && mv /tmp/proj-grids $PROJ_DATA_DIR

i.e. a clear command to actually obtain and install the grids. At the moment the instructions are very vague, and other online documentation is confused since we're at the transition between v6 and v7.


What I'm doing:

RUN curl -L --output /tmp/proj-datumgrid-oceania-1.2.zip https://github.com/OSGeo/proj-datumgrid/releases/download/oceania-1.2/proj-datumgrid-oceania-1.2.zip \
&& unzip /tmp/proj-datumgrid-oceania-1.2.zip -d /usr/local/share/proj \
&& curl -L --output /tmp/proj-datumgrid-north-america-1.4.zip https://github.com/OSGeo/proj-datumgrid/releases/download/north-america-1.4/proj-datumgrid-north-america-1.4.zip \
&& unzip /tmp/proj-datumgrid-north-america-1.4.zip -d /usr/local/share/proj \
&& curl -L --output /tmp/proj-datumgrid-europe-1.6.zip https://github.com/OSGeo/proj-datumgrid/releases/download/europe-1.6/proj-datumgrid-europe-1.6.zip \
&& unzip /tmp/proj-datumgrid-europe-1.6.zip -d /usr/local/share/proj \
&& curl -L --output /tmp/proj-datumgrid-world-1.0.zip https://github.com/OSGeo/proj-datumgrid/releases/download/world-1.0/proj-datumgrid-world-1.0.zip \
&& unzip /tmp/proj-datumgrid-world-1.0.zip -d /usr/local/share/proj

It would be nice if this was documented clearly. (And, as an aside, distrubuted like all-latest rather than per-region and per-version.)

why it is needed

hello, everyone,

could you explain why would one need this package at all?
Is it a required component for PROJ or just an optional ?

Thank you very much

Canadian NTv2 grid for Newfoundland and Labrador

https://webapp.geod.nrcan.gc.ca/geod/data-donnees/transformations.php?locale=en mentions

In the province of Newfoundland and Labrador there is a grid shift file for transforming between NAD83(Original) and NAD83(CSRS) epoch 2010.
Coverage | From | To | Grid
-- | -- | -- | --
Newfoundland (Island only) | NAD83(Original) | NAD83(CSRS) 2010 | Download   										NLCSRSV4.GSB

Download link: https://webapp.geod.nrcan.gc.ca/geod/process/download-helper.php?file_id=NLCSRSV4
License: Open Government Licence - Canada

However there is no EPSG transformation for it

Proposal for future organization of proj-datumgrid

I just had a IRC chat with @hobu and we discussed about future plans for the organization of proj-datumgrid. The 'regional' model is mostly a workaround to have packages of reasonable size and a structure of the repository, but it isn't perfect. For example, data for France is in europe/ but a number of grids in those grids are for overseas directories in North America, Carribeans and Indian ocean. Also the regional approach doesn't necessarily match the user needs: for Oceania, it is unlikely that a New Zealander will need Australian data given they have no common boundary.

I've done a quick experiment at converting all our NTv2 and GTX files into DEFLATE compressed TIFF: the result is 470 MB of compressed TIFF for the whole repository, vs 1.4 GB of uncompressed NTv2 and GTX files. So if RFC4 is implemented and libtiff a required dependency, we could just release one single proj-datumgrid-all.zip file. That would make life easier for us, and users (confused by which packages to install). People that would want more fine grained distribution could potentially use a future proj-datumgrid-install tool ( OSGeo/PROJ#1750 ) that would download (from the CDN?) the grids correponding to a producing agency. To have still some structure in the proj-datumgrid repository, we could have subdirectory by producers: ignfrance, linz, noaa, etc... We would just fold everything into a single package for release.

Divide the grids into several packages in the future

The recently included grids from Australia are quite big (80MB). Over time the grid collection will be larger and larger making the datum grid package unnecessarily big for most users. We should consider dividing the grids into several packages, for instance differentiating between horizontal and vertical grids. This could be subdivided even further in regional packages if necessary.

At first I think it makes sense to have two packages:

  1. proj-horizontal-datumgrids-1.7.0.tar.gz
  2. proj-vertical-datumgrids-1.70.0.tar.gz

Which eventually can be divided into

1a. proj-horizontal-datumgrids-europe-1.70.0.tar.gz
1b. proj-horizontal-datumgrids-northamerica-1.70.0.tar.gz
1c. ...
2a. proj-vertical-datumgrids-europe-1.70.0.tar.gz
2b. proj-vertical-datumgrids-northamerica-1.70.0.tar.gz
2c. ...

At some point it could also be necessary to create a package of deformation/velocity model grids, but so far not many of those exists.

git-lfs is not cost free

@hobu @kbevers I've issued a benign pull request which fails with https://travis-ci.com/OSGeo/proj-datumgrid/builds/130801548

Error downloading object: world/egm08_25.gtx (c18f20d): Smudge error: Error downloading world/egm08_25.gtx (c18f20d1fe88616e3497a3eff993227371e1d9acc76f96253e8d84b475bbe6bf): batch response: This repository is over its data quota. Purchase more data packs to restore access.

Quick googling for that error message leads to nabla-c0d3/nassl#17

Going to https://github.com/organizations/OSGeo/settings/billing , I see we are at "167% bandwidth, 14% storage used ". I'm not sure if every Travis build or "git clone" for folks count for bandwidth usage, but if so then it would be 150 MB each time, so with 7 downloads a month we are out of bandwidth. Apparently for 5 USD / month, storage and bandwidth quota go to 50 GB.

Apparently gitlab.com offers 10 GB LFS storage and unlimited bandwidth : https://about.gitlab.com/2015/04/08/gitlab-dot-com-storage-limit-raised-to-10gb-per-repo/

What should we do ?

Portugal (Continental) - *.gsb files

It would be nice to include in this repository two NTv2.0 grid shift files available for download from the Portuguese National Geodetic Authority (DGTerritorio) web site, and published under Creative Commons - Attribution 4.0 International.

I have all the relevant information, grids included, in the following GitHub repository:

https://github.com/lmikegeo/ntv2-pt

NTv2_SN (RD/83->ETRS89 East-Germany/Saxony) can be included

The product NTv2_SN , to be downloaded at https://www.landesvermessung.sachsen.de/prod_fest_raum_fest/NTv2_SN_2014.zip (from http://www.landesvermessung.sachsen.de/download-5608.html?_cp=%7B%22accordion-content-4389%22%3A%7B%222%22%3Atrue%7D%2C%22previousOpen%22%3A%7B%22group%22%3A%22accordion-content-4389%22%2C%22idx%22%3A2%7D%7D ) , is the RD/83 -> ETRS89 transformation for East-Germany, and especially Saxony.

As an answer to my question to get licence information, [email protected] (GeoSN) answered on Dec 3rd 2019

Sehr geehrter Herr Rouault,
selbstverständlich dürfen Sie alle unsere Daten nutzen. 

Für die Nutzung der bereitgestellten Informationen des amtlichen
Vermessungswesens gelten die Bestimmungen der Datenlizenz Deutschland –
Namensnennung – Version 2.0 ([1]https://www.govdata.de/dl-de/by-2-0) unter
Angabe der Quelle (Namensnennung) „GeoSN“.

that is it is licensed under https://www.govdata.de/dl-de/by-2-0
"Data licence Germany – attribution – version 2.0" license listed by
https://opendefinition.org/licenses/ as a "Other conformant licenses", in the
same category as the license for the Canadian NTv2 grids we already have, and we must attribute it to the GeoSN source

Task for 2020 or later: include Swiss NTv2 grids

Some exchanges with Swiss folks have shown that Swisstopo might release in (not earlier than) 2020 some of its datasets, including the NTv2 grids that do CH1903 to CH1903+ or ETRS89, which are currently downloadable as cost free but with some restrictions, under an open data license.

Symbolic links to point to the latest version of the grids ?

For my grid_packages table in proj.db, I currently point to URLs like 'https://download.osgeo.org/proj/proj-datumgrid-1.8.zip'.
This has the potential to rot quite quickly, and I think that pointing to the latest available version would generally be better.
A solution would to create and update symbolic links on https://download.osgeo.org/proj/ like
ln -s proj-datumgrid-1.8.zip proj-datumgrid-latest.zip each time we release a new package.

If you agree, I can offer the needed updates to HOWTORELEASE

The other possibility would be to update HOWTORELEASE to mention updating grid_alternatives.sql (but that might be too late if PROJ is released before the grid packages)

Saarland Seta2016 NTv2 grid can be included

Got confirmation from lvgl.saarland.de that the Seta2016 dataset can be distributed under the terms of CC BY 4.0:
Home page: https://www.saarland.de/74918.htm
Download link: https://www.saarland.de/dokumente/thema_lkvk2/SeTa2016.zip

Received: from wexclsaar314.saarland.de ([fe80::bc25:e876:b5b3:46e6]) by
 wexclsaar314.saarland.de ([fe80::bc25:e876:b5b3:46e6%21]) with mapi id
 15.01.1779.002; Fri, 6 Dec 2019 13:25:49 +0100
Subject: AW: AW: Lizenz von SeTa2016.zip ?
Date: Fri, 6 Dec 2019 12:25:49 +0000

 <{redacted}@lvgl.saarland.de>
Dear Mr. Rouault,
as my colleague Ms. Schmitt has already answered, there are no formal licensing requirements for the Seta 2016 transformation parameters.
However, the naming of the license CC BY 4.0 can be applied analogously in case of a transfer.

Mit freundlichen Grüßen

{redacted}

Sachgebietsleiter
Sachgebiet 4.3 - Vertrieb, Gebühren -

- Zentrale -

Include OSTN02_NTv2.gsb and OSTN15 (Great Britain)

Hello,
While looking at OSGeo/PROJ#904 I noticed the ESRI file uses 102 times the NTv2 grid "OSTN02_NTv2.gsb".
I found it here.
The license seems OK:

The OSTN02 data in NTv2 format is licensed to users pursuant to the terms of the Open Source Initiative BSD Licence (see the opensource bsd license page).

The copyright notice which must be attached to the software under the terms of the BSD licence is as follows:

'© Crown copyright, Ordnance Survey and the Ministry of Defence (MOD) 2002. All rights reserved.

Should it be included in this package?

include Brazil NTv2 grid shift files

  • See discussion in QGIS-Brazil forum: https://groups.google.com/d/msg/qgisbrasil/zdNGyfnoxKg/9a8xpU_2CQAJ

  • Grid files provided by Brazil's national mapping agency, IBGE : ftp://geoftp.ibge.gov.br/informacoes_sobre_posicionamento_geodesico/sirgas/aplicativos/transformacao_coordenadas/progrid_compacto.zip

  • Note that the archive seems to be for a 'ProGrid' software, but the grid files live in the archive at /ProGriD_compacto/program files/Progrid/GridFiles

  • here are those 4 grid files: brazil-grids.zip

  • I am unsure of the exact license : there is however a licence file for 'ProGrid', in Portuguese ProgridLic.pdf

Will try to get others from QGIS-Brazil to join this ticket discussion...

Confusing description for the direction of .gtx files

README.EUROPE mentions for example "Denmark: GRS80 ellipsoidal heights -> DVR90 heights", but the content of the dvr90.gtx file is the value to add to a DVR90 height to get a GRS80 ellipsoidal height, so I think it would be less confusing to name it "Denmark: DVR90 heights -> GRS80 ellipsoidal heights".
The same applies for most of other .gtx file descriptions

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.