niwa / geoapis Goto Github PK
View Code? Open in Web Editor NEWA Python package for simply downloading publicly available web-hosted geo-spatial data. View API docs at: https://niwa.github.io/geoapis/
License: MIT License
A Python package for simply downloading publicly available web-hosted geo-spatial data. View API docs at: https://niwa.github.io/geoapis/
License: MIT License
In the vector WfsQueryBase
class in the get_features_inside_catchment
method the CRS information is queried before we check to see if their are any features returned. In the case of no feature information being returned the CRS is none and a key error is returned for feature_collection['crs']['properties']['name']
.
Fix this bug by only checking for the CRS information after checking to see if any features have been returned
Add support for downloading vector data from LandCares - https://lris.scinfo.org.nz/p/about-lris-portal/
This is also based on the Koordinates platform and the functionality can be based on the existing vector.Linz class
Add support for downloading complete datasets by name from OpenTopography instead of specifying a polygon in which you would like to download all datasets within.
boundary_polygon
in the constructor to be 'None'dataset_name
which defaults to None
.
boundary_polygon
and no dataset_name
as it will do nothingNone
download all in the boundary_polygon
boundary_polygon
if the boundary_polygon
is no None
.Update pyproject.toml to reflect that this can be built with python 3.6
The NETLOC_API and GEOMETRY_NAMES will be created at instantiation
For examples LINZ layer 50448 has column information ['fidn', 'expsou', 'nobjnm', 'objnam', 'quasou', 'souacc', 'tecsou', 'verdat', 'status', 'inform', 'ninfom', 'ntxtds', 'scamin', 'txtdsc', 'sordat', 'sorind', 'depth', 'geometry', 'points'] which is currently not downloaded using geoapis.
What's required for release V1?
Add support for pulling raster information down the LDS or Koordinates directly.
Example layers include:
Koordinates documentation:
Note that for area photography example WMTS and x/y/z access are supported. This does not appear to be available for elevation data.
There is a Koordinates Python API client . We should check this to see if geoapis is duplicating any of this. Also, this likely supports the raster access and download.
There are also the Koordinates Admin APIs. It's not clear if these are open or not, but they may provide the raster tile download we are after. In particular the Exports API may be helpful.
make use of logging for printing out information
Currently it is assumed all files for a OpenTopography dataset are in the top level AWS folder. This causes a 404 traceback when the tile files are grouped in subfolders. i.e. Chch_Selwn_2015
The TileIndex file also contains a URL to the file location. It should be possible to use this directly to extract the folder information.
The USGS is moving to publically host it's LiDAR data on a public AWS server. Details can be found at: https://registry.opendata.aws/usgs-lidar/
The key information is:
location = us-west-2 -> s3.us-west-2.amazonaws.com
bucket = usgs-lidar-public
The AWS key appears to be inhte URL to the dataset on open topograpy. For instace the key for https://portal.opentopography.org/usgsDataset?dsid=USGS_LPC_AL_25Co_B3_2017 is USGS_LPC_AL_25Co_B3_2017
The only challenge seems to be tracking down the key of the dataset as this information doesn't seem to be listed in the metadata seek link for an example.
The LiDAR and vector fetching capabilities of geoapis were initially developed in GeoFabrics. Migrate these files and tests into a new repository.
Various entities host data on the ArcGIS Hub. It appears that this data can be accessed directly from the Hub by searching for the datasets name, or through an 'opendata' site i.e. data-kiwirail. Note the /search
is needed to view a list of all datasets.
API calls exist to download an individual dataset and are accessed by clicking the blue banner 'I want to use this' followed by 'View API Resources'. Two API Queries exist - GeoService or GeoJSON:
It seems we will want a generic class for accessing any data hosted on the ArcGIS Hub. If we go with the GeoJSON URL's can be read directly in geopandas. See webpage
Add support for the Stats NZ data service. This has the same back-end as the LRIS and LINZ data services. It's URL is: https://datafinder.stats.govt.nz/
It looks like some tests are now failing. Fix these.
This involves two related pieces of work for the vector,Linz class
Publish pages with sphinx documentation using read the docs as the theme
in lidar.OpenTopography check for .lax files and download if available.
Information on the uses of lax files - https://cran.r-project.org/web/packages/lidR/vignettes/lidR-computation-speed-LAScatalog.html
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.