dominodeorg / dominode Goto Github PK
View Code? Open in Web Editor NEWDevelopment of the Dominica SDI
Development of the Dominica SDI
This is still to be better described
'analytics' mentioned in section 5 Deliverables table - enquire what this actually means
Write a document specifying the conventions for naming DomiNode resources.
The document shall be created here:
https://docs.google.com/document/d/1ttyl9iSCs3uF0HEi8az77bIsZjdIae9uDgcM5P-vsjI/edit
3.5.6 Introduction of Cloud Based Analysis and Processing Tools
The firm will work with the LSD and PPD to determine possible cloud based tools, such as Google Earth Engine and cloud hosted Jupyter notebook, which they can use in their workflows. Other possible tools include cloud based drone imagery processing for LSD.
Use elements from dominode.dm to skin the new one in the current best practice way using the same logo and colour scheme.
We just want a basic skin for now, not too much effort.
schemas, users and groups for PPD and LSD and other priority data maintainers to be able to load data
a generic user for readonly access?
service files?
Write a document specifying how to do versioning of DomiNode resources
The document shall be created here:
https://docs.google.com/document/d/1KhOmdEJsJYuKyOPhO-CdALWWWQvHlQqEYtJo4SuHau0/edit#
Write a short guide on how to connect to the staging environment
Please include:
Write a document describing how data management workflows should be done.
This document shall describe workflows for both dataset initial ingestion and further modifications, describing the following:
The document shall be created here:
https://docs.google.com/document/d/1rcoH0c1RpCguuPFLe92V-2xdipJU9ODwItOS_XPe-GM/edit
After #33 is done, or while it is being finalized we need to deploy the tech stack into the production environment.
- Rancher and Kubernetes cluster configuration
- minIO
production
and a staging
area for each, as specified in #25- Install PostGIS data DB
production
and staging
as specified in #26- Install and configure GeoServer
- Install and configure Geonetwork - This will also require a DB for storage of metadata records
- Install and configure Geonode
The data permission matrix should identify
It should mention
Access to the matrix:
We need to send a patch to Charles's customization repo, in order to make it work against recent geonode.
We need to produce Dominican topo maps for the following scales:
In QGIS and based on a fork of https://github.com/kartoza/topostyle
The GoCD currently operates four (4) high accuracy GNSS base-stations, which report observations in RINEX, Leica, and Trimble formats. These observations are useful for the post-processing of GNSS observations by surveyors and other data collection personnel. It is the intention of the GoCD to consolidate the collection of these data and streamline access.
The firm will work with the GoCD to consolidate all CORS data on a single server and develop a web based access to this server with read only access (as detailed in Task 3.2.2 of these Terms of Reference).
To streamline the use of these data, the firm will develop an app to extend the DomiNode interface to allow for easy access to the CORS datasets. The app shall:
We want to provide users with a nice interface for performing CRUD operations on metadata. geonetwork seems like a good fit for this job.
However, we need to investigate on the current state of the integration between geonode and geonetwork:
Production deployment is to be documented with step by step directions.
This document shall then be used to perform the actual deployment.
The spreadsheet in
https://docs.google.com/spreadsheets/d/1uiuey2w4IvCNtNK0rV2Z3e5IOk0TsbGrkQit9Cdic0o/edit#gid=0
contains a Catalog
sheet which contains an initial list of most datasets that were identified during previous stages of the project.
We need to fill in the blanks in the spreadsheet in order to
This sheet shall contain the following columns - be sure to create any columns listed here that may not be in the spreadsheet yet:
Columns related to data description and owners
Lookups
sheetYES/NO
)NATIONAL BASEMAP/CORE LAYER/PROJECT LAYER
- Read more about this in the DomiNode Data Assessment SOPColumns related to data ingestion workflow status - These are mostly Yes/No
columns
Interact with the various project stakeholders in order to gather the information specified above.
Start with the datasets owned by the LSD and PPD departments, as these are the biggest stakeholders.
The topo maps need to contain similar themes to the ones used by UK's Ordnance Survey agency in 1991, of which a picture is available on the first mission report
We need to understand which layers are needed and how to use them in order to produce a topographic map of similar quality
https://docs.google.com/spreadsheets/d/1a52ZJAwjK5hI-BNBaTTPSh06uc0b0NPG2eEfvDIBXz8/edit#gid=0
3.5.7 Budgeting and Recurring Costs
The firm will assist the GoCD in budgeting for the maintenance of the NSDI, and particularly the SDMP and related components. Minimizing recurring costs to a level which can be supported by the budgets of participating agencies is critical. Cloud services used under this project, for instance, must have a long term recurring cost which is possible with the budgets of participating agencies. Yearly budgets for maintenance of all hardware and software required for maintaining the processes and systems created under this project, or deemed vital for the NSDI by the GoCD, will be developed by the firm for a period of 5 years from the start of this contract.
further clarification from Collin email 8 June:
A five-year budget will be a rough estimate at best given the pace of technological change. If the Firm gives a budget before the end of your engagement, it should be fine as long as it identifies the factors which could substantially increase or lower the quoted amounts.
not sure we have to implement it - not mentioned in contract
clarification from Collin email 8 June:
When the TOR was initially written, we felt that the implementation of a field surveying application would be out of scope given the available budget. So only a plan, which the government could act upon if funding became available from a different source, was requested. If doing more is within scope and the line agencies find this useful then the PCU would go ahead with a full implementation.
To start now with the staging system and continue through to the production release
assign to Luisa
Taken from slack message:
I pointed out the following to Gavin in respect of the Dominode:
in 3.5.1: The firm will also assist in developing a data request process along with a data request form hosted on the DomiNode.
more detail from Collin email 8 June:
The PCU will follow up with Lands and Surveys, ICTU as well as Physical Planning with regards to a form. A call with the Firm and those agencies to sketch out the content of this form may be useful. They will need to define if they want one form for all requests or different forms for different parties, i.e. commercial vs research requests. Parties will also need to define the process for acceptance and processing of these requests.
We need to implement a web interface for the public to access the generated topo maps. This might be subject to data distribution policies and/or some monetization
Write a short section on our internal docs detailing how to access, use and confgure the minio instance that is currently deployed to staging environment
All layers used in the production of the topo maps are priorities to be available in PostGIS to support topo maps in QGIS
The layers might well be published in GeoServer as well (to provide web service endpoints for general users)
from Collin 8 June:
Please follow up with Charles and Lands and Surveys (arranging a call may be useful) with regards to the current status of the CORS.
Printing of Dominican national topo maps shall be done from QGIS, so we need to develop suitable QGIS map layout templates for all scales:
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.