terriajs / de-australia-map Goto Github PK

• update catalogue:
  "Could the default catalog of de-australia.terria.io please be pointed to https://raw.githubusercontent.com/GeoscienceAustralia/dea-config/master/dev/terria/dea-maps.json"

Updated service: https://services.ga.gov.au/gis/rest/services/NationalBaseMap/MapServer

• Google analytics set up #76
• UX research summary #80
• splitter is fixed: TerriaJS/terriajs#5370
• sharing is fixed: TerriaJS/terriajs#5300

Robbi (DEA team) is preparing the Coastal erosion story for launch by Minister between 12- 16 April (exact date TBC).

DEA team has prepared a change to the Coastlines data needed for the launch.
Here are the changes to config file: https://www.dropbox.com/s/lhlh0xtxkq73wxn/deacoastlines_v8_revised.json?dl=1

The share url also needs to be manually set up as: https://maps.dea.ga.gov.au/#share=s-DEACoastlines

• catalogue - Checklist to test the upgraded http://de-australia.saas.terria.io/ matches the features and performance of http://de-australia.terria.io/

• help menu

• https not http

• url redirect to http://maps.dea.ga.gov.au/

• double check update disclaimer to match ~- where to; because it will be replaced by welcome onboarding modal ~

• catalogue needs to match v7

• v7 share links need to be maintained

Examples to test:

• https://www.ga.gov.au/dea/products/iem
• https://www.ga.gov.au/dea/products/hltc

SaaS

v7

• onboarding designs based on discussions with DE Australia team

Notes live here

As a non-technical, non-spatial map user,

I want to be on-boarded in my own personally preferred way of processing new information,

so I can get started using a given TerriaMap (DEA Aust/Africa)

Other notes from Vic:

We felt the first step to fixing the on-boarding experience was leaning up the UI so its a little easier to understand, especially for first time users. I tried not to go too far with my designs and so more of a clean up. This is by no mens perfect or the ideal layout but I feel it is an improvement. Please note that when I do the actual on-boarding screens such as modal disclaimer & help, the layout may need to some tweaks.

Design discussion ticket at #39

Gdrive notes: https://docs.google.com/document/d/1cENE8rKUDknTd5EY9NzplAghaV4FetJij-UwIgX2AtU/edit?folder=17hIu2s1LGi2semARtA6h79yBsls3HtxM

Based on designs: https://projects.invisionapp.com/share/VQWC0P9FC3D

On - boarding (4ish) pieces:

• Disclaimer: TerriaJS/terriajs#4181

• Welcome: TerriaJS/terriajs#4180

• Tour: TerriaJS/terriajs#4183

• Help: TerriaJS/terriajs#4182

  • We need a help-content-strategy: X # of
  • Merge "getting started" with "how it works". Have a default, generic video with main functions of any terria map, put it into the default "how it works/getting started", put the "list menu" design underneath the video (@alyce)

(Unrelated to this ticket splitter notes)

• continue designing split. req for feedback.
• in the meantime, for delta, leave splitter as it is, re-wire delta to use a hybrid solution of deltav2 and delta v2.5(20200330 Sprint planning vic-demo)

Remaining things from closed v2 tickets:

• [Relevant docs are updated] item for help panel TerriaJS/terriajs#4182
• [Relevant docs are updated] item for disclaimer TerriaJS/terriajs#4181
• TerriaJS/terriajs#4353

Under Feedback, add after "We would love to hear from you!" - "contact us at [email protected]"
or enter the details below"

This ticket will incorporate feedback from migration testing post 24/12/2020 and other outstanding issues.

• Delta date label wrong - TerriaJS/terriajs#5236 TerriaJS/terriajs#5248
• Waterbodies - hide some CSV rows - #71 - done, merged
• Waterbodies - dots on charts - #72 - done, merged
• update to latest TerriaJS next

Post Feb 21 release of saas version

• wrong email in terrain server - #67 this is for v7 - not v8

DEACoastLines WMS is now on prod: https://geoserver.dea.ga.gov.au/geoserver/wms

When tested on a non-MobX map such as https://terria-cube.terria.io/, the wms is correctly added to the catalogue:
https://terria-cube.terria.io/#share=s-jDQF9nKRUykVhlMxnReWasLN14F

When tested on the new DE Australia on MobX http://de-australia.saas.terria.io/, the wms is not picked up and shown in the catalogue:

• geojson catalog items converted to mobx-catalogs

• Specific to DEA: Waterbodies charts display the same behaviour and warning message: http://de-australia.terria.io/#share=s-q2fCou4W0OVpWyZXUBkzqvFvnJz; - [ ] Copy implementation of warning message when opening waterbodies and click on expand chart - #49; needs this: TerriaJS/terriajs#4479

• Delta v3 implementation - post user testing undertaken 19-21/05/2020 - TerriaJS/terriajs#4390; PR TerriaJS/terriajs#4515

• Delta v3 - has to work with ODC DEA OWS set up as well as with NCI GSKY service

#37

Related maps button to show only the DE Africa and NationalMap.

Under The NationalMap:

• The NationalMap is a website for map-based access to spatial data from Australian government agencies. It is an initiative of the Australian Government's Department of the Prime Minister and Cabinet and the software has been developed by Data61 working closely with the Department of the Prime Minister and Cabinet, Geoscience Australia and other government agencies.

• use this photo:
  

Under Digital Earth Africa

• Digital Earth Africa is leveraging international Earth Observation (EO) data and science to produce new information and services that benefit African countries.

• use this photo:
  

• workbench user stepping guide - TerriaJS/terriajs#3743
  with this, once the modal is created on front page, the "take a tour" button will have to point to the Help & FAQ pages because it cannot copy the video button from DE Africa (that video will be very specific to Africa map)

• update related maps - #15

• add data = explore data: TerriaJS/terriajs#3742 and TerriaJS/terriajs#3707

• redraft and include dea email address on feedback form #16

• Leaflet fix - TerriaJS/terriajs#3740

• update DNS - #18

• logos - #7

• about pages - #6

• data and metadata - #8

• help menu button to point to help and FAQ - #14

• social media links in about pages - #19 - only if time permits

testing of v1 prototype of Delta functionality

Scope/plan improvement of existing content. Final version is HERE

• Terry the trainer - add more / other workflows
• Help menu - add more/other videos for workflows: 1) NEII (satellite + water gauges); 2) Delta
• Help menu - add new/updated welcome video on landing page
• Catalogue - data group descriptions
• Catalogue review: 1) organisation; 2) names; 3) metadata
• About page - more information about DE Australia program; its objectives and scope

The DEA team would like to continue to maintain the catalogue on the http://de-australia.saas.terria.io/.
Is that a good candidate for Catalogue Editor? Is there a different way for them to retain that capability?

Digital Earth Australia v8 should have Google analytics set up when v7 is decommissioned.

On all hydro layers

• Watercourse Discharge
• Watercourse Levels
  For both reference and all stations

https://github.com/TerriaJS/de-australia-map/blob/master/wwwroot/init/terria-cube.json#L9361-L9367

Get rid of this category
https://github.com/TerriaJS/de-australia-map/blob/master/wwwroot/init/terria-cube.json#L9402

Copy the message used for Waterbodies charts (when clicking Expand):

Checklist to test the upgraded http://de-australia.saas.terria.io/ matches the features and performance of http://de-australia.terria.io/

Here’s our disclaimer text for the DEA Maps popup window.

The information displayed on the DEA Maps (the “Service”) is for general informational purposes only, and is not intended to provide any commercial, financial, or legal advice.

The Service provides access to a range of data sets and tools, some of which are in development (beta). All data and tools are provided on an “as is” and “with all faults” basis without any warranty whatsoever. Geoscience Australia and Data61 do not warrant that these data sets and tools shall meet any requirements or expectations, or that the will be fit for any intended purposes.

Geoscience Australia and Data61 assumes no responsibility for errors or omissions in the contents of the Service and reserves the right to make additions, deletions, or modification to the contents on the Service at any time without prior notice.

Geoscience Australia and Data61 does not guarantee the accuracy, relevance, timeliness, or completeness of any information or data available through the Service or on linked external websites.

See full terms and conditions [here].

A couple of other bits and pieces:

• the link in the final sentence of the disclaimer should take users to our existing T&Cs
• the button to close the modal and progress to the maps portal should say “Acknowledge”
• the other option should be “Cancel” button with the behaviour being to close the window/tab, i.e. the whole maps window not just the modal, if that option is selected.

DEA team would like to start using vanity url shortner for broadcasting work on some specific datasets.
The first example will be the use of the short url for the Coastlines data, to be published and disseminated to Government and other users on 17th of Sep.

There are 2 stages:

1. 15 Sep 2020 - enable the http://maps.dea.ga.gov.au/**#share=s-DEACoastlines** when DEA team advises the data publication and its url
2. 28 Sep 2020 - work and release a more elegant shortening of urls which will transform the above url closer to http://maps.dea.ga.gov.au/**DEACoastlines** (TerriaJS/terriajs#4692)

When new Coastlines WMS https://geoserver.dea.ga.gov.au/geoserver/wms is tested on a non-mobx maps such as https://terria-cube.terria.io/ https://terria-cube.terria.io/#share=s-jDQF9nKRUykVhlMxnReWasLN14F, the legend appears 3 times in the workbench.

The legend has been uploaded here: https://data.dea.ga.gov.au/projects/coastlines/coastlines_legend.png

@philipgrimmett what would be the best option to link to social media channels from the UI:
Twitter - https://twitter.com/GeoscienceAus
Facebook - https://www.facebook.com/GeoscienceAustralia
Youtube - https://www.youtube.com/user/GeoscienceAustralia
LinkedIn - https://au.linkedin.com/company/geoscience-australia

• DNS to be confirmed; new name

• https - enable

Pretty minor issue, but when the terrain server isn't responding the contact email is [email protected]:

Terrain Server Not Responding
The terrain server is not responding at the moment. You can still use all the features of Digital Earth Australia but there will be no terrain detail in 3D mode. We're sorry for the inconvenience. Please try again later and the terrain server should be responding as expected. If the issue persists, please contact us via email at [email protected].

As a user,
When I download a CSV of a chart of Waterbodies data, I want the metadata from the dataset to be included
So that when browsing those files on my computer later, I know which dataset is which and I don't lose the associated metadata.

Follows on from #71

Metadata in a CSV won't currently be included when the data is downloaded from the Chart panel, and GA requests that it should be. Because a chart CSV download could include multiple datasets, the metadata from each dataset should be included along with information on which column (original dataset) it's associated with.

Ability to put dots on the line chart to show where the valid observations are.

This is a symbology change, so quite different to the Water discharge level example.

Instead of a line chart the irrigators would like a line with markers chart. Here is a very basic example using excel. Data is on the left.

Please note that there are fewer points in the DEA waterbodies time series than there are in the imagery stack (surface area isn't calculated for cloud affected / partial coverage of waterbody), so the plot symbology needs to be drawn from the data in the CSV's not from the imagery service stack at that location.

Landing page:

• delete Prototype from logos section

• add GA logo https://drive.google.com/drive/u/0/folders/1BpfjZvjI2QPk5254n6RUQgbdG7l_Jc7w

• replace Data61 logo with the recent one (CSIRO Data61) https://drive.google.com/drive/u/0/folders/19XZfBUS4xPdCMeDObPaa5Vn2aSnWOifi

UA-158835145-1

Following agreement with DEA and UI developers, Delta v2 designs to be finalised by 20 March if possible.

To replicate the behaviour of showing dates as dots on water discharge charts, we need to replace the lines currently available on MobX for charts

• Due to issues with services performance due to a cap on requests (max 3)
• Done for DE Africa: https://github.com/TerriaJS/de-africa-map/pull/19
• needs done for all maps where DE Satellite Imagery is included

text to be sent by DEA team

GeoscienceAustralia/dea-config#588

A challenge with using DEA Maps to share links to our data is that small changes to the Terria config can cause Terria share links to break. This occurs when a layer is renamed (e.g. Coastal/NIDEM > Coastal/Intertidal Elevation) or moved to a new directory (e.g. (e.g. Coastal/NIDEM > Intertidal/NIDEM). Given how frequently we change the structure of the DEA Maps catalogue, this means that Terria share links go out of date quickly, which is problematic as it means our documentation or public-facing websites (CMI and DEA website) go out of date too.

A lot of these issues could be resolved if we included a unique Terria id config option in each of the layers in the DEA Maps Terria config. According to the Terria documentation:

id:
An optional unique id for this member, that is stable across renames and moves. Use uniqueId to get the canonical unique id for this CatalogMember, which is present even if there is no id.
https://docs.terria.io/guide/connecting-to-data/catalog-type-details/wms/

This is could be a pretty simple fix for a big reduction in future effort; see the unique IDs used for the DEA Coastlines Terria config below (although see #588 (comment) for a better suggestion for unique IDs):

https://github.com/GeoscienceAustralia/dea-config/blob/master/dev/terria/dea-maps.json#L1004

• add disclaimer: #34

• update Blended service: #30

• add social media links: #19

Enable the option for featureinfo to skip rows when opening csvs, so that we can include metadata at the start of each timeseries csv file.

When trying to use the BoM Stream Guages data, when you click on a station on the map, the timeseries often shows the preview in the feature info popup, but when you click Expand you get a 500 Server Error 95% of the time.

E.g. this URL: https://maps.dea.ga.gov.au/#share=s-qPKEFkC0bO1Ztq99QLAMutiONmW

Clicking on the point (sometimes doesn't work, may have to click again):

When clicking Expand (usually doesn't work, but sometimes does):

Looking at what happens on the request, it's actually a Tomcat OutOfMemoryError:

<html><head><title>Apache Tomcat/6.0.24 - Error report</title><style><!--H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}HR {color : #525D76;}--></style> </head><body><h1>HTTP Status 500 - </h1><HR size="1" noshade="noshade"><p><b>type</b> Exception report</p><p><b>message</b> <u></u></p><p><b>description</b> <u>The server encountered an internal error () that prevented it from fulfilling this request.</u></p><p><b>exception</b> <pre>javax.servlet.ServletException: Servlet execution threw an exception
</pre></p><p><b>root cause</b> <pre>java.lang.OutOfMemoryError: unable to create new native thread
	java.lang.Thread.start0(Native Method)
	java.lang.Thread.start(Thread.java:714)
	sun.rmi.transport.DGCClient$EndpointEntry.&lt;init&gt;(DGCClient.java:266)
	sun.rmi.transport.DGCClient$EndpointEntry.lookup(DGCClient.java:237)
	sun.rmi.transport.DGCClient.registerRefs(DGCClient.java:155)
	sun.rmi.transport.ConnectionInputStream.registerRefs(ConnectionInputStream.java:94)
	sun.rmi.transport.StreamRemoteCall.releaseInputStream(StreamRemoteCall.java:156)
	sun.rmi.transport.StreamRemoteCall.done(StreamRemoteCall.java:312)
	sun.rmi.server.UnicastRef.done(UnicastRef.java:450)
	sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
	java.rmi.Naming.lookup(Naming.java:101)
	de.kisters.kiwis.datasource.wdp.WDPConnector.init(WDPConnector.java:97)
	de.kisters.kiwis.datasource.wdp.WDPConnectionPool.createWDPConnection(WDPConnectionPool.java:159)
	de.kisters.kiwis.datasource.wdp.WDPConnectionPool.getConnection(WDPConnectionPool.java:79)
	de.kisters.kiwis.main.KiWIS.getWDPConnection(KiWIS.java:1705)
	de.kisters.kiwis.services.sos2.wdp.WDPSOS2Operations.doSos2GetObservation(WDPSOS2Operations.java:108)
	de.kisters.kiwis.services.SOAPHandler.handleSOAPRequest(SOAPHandler.java:103)
	de.kisters.kiwis.main.KiWIS.doXMLPost(KiWIS.java:755)
	de.kisters.kiwis.main.KiWIS.doPost(KiWIS.java:673)
	javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
	javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
</pre></p><p><b>note</b> <u>The full stack trace of the root cause is available in the Apache Tomcat/6.0.24 logs.</u></p><HR size="1" noshade="noshade"><h3>Apache Tomcat/6.0.24</h3></body></html>

This is actually a problem with the data service from BoM - we should raise it with them.

• update to latest terriajs

• update to latest terria server 3.0.1 which fixes bug with shortening url when sharing TerriaJS/terriajs#3510 - to be double checked by @steve9164

• logos/styling - #1

Based on discussions recorded here: https://docs.google.com/document/d/1Y7Z1EwwkzuBrOgrqowxauJ0-p4v70oVGyoDztOSwoUY/edit

• add help button in the top right hand side menu similar to https://soe.terria.io/

• fix the issue with users not being able to return to previous step (in case they are at step 2)

Add the following options/guides:

• Explore map data

• Interact with the data. To include instructions on general interaction with datasets and more specifically for satellite imagery

• Zoom in to show satellite, flag to user he needs to wait to load to get imagery

• Calendar - time

• Zoom to location and filter by location

• Splitter

other?

• Add your own data

• Change map settings

• Share/Export/Print

Hi All,

The new blended service layer (with true/false styles) has been released. The new layer is called “Multi-sensor (Landsat and Sentinel 2) surface reflectance (Beta)” which can be found at the DEA endpoint (https://gsky.nci.org.au/ows/dea ).

Note the “Multi-sensor (Landsat and Sentinel 2) surface reflectance true Colour (Beta)” and ““Multi-sensor (Landsat and Sentinel 2) surface reflectance false Colour (Beta)” layers are still available.

• no changes are recommended during the GEO week (4-8 Nov)
• the above services will live in parallel till the week after

• clarify the data shown when a waterbody is clicked on

https://docs.google.com/document/d/1TW4SBcMon_xFxl0r_BOzJ-g958tnq_yKm8846W8qlpA/edit

• decommission v7

• About pages revised: https://docs.google.com/document/d/1BwLK1O-FEvn37DCB9GStPG7ZkZdFG3XZ/edit#heading=h.gjdgxs

• Ana to write a summary of UX research conducted end of 2020

Based on discussion with the DEA team, UX will draft flat designs to discuss with DEA, before completion of v2 design.
Meeting booked for 16 March to discuss the workflow approach.
Designs for v2 to be finalised after meeting, until 20 March 2020.

Acceptance criteria for update of DE Australia to MobX TerriaJS:

• Application available for testing at a new distinct DE Australia-on-MobX url

• Data catalogue available in MobX map: 61 datasets in 29 groups

• geojson catalog items converted to mobx-catalogs

• Specific to DEA: Waterbodies charts display the same behaviour and warning message: http://de-australia.terria.io/#share=s-q2fCou4W0OVpWyZXUBkzqvFvnJz

• Specific to DEA: Show satellite imagery as dots on the charts of Water regulations data (BoM) http://de-australia.terria.io/#share=s-dcJhodA74cvLC7tHvuR78rUqq9I

• This will work once we set the trait

• Availability of Delta functionality working with both DE OWS and NCI GSKY service implementation

• Include Delta v2 available on test site: https://tc-user-testing.terria.io/

Development to support the above:

• SOS on MobX TerriaJS/terriajs#3896 and PR TerriaJS/terriajs#4167

  • Port SOS
  • To confirm with Nanda that Mode 2 ("fetching features and observation data together.") is not needed

• Timeseries on MobX - TerriaJS/terriajs#4226

• Clip and ship (TBC) - TerriaJS/terriajs#4340; PR TerriaJS/terriajs#4461 - Crispy to review

• Implement dots on charts to show imagery (currently implemented as lines) - #48

• Copy implementation of warning message when opening waterbodies and click on expand chart - #49; needs this: TerriaJS/terriajs#4479

• themeying - TerriaJS/terriajs#4480

• (merge theme-ing into mobx, but for now it is released off a branch)

Post 30 June - to release 30 June - 15 July 2020

• Delta v3 implementation - post user testing undertaken 19-21/05/2020 - TerriaJS/terriajs#4390

• Delta v3 - has to work with ODC DEA OWS set up as well as with NCI GSKY service

• DEA logo/s

• styling

Details in terria drive, under DEA: https://drive.google.com/drive/folders/1jg4RxKM59aYB2Oii1GODll93cnCvfpow