Code Monkey home page Code Monkey logo

pscis_datafixes's Introduction

PSCIS datafixes

Tracking and fixing data issues in the BC Provincial Stream Crossing Information System (PSCIS)

PSCIS layers available through DataBC Catalogue:

Workflow

  • open issues in this repo for quickly logging a PSCIS data error (and noting proposed fix if apparent)
  • generate code to apply fixes (todo)

Note that fix scripts need to reflect the operational PSCIS database and must be tested against a copy of this db (internal to @bcgov) for validity.

References

pscis_datafixes's People

Contributors

smnorris avatar

Watchers

 avatar  avatar  avatar

pscis_datafixes's Issues

198380 - 5 Mile Creek - Wrong UTM in submission

stream_crossing_id : 198380, Five Mile Creek

A phase 1 submission sheet was submitted to PSCIS yesterday (April 27) containing one crossing that was surveyed in 2022 for the Ministry of Transportation. There is a mistake in the UTM field. The value inputted was 9 when it should have been 10. This submission needs to be removed from the system.

  • Note: The UTM was changed and the spreadsheet was re submitted today (April 28).
  • Below is a screenshot of the submission confirmation (the one with the incorrect UTM that needs to be removed).

image

62244 - Tobermory - secondary culvert, delete or transfer data to 62245

VAST (2012) assessed two culverts at this location. Primary flow of channel was through 62244 in 2012 but migrated over to 62245 when reassessment was done (MASSE, 2015).

Site 62244 should just be deleted (or the info transferred over into initial assessment of 62245). Because older assessment data is not available via PSCIS warehouse views it won't make much difference to users either way.

STREAM_CROSSING_ID - STREAM NAME - FIX REQUIRED

Describe the problem

A clear and concise description of which crossing(s) is/are affected, what the problem is, and how the data differs from what is expected.
Identify the crossing with its stream_crossing_id, include references to other crossings, links photos, etc as needed.

EXAMPLE:

stream_crossing_id: 3138, McQuarrie Creek

Screenshots
If applicable, add map/photo screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

Duplicates

Describe the problem

See output of https://github.com/smnorris/bcfishpass/blob/main/01_prep/02_pscis/sql/05_pscis_points_duplicates.sql

Currently there are >200 crossings that are likely to be duplicates (487 records in the duplicates table, but each record from a set of duplicates is included)

The usual reasons for duplication include (but are not limited to):

  • re-assessments that did not include the original stream_crossing_id in the reassessment submission
  • separate assessments of two pipes at a single crossing (contrary to PSCIS assessment guide, mostly just in older assessments)
  • two crossings have been snapped to the same stream when one is on an unmapped stream

Hot spots (10 or more):

 ALBN                 |    10
 GRAI                 |    10
 LARL                 |    10
 TABR                 |    10
 HORS                 |    12
 REVL                 |    16
 KOTL                 |    16
 SETN                 |    16
 HOLB                 |    17
 KETL                 |    18
 PARS                 |    20
 MORI                 |    20
 LFRA                 |    22
 KOTR                 |    24
 ELKR                 |    28
 SALM                 |    29
 BULK                 |    32
 MCGR                 |    32

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.