Comments (6)
We totally can, the only drawback is that the files bundle stations data so we'll have to download the correct file, then extract the data (and the files are generally 5-8mb). It's not the end of the world, but would be slow... Alternatively, we could bundle the data in weathercan as an internal dataset, but that would be a large file to have. So as I see it we have three options:
-
Function to access and extract station normals from ftp site as needed
Pro: Simple and up-to-date
Con: Slow -
Function to acces and extract station normals from locally store data as needed
Pro: Relatively simple, fast
Con: May get out of date, large data set to store -
We calculate normals based on ftp://[email protected]/Pub/Normals/English/Calculation_of_the_1981_to_2010_Climate_Normals_for_Canada.doc
And hope that we can recreate the values
Pro: Fast, up-to-date
Con: May not match ECCC values if there's something else going on
from weathercan.
I tend to think that using the ECCC values makes the most sense because decisions in summarizing the data may have been made that we will be unaware off. The opens up a situation where we could have different data (if I am understanding this correctly). On the other hand though, since the climate normals are not current, we may be able to update them. It also may be more to maintain if we create a normals
function.
Is there any reason that we wouldn't simply point to the csv files:
ftp://ftp.tor.ec.gc.ca/Pub/Normals/English/English_CSV_files/
from weathercan.
Thinking about this a little more I think option 3 is probably the best. I think the issue is that it is also the most work. I hadn't totally understood the .csv files correctly so thanks for explaining that.
from weathercan.
Yeah, it's really too bad about .csv files because that would definitely be the best way to go about it. I agree that option 3 is probably the most work :) we'll see how much time I have!
from weathercan.
Actually there's also option 4) Scrape the data from the website: http://climate.weather.gc.ca/climate_normals/results_1981_2010_e.html?searchType=stnName&txtStationName=brandon&searchMethod=contains&txtCentralLatMin=0&txtCentralLatSec=0&txtCentralLongMin=0&txtCentralLongSec=0&stnID=3471&dispBack=0
But this is prone to errors and may be susceptible to small website changes.
from weathercan.
Consider adding normals from:
https://dd.meteo.gc.ca/climate/doc/observations/README_climate.txt
With the data being here:
https://dd.meteo.gc.ca/climate/observations/
from weathercan.
Related Issues (20)
- Release weathercan 0.6.0
- Release weathercan 0.6.0
- Vignette: Homogenizing ECCC Data from weathercan
- Function to identify potentially continuous stations HOT 14
- Error in validate_key(key) : could not find function "validate_key" HOT 5
- weather_dl() throws "Error: `guess_max` must be a positive integer" HOT 6
- `vcr::vcr_test_path` issue from vcr v1.0.0 HOT 9
- Update docs to reflect installing weathercan from the R-universe HOT 9
- weathercan unavailable on CRAN? HOT 1
- Issues updating stations list HOT 5
- Installing using `devtools` HOT 3
- Only update stations if ECCC version changed
- pkgdown failure HOT 2
- weathercan support for R 4.2? HOT 2
- Delete docs folder and gitignore it? HOT 3
- pkgdown error on docs server HOT 13
- Fix dplyr deprecation warnings HOT 5
- Spring Cleaning
- where in the package is the stations object still used HOT 5
- Add 1991-2020 climate normals
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from weathercan.