pik-piam / modelstats Goto Github PK
View Code? Open in Web Editor NEWA collection of tools for monitoring and diagnosing models
A collection of tools for monitoring and diagnosing models
It would be nice to have a better abort message for rs2 -cr
for when there are no current runs, than:
Global .Rprofile loaded!
Error in myruns[[i]] : subscript out of bounds
Calls: <Anonymous> -> grepl
Execution halted
I think it would be good if make test-full
would be run during a REMIND modeltest. Could be implemented roughly like this:
logfile <- "make-test.txt" # best add some _2023-10-25 etc. here
system(paste0("sbatch --qos=priority --wrap='make test-full' --job-name=make-test --mail-type=END --output=", logfile, " --comment=REMIND_AMT_make_test-full"))
And then later add the outcome of this line to the gitlab commit:
paste0(logfile, ": ", tail(grep("[ FAIL", readLines(logfile), value = TRUE, fixed = TRUE)))
which returns something like
make-test.txt: [ FAIL 0 | WARN 0 | SKIP 6 | PASS 83 ]
Currently, AMTs are running in qos=priority, which is imho inappropriate for automated, periodic stuff.
As it is now, getRunStatus()
returns run times as strings that are a pain to process automatically.
These scenarios did not start at all:
SSP2EU-NDC-AMT
SSP2EU-PkBudg500-AMT
SSP2EU-PkBudg650-AMT
SSP2EU-PkBudg1050-AMT
SSP2EU-EU21-NDC-AMT
SSP2EU-EU21-PkBudg650-AMT
SSP2EU-EU21-PkBudg500-AMT
SSP2EU-EU21-PkBudg1050-AMT
SSP1-NDC-AMT
SSP1-PkBudg650-AMT
SSP1-PkBudg1050-AMT
SSP5-NDC-AMT
SSP5-PkBudg650-AMT
SSP5-PkBudg1050-AMT
SDP_MC-Base-AMT
SDP_MC-NDC-AMT
SDP_MC-NPi-AMT
SDP_MC-PkBudg650-AMT
vs.
/p/projects/remind/modeltests/remind/output $ ls *_2024-01-0{5,7}_*/log.txt | grep -f <( sed -n '/These scenarios did not start at all:/,$ { /^S[SD]/ p }' /p/projects/remind/modeltests/testing_suite/README.md ) | xargs grep "full.log states:" | sed 's/:/:@/' | column -ts '@'
SDP_MC-Base-AMT_2024-01-05_22.10.45/log.txt: full.log states: *** Status: Normal completion
SDP_MC-NPi-AMT_2024-01-05_22.11.06/log.txt: full.log states: *** Status: Normal completion
SDP_MC-PkBudg650-AMT_2024-01-07_04.11.05/log.txt: full.log states: *** Status: Normal completion
SSP1-NDC-AMT_2024-01-07_06.46.39/log.txt: full.log states: *** Status: Normal completion
SSP1-PkBudg1050-AMT_2024-01-07_04.10.42/log.txt: full.log states: *** Status: Normal completion
SSP1-PkBudg650-AMT_2024-01-07_04.10.34/log.txt: full.log states: *** Status: Normal completion
SSP2EU-NDC-AMT_2024-01-07_04.10.01/log.txt: full.log states: *** Status: Normal completion
SSP2EU-PkBudg1050-AMT_2024-01-07_04.10.26/log.txt: full.log states: *** Status: Normal completion
SSP2EU-PkBudg500-AMT_2024-01-07_04.10.10/log.txt: full.log states: *** Status: Normal completion
SSP2EU-PkBudg650-AMT_2024-01-07_04.10.18/log.txt: full.log states: *** Status: Normal completion
SSP5-PkBudg1050-AMT_2024-01-07_04.10.57/log.txt: full.log states: *** Status: Normal completion
SSP5-PkBudg650-AMT_2024-01-07_04.10.49/log.txt: full.log states: *** Status: Normal completion
From @0UmfHxcvx5J7JoaOhFSs5mncnisTJJ6q:
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.