ebi-gene-expression-group / atlas-gtex-bulk Goto Github PK

For aggregation script (for the whole study): add a way to capture memory usage and automate rerun with higher memory when the run fails because of memory issue

One comment we got today, and something to think about, is whether we could generalise the workflow to work not only on GTEx data, but on data from non-ENA external databases (e.g GeneLab), and non-necessarily controlled access.

After the first run, the logs show the memory used for each rule. We should be in a good position to optimise memory use, for instance by correlating with the number of reads in input Fastq files. This will reduce the time necessary for complete analysis of GTEX datasets.