hdf5 issue - unable to open file about gatb-minia-pipeline HOT 5 CLOSED

My experience is that such errors are the result of specifying paths for input or output files. minia doesn't deal well with that. If I start in my project root and call, for instance
./gatb-pipeline/gatb -1 data/reads1.fq -2 data/reads2.fq ...
then minia fill produce files with "file lists" that contain the data/ path prefix, but it will look for them not relative to the project root (.) but to something else (perhaps the directory where gatb is, I don't know) and then it may not find the .fq files; a similar issue seems to arise if it wants to read or write h5 files, perhaps a directory that is assumed to exist does not exist.
My workaround was not to include any paths in filenames. This is not beautiful, especially if you want to combine this with workflow management such as Snakemake, but it works.

from gatb-minia-pipeline.

hi Sven, yes in fact, gatb-pipeline is even less robust than minia (as it accumulates the bugs of both :) ). Sorry about that, it's indeed a more sure thing to specify full paths rather than relative paths. And regarding output, it's a byproduct of the fact that I always run analyses in current folders (e.g. cd /my/data && /path/to/gatb_pipeline/gatb -l file.fastq), not the most versatile handling of paths, I know.

from gatb-minia-pipeline.

Hi Thomas,

I'm not sure about this one. Can you make sure that the input files do exist and that the metafilesfolder exists?
Does the pipeline not run on any input on this system, even the simple test provided with it?

Rayan

from gatb-minia-pipeline.

I'm going to close this one, feel free to reopen in case the problem occurs again.

from gatb-minia-pipeline.

I understand that I am incredibly late to the party but I ran into this problem again and remembered that this ticket exists. Thank you @rchikhi and @svenrahmann for commenting on this and providing valuable hints! For the gatb-minia-pipeline in particular specifying the absolute path for the output folder (parameter -o) solved the issue.

Bonus: specifying the absolute path for the input files only does not help. It looks like it does at first but, due to the required solution above, the run breaks after the first iteration.

from gatb-minia-pipeline.