Comments (2)
From the error message it appears that singularity could not connect to the galaxy repository housing the image. If running the pull command manually (singularity shell https://depot.galaxyproject.org/singularity/sra-tools:2.11.0--pl5321ha49a11a_3
) results in the same error, then the issue is likely due to the configuration of the HPC system or its network/firewall.
Depending on the way the HPC is configured, it could be that the problem only occurs on worker nodes during job execution, but not on login nodes. In any case, I'd reach out to your HPC's help desk and ask them if they block the download of singularity images from https://depot.galaxyproject.org/singularity/.
As a workaround, you could download the image manually on your own device and upload it to the HPC yourself. You'd also need to instruct nextflow to look for the image in a specific location rather than downloading it from galaxy, as described here:
Nextflow caches those images in the singularity directory in the pipeline work directory by default. However it is suggest to provide a centralised caching directory by using either the NXF_SINGULARITY_CACHEDIR environment variable or the singularity.cacheDir setting in the Nextflow config file.
If you use the environment variable, be sure to export it or define it in your job submission script, rather than just setting it in your local shell. E.g. export NXF_SINGULARITY_CACHEDIR=/path/to/cachedir
, and also ensure it is in a location that your HPC worker nodes can access.
from fetchngs.
Yep, I agree this is an infrastructure and not pipeline related issue. Will close this for now but please feel free to join the nf-core Slack Workspace for any future questions/issues. We have an #fetchngs channel where you can get more real-time help.
from fetchngs.
Related Issues (20)
- TypeError: unsupported operand type(s) for |: 'dict' and 'dict' HOT 1
- error executing process HOT 3
- Add compatibility with sarek samplesheet
- SRAtools download seems to insert paired-end suffix into workdir path HOT 6
- Support .ngc file for dbgap downloads HOT 2
- FEAT: Pass scientific name as input to download the data
- Pipeline fails for large studies HOT 1
- Pipeline crashes if some samples are not available HOT 3
- Use nf-test for input validation
- check out extensions for input files HOT 1
- Add ability to download more than 2 FastQ files via FTP and Aspera HOT 3
- Merge technical replicates (SRR1 + SRR2 -> SRX)
- nf-validation-1.1.3: Operation not supported HOT 20
- `vdb-validate` does not detect file corruption HOT 5
- URGENT: pin nf-validation version HOT 1
- wget host address error HOT 5
- aspera `CONDA_PREFIX` error HOT 1
- Automatic retrieval of input id.csv from test-datasets for test profile HOT 5
- SRA file links deprecated HOT 3
- Support for GSA accessions
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fetchngs.