Comments (4)
Hi Neng,
I am assuming that you are using NanoCaller_WGS.py to run NanoCaller because that's where I have seen this problem before. This is happening because NanoCaller is running 48 tensorflow sessions, one in each thread, which can exceed the number of processes allowed.
Here are a few suggestions that can help:
- Run
ulimit -u unlimited
command in terminal as suggested here: https://stackoverflow.com/questions/52026652/openblas-blas-thread-init-pthread-create-resource-temporarily-unavailable. - Use fewer threads than 48, perhaps 16 or 24.
- Use docker container to run NanoCaller. I have noticed that the problem you mentioned goes away when I use docker to run NanoCaller instead.
- Use NanoCaller.py command instead for each contig individually. If you use any number of CPUs with this command, it creates only one tensorflow session and uses other threads for feature generation only.
I am looking at reorganizing/reimplementing parallelism in NanoCaller_WGS.py in a way that it also creates only one tensorflow session but that might take some time.
Let me know if this helps,
Umair
from nanocaller.
Hi Umair:
I am trying to run NanoCaller on HPC using singularity. After I pulled the image and started to run as the steps you provided, it told me can not find the file.
from nanocaller.
Hi,
I think the problem is that NanoCaller is installed in /app inside to Docker container and by default the working directory is /app. But singularity ignore this.
Try the following:
singularity run nanocaller_${VERSION}.sif python /app/NanoCaller.py --help
or
singularity exec -e --pwd /app nanocaller_${VERSION}.sif python NanoCaller.py --help
Let me know if this works out. Also, please use the version 1.0.1 for NanoCaller because it has some speed up optimizations, I have just uploaded a docker image for it.
from nanocaller.
To umahsn:
It works when I tested the two command you provided. Thanks a lot.
Best
Neng
from nanocaller.
Related Issues (20)
- High coverage genotyping outputs only G HOT 10
- Using NanoCaller with BED files and Indel Calling Gives Empty VCF files HOT 3
- bcf tools error and error in whatshap HOT 4
- docker build fails due to missing NanoCaller_WGS file HOT 2
- Models compatible with Guppy6.x.x HOT 1
- Failed installation HOT 2
- bam file issue!
- what do you want to fill in the β--chromβ option? I read the instructions and there is no document. HOT 22
- header error in variant_calls.snps.phrased.vcf.gz HOT 6
- Unnormal results ! HOT 8
- AD (allelic depth) field HOT 5
- TypeError HOT 2
- Supporting reads HOT 3
- conda install incompatibilities HOT 2
- Models for R10.4.1 dorado
- Module not found tqtm after install with conda HOT 1
- Error phasing large chromosomes (550mb chromosome) due to inability to store as tbi index HOT 3
- Applications HOT 12
- indels HOT 2
- keras import issue by conda install
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nanocaller.