cellgeni / cellatac Goto Github PK
View Code? Open in Web Editor NEWSanger Cellular Genetics single-cell ATAC-seq pipeline.
License: GNU General Public License v3.0
cellatac's People
Contributors
Stargazers
Watchers
cellatac's Issues
ca_make_chromtab.pl
Hi @micans
I am just trying to set up the cellatac pipeline on openstack. Is it possible that bin/ca_make_chromtab.pl should be part of the repository?
Thank you,
Daniel
Clustering step failing on cellranger-arc mapping output
Dear cellatac devs,
When running cellatac on a single sample of my cellranger-arc mapping output I'm running into the following error during the clustering step of the script (specifically at this step: so <- RunTFIDF(so)). Using 'cusanovich' and 'episcanpy' similarily failed the script at the clustering step. I also tried running ca_seurat_clades.R locally on my laptop using the files (cell.names, filtered_window_bc_matrix.mmtx.gz, regions.names) present in the mmtx folder at which point the script fails when creating the seurat object.
Converting f_binary_mat like this
f_binary_mat <- as(f_binary_mat, "dgCMatrix")or this
f_binary_mat <- as.matrix(f_binary_mat)didnt help either
Any help as per what I'm doing wrong would be appreciated :).
encountered error
> so <- RunTFIDF(so)
Performing TF-IDF normalization
Error in checkSlotAssignment(object, name, value) :
assignment of an object of class “dgeMatrix” is not valid for slot ‘data’ in an object of class “Assay”; is(value, "AnyMatrix") is not TRUE
Calls: RunTFIDF ... SetAssayData.Assay -> slot<- -> checkSlotAssignment
Execution halted
INFO: Cleaning up image...
I ran cellatac using the following script:
rm -rf .nextflow reports results work
rm .nextflow.log
source=/home/ceger/cellatac/
sample_dir=/mnt/LaCIE/ceger/Projects/human_heart_mapping/backup/.data/mapping_py/HCAHeart9508627_HCAHeart9508819/HCAHeart9508627_HCAHeart9508819/outs/
manifest="$sample_dir"/"singlecell.csv"
posbam="$sample_dir"/"atac_possorted_bam.bam"
fragments="$sample_dir"/"atac_fragments.tsv.gz"
chromlen=chromlen.txt
cellbatchsize=400
nclades=10
nextflow run $source \
--cellcsv $manifest \
--fragments $fragments \
--cellbatchsize $cellbatchsize \
--posbam $posbam \
--chromlen $chromlen
--outdir results \
--sampleid HCAHeart9508627_HCAHeart9508819 \
-profile local \
--mermul true \
--usecls '__seurat__' \
--mergepeaks true \
-with-report reports/report.html \
-resume -w work -ansi-log false \
-config my.config.nextflow.log
Jul-10 10:14:58.927 [main] DEBUG nextflow.cli.Launcher - $> nextflow run /home/ceger/cellatac/ --cellcsv /mnt/LaCIE/ceger/Projects/human_heart_mapping/backup/.data/mapping_py/HCAHeart9508627_HCAHeart9508819/HCAHeart9508627_HCAHeart9508819/outs//singlecell.csv --fragments /mnt/LaCIE/ceger/Projects/human_heart_mapping/backup/.data/mapping_py/HCAHeart9508627_HCAHeart9508819/HCAHeart9508627_HCAHeart9508819/outs//atac_fragments.tsv.gz --cellbatchsize 400 --posbam /mnt/LaCIE/ceger/Projects/human_heart_mapping/backup/.data/mapping_py/HCAHeart9508627_HCAHeart9508819/HCAHeart9508627_HCAHeart9508819/outs//atac_possorted_bam.bam --chromlen chromlen.txt
Jul-10 10:14:58.956 [main] INFO nextflow.cli.CmdRun - N E X T F L O W ~ version 22.10.6
Jul-10 10:14:58.967 [main] DEBUG nextflow.plugin.PluginsFacade - Setting up plugin manager > mode=prod; embedded=false; plugins-dir=/home/ceger/.nextflow/plugins; core-plugins: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected]
Jul-10 10:14:58.972 [main] INFO org.pf4j.DefaultPluginStatusProvider - Enabled plugins: []
Jul-10 10:14:58.973 [main] INFO org.pf4j.DefaultPluginStatusProvider - Disabled plugins: []
Jul-10 10:14:58.974 [main] INFO org.pf4j.DefaultPluginManager - PF4J version 3.4.1 in 'deployment' mode
Jul-10 10:14:58.979 [main] INFO org.pf4j.AbstractPluginManager - No plugins
Jul-10 10:14:59.378 [main] DEBUG nextflow.config.ConfigBuilder - Found config base: /home/ceger/cellatac/nextflow.config
Jul-10 10:14:59.379 [main] DEBUG nextflow.config.ConfigBuilder - Parsing config file: /home/ceger/cellatac/nextflow.config
Jul-10 10:14:59.384 [main] DEBUG nextflow.config.ConfigBuilder - Applying config profile: `standard`
Jul-10 10:14:59.431 [main] DEBUG nextflow.cli.CmdRun - Applied DSL=1 by probing script field
Jul-10 10:14:59.443 [main] INFO nextflow.cli.CmdRun - Launching `/home/ceger/cellatac/main.nf` [insane_lamarr] DSL1 - revision: 0eb968d72b
Jul-10 10:14:59.444 [main] DEBUG nextflow.plugin.PluginsFacade - Plugins default=[]
Jul-10 10:14:59.444 [main] DEBUG nextflow.plugin.PluginsFacade - Plugins resolved requirement=[]
Jul-10 10:14:59.448 [main] DEBUG nextflow.secret.LocalSecretsProvider - Secrets store: /home/ceger/.nextflow/secrets/store.json
Jul-10 10:14:59.450 [main] DEBUG nextflow.secret.SecretsLoader - Discovered secrets providers: [nextflow.secret.LocalSecretsProvider@4cbc2e3b] - activable => nextflow.secret.LocalSecretsProvider@4cbc2e3b
Jul-10 10:14:59.506 [main] DEBUG nextflow.Session - Session UUID: 4f5b8ef8-6140-44ec-a5cd-306e767d74bf
Jul-10 10:14:59.506 [main] DEBUG nextflow.Session - Run name: insane_lamarr
Jul-10 10:14:59.506 [main] DEBUG nextflow.Session - Executor pool size: 64
Jul-10 10:14:59.528 [main] DEBUG nextflow.util.ThreadPoolBuilder - Creating thread pool 'FileTransfer' minSize=10; maxSize=192; workQueue=LinkedBlockingQueue[10000]; allowCoreThreadTimeout=false
Jul-10 10:14:59.550 [main] DEBUG nextflow.cli.CmdRun -
Version: 22.10.6 build 5843
Created: 23-01-2023 23:20 UTC (24-01-2023 00:20 CEST)
System: Linux 6.9.7-100.fc39.x86_64
Runtime: Groovy 3.0.13 on OpenJDK 64-Bit Server VM 17.0.11-internal+0-adhoc..src
Encoding: UTF-8 (UTF-8)
Process: 3992615@carlos [169.254.3.1]
CPUs: 64 - Mem: 755.2 GB (356.5 GB) - Swap: 8 GB (6.9 GB)
Jul-10 10:14:59.577 [main] DEBUG nextflow.Session - Work-dir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work [ext2/ext3]
Jul-10 10:14:59.594 [main] DEBUG nextflow.executor.ExecutorFactory - Extension executors providers=[]
Jul-10 10:14:59.600 [main] DEBUG nextflow.Session - Observer factory: DefaultObserverFactory
Jul-10 10:14:59.618 [main] DEBUG nextflow.cache.CacheFactory - Using Nextflow cache factory: nextflow.cache.DefaultCacheFactory
Jul-10 10:14:59.624 [main] DEBUG nextflow.util.CustomThreadPool - Creating default thread pool > poolSize: 65; maxThreads: 1000
Jul-10 10:15:00.194 [main] DEBUG nextflow.Session - Session start
Jul-10 10:15:00.197 [main] DEBUG nextflow.trace.TraceFileObserver - Workflow started -- trace file: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/reports/trace.txt
Jul-10 10:15:00.904 [main] DEBUG nextflow.script.ScriptRunner - > Launching execution
Jul-10 10:15:01.039 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.039 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.042 [main] DEBUG nextflow.executor.Executor - [warm up] executor > local
Jul-10 10:15:01.045 [main] DEBUG n.processor.LocalPollingMonitor - Creating local task monitor for executor 'local' > cpus=64; memory=755.2 GB; capacity=64; pollInterval=100ms; dumpInterval=5m
Jul-10 10:15:01.091 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.091 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.097 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.097 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.107 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.107 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.125 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.126 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.136 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.136 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.140 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.140 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.142 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.143 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.145 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.145 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.147 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.147 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.149 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.149 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.152 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.152 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.154 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.155 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.163 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.163 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.163 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:15:01.165 [Task submitter] INFO nextflow.Session - [cd/9be202] Submitted process > prepare_cr_single (cr-prep 400)
Jul-10 10:15:01.166 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.166 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.169 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.169 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.173 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.173 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.179 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.179 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.181 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.181 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.184 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Jul-10 10:15:01.184 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Jul-10 10:15:01.185 [main] DEBUG nextflow.Session - Workflow process names [dsl1]: prepare_cr_single, make_big_matrix, cusanovich_clustering, prepare_cr_mux, filter_big_matrix, clusters_index, make_subset_peakmatrix, join_muxfiles, peaks_make_masterlist, cells_masterlist_coverage, make_sample_matrix, clusters_macs2, sample_demux, clusters_merge_inputs, mmtx_big_matrix, join_sample_matrix, make_master_peakmatrix, seurat_clustering, prepare_mm, episcanpy_clustering
Jul-10 10:15:01.185 [main] DEBUG nextflow.script.ScriptRunner - > Awaiting termination
Jul-10 10:15:01.185 [main] DEBUG nextflow.Session - Session await
Jul-10 10:15:01.811 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 1; name: prepare_cr_single (cr-prep 400); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/cd/9be2029d258f3299d563cdad309c3b]
Jul-10 10:15:01.875 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:15:01.876 [Task submitter] INFO nextflow.Session - [40/2b1ab8] Submitted process > sample_demux (sample-crsingle batch-ah)
Jul-10 10:15:01.882 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:15:01.882 [Task submitter] INFO nextflow.Session - [b2/e66411] Submitted process > sample_demux (sample-crsingle batch-ad)
Jul-10 10:15:01.888 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:15:01.888 [Task submitter] INFO nextflow.Session - [58/8568c8] Submitted process > sample_demux (sample-crsingle batch-ag)
Jul-10 10:15:01.893 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:15:01.894 [Task submitter] INFO nextflow.Session - [4c/bf7058] Submitted process > sample_demux (sample-crsingle batch-ai)
Jul-10 10:15:01.898 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:15:01.898 [Task submitter] INFO nextflow.Session - [84/c76ba9] Submitted process > sample_demux (sample-crsingle batch-ae)
Jul-10 10:15:01.902 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:15:01.903 [Task submitter] INFO nextflow.Session - [b2/082d6b] Submitted process > sample_demux (sample-crsingle batch-aa)
Jul-10 10:15:01.907 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:15:01.907 [Task submitter] INFO nextflow.Session - [98/4385bb] Submitted process > sample_demux (sample-crsingle batch-ac)
Jul-10 10:15:01.912 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:15:01.912 [Task submitter] INFO nextflow.Session - [96/492a6e] Submitted process > sample_demux (sample-crsingle batch-ab)
Jul-10 10:15:01.916 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:15:01.916 [Task submitter] INFO nextflow.Session - [c5/2695d1] Submitted process > sample_demux (sample-crsingle batch-af)
Jul-10 10:19:08.704 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 10; name: sample_demux (sample-crsingle batch-ag); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/58/8568c85d75608ed66f0bf29f50471e]
Jul-10 10:19:08.736 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 7; name: sample_demux (sample-crsingle batch-ad); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/b2/e66411919ea1779667814a92f3d9e0]
Jul-10 10:19:09.038 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 9; name: sample_demux (sample-crsingle batch-af); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/c5/2695d1388ac7672b1b8434c32da86d]
Jul-10 10:19:09.294 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 12; name: sample_demux (sample-crsingle batch-ai); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/4c/bf7058bcb3b17d40858ee43a268620]
Jul-10 10:19:10.379 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 6; name: sample_demux (sample-crsingle batch-ac); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/98/4385bbd5ed94924225d6e106e76e2f]
Jul-10 10:19:11.080 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 4; name: sample_demux (sample-crsingle batch-aa); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/b2/082d6b1c0f19d1f2c2edca2ef714df]
Jul-10 10:19:11.773 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 5; name: sample_demux (sample-crsingle batch-ab); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/96/492a6ea6826f3ac8c7d68996e7e002]
Jul-10 10:19:12.210 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 8; name: sample_demux (sample-crsingle batch-ae); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/84/c76ba946338166d602047d1659c055]
Jul-10 10:19:12.422 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 11; name: sample_demux (sample-crsingle batch-ah); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/40/2b1ab88f200fd999f78fa7f0f9ddaf]
Jul-10 10:19:12.451 [Actor Thread 62] WARN nextflow.container.SingularityCache - Singularity cache directory has not been defined -- Remote image will be stored in the path: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/singularity -- Use env variable NXF_SINGULARITY_CACHEDIR to specify a different location
Jul-10 10:19:12.451 [Actor Thread 62] INFO nextflow.container.SingularityCache - Pulling Singularity image docker://quay.io/cellgeni/cellclusterer [cache /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/singularity/quay.io-cellgeni-cellclusterer.img]
Jul-10 10:19:12.906 [Actor Thread 58] DEBUG nextflow.sort.BigSort - Sort completed -- entries: 3463; slices: 1; internal sort time: 0.415 s; external sort time: 0.044 s; total time: 0.459 s
Jul-10 10:19:12.944 [Actor Thread 58] DEBUG nextflow.file.FileCollector - Saved collect-files list to: /tmp/83b72cf4c1fa6b92be4a5d236641ff6d.collect-file
Jul-10 10:19:12.948 [Actor Thread 58] DEBUG nextflow.file.FileCollector - Deleting file collector temp dir: /tmp/nxf-3340720557633142387
Jul-10 10:19:14.933 [Actor Thread 62] DEBUG nextflow.container.SingularityCache - Singularity pull complete image=docker://quay.io/cellgeni/cellclusterer path=/mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/singularity/quay.io-cellgeni-cellclusterer.img
Jul-10 10:19:14.943 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:19:14.943 [Task submitter] INFO nextflow.Session - [07/f75f0a] Submitted process > make_big_matrix (1)
Jul-10 10:19:14.945 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:19:14.945 [Task submitter] INFO nextflow.Session - [7e/1bbad8] Submitted process > make_sample_matrix (crsingle)
Jul-10 10:19:18.146 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 14; name: make_sample_matrix (crsingle); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/7e/1bbad88042d351ca6ec65a9ec8e28a]
Jul-10 10:19:18.164 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:19:18.164 [Task submitter] INFO nextflow.Session - [e4/590db8] Submitted process > join_sample_matrix
Jul-10 10:19:21.214 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 13; name: make_big_matrix (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/07/f75f0a281ceff35382d6298c201f9f]
Jul-10 10:19:21.221 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:19:21.221 [Task submitter] INFO nextflow.Session - [31/ff9df1] Submitted process > mmtx_big_matrix (raw_window_bc_matrix)
Jul-10 10:19:21.239 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:19:21.239 [Task submitter] INFO nextflow.Session - [da/d7b1c5] Submitted process > filter_big_matrix (bed-mcx-mmtx)
Jul-10 10:19:21.282 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 15; name: join_sample_matrix; status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/e4/590db80fa2258cbcdd62aefd6e9288]
Jul-10 10:19:21.312 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Jul-10 10:19:21.313 [Task submitter] INFO nextflow.Session - [74/6e1212] Submitted process > seurat_clustering (seurat2020)
Jul-10 10:19:24.658 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 17; name: filter_big_matrix (bed-mcx-mmtx); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/da/d7b1c5ca5d11d4f9c729ccdb2cf6d8]
Jul-10 10:19:24.668 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 16; name: mmtx_big_matrix (raw_window_bc_matrix); status: COMPLETED; exit: 0; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/31/ff9df1612f45316458e185a1f04818]
Jul-10 10:19:31.280 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 18; name: seurat_clustering (seurat2020); status: COMPLETED; exit: 1; error: -; workDir: /mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/74/6e12124514ab4196e97fe41faf16f7]
Jul-10 10:19:31.286 [Task monitor] ERROR nextflow.processor.TaskProcessor - Error executing process > 'seurat_clustering (seurat2020)'
Caused by:
Process `seurat_clustering (seurat2020)` terminated with an error exit status (1)
Command executed:
R --no-save --args < /home/ceger/cellatac/bin/ca_seurat_clades.R
Command exit status:
1
Command output:
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
> library(Signac)
> library(Seurat)
> library('Matrix')
> library(R.utils)
>
> theargs <- R.utils::commandArgs(asValues=TRUE)
> have_multisample <- is.null(theargs$"single-sample")
> do_clip <- is.null(theargs$noclip) # with contortion apologies.
>
> ### NOTE/check: make sure CR singlecell.csv table works as expected if we merge multiplets ourselves
>
> # cell.names filtered_cell.stats filtered_window_bc_matrix.mmtx.gz regions.names win.stats
>
> ### Load cellATAC windows binary matrix
> f_binary_mat <- as(readMM(file = 'mmtx/filtered_window_bc_matrix.mmtx.gz'), "dgCMatrix")
> regions.names = read.delim('mmtx/regions.names', header = FALSE, stringsAsFactors = FALSE)
> cell.names = read.delim('mmtx/cell.names', header = FALSE, stringsAsFactors = FALSE)
> colnames(f_binary_mat) = cell.names$V1
> rownames(f_binary_mat) = regions.names$V1
>
> ### Load cell calling from cellranger - Seurat likes this
> metadata <- read.csv(file = 'singlecell.csv', header = TRUE, row.names=1, sep="\t")
>
> ## Filter metadata to match cells in f_binary_mat
> #metadata <- metadata[colnames(f_binary_mat), , drop=FALSE]
> #
> ## Ensure metadata only contains cells present in the count matrix
> #common_cells <- intersect(colnames(f_binary_mat), rownames(metadata))
> #f_binary_mat <- f_binary_mat[, common_cells, drop=FALSE]
> #metadata <- metadata[common_cells, , drop=FALSE]
> # Check for zero rows and columns in the matrix
>
> ### Creating a Seurat object using the windows/cell matrix
> so <- CreateSeuratObject(
+ counts = f_binary_mat,
+ assay = 'peaks',
+ project = 'ATAC',
+ min.cells = 1,
+ meta.data = metadata
+ )
>
> ### Normalization - term frequency-inverse document frequency (TF-IDF)
> # is a two-step normalization procedure,
> # that both normalizes across cells to correct for differences in cellular sequencing depth,
> # and across peaks to give higher values to more rare peaks
> so <- RunTFIDF(so)
Command error:
warnings
>
> theargs <- R.utils::commandArgs(asValues=TRUE)
> have_multisample <- is.null(theargs$"single-sample")
> do_clip <- is.null(theargs$noclip) # with contortion apologies.
>
> ### NOTE/check: make sure CR singlecell.csv table works as expected if we merge multiplets ourselves
>
> # cell.names filtered_cell.stats filtered_window_bc_matrix.mmtx.gz regions.names win.stats
>
> ### Load cellATAC windows binary matrix
> f_binary_mat <- as(readMM(file = 'mmtx/filtered_window_bc_matrix.mmtx.gz'), "dgCMatrix")
> regions.names = read.delim('mmtx/regions.names', header = FALSE, stringsAsFactors = FALSE)
> cell.names = read.delim('mmtx/cell.names', header = FALSE, stringsAsFactors = FALSE)
> colnames(f_binary_mat) = cell.names$V1
> rownames(f_binary_mat) = regions.names$V1
>
> ### Load cell calling from cellranger - Seurat likes this
> metadata <- read.csv(file = 'singlecell.csv', header = TRUE, row.names=1, sep="\t")
>
> ## Filter metadata to match cells in f_binary_mat
> #metadata <- metadata[colnames(f_binary_mat), , drop=FALSE]
> #
> ## Ensure metadata only contains cells present in the count matrix
> #common_cells <- intersect(colnames(f_binary_mat), rownames(metadata))
> #f_binary_mat <- f_binary_mat[, common_cells, drop=FALSE]
> #metadata <- metadata[common_cells, , drop=FALSE]
> # Check for zero rows and columns in the matrix
>
> ### Creating a Seurat object using the windows/cell matrix
> so <- CreateSeuratObject(
+ counts = f_binary_mat,
+ assay = 'peaks',
+ project = 'ATAC',
+ min.cells = 1,
+ meta.data = metadata
+ )
>
> ### Normalization - term frequency-inverse document frequency (TF-IDF)
> # is a two-step normalization procedure,
> # that both normalizes across cells to correct for differences in cellular sequencing depth,
> # and across peaks to give higher values to more rare peaks
> so <- RunTFIDF(so)
Performing TF-IDF normalization
Error in checkSlotAssignment(object, name, value) :
assignment of an object of class “dgeMatrix” is not valid for slot ‘data’ in an object of class “Assay”; is(value, "AnyMatrix") is not TRUE
Calls: RunTFIDF ... SetAssayData.Assay -> slot<- -> checkSlotAssignment
Execution halted
INFO: Cleaning up image...
Work dir:
/mnt/LaCIE/ceger/Projects/human_heart_mapping/human_heart_mapping/0-raw_data_processing/3-240417-E-MTAB-12916_E-MTAB-12919/1-240419-CellRanger_ARC/work/74/6e12124514ab4196e97fe41faf16f7
Tip: you can replicate the issue by changing to the process work dir and entering the command `bash .command.run`
Jul-10 10:19:31.289 [Task monitor] DEBUG nextflow.Session - Session aborted -- Cause: Process `seurat_clustering (seurat2020)` terminated with an error exit status (1)
Jul-10 10:19:31.298 [Task monitor] DEBUG nextflow.Session - The following nodes are still active:
[process] peaks_make_masterlist
status=ACTIVE
port 0: (value) bound ; channel: np_files
port 1: (value) bound ; channel: f_chromlen
port 2: (cntrl) - ; channel: $
[process] cells_masterlist_coverage
status=ACTIVE
port 0: (value) OPEN ; channel: masterbed_sps
port 1: (value) bound ; channel: f_chromlen
port 2: (queue) OPEN ; channel: celldef_list
port 3: (cntrl) - ; channel: $
[process] make_master_peakmatrix
status=ACTIVE
port 0: (queue) OPEN ; channel: metafile
port 1: (value) OPEN ; channel: masterpeak.bed
port 2: (value) bound ; channel: cells.tab
port 3: (cntrl) - ; channel: $
Jul-10 10:19:31.299 [main] DEBUG nextflow.Session - Session await > all processes finished
Jul-10 10:19:31.299 [main] DEBUG nextflow.Session - Session await > all barriers passed
Jul-10 10:19:31.299 [Actor Thread 64] DEBUG nextflow.file.SortFileCollector - FileCollector temp dir not removed: null
Jul-10 10:19:31.302 [main] DEBUG nextflow.trace.WorkflowStatsObserver - Workflow completed > WorkflowStats[succeededCount=15; failedCount=1; ignoredCount=0; cachedCount=0; pendingCount=1; submittedCount=0; runningCount=0; retriesCount=0; abortedCount=0; succeedDuration=37m 20s; failedDuration=9.9s; cachedDuration=0ms;loadCpus=0; loadMemory=0; peakRunning=9; peakCpus=9; peakMemory=0; ]
Jul-10 10:19:31.302 [main] DEBUG nextflow.trace.TraceFileObserver - Workflow completed -- saving trace file
Jul-10 10:19:31.303 [main] DEBUG nextflow.trace.TimelineObserver - Workflow completed -- rendering execution timeline
Jul-10 10:19:31.497 [main] DEBUG nextflow.cache.CacheDB - Closing CacheDB done
Jul-10 10:19:31.503 [main] DEBUG nextflow.script.ScriptRunner - > Execution complete -- Goodbye
singlecell.csv (created based on the per_barcode_metrics.csv file made by cellranger-arc and containing the unfiltered list of barcodes):
barcode total duplicate chimeric unmapped lowmapq mitochondrial passed_filters cell_id is_cell_barcode DNase_sensitive_region_fragments enhancer_region_fragments promoter_region_fragments on_target_fragments blacklist_region_fragments excluded_reason TSS_fragments peak_region_fragments peak_region_cutsites
AAACAAGCAAACAAAG-1 10 3 0 2 0 0 0 0 0 0 0 0 0 0 20 0 0
AAACAAGCAAACATGT-1 12 0 0 1 7 0 0 0 0 0 0 0 0 0 03 2 4
AAACAAGCAAACCCAA-1 225 28 1 3 40 0 0 0 0 0 0 0 0 0 040 38 68
AAACAAGCAAACCTAG-1 3 1 0 0 0 0 0 0 0 0 0 0 0 0 01 1 2
AAACAAGCAAACGCGT-1 1 0 0 0 1 0 0 0 0 0 0 0 0 0 00 0 0
...
chromlen.txt (created based on this comment in main.nf: ```nextflow params.chromlen = null // File with names of chromosomes. ```)
chr1
chr2
chr3
chr4
chr5
chr6
chr7
chr8
chr9
chr10
chr11
chr12
chr13
chr14
chr15
chr16
chr17
chr18
chr19
chr20
chr21
chr22
chrX
chrY
chrM
Mamba environment
name: nextflow-env
channels:
- bioconda
- conda-forge
dependencies:
- _libgcc_mutex=0.1
- _openmp_mutex=4.5
- alsa-lib=1.2.11
- bzip2=1.0.8
- c-ares=1.28.1
- ca-certificates=2024.6.2
- cairo=1.18.0
- cni=1.0.1
- cni-plugins=1.3.0
- coreutils=8.25
- curl=7.88.1
- expat=2.6.2
- font-ttf-dejavu-sans-mono=2.37
- font-ttf-inconsolata=3.000
- font-ttf-source-code-pro=2.038
- font-ttf-ubuntu=0.83
- fontconfig=2.14.2
- fonts-conda-ecosystem=1
- fonts-conda-forge=1
- freetype=2.12.1
- giflib=5.2.2
- graphite2=1.3.13
- harfbuzz=8.5.0
- icu=73.2
- jq=1.7.1
- keyutils=1.6.1
- krb5=1.20.1
- lcms2=2.16
- lerc=4.0.0
- libarchive=3.5.2
- libcups=2.3.3
- libcurl=7.88.1
- libdeflate=1.20
- libedit=3.1.20191231
- libev=4.33
- libexpat=2.6.2
- libffi=3.4.2
- libgcc=7.2.0
- libgcc-ng=14.1.0
- libglib=2.80.2
- libgomp=14.1.0
- libiconv=1.17
- libjpeg-turbo=3.0.0
- libnghttp2=1.58.0
- libpng=1.6.43
- libseccomp=2.4.4
- libssh2=1.11.0
- libstdcxx-ng=14.1.0
- libtiff=4.6.0
- libuuid=2.38.1
- libwebp-base=1.4.0
- libxcb=1.16
- libxml2=2.12.7
- libzlib=1.3.1
- lz4-c=1.9.4
- lzo=2.10
- ncurses=6.5
- nextflow=22.10.6
- oniguruma=6.9.9
- openjdk=17.0.11
- openssl=3.3.1
- pcre2=10.44
- pixman=0.43.2
- pthread-stubs=0.4
- singularity=3.8.6
- squashfs-tools=4.6.1
- xorg-fixesproto=5.0
- xorg-inputproto=2.3.2
- xorg-kbproto=1.0.7
- xorg-libice=1.1.1
- xorg-libsm=1.2.4
- xorg-libx11=1.8.9
- xorg-libxau=1.0.11
- xorg-libxdmcp=1.1.3
- xorg-libxext=1.3.4
- xorg-libxfixes=5.0.3
- xorg-libxi=1.7.10
- xorg-libxrender=0.9.11
- xorg-libxt=1.3.0
- xorg-libxtst=1.2.3
- xorg-recordproto=1.14.2
- xorg-renderproto=0.11.1
- xorg-xextproto=7.3.0
- xorg-xproto=7.0.31
- xz=5.2.6
- zlib=1.3.1
- zstd=1.5.6
prefix: /home/ceger/miniforge3/envs/nextflow-env
Thank you for your time!
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.