dib-lab / 2022-branchwater-benchmarking Goto Github PK
View Code? Open in Web Editor NEWBenchmarking etc code for https://dib-lab.github.io/2022-paper-branchwater-software/
Benchmarking etc code for https://dib-lab.github.io/2022-paper-branchwater-software/
Command being timed: "/home/ctbrown/scratch/magsearch/bin/searcher -k 31 --scaled=1000 -o output.csv siglist-a.txt data/wort-list-a.txt"
User time (seconds): 46185.31
System time (seconds): 1329.98
Percent of CPU this job got: 2593%
Elapsed (wall clock) time (h:mm:ss or m:ss): 30:31.75
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 24259940
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 12
Minor (reclaiming a frame) page faults: 428254673
Voluntary context switches: 166157
Involuntary context switches: 7161352
Swaps: 0
File system inputs: 196555504
File system outputs: 2304
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
from code added in 2b78b96, this:
srun -p high2 --time=5:00:00 --nodes=1 --cpus-per-task 32 --mem 50GB --pty /bin/bash
snakemake -j 32 --snakefile benchmarking.snakefile
csvtk concat benchmarks/*.txt | csvtk cut -t -f "h:m:s",cpu_time,max_rss
yields:
h:m:s cpu_time max_rss
0:23:14 40626.79 16106.77
0:23:14 38643.81 17553.49
0:22:37 37936.37 18257.87
0:25:05 39209.39 16107.48
0:26:36 37791.57 14046.44
in ~ctbrown/scratch/2022-magsearch-benchmarking
,
% scripts/intersect-ls-and-catalog.py data/ls-wort.txt data/metagenomes-catalog.txt
loaded 767277 accessions from 'data/metagenomes-catalog.txt'
example acc: ERR1083538
Loaded 767277 file sizes from 'data/ls-wort.txt'
average file size: 9716.0
median file size: 570
rule a_vs_catalog
:
Command being timed: "snakemake -j 32 --snakefile benchmarking.snakefile"
User time (seconds): 3609042.48
System time (seconds): 98105.28
Percent of CPU this job got: 2963%
Elapsed (wall clock) time (h:mm:ss or m:ss): 34:44:51
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 52518880
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 24
Minor (reclaiming a frame) page faults: 30125462817
Voluntary context switches: 9804070
Involuntary context switches: 564183263
Swaps: 0
File system inputs: 14879893680
File system outputs: 178544
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.