Code Monkey home page Code Monkey logo

bash-parallel's Introduction

bash-parallel

Only talking about parallel_submit_legacyV1.1.sh, other scripts are depreciated Purpose: bash script to submit commands/other scripts in parallel

Prerequisites: Tested mainly on MAC OSX, some testing on Ubuntu 14.04 LTS

Parameters: Mandatory -s The script you wish to run (write it out like how you would normally write it on the commandline) -j the maximum number of jobs you want to run cocurrently Optional -c deletes the intermediate .txt files (only useful for debugging) -m Try not to let free memory dip below this number (in kilobytes), takes precedence over the -j flag, but the -j flag still needs to be set

Notes about usage: The objects/inputs you wish to run cocurrently must be specified in a .parallel file. For example, if I needed processing to be completed on subjects 1001.nii.gz, 1002.nii.gz, and 1003.nii.gz, I would make a file named subs.parallel and if I were to call cat subs.parallel I would see as output: 1001.nii.gz 1002.nii.gz 1003.nii.gz

Example usage: parallel_submit_legacyV1.1.sh -s "MBA.sh -s sub_MPRAGES.parallel -o /Volumes/VossLab/Repositories/Bike/FIRST_practice -a /Volumes/VossLab/Repositories/MBA_maps -b /Volumes/VossLab/Repositories/MBA_maps/brainPrior/Ave_brain.nii.gz" -j 8

For more help see the top part of the parallel_submit_legacyV1.1.sh script.

bash-parallel's People

Contributors

jdkent avatar

Watchers

 avatar  avatar

Forkers

rachclark

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.