ghuls / moreutils-parallel Goto Github PK

It seems like the functionality provided by moreutils is equivalent to what you can get with xargs -P -I, with the major difference between the two being whether replace args are passed as arguments (as in moreutils) or via stdinput (as in xargs).

This looks easy to do, any reason why it hasn't been? It fixes the problem I face with dropping the gnu version (motive: a tool like this should not be demanding to be cited in research any more than pipette supplier's order form).

Advantages: no command line length limitation, and can run a variety of cmds. See ###-marked usage.

Usage: parallel [OPTIONS] COMMAND -- ARGUMENTS
     Run COMMAND in parallel and pass one ARGUMENT to each instance.
   or: parallel [OPTIONS] -- COMMANDS
   or: cat COMMANDS | parallel [OPTIONS]   ####new
         Run specified COMMANDS in parallel.

For -i and -n usage, adding

                  Not compatible with piped commands. ###new

Update: My mod seems to work with pipe as shown, but not with redirection: "parallel [OPTIONS] < cmd_file", where it seems to reread the file with mistakes forever after the first pass. It uses getline() to read stdin.

True aficianodos would want to port the applicable -i -n {} features to it. Production testing result to follow. Seems it could be adapted easily to manage gpu's or other resources as well as cpu threads. Any of this might justify forking to a non-colliding program name, and letting package managers decide. Hmm, is moreutils-parallel exactly that?