Parallel

This program makes concurrent execution of processes easy, especially if you have more processes to run than you want running at any one time. The purpose of this program is to execute large numbers of batch jobs on either an SMP machine, or a cluster of SMP machines such that all the processors are used. Make n larger than the number of processors if the jobs do a mixture of IO and processing (e.g. image processing).

parallel n

Takes lines from the standard input and executes them using bash, with at most n running at any one time.

ssh_parallel . "" 2 user@host1 4 user@host2 4

Takes lines from the standard input and executes them using bash, in the current directory, with at most 2 processes running on the local machine, 4 on host1 and 4 on host2. See the man page for more complete documentation and examples.
Download: parallel-1.3.3.tar.gz
Browse: parallel-1.3.3
Previous versions:
Changelog: ChangeLog

Updated July 14^th 2011, 10:52