Using Linux bash scripting to run multiple jobs simultaneously on HPCC

Question

I want to run 20 jobs simultaneously on HPCC using a bash script. I wrote the code below, but this code cannot run the jobs simultaneously. Can everyone help me out with how can I modify this code to do that?

cd $SLURM_SUBMIT_DIR

for((i=0;i<20;i++))
do
    cd $i
    #running a code
    cd ../
    
done

~
~

`xargs` or GNU `parallel` if you have access to those. Also: https://stackoverflow.com/questions/42651475/run-a-specifiable-number-of-commands-in-parallel-contrasting-xargs-p-gnu-par — wkl, Jul 16 '22 at 22:33
Thanks, by job array, do you mean something like below? /home/..... @Poshi — amirre, Jul 17 '22 at 20:39

score 0 · Answer 1 · answered Jul 17 '22 at 00:48

0

Put jobs to background and wait for completion?

declare -a pids

for ((i=0;i<20;i++))
do
    (
        cd $i
        #running a code
    ) &
    pids+=($!)
done

wait ${pids[*]}

answered Jul 17 '22 at 00:48

dimich

1,305
1
5
7

Using Linux bash scripting to run multiple jobs simultaneously on HPCC

1 Answers1