Gnu parallel: print each job to a different file

Question

I am trying to process such text files awkusing the command parallelas a shell script, but could not get it to output each job to another file

If I try:

seq 10 | parallel awk \''{ if ( $5 > 0.4 ) print $2}'\' file{}.txt > file{}.out

It outputs to a file file{}.outinstead file1.out, file2.outetc.

The tutorial and man pages also suggest that I could use --files, but it just prints to stdout:

seq 10 | parallel awk \''{ if ( $5 > 0.4 ) print $2}'\' file{}.txt --files file{}.out

Answer 1

Turns out I need to quote the redirect because it was handled outside parallel:

seq 10 | parallel awk \''{...}'\' file{}.txt ">" file{}.out

Answer 2

- :

seq 10 | parallel " awk command > file{}.out "

, stdout. , tee. , , :

seq 10 | parallel " awk command | tee file{}.out "

Answer 3

Since I parallelized a script that supports without pipes , the solutions here are not valid for me, so I opened a new thread here , which solves the problem .

I hope this helps some others arriving here.