broderickpt
commented
2 years ago Tomorrow I expect to let everyone know about build-lib-code.sh, which does that (I modified the python scripts last week to operate on temporary files identified with the process id). It build the libraries in parallel.
Patrick Broderick
(412) 608-7202
@.> @.
“Chains of habit are too light to be felt until they are too heavy to be broken.” - Warren Buffett
From: petermcLBL @.> Sent: Tuesday, January 18, 2022 19:39 To: spiral-software/fftx @.> Cc: Subscribed @.***> Subject: [spiral-software/fftx] Allow the python commands in examples/library/create_lib_code.sh to be run in parallel. (Issue #55)
Each of the python commands in examples/library/create_lib_code.sh writes out and reads in intermediate files that are called myscript.g and testscript.g
As a result, you cannot run, say, python gen_files.py fftx_mddft cuda true and python gen_files.py fftx_mdprdft cuda false in parallel in separate xterms, because those intermediate files will interfere with one another. You have to run them sequentially.
So how about changing the names of myscript.g and testscript.g to be more specific? Say, {my|test}_fftx_mddft_cuda_true_script.g. Then we could run the python gen_files.py commands in parallel. Maybe even include the size in the names as well.
— Reply to this email directly, view it on GitHub https://github.com/spiral-software/fftx/issues/55 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AL6KP2ZTHP326Z6CZMODN63UWYB2XANCNFSM5MIRWGMA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub . You are receiving this because you are subscribed to this thread. https://github.com/notifications/beacon/AL6KP2Y2BA37DL3RA5UCBR3UWYB2XA5CNFSM5MIRWGMKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4QQDGRQA.gif Message ID: @. @.> >
Each of the python commands in
examples/library/create_lib_code.shwrites out and reads in intermediate files that are calledmyscript.gandtestscript.gAs a result, you cannot run, say,
python gen_files.py fftx_mddft cuda trueandpython gen_files.py fftx_mdprdft cuda falsein parallel in separate xterms, because those intermediate files will interfere with one another. You have to run them sequentially.So how about changing the names of
myscript.gandtestscript.gto be more specific? Say,{my|test}_fftx_mddft_cuda_true_script.g.Then we could run thepython gen_files.pycommands in parallel. Maybe even include the size in the names as well.