Test: fix some issues with python API test

flux-framework / dyad

DYAD: DYnamic and Asynchronous Data Streamliner

GNU Lesser General Public License v3.0

7 stars 5 forks source link

Closed JaeseungYeom closed 8 months ago

JaeseungYeom commented 8 months ago

tests/pydyad_spsc seems to have multiple issues.

KVS_NAMESPACE variable is inconsistently used with DYAD_KVS_NAMESPACE
DYAD managed directory is not created.
In case that such a directory already exists, and the directory contains the files from the previous runs, the test is invalid
module load uses producer's managed path which is misleading due to the variable name
Depending on the DTL mode, it shows different errors

JaeseungYeom commented 8 months ago

I test it manually using 2 compute nodes. It was working for both UCX and FLUX_RPC.

hariharan-devarajan commented 8 months ago

@JaeseungYeom the ci seem to have no such file or directory. Do we need to create any directories on ci for that

JaeseungYeom commented 8 months ago

I think the CI failure is a separate issue. We should look at the memory usage. I will add something and see how much memory it uses.

hariharan-devarajan commented 8 months ago

Ok if that's the case I can merge it.