search

CARTAvis / ICD-RxJS

This is the carta-backend ICD tests based on the RxJS library
1 stars 0 forks source link

Mylin/#40 performance tests #42

Closed acdo2002 closed 7 months ago

acdo2002 commented 7 months ago

Description

Fixed #40, now the performance regression tests are all migrated to the RxJS based. The tests are located in /ICD-RxJS/src/performance/PERF*.test.ts I have run them in my two Desktop (MacOS 13 M1 + Ubuntu 22.04), they are all fine.

Checklist

For the pull request:

ajm-ska commented 7 months ago

@acdo2002 I seem to have problems with the ANIMATOR_PLAYBACK tests on the AlmaLinux8 server.

PERF_ANIMATION_PLAYBACK_HDF5.test.ts starts running and I see the [CARTA] [debug] The compression ratio for tile output lines on the carta_backend, but then it appears to hang and it eventually times out Exceeded timeout of 600000 ms for a test

For PERF_ANIMATION_PLAYBACK_FITS.test.ts and PERF_ANIMATION_PLAYBACK_CASA.test.ts it is a bit different. It gives same error in each:

✕ (Step 2)"cube_B_09600_z00100.image" Image should return within 200000: (200003 ms)

The timeout value of 20000 is hard-coded to the. I would expect it to be adjustable in config.json.

I thought the hardware I am testing it on might be slow, but even if I manually adjust it up to 600000, the test still fails:

✕ (Step 2)"cube_B_09600_z00100.fits" Image should return within 600000: (600002 ms)

Do these tests pass on your systems?

acdo2002 commented 7 months ago

@ajm-asiaa Yes, they are all passed on my MacOS 13 and Ubuntu 22.04. For MacOS 13:

PASS src/performance/PERF_ANIMATION_PLAYBACK_CASA.test.ts (20.273 s) PERF_ANIMATION_PLAYBACK Register a session ✓ check connection ✓ Get basepath and modify the directory path (1 ms) Initialization: open the image ✓ (Step 1)"cube_B_09600_z00100.image" OPEN_FILE_ACK and REGION_HISTOGRAM_DATA should arrive within 16000 ms (415 ms) ✓ (Step 1)"cube_B_09600_z00100.image" SetImageChannels & SetCursor responses should arrive within 5000 ms (34 ms) Play some channels forwardly ✓ (Step 2)"cube_B_09600_z00100.image" Image should return within 200000: (17795 ms)

PASS src/performance/PERF_ANIMATION_PLAYBACK_HDF5.test.ts (5.811 s) PERF_ANIMATION_PLAYBACK Register a session ✓ check connection (1 ms) ✓ Get basepath and modify the directory path (2 ms) Initialization: open the image ✓ (Step 1)"cube_B_09600_z00100.hdf5" OPEN_FILE_ACK and REGION_HISTOGRAM_DATA should arrive within 16000 ms (25 ms) ✓ (Step 1)"cube_B_09600_z00100.hdf5" SetImageChannels & SetCursor responses should arrive within 5000 ms (54 ms) Play some channels forwardly ✓ (Step 2)"cube_B_09600_z00100.hdf5" Image should return within 600000: (5453 ms)

PASS src/performance/PERF_ANIMATION_PLAYBACK_FITS.test.ts (16.685 s) PERF_ANIMATION_PLAYBACK Register a session ✓ check connection (1 ms) ✓ Get basepath and modify the directory path (1 ms) Initialization: open the image ✓ (Step 1)"cube_B_09600_z00100.fits" OPEN_FILE_ACK and REGION_HISTOGRAM_DATA should arrive within 16000 ms (253 ms) ✓ (Step 1)"cube_B_09600_z00100.fits" SetImageChannels & SetCursor responses should arrive within 5000 ms (33 ms) Play some channels forwardly ✓ (Step 2)"cube_B_09600_z00100.fits" Image should return within 200000: (16226 ms)

Test Suites: 3 passed, 3 total Tests: 15 passed, 15 total Snapshots: 0 total Time: 42.8 s

For Ubuntu 22.04:

PASS src/performance/PERF_ANIMATION_PLAYBACK_CASA.test.ts (57.319 s) PERF_ANIMATION_PLAYBACK Register a session ✓ check connection (1 ms) ✓ Get basepath and modify the directory path (2 ms) Initialization: open the image ✓ (Step 1)"cube_B_09600_z00100.image" OPEN_FILE_ACK and REGION_HISTOGRAM_DATA should arrive within 16000 ms (1697 ms) ✓ (Step 1)"cube_B_09600_z00100.image" SetImageChannels & SetCursor responses should arrive within 5000 ms (78 ms) Play some channels forwardly ✓ (Step 2)"cube_B_09600_z00100.image" Image should return within 200000: (52412 ms)

PASS src/performance/PERF_ANIMATION_PLAYBACK_HDF5.test.ts (11.324 s) PERF_ANIMATION_PLAYBACK Register a session ✓ check connection (1 ms) ✓ Get basepath and modify the directory path (7 ms) Initialization: open the image ✓ (Step 1)"cube_B_09600_z00100.hdf5" OPEN_FILE_ACK and REGION_HISTOGRAM_DATA should arrive within 16000 ms (112 ms) ✓ (Step 1)"cube_B_09600_z00100.hdf5" SetImageChannels & SetCursor responses should arrive within 5000 ms (187 ms) Play some channels forwardly ✓ (Step 2)"cube_B_09600_z00100.hdf5" Image should return within 600000: (10715 ms)

PASS src/performance/PERF_ANIMATION_PLAYBACK_FITS.test.ts (51.838 s) PERF_ANIMATION_PLAYBACK Register a session ✓ check connection (1 ms) ✓ Get basepath and modify the directory path (3 ms) Initialization: open the image ✓ (Step 1)"cube_B_09600_z00100.fits" OPEN_FILE_ACK and REGION_HISTOGRAM_DATA should arrive within 16000 ms (1230 ms) ✓ (Step 1)"cube_B_09600_z00100.fits" SetImageChannels & SetCursor responses should arrive within 5000 ms (88 ms) Play some channels forwardly ✓ (Step 2)"cube_B_09600_z00100.fits" Image should return within 200000: (50241 ms) Test Suites: 3 passed, 3 total Tests: 15 passed, 15 total Snapshots: 0 total Time: 120.532 s