jonescompneurolab / hnn-core

Simulation and optimization of neural circuits for MEG/EEG source estimates
https://jonescompneurolab.github.io/hnn-core/
BSD 3-Clause "New" or "Revised" License
50 stars 50 forks source link

ci: Debugging ubuntu pytest gh runner #781

Closed gtdang closed 1 week ago

gtdang commented 1 month ago

Debugging ubuntu pytest gh runner. #780

gtdang commented 1 month ago
  1. I've edited the gh action to run the MPI test noted in our Parallel backends guide. The Linux runners are not returning the expected results. The Mac runners are returning the expected result.

Linux Runners

numprocs=1
numprocs=1
NEURON -- VERSION 8.2.4 HEAD (1d87d5d39) 2024-02-09
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2022
See http://neuron.yale.edu/neuron/credits

NEURON -- VERSION 8.2.4 HEAD (1d87d5d39) 2024-02-09
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2022
See http://neuron.yale.edu/neuron/credits

Hello from proc 0
Hello from proc 0

Expected result

numprocs=2
NEURON -- VERSION 8.2.4 release/8.2 (1d87d5d39) 2024-02-09
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2018
See http://neuron.yale.edu/neuron/credits

Hello from proc 0
Hello from proc 1

The Linux runners seem to be duplicating a single process when it should be splitting into two processes.

  1. Running the pytest with verbose I've confirmed the unbuntu runners are stalling on the pytest step at test_dipole.py>test_cell_response_backends. This test requires MPI.
ntolley commented 1 month ago

Thanks for digging into this @gtdang!

I wonder if other repo's that test with MPI are experiencing the same issue...

jasmainak commented 1 month ago

was a new ubuntu release made that broke the runners?

gtdang commented 1 month ago

was a new ubuntu release made that broke the runners?

They did release updated GitHub runner images in the last week. I've tested all 3 versions of Ubuntu that they offer and they all have the same issue... All 3 images were updated though. I need to look into how to run previous releases.

jasmainak commented 1 month ago

perhaps this is helpful: https://github.com/mpi4py/setup-mpi ?