Open benjeffery opened 1 year ago
Possibly related to #869? Do you get segfaults if you disable numba caching?
Ah, yes this is! Thanks for the pointer.
I think it's important that we test on both the default dask threads-within-process and an explicit scheduler. Is there something we can do with pytest to run the full test suite under both conditions?
1043 shows that we should test with a processed-based dask cluster.
I've tried this by adding
client = dask.distributed.Client(n_workers=1, threads_per_worker=1)
toconftest.py
but I get segfaults in workers. Attaching GDB to the workers shows that the segfaults are in several numba gufuncs such ascount_alleles
andcohort_sum
. Deleting the__pycache__
will sometimes stop a particular test from failing, which is disconcerting!