search

illinois-or-research-analytics / cm_pipeline

Pipeline that uses an improved version of CM for generating well-connected clusters
GNU General Public License v3.0
5 stars 4 forks source link

Parallel limit #24

Closed chackoge closed 1 year ago

chackoge commented 1 year ago

In pipeline.json

{ "name": "clustering", "parallel_limit": 2 },

seems to spawn 5 parallel clustering jobs one for each resolution in "resolution": [0.5, 0.1, 0.01, 0.001, 0.0001], I don't have an MWE handy sorry. It should be easy enough to test on a small network. Setting parallel_limit to 1 results in sequential behavior

vikramr2 commented 1 year ago

Applied the fix to this issue

vikramr2 commented 1 year ago

Now parallel limits will actually be enforced