-
multiprocessing.Pool has a handy initializer parameter to pass a callable for setting up per-process resources (database connections, loggers, etc) but joblib doesn't expose a way to pass this.
I see…
-
Is there any support for profiling multiple processes? Right now profiling code that uses multiprocessing gives me eg.
```
40.909 update_basketball_events_db db_updater/events.py:38
└─ 40.855 map …
sYnfo updated
3 years ago
-
Hi,
When we have large number of time series to forecast like say above 150K then below steps take lot of time.
```
forecasts = list(forecast_it)
tss = list(ts_it)
```
Does anyone know t…
-
Having a seperate issue but I'm having a tough time debugging as my debug statements (adding `breakpoint()` ) don't work seemingly because of the use of `joblib.parallel`. Maybe just a writeup in the…
visch updated
10 months ago
-
Hi,
I have a problem running the cosco on physical environment. I run it on VLAN mode. I don't have access to azure, AWS or any other famous cloud provider. I have access to 10 VMs with same resource…
-
I encountered the same problem when I ran
Node2Vec(G, dimensions = 64, q = 0.025, p = 4, workers = 4, num_walks = 1, walk_length = 5, weight_key = 'weight')**
```python-traceback
Traceback (mos…
-
A project can get in a state where it is impossible to build with sphinx-gallery:
https://readthedocs.org/projects/joblib/builds/6641437/
I think that I've already seen this on my own computer and…
-
Hi there,
Just stumbled upon this project: looks super-useful for reproducible science! I'm currently a collaborator on [PyPREP](https://github.com/sappelhoff/pyprep) (an MNE-Python reimplementatio…
-
I am observing a linear increase in disk-usage for an increasing number of tasks when working on `pandas.DataFrame` objects with `pandas.MultiIndex` indices. The problem disappears when using standard…
-
A large amount of the running time tends to be spent in `parse.makeIdentifiers()`, which is essentially a triple-nested `for` loop over blocks, sentences, and words.
Previously this was "resolved" …