Nixtla / neuralforecast

Scalable and user friendly neural :brain: forecasting algorithms.
https://nixtlaverse.nixtla.io/neuralforecast
Apache License 2.0
2.75k stars 316 forks source link

multi-node distributed training with spark #935

Closed jmoralez closed 3 months ago

jmoralez commented 4 months ago

Adds the functionality to perform distributed data parallel training with spark. The logic is as follows:

There were a couple of challenges:

Also makes the following change, which isn't strictly necessary and could be made in a separate PR:

review-notebook-app[bot] commented 4 months ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB