search

mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.99k stars 525 forks source link

Make the exceptions serializable #1239

Closed dakinggg closed 4 months ago

dakinggg commented 4 months ago

In order for our custom exceptions to propagate correctly from a multiprocessing context, they need to be serializable. This PR does that, and adds a unit test to confirm that all our custom exceptions are serializable.

Based on https://github.com/mosaicml/llm-foundry/pull/1233