mozilla-ai / lm-buddy

Your buddy in the (L)LM space.
Apache License 2.0
64 stars 3 forks source link

Pin all libraries #116

Open aittalam opened 1 month ago

aittalam commented 1 month ago

Some of the libs we use (e.g. HF evaluate) depend on other libs which are not direct deps for us without pinning them (in the specific case of nltk, evaluate does not even include it as a dep but will just warn you to install it if you try to use e.g. meteor without having it installed). As a result, we cannot guarantee stability (the nltk case made this evident). To fix this, we should test our code to make sure our current set of dependencies is stable and then pin all dependencies, even indirect ones.