Removed the dependency on fastchat, which fixes a lockfile generation down the line due to a chain of imports ending in a library (wavedrom) with bad metadata / setup file.
For now I just imported one single script from an older version of the library, then we'll get rid of it for good as prometheus only needs llama-2 conversation template
What's changing
Removed the dependency on fastchat, which fixes a lockfile generation down the line due to a chain of imports ending in a library (wavedrom) with bad metadata / setup file.
For now I just imported one single script from an older version of the library, then we'll get rid of it for good as prometheus only needs llama-2 conversation template
How to test it
lm-buddy evaluate prometheus --config <a valid config file>(more details in https://asciinema.org/a/FiYe21Ld7vRv7ouwcVtIRIdB8) - tested locally and workingpytest