delphi-suite / delphi

small language models training made easy
Apache License 2.0
9 stars 1 forks source link

setup + requirements deps in pyproject.toml; transformers to 4.39.2 #100

Closed jaidhyani closed 6 months ago

jaidhyani commented 6 months ago

This makes it possible to install delphi using pip without needing to install requirements separately. Requirements are now specified in pyproject.toml, and these are used by both pip and requirements.txt.

jaidhyani commented 6 months ago

Tested with:

pip install git+https://github.com/delphi-suite/delphi.git@dependencies_update

jaidhyani commented 6 months ago

Tested the optional cuda packages with:

pip install "git+https://github.com/delphi-suite/delphi.git@dependencies_update#egg=delphi[cuda]" (this is apparently the simplest syntax for installing an optional set of extra requirements from a package over git)

Fails as expected on mac...which means it's working.