delphi-suite / delphi

small language models training made easy
Apache License 2.0
8 stars 1 forks source link

find, implement & document auth solution for hf & wandb #121

Closed jettjaniak closed 1 month ago

jettjaniak commented 2 months ago

maybe we just don't pass tokens around and assume the user has them in env_variables / home dir? in this case we probably want to default to hf=True, wandb=True so it fails loudly if not provided, and has to be explicitly turned off

SrGonao commented 2 months ago

I agree

jettjaniak commented 1 month ago

HF fails loudly, TODO wandb

jettjaniak commented 1 month ago

actually, we should try to make a HF repo first and if it fails don't proceed with the training