datadreamer-dev / DataDreamer

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤
https://datadreamer.dev
MIT License
724 stars 39 forks source link

Adding Progress Bar #32

Open kaifronsdal opened 3 days ago

kaifronsdal commented 3 days ago

Currently datadreamer seems to rely on occasional messages to indicate the current progress/amount of time left such as:

Step '********' progress: 90% 🔄 (Estimated time left: 28 secs)

However, it would be nice to have the option of using a progress bar instead such as tqdm (which can also display other information such as loss/error rates during finetuning) that other libraries like HuggingFace Trainers use. Right now, there isn't even a way to reenable model's default progress bar if desired. For instance, the vLLM wrapper hardcodes use_tqdm=False.