Job running / progress bar enhancements

expectedparrot / edsl

Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.

https://docs.expectedparrot.com

MIT License

189 stars 19 forks source link

Job running / progress bar enhancements #1081

Open johnjosephhorton opened 1 month ago

johnjosephhorton commented 1 month ago

[x] Batching of interview tasks to create smoother progress bar
[ ] Refactor report generation calling / remove failing question stuff
[x] Run jobs and progress bar in separate threads
[x] Enhanced visual progress display with better layout
[x] Graceful keyboard interrupt exit
[ ] Adjust TPM / RPM is lots of bad model responses

johnjosephhorton commented 1 month ago

[ ] Don't replicate token buckets if being shared across models
[ ] Give option to consolidate or keep models separate
[ ] Make progress components scriptable

johnjosephhorton commented 1 month ago

Notes: Abandoning current progress_bar_improvement PR and trying again. Reason: Introduction of thread to monitor job or possibly an issue relating to Notebook even loop is causing hard-to-debug issues. Going to pull out the "good" parts of the PR, test and try again.