Fix bugs and improve usability - Githubissues

VikParuchuri / textbook_quality

Generate textbook-quality synthetic LLM pretraining data

MIT License

461 stars 46 forks source link

Fix bugs and improve usability #2

Closed VikParuchuri closed 9 months ago

VikParuchuri commented 9 months ago

Add multiple threads per worker
Retry concepts and outlines
Enable more concurrency