Better scalability - Githubissues

VikParuchuri / textbook_quality

Generate textbook-quality synthetic LLM pretraining data

MIT License

461 stars 46 forks source link

Better scalability #10

Closed VikParuchuri closed 8 months ago

VikParuchuri commented 8 months ago

Reduce queries and load
Reduce length of finetuned model completions + prompts