issues
search
VikParuchuri
/
textbook_quality
Generate textbook-quality synthetic LLM pretraining data
MIT License
461
stars
46
forks
source link
Switch to ray
#3
Closed
VikParuchuri
closed
9 months ago
VikParuchuri
commented
9 months ago
Use ray for multiprocessing
Dedup links
Save memory