VikParuchuri / textbook_quality

Generate textbook-quality synthetic LLM pretraining data
MIT License
488 stars 50 forks source link

Generate ABAP code examples and train a LLAMA code using it #7

Closed allthingssecurity closed 1 year ago

allthingssecurity commented 1 year ago

Hi, Can I use it to generate ABAP code with quality and use it to for finetuning code LLAMA model. How do I generate samples in instruction format?

VikParuchuri commented 1 year ago

This is only for pretraining data - it creates data that is formatted like a textbook