search

VikParuchuri / textbook_quality

Generate textbook-quality synthetic LLM pretraining data
MIT License
461 stars 46 forks source link

Generate ABAP code examples and train a LLAMA code using it #7

Closed allthingssecurity closed 9 months ago

allthingssecurity commented 9 months ago

Hi, Can I use it to generate ABAP code with quality and use it to for finetuning code LLAMA model. How do I generate samples in instruction format?

VikParuchuri commented 9 months ago

This is only for pretraining data - it creates data that is formatted like a textbook