DSPy : Synthetic Data Generator

TeamTonic / adapt-a-rag

a RAG retrieval application that adapts to its specific user and topic , so that it's purpose built everytime.

MIT License

12 stars 7 forks source link

DSPy : Synthetic Data Generator #20

Closed Josephrp closed 6 months ago

Josephrp commented 6 months ago

Issues

class SyntheticDataGenerator: is using default / ai generated code , and it will produce low quality outputs

Tasks

[x] #23
[ ] redo the prompts for synthetic data generation
[ ] run and debug

Mind-Interfaces commented 6 months ago

it could be worse.. far worse.. hides their work which model did you say? more like: up for three days straight engineering that, "nah bro.. came like that in the picture frame. ai gen probly."

Josephrp commented 6 months ago

prompts should be :

generate a question from the text snippet provided
generate a description using titles and subtitles in long form format in markdown format
json escape the results