[Hivemind ETL] Discord Summarization prompt fine tuning - Githubissues

TogetherCrew / airflow-dags

1 stars 1 forks source link

[Hivemind ETL] Discord Summarization prompt fine tuning #81

Closed amindadgar closed 7 months ago

amindadgar commented 8 months ago

Here's the notion document to do it: https://www.notion.so/rndadocs/Summarization-Prompt-Finetuning-beedd8dc459148ae825096252cd33963

And the tasks lists in summary

[x] Raw data summarizing prompt update
[x] Separate each summary bullet point and save each as a llama-index document
[x] Update the summary document’s metadata
[x] Thread name update for channel summarizer (in case it was None, use "Main channel")