Improvement: Improve general summarization pipeline

[rmusser01]

Title.

Whatever we can do to improve accuracy and speed of the summarization pipeline.

This issue can act as a tracker for ideas, approaches and information.

Articles:

Videos:

• [ ] https://www.youtube.com/watch?v=8OJC21T2SL4

Optimizing Whisper:

• [ ] https://github.com/Vaibhavs10/insanely-fast-whisper
• [ ] https://github.com/Vaibhavs10/optimise-my-whisper
• [ ] https://github.com/huggingface/distil-whisper
• [ ] https://huggingface.co/blog/asr-diarization

Flan-T5 Finetuning:

• [ ] https://huggingface.co/emonty777/QLoRA-Flan-T5-Small
• [ ] https://readmedium.com/simple-abstractive-text-summarization-with-pretrained-t5-text-to-text-transfer-transformer-10f6d602c426
• [ ] https://readmedium.com/mastering-ai-summarization-your-ultimate-productivity-hack-buildyourownai-cbd9e964dc65
• [ ] https://github.com/Erionis/Flan-T5-Summarization
• [ ] https://github.com/olonok69/LLM_Notebooks/blob/main/summarization/T5_base_Finetune_multi_news_summarization_v2_final.ipynb
• [ ] https://blog.eleuther.ai/pile-t5/
• [ ] https://www.philschmid.de/fine-tune-flan-t5
• [ ] https://arxiv.org/abs/2402.00841v2

Improving summarization approach:

• [ ] https://arxiv.org/abs/2309.04269

Unsorted Papers:

• [ ] https://arxiv.org/abs/2404.01588
• [ ] https://arxiv.org/abs/2406.11289
• [ ] https://aclanthology.org/2024.lrec-main.771/
• [ ] https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00632/119276/Benchmarking-Large-Language-Models-for-News
• [ ] https://arxiv.org/pdf/2406.11289
• [ ] https://arxiv.org/abs/2309.02654