akiwarheit / mads-capstone-project

0 stars 0 forks source link

Model Exploration #11

Open akiwarheit opened 2 weeks ago

akiwarheit commented 2 weeks ago

The goal is to explore different models & to determine what metric to use to measure & compare.

https://github.com/microsoft/generative-ai-for-beginners/blob/main/02-exploring-and-comparing-different-llms/README.md?WT.mc_id=academic-105485-koreyst

Tutorials on training

Hugging face has great tutorials for training question answering transformer models - we can use this as reference.

https://huggingface.co/docs/transformers/main/en/index https://huggingface.co/docs/transformers/en/tasks/question_answering

Some inspirations:

T5

https://huggingface.co/docs/transformers/en/model_doc/t5#transformers.T5ForQuestionAnswering