Encoder-Decoder zero shot domain (skill), intent, and entity tagging NLU model with a zero-shot NLG for generating voice assistant responses. All in one!
Apache License 2.0
1
stars
0
forks
source link
Analysis: Literature Search for Encoder-Decoder vs Decoder-Only Models #7
Use an LLM to perform a literature search and identify key papers discussing encoder-decoder vs decoder-only models, T5, and model scaling for efficiency. Summarize findings and prepare citations for the analysis.We want to focus on smaller-sized models, over scaling to bigger models where it is clear that decoder-only dominates.
Questions
Are there particular areas where encoder-decoder models have been shown to significantly outperform decoder-only models for similar tasks? (smaller models)
DoD
[ ] Use AI to conduct a literature search.
[ ] Identify 3-5 key papers related to the use of encoder-decoder models.
Description
Use an LLM to perform a literature search and identify key papers discussing encoder-decoder vs decoder-only models, T5, and model scaling for efficiency. Summarize findings and prepare citations for the analysis.We want to focus on smaller-sized models, over scaling to bigger models where it is clear that decoder-only dominates.
Questions
DoD