search

konabuta / my-scratch-book

MIT License
1 stars 0 forks source link

Small Language Model #10

Open konabuta opened 8 months ago

konabuta commented 8 months ago

Small Language Model

konabuta commented 8 months ago

Microsoft Research developed 3 models (phi-1, phi-1.5, and phi-2).

phi-1

Paper: Textbooks Are All You Need

phi-1.5

Paper: Textbooks Are All You Need II: phi-1.5 technical report

phi-2

Blog: Phi-2: The surprising power of small language models