Zak-Hussain / againstJustaism

4 stars 0 forks source link

Are Emergent Abilities in Large Language Models just In-Context Learning? #1

Open KnutJaegersberg opened 3 months ago

KnutJaegersberg commented 3 months ago

Are Emergent Abilities in Large Language Models just In-Context Learning?

This paper suggests that emergence is the "result from a combination of in-context learning, model memory, and linguistic knowledge".

https://arxiv.org/abs/2309.01809#

Zak-Hussain commented 2 weeks ago

Thanks for sharing (and sorry for the late response)! Looks like an interesting paper. However, given the substantial and empirical nature of the work, I wouldn't classify it as "Justaic".