Emergent Abilities of Large Language Models

[jinmang2]

집현전 최신반 스터디

• 2022년 7월 3일 일요일 10시
• 김유빈님 오수지님
• 논문 링크: https://arxiv.org/abs/2206.07682

Abstract

Scaling up language models has been shown to predictably improve performance and sample efficiency on a wide range of downstream tasks. This paper instead discusses an unpredictable phenomenon that we refer to as emergent abilities of large language models. We consider an ability to be emergent if it is not present in smaller models but is present in larger models. Thus, emergent abilities cannot be predicted simply by extrapolating the performance of smaller models. The existence of such emergence implies that additional scaling could further expand the range of capabilities of language models.

[eubinecto]

발표자료 첨부합니다~! 집현전_7조_220703.pdf

[jinmang2]

• 발표링크: https://www.youtube.com/watch?v=xHbOZC79Ag4&list=PL2tRglRS_GqivYoDuzLNo_HezOvh4Z1XN&index=13