PaddlePaddle / PaddleNLP

πŸ‘‘ Easy-to-use and powerful NLP and LLM library with πŸ€— Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including πŸ—‚Text Classification, πŸ” Neural Search, ❓ Question Answering, ℹ️ Information Extraction, πŸ“„ Document Intelligence, πŸ’Œ Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
12k stars 2.93k forks source link

Add ReFT #8582

Closed TranscenderNing closed 2 months ago

TranscenderNing commented 3 months ago

PR types

New features

PR changes

Add main ReFT api in paddlenlp/reft Add test things in llm/test-loreft

Description

paper: ReFT: Representation Finetuning for Language Models test results: 图片1

paddle-bot[bot] commented 3 months ago

Thanks for your contribution!

CLAassistant commented 3 months ago

CLA assistant check
All committers have signed the CLA.