search

PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.71k stars 2.86k forks source link

[WIP] Support unified checkpoint for expert_parallel #8591

Open DesmonDay opened 2 weeks ago

DesmonDay commented 2 weeks ago

PR types

New features

PR changes

Others

Description

Support unified checkpoint for expert_parallel.

paddle-bot[bot] commented 2 weeks ago

Thanks for your contribution!

codecov[bot] commented 2 weeks ago

Codecov Report

Attention: Patch coverage is 4.00000% with 120 lines in your changes missing coverage. Please review.

Project coverage is 55.74%. Comparing base (4e3f60d) to head (c555c30). Report is 48 commits behind head on develop.

Files Patch % Lines
paddlenlp/trainer/plugins/unified_checkpoint.py 4.00% 120 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #8591 +/- ## =========================================== + Coverage 53.86% 55.74% +1.88% =========================================== Files 620 620 Lines 97110 96741 -369 =========================================== + Hits 52306 53930 +1624 + Misses 44804 42811 -1993 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.