search

PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.71k stars 2.86k forks source link

[PaddleNLP 3.0] update dataset preprocess #8629

Closed DrownFish19 closed 1 week ago

DrownFish19 commented 1 week ago

PR types

Others

PR changes

Others

Description

from legacy/model_zoo/ernie-1.0 move dataset preprocess to llm/tools

paddle-bot[bot] commented 1 week ago

Thanks for your contribution!

codecov[bot] commented 1 week ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 55.25%. Comparing base (7318273) to head (87d6b33).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #8629 +/- ## ======================================== Coverage 55.25% 55.25% ======================================== Files 620 620 Lines 96556 96556 ======================================== Hits 53349 53349 Misses 43207 43207 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.