PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.71k stars 2.86k forks source link

[NPU][LLM] add README & reformat llama scripts #8642

Closed SylarTiaNII closed 1 week ago

SylarTiaNII commented 1 week ago

PR types

Others

PR changes

Others

Description

add README for llama training/inference on NPU(910)

paddle-bot[bot] commented 1 week ago

Thanks for your contribution!

codecov[bot] commented 1 week ago

Codecov Report

Attention: Patch coverage is 0% with 1 line in your changes missing coverage. Please review.

Project coverage is 55.81%. Comparing base (65e721e) to head (5419849).

:exclamation: Current head 5419849 differs from pull request most recent head 7ab4a98

Please upload reports for the commit 7ab4a98 to get more accurate results.

Files Patch % Lines
paddlenlp/transformers/mc2_parallel_linear.py 0.00% 1 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #8642 +/- ## =========================================== + Coverage 55.80% 55.81% +0.01% =========================================== Files 620 620 Lines 96642 96599 -43 =========================================== - Hits 53928 53917 -11 + Misses 42714 42682 -32 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

onecatcn commented 1 week ago

LGTM

ronny1996 commented 1 week ago

https://github.com/PaddlePaddle/PaddleNLP/blob/develop/llm/predict/export_model.py#L104 这里帮忙改成

from npu.llama.export_utils import process_params