PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.71k stars 2.86k forks source link

xpu devices support llama-7b basic mode inference (turn on BlockAtten… #8588

Closed zhink closed 2 weeks ago

zhink commented 2 weeks ago

…tion)

PR types

New features

PR changes

Others

Description

xpu devices support llama-7b basic mode inference (turn on BlockAttention)

paddle-bot[bot] commented 2 weeks ago

Thanks for your contribution!

codecov[bot] commented 2 weeks ago

Codecov Report

Attention: Patch coverage is 0% with 31 lines in your changes missing coverage. Please review.

Project coverage is 54.41%. Comparing base (525eef7) to head (8717c5e). Report is 2 commits behind head on develop.

Files Patch % Lines
...erimental/transformers/fused_transformer_layers.py 0.00% 11 Missing :warning:
...enlp/experimental/transformers/generation_utils.py 0.00% 9 Missing :warning:
...dlenlp/experimental/transformers/llama/modeling.py 0.00% 3 Missing :warning:
...dlenlp/experimental/transformers/bloom/modeling.py 0.00% 2 Missing :warning:
...ddlenlp/experimental/transformers/qwen/modeling.py 0.00% 2 Missing :warning:
...enlp/experimental/transformers/chatglm/modeling.py 0.00% 1 Missing :warning:
...p/experimental/transformers/chatglm_v2/modeling.py 0.00% 1 Missing :warning:
...addlenlp/experimental/transformers/gpt/modeling.py 0.00% 1 Missing :warning:
...addlenlp/experimental/transformers/opt/modeling.py 0.00% 1 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #8588 +/- ## =========================================== - Coverage 54.42% 54.41% -0.02% =========================================== Files 632 632 Lines 99451 99470 +19 =========================================== Hits 54129 54129 - Misses 45322 45341 +19 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.