PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.71k stars 2.86k forks source link

[bug fix] fix sharding stage1 allgather overlap bug, which needs to forbiden pin memory #8594

Closed iosmers closed 2 weeks ago

iosmers commented 2 weeks ago

PR types

Bug fixes

PR changes

Others

Description

1、sharding stage overlap不能正确生效,原因是没有禁用pin memory 2、必须使用paddle.io.reader 里的 use_pinned_memory, paddle.io.base里面的use_pinned_memory(False)无法生效,原因未知

paddle-bot[bot] commented 2 weeks ago

Thanks for your contribution!

codecov[bot] commented 2 weeks ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 54.40%. Comparing base (5bdf751) to head (09449fc). Report is 9 commits behind head on develop.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #8594 +/- ## =========================================== - Coverage 54.42% 54.40% -0.02% =========================================== Files 632 632 Lines 99451 99495 +44 =========================================== + Hits 54129 54134 +5 - Misses 45322 45361 +39 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.