Make sharding_first by default

PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.

https://paddlenlp.readthedocs.io

Apache License 2.0

11.71k stars 2.86k forks source link

Make sharding_first by default #8638

Closed sneaxiy closed 1 week ago

sneaxiy commented 1 week ago

PR types

Others

PR changes

Others

Description

Make sharding_first for hybrid_parallel_topo_order by default.

paddle-bot[bot] commented 1 week ago

Thanks for your contribution!