update pvt model - Githubissues

hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI

Apache License 2.0

334 stars 102 forks source link

update pvt model #74

Closed boyagesmile closed 2 years ago

binmakeswell commented 2 years ago

Hi @boyagesmile , thanks for your contribution. It looks like that the PVT example does not support main features of Colossal-AI, eg. tensor/data/pipeline parallel, ZeRO, etc. More details about features, usage, explanation, and validation can been added in REAME.

binmakeswell commented 2 years ago

This PR is closed due to inactivity.