Hi, how many hours needed for one pretrain process using 10 Nvidia A5000?

taokz / BiomedGPT

BiomedGPT: A Unified and Generalist Biomedical Generative Pre-trained Transformer for Vision, Language, and Multimodal Tasks

Apache License 2.0

364 stars 34 forks source link

Closed Ruiyuan-Zhang closed 8 months ago

Ruiyuan-Zhang commented 8 months ago

See title.

taokz commented 8 months ago

Hi @Ruiyuan-Zhang

Base: approximately 87 hours Medium: around 32 hours Small: 8.7 hours

Ruiyuan-Zhang commented 8 months ago

Thx, (～￣▽￣)～