search

WHU-Sigma / HyperSIGMA

The official repo for the paper "HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model"
142 stars 12 forks source link

Standardise number of GPU Used? #7

Closed kowo1001 closed 2 weeks ago

kowo1001 commented 2 months ago

Hello, I have three questions.

From the paper 32, 64, 128 NVIDIA V100 GPUs, are used.

(1) I'm trying to make spec-vit-base-ultra-checkpoint-1599.pth, spat-vit-base-ultra-checkpoint-1599.pth foundation model. Specifically, when can I download HyperGlobal-450K dataset?

(2) How many NVIDA A100 80GB do you think you need to make spec-vit-base-ultra-checkpoint-1599.pth, spat-vit-base-ultra-checkpoint-1599.pth?

(3) How many NVIDIA A100 80GB GPUs do you think each of ViT versions(base, large, and huge) should have?

Any help is highly appreciated ;)

Thanks!

DotWang commented 2 months ago

@kowo1001 For (1), please see https://github.com/WHU-Sigma/HyperSIGMA/issues/2 For (2)(3), the GPUs that we used have 16GB, so you can manually estimate it.