search

whai362 / PVT

Official implementation of PVT series
Apache License 2.0
1.74k stars 246 forks source link

Question about cls token #100

Open eremo2002 opened 2 years ago

eremo2002 commented 2 years ago

Hi author! thanks for your nice work.

I have a question about cls token in PVT.

In ViT and DeiT, cls token is appended at input embedding process. But PVT append cls token at input of last stage.

Why PVT doesn't append cls token at input embedding process?

Thanks.

IwantNewway commented 6 months ago

Hi author! thanks for your nice work.

I have a question about cls token in PVT.

In ViT and DeiT, cls token is appended at input embedding process. But PVT append cls token at input of last stage.

Why PVT doesn't append cls token at input embedding process?

Thanks.

would u tell me placement where appended cls ?, i find here image