wilson1yan / VideoGPT

MIT License
962 stars 115 forks source link

Questions about downsample and codebook #36

Open qklee-lz opened 1 year ago

qklee-lz commented 1 year ago

Hello, in videoGPT, if I use the ucf101 dataset for training and change the model stride (such as 2x16x16). Will the dimensions of the codebook change accordingly? If it changes, do I need to set any hyperparameters during training, or just set --downsample 2 16 16?