ariesssxu / vta-ldm

Apache License 2.0
45 stars 2 forks source link

线性层不加载参数会影响结果吗 #2

Closed lszhou0126 closed 3 months ago

lszhou0126 commented 3 months ago

class Clip4Video中,self.clip_vision这些都是加载预训练模型,self.linear_layer = nn.Linear(input_dim, embedding_dim)用的是随机初始化,而不是训练好的参数,是否会对结果造成影响

ariesssxu commented 3 months ago

inference的时候会load相应参数,train的时候需要重新训练