search

naver / croco

Other
304 stars 30 forks source link

Cannot find cuda-compiled version of RoPE2D #32

Open nobeldang opened 3 weeks ago

nobeldang commented 3 weeks ago

Hi, whenever I try to use the croco model it says as a warning: "Warning, cannot find cuda-compiled version of RoPE2D, using a slow pytorch version instead." Does this mean that the model is not using the RoPE2D embeddings but rather the cosine embeddings? If so can you provide any suggestions on how to resolve that?

yocabon commented 3 weeks ago

Hi, no you are still using RoPE2D.

It means you are using this implementation: https://github.com/naver/croco/blob/master/models/pos_embed.py#L110 instead of https://github.com/naver/croco/blob/master/models/curope/curope2d.py#L32

Install instructions are written in the README: https://github.com/naver/croco/tree/master?tab=readme-ov-file#preparation ; 2. Compile cuda kernels for RoPE