Question about object queries.

[AjibolaPy]

I've gone through the code. I learned that object queries are nn.Embedding weights and zeros matrixes are added if you wish to add positional Embedding.

My confusion/question is are the embeddings trainable since it is a weight of the embedding layer?

[quamernasim]

I had the same confusion. I checked, embedding weights are not being updated

EDIT: I rechecked and embedding weights are indeed changing

[MLDeS]

In the Colab notebook, it is initialized as nn.parameter. Also, this should be learnable, right? That's the point of the paper, that they use learnable queries. How did you verify that they are not updated?

[AjibolaPy]

In the Colab notebook, it is initialized as nn.parameter. Also, this should be learnable, right? That's the point of the paper, that they use learnable queries. How did you verify that they are not updated?

Since the weight are learnt weight. Then they should will be updated every step. You said nn.parameter, they didn't use Embedding layer?

[quamernasim]

sorry about the confusion guys. Someday later after posting this comment, I revisited the detr and saw that indeed the query weights are changing and hence learnt. In the colab they used this nn.parameter but in the actual implementation they have used nn.Embeddings