search

Unbabel / COMET

A Neural Framework for MT Evaluation
https://unbabel.github.io/COMET/html/index.html
Apache License 2.0
441 stars 72 forks source link

[QUESTION] why num_layers = num_hidden_layers + 1 #214

Closed vince62s closed 2 months ago

vince62s commented 2 months ago

What is the reason for this ?

here: https://github.com/Unbabel/COMET/blob/master/comet/encoders/bert.py#L67

thanks.

ricardorei commented 2 months ago

Hi @vince62s yes because the config does not account for the embeddings, yet the representations are returned when you set output_hidden_states=True.