Closed kasanari closed 4 years ago
Can't find them either, could you please help us out?
You can find them in train_multihead.py on line 92 and 93. Let me know if this is what you're looking for.
Thank you, I was looking for the embedding layers and with that info I managed to find them. They are on lines 618 and 619 in modeling_openai.py for anyone else who is looking for them.
In your report you mention using additional embeddings for emotions and actions. I can not find any reference to these in the source code. Are they missing, or named something non-obvious?