tamas-visy / cs4nlp-plmrb

Other
0 stars 0 forks source link

More encodings of LMs #10

Closed V-G-spec closed 5 months ago

V-G-spec commented 5 months ago

After recent conversation with Yifan, we need the following encodings for all the models (or for as many as possible): The one after the embedding layer The one after the encoder bit of the model (For the few models which don't have the encoder-decoder architecture, anything from the middle layers would work) The final representation (If I understand correctly, this is what @noah already wrote the script for)

tamas-visy commented 5 months ago

More specifically, we could use any numerical representation from the model, so any embedding between the initial embedding and the final representation could be investigated.