Open gurvindersingh opened 4 years ago
Hi there, Thanks for opening this issue! I do have a few scripts for visualizing the attention weights and the beam search process in Transformers model in fairseq. But I made them by hacking into the model's implementation, so it requires installing and modifying fairseq's source code locally. I can send them to you if you are interested. :)
Sure, I can give it a try.
@player-eric Thanks for your work! I am really interested in visualizing fairseq nmt attention weight. I wonder if I can get your help with fairseq nmt visualizing attention solution. Thanks ahead!
Thanks for the useful tool. I am wondering if you have example of using fariseq model e.g. EN-DE and visualize its attention, embedding and Beam search. If no, then can you suggest as any starting point to start implementing such support.