How to visualize attention in Bert ?

strongio / keras-bert

A simple technique to integrate BERT from tf hub to keras

258 stars 108 forks source link

How to visualize attention in Bert ? #13

Closed PradyumnaGupta closed 5 years ago

PradyumnaGupta commented 5 years ago

Can you please suggest a way I can visualize the attention mechanism of Bert while using your code ( I mean while using Tensorflow Hub for the weights ) ?

PradyumnaGupta commented 5 years ago

Got it !!!