Open rusheb opened 1 year ago
@rusheb what's the status on this?
I'd love to contribute to this..
Hi Tim, I think the work is up for grabs if you are keen. Probably worth checking with @jbloomAus what his priorities are and spinning out a ticket for anything you decide to work on.
I'm happy to discuss specifics if that would be helpful.
Proposal
This ticket documents enhancements to BERT support in TransformerLens, following on from issue #258, which were out of scope for the MVP (PR #276).
These items can be prioritised and spun into separate tickets as necessary.
demos/BERT.ipynb
). The notebook should includeW_U
,b_u
,W_E
, etc)Checklist