search

jpWang / LiLT

Official PyTorch implementation of LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding (ACL 2022)
MIT License
335 stars 40 forks source link

Is LiLT-Large possible? #29

Closed logan-markewich closed 1 year ago

logan-markewich commented 1 year ago

Is it possible to build LiLT using RoBERTa large? From my understanding, that would also have to be pre-trained before fine tuning as well.

Is this something you are able to publish? It would be very helpful for improving LiLT's accuracy 🙏🏻

logan-markewich commented 1 year ago

I see this is already addressed, whoops