search

jpWang / LiLT

Official PyTorch implementation of LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding (ACL 2022)
MIT License
335 stars 40 forks source link

large checkpoint #24

Closed saetlan closed 1 year ago

saetlan commented 1 year ago

Hello, Thanks for making the code available !

I was wondering if there was a lilt-only-large checkpoint available or a way to easily generate it ? I would like to try to combine lilt with a large xlm Roberta to see the potential gain between base and large.

Thanks !

jpWang commented 1 year ago

Hi, due to the limitation of computing resources, we haven't trained the large LiLT model yet. It is considered for future work.

logan-markewich commented 1 year ago

+1 for training LiLT-Large 👍🏻