huggingface / swift-coreml-transformers

Swift Core ML 3 implementations of GPT-2, DistilGPT-2, BERT, and DistilBERT for Question answering. Other Transformers coming soon!
Apache License 2.0
1.62k stars 179 forks source link

Using the "past" flag in CoreML? #20

Open jbmaxwell opened 4 years ago

jbmaxwell commented 4 years ago

I was just reading about the past flag, for caching state, and wondered whether it's possible to use that in CoreML? Also, is this repo still active, or has CoreML 4 (and the new pytorch->CoreML conversion tools) kind of eclipsed the work being done here? I'm using your GPT2, trained on custom data, and would be curious about experimenting with XLNet, but activity here seems pretty quiet... ?