Implement BERT, ElMo and ULMFit - Transfer learning for NLP models

mratsim / Arraymancer

A fast, ergonomic and portable tensor library in Nim with a deep learning focus for CPU, GPU and embedded devices via OpenMP, Cuda and OpenCL backends

https://mratsim.github.io/Arraymancer/

Apache License 2.0

1.34k stars 96 forks source link

Implement BERT, ElMo and ULMFit - Transfer learning for NLP models #268

Open mratsim opened 6 years ago

mratsim commented 6 years ago

See fast.ai

announcement: http://nlp.fast.ai/classification/2018/05/15/introducting-ulmfit.html
paper: https://arxiv.org/abs/1801.06146
course: http://course.fast.ai/lessons/lesson10.html

mratsim commented 6 years ago

A new paper on pre-trained language model: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding and discussion