search

google-research / albert

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Apache License 2.0
3.24k stars 569 forks source link

Finetune on RACE #55

Closed ViktorAlm closed 4 years ago

ViktorAlm commented 4 years ago

Hello!

I would like to try ALBERT on a Swedish equivalent to the SAT. One part is very similar to RACE: https://www.studera.nu/hogskoleprov/fpn/elf-exempelprov/

I think I will be able to extract about 1600 samples to try it on, I have found some examples on BERT and others but I would really prefer to run it on Albert. Is there any plan to release a finetuning script on the race-task? It would be fun to see how it compares to the average Swede.

Happy New Years!

ViktorAlm commented 4 years ago

Thank you very much for the update! Will try it out