LUKE is a transformer model that is especially good at question answering tasks, but the publicly available checkpoints on huggingface.co have not been fine-tuned for question answering yet. To make it possible to integrate this model into the scope pipeline, a script should be made to fine-tune the model on the Stanford Squad dataset and use the script to quickly train the model on the William and Mary HPC.
LUKE is a transformer model that is especially good at question answering tasks, but the publicly available checkpoints on huggingface.co have not been fine-tuned for question answering yet. To make it possible to integrate this model into the scope pipeline, a script should be made to fine-tune the model on the Stanford Squad dataset and use the script to quickly train the model on the William and Mary HPC.