Closed lairikeqiA closed 4 years ago
I am not entirely following. With some simplification we have:
TAPAS: input > Bert (with special embeddings) | Answer selection > outputs
I understand you want to replace the BERT model with a custom one but use our answer selection loss?
If your custom BERT model only differs in the parameters you can just load it. You might have to disable the special embeddings (row, column, numeric ranks).
If you have a different Bert implementation you might have to chance some code. This is where we create the Bert model in the code.
Will close this one for the time being, please reopen if there are further questions or clarifications.
I plan to use the output of my bert to replace the output of the bert of tapas. Where should I input the output of my bert into tapas?