google-research / tapas

End-to-end neural table-text understanding models.
Apache License 2.0
1.15k stars 217 forks source link

How do I put my output of the bert into the tapas? #59

Closed lairikeqiA closed 4 years ago

lairikeqiA commented 4 years ago

I plan to use the output of my bert to replace the output of the bert of tapas. Where should I input the output of my bert into tapas?

ghost commented 4 years ago

I am not entirely following. With some simplification we have:

TAPAS: input > Bert (with special embeddings) | Answer selection > outputs

I understand you want to replace the BERT model with a custom one but use our answer selection loss?

If your custom BERT model only differs in the parameters you can just load it. You might have to disable the special embeddings (row, column, numeric ranks).

If you have a different Bert implementation you might have to chance some code. This is where we create the Bert model in the code.

eisenjulian commented 4 years ago

Will close this one for the time being, please reopen if there are further questions or clarifications.