facebookresearch / TaBERT

This repository contains source code for the TaBERT model, a pre-trained language model for learning joint representations of natural language utterances and (semi-)structured tables for semantic parsing. TaBERT is pre-trained on a massive corpus of 26M Web tables and their associated natural language context, and could be used as a drop-in replacement of a semantic parsers original encoder to compute representations for utterances and table schemas (columns).
Other
580 stars 63 forks source link

Converting the Pytorch tabert model to Tensorflow #3

Open wentinghome opened 3 years ago

wentinghome commented 3 years ago

Hi, Thanks for publishing the code.

I'm trying to map the weight of tabert to my tensorflow version bert model. I'm wondering if the tabert model has the same BERT structure from Huggingface BERT? If yes, have you tried to use the script to convert the model?

Thanks!