search

facebookresearch / TaBERT

This repository contains source code for the TaBERT model, a pre-trained language model for learning joint representations of natural language utterances and (semi-)structured tables for semantic parsing. TaBERT is pre-trained on a massive corpus of 26M Web tables and their associated natural language context, and could be used as a drop-in replacement of a semantic parsers original encoder to compute representations for utterances and table schemas (columns).
Other
580 stars 63 forks source link

How to replace BERT with TaBERT in a giving model? #18

Open mellahysf opened 3 years ago

mellahysf commented 3 years ago

Hi,

Supposing we have some model "M" with BERT as the representation of inputs (M+BERT), operated on some task.

The question is how to replace BERT with TaBERT? (to have M+TaBERT instead of M+BERT)?

Thanks,