macanv / BERT-BiLSTM-CRF-NER

Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services
https://github.com/macanv/BERT-BiLSMT-CRF-NER
4.68k stars 1.25k forks source link

input_idx #334

Closed whao1011 closed 4 years ago

whao1011 commented 4 years ago

请问一下,模型输入中有个input_idx,这个是输入数据的id表示,用它来寻找自己的词向量吗,那id怎么和词向量一一对应的,id是如何生产的呢。

macanv commented 4 years ago

id 是根据词表来产生的,预训练的时候,每个char的ID已经固定了。可以类别word2vec的embedding_lookup