search

IBM / SQL-to-Text

SQL-to-Text is a simple code for translating SQL to Text Generation with a novel Graph-to-Sequence Model
Apache License 2.0
72 stars 23 forks source link

Few questions on paper and implementation #3

Open yoongi0428 opened 5 years ago

yoongi0428 commented 5 years ago

First of all, thanks for your nice work and code. I have several questions on the paper and code.

  1. Can you elaborate more on measuring with BLEU-4? BLEU has many smoothing methods and measuring ways. Also many packages and codes. But I don't see any BLEU on this repo nor Graph2Seq repo. I want to try it myself so I'm asking this question.

  2. In the paper, Seq2Seq baseline has a template. How exactly and is dealt with? Take pretrained word embedding of word 'max' for MAX?

  3. I think there are a lot of OOV words in WikiSQL dataset, expecially in condition values. If you use pretrained GloVe, then how did you handle that?

Thank you.

311dada commented 4 years ago

I also want to know which BLEU-4 evaluation script is used. There is a large gap between my implementation and the result in paper.