microsoft / rat-sql

A relation-aware semantic parsing model from English to SQL
https://arxiv.org/abs/1911.04942
MIT License
406 stars 117 forks source link

0% accuracy during evaluation from trained model. - GLOVE #62

Open rkdey95 opened 2 years ago

rkdey95 commented 2 years ago

Hey guys,

I've downloaded and managed to preprocess and train the model for the problem.

Training was done using the GloVe configuration.

During training Accuracy and Loss was printed on screen.

However during evaluation, the results seem to show 0% accuracy. I noticed that during inferencing, the results from decoding came out as an empty list "[]".

Anyone faced this problem before? Appreciate any advise / workaround. Thanks.

I have also attached the .infer and .eval files in for reference.

glove_run_true_1-step30100.zip

manzambi11 commented 2 years ago

Please share the screenshot