google-research / tapas

End-to-end neural table-text understanding models.
Apache License 2.0
1.15k stars 217 forks source link

Weird results when running custom question on Colab example #21

Closed eliwilner closed 4 years ago

eliwilner commented 4 years ago

Hello Again, I tried to create a simple question: "what is the average Points?" from the example table you published on the Colab notebook. I got the Column 'Points' just printed out. I tried both base and large models and the results didn't change.

Any thoughts?

eisenjulian commented 4 years ago

The SQA model used in the example is not trained with the options to do aggregations, because the dataset only uses answers within the table, you would have to used a model trained on WikiTableQuestions instead, for example.

mdmustafizurrahman commented 4 years ago

Can you share the model trained on WikiTableQuestion. please? Because I tried all base models that you shared and got error like this tensorflow.python.framework.errors_impl.NotFoundError: Key column_output_bias not found in checkpoint

sbhttchryy commented 4 years ago

Hello, could you please make the pretrained checkpoint available for WikiTQ? Thank you very much.