search

sunnweiwei / AmbigPrompt

Answering Ambiguous Questions via Iterative Prompting
13 stars 2 forks source link

Missing link to WebQ data #1

Closed ameyagodbole closed 8 months ago

ameyagodbole commented 8 months ago

Hi,

I am attempting to recreate some of the results reported in the paper (especially results on the WebQ dataset). The publicly available WebQ dataset (downloaded from here) has a different number of train-dev-test examples than the statistics reported in your paper. For the sake of reproducibility and fair comparison to your work, could you please share your version of the dataset?

As a follow-up: did you train a separate reader + query generator model for WebQ?

Thanks for the great work! -- Ameya

sunnweiwei commented 8 months ago

Hi,

Sure, here is the webqsp dataset I used: https://drive.google.com/file/d/1t7u2zWtjJpywzw_SGun3fedwYlZ5e99q/view?usp=sharing

Yes I train separate model for each dataset.

ameyagodbole commented 8 months ago

Thank you for the prompt response!

Best, Ameya