ServiceNow / picard

PICARD - Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models. PICARD is a ServiceNow Research project that was started at Element AI.
https://arxiv.org/abs/2109.05093
Apache License 2.0
342 stars 122 forks source link

Add Spider-realistic #59

Closed tscholak closed 2 years ago

tscholak commented 2 years ago

See https://zenodo.org/record/5205322#.Ygpi3S-B0Xw

kotalaraghava commented 2 years ago

Hey @tscholak, I would like to take up this issue and contribute.

I suppose I need to add spider_realistic.py at [picard/seq2seq/datasets/] and

some straight-forward code here: [picard/seq2seq/utils/dataset_loader.py]

Since it is only used for evaluation I need to test it while calling the evaluation module only.

Is that it ? or any other changes?

Thanks, Raghav

tscholak commented 2 years ago

Hi Raghav, Yes, that sounds about right! Looking forward to your contribution!

tscholak commented 2 years ago

support added by #69