prediction during evaluation is empty

[trytomakeitwork]

Hi there! I am currently trying to run the snowball framework using the run_spider_large.sh, however the evaluation results for every epoch stored in saves/spider_snow_balllarge/generator/eval/epoch{}.json contains prediction results as empty strings like "pred": "". I did not modify any file within the framework, how can I possibly solve that? Thanks

ks

[Ciaranshu]

Hi there,

Many thanks for your question. I will try to reproduce this error and get back to you as soon as possible.

Best Regards,

Chang

From: trytomakeitwork @.> Date: Wednesday, December 8, 2021 at 2:39 PM To: Ciaranshu/relogic @.> Cc: Subscribed @.***> Subject: [Ciaranshu/relogic] prediction during evaluation is empty (Issue #1)

Hi there! I am currently trying to run the snowball framework using the run_spider_large.sh, however the evaluation results for every epoch stored in saves/spider_snow_balllarge/generator/eval/epoch{}.json contains prediction results as empty strings like "pred": "". I did not modify any file within the framework, how can I possibly solve that? Thanks [DEBAF81B-5DA7-401C-8E8A-6F968C6A73AD]https://user-images.githubusercontent.com/95738049/145160667-699bec7e-ff33-4a14-bb4e-e88da7c67e51.png ks

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/Ciaranshu/relogic/issues/1, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AFTNZMKRFBW4T5E6W3KDAXTUP34S7ANCNFSM5JTAQQUA. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

[trytomakeitwork]

Hi there, Many thanks for your question. I will try to reproduce this error and get back to you as soon as possible. Best Regards, Chang From: trytomakeitwork @.> Date: Wednesday, December 8, 2021 at 2:39 PM To: Ciaranshu/relogic @.> Cc: Subscribed @.***> Subject: [Ciaranshu/relogic] prediction during evaluation is empty (Issue #1) Hi there! I am currently trying to run the snowball framework using the run_spider_large.sh, however the evaluation results for every epoch stored in saves/spider_snow_balllarge/generator/eval/epoch{}.json contains prediction results as empty strings like "pred": "". I did not modify any file within the framework, how can I possibly solve that? Thanks [DEBAF81B-5DA7-401C-8E8A-6F968C6A73AD]https://user-images.githubusercontent.com/95738049/145160667-699bec7e-ff33-4a14-bb4e-e88da7c67e51.png ks — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#1>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AFTNZMKRFBW4T5E6W3KDAXTUP34S7ANCNFSM5JTAQQUA. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Hi there, thanks for your reply. I just tried using the latest version of bart large and it seems to function normally. Perhaps the recommended version mentioned in readme is no longer actively maintained.

[Ciaranshu]

Hi there, Many thanks for your question. I will try to reproduce this error and get back to you as soon as possible. Best Regards, Chang From: trytomakeitwork @.**> Date: Wednesday, December 8, 2021 at 2:39 PM To: Ciaranshu/relogic @.**> Cc: Subscribed @.***> Subject: [Ciaranshu/relogic] prediction during evaluation is empty (Issue #1) Hi there! I am currently trying to run the snowball framework using the run_spider_large.sh, however the evaluation results for every epoch stored in saves/spider_snow_balllarge/generator/eval/epoch{}.json contains prediction results as empty strings like "pred": "". I did not modify any file within the framework, how can I possibly solve that? Thanks [DEBAF81B-5DA7-401C-8E8A-6F968C6A73AD]https://user-images.githubusercontent.com/95738049/145160667-699bec7e-ff33-4a14-bb4e-e88da7c67e51.png ks — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#1>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AFTNZMKRFBW4T5E6W3KDAXTUP34S7ANCNFSM5JTAQQUA. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Hi there, thanks for your reply. I just tried using the latest version of bart large and it seems to function normally. Perhaps the recommended version mentioned in readme is no longer actively maintained.

Hi,

Good to hear.

Best, Chang

[trytomakeitwork]

Hi there, Many thanks for your question. I will try to reproduce this error and get back to you as soon as possible. Best Regards, Chang From: trytomakeitwork @.**> Date: Wednesday, December 8, 2021 at 2:39 PM To: Ciaranshu/relogic @.**> Cc: Subscribed @.***> Subject: [Ciaranshu/relogic] prediction during evaluation is empty (Issue #1) Hi there! I am currently trying to run the snowball framework using the run_spider_large.sh, however the evaluation results for every epoch stored in saves/spider_snow_balllarge/generator/eval/epoch{}.json contains prediction results as empty strings like "pred": "". I did not modify any file within the framework, how can I possibly solve that? Thanks [DEBAF81B-5DA7-401C-8E8A-6F968C6A73AD]https://user-images.githubusercontent.com/95738049/145160667-699bec7e-ff33-4a14-bb4e-e88da7c67e51.png ks — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#1>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AFTNZMKRFBW4T5E6W3KDAXTUP34S7ANCNFSM5JTAQQUA. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Hi there, thanks for your reply. I just tried using the latest version of bart large and it seems to function normally. Perhaps the recommended version mentioned in readme is no longer actively maintained.

Hi,

Good to hear.

Best, Chang

Hi there, Many thanks for your question. I will try to reproduce this error and get back to you as soon as possible. Best Regards, Chang From: trytomakeitwork @.**> Date: Wednesday, December 8, 2021 at 2:39 PM To: Ciaranshu/relogic @.**> Cc: Subscribed @.***> Subject: [Ciaranshu/relogic] prediction during evaluation is empty (Issue #1) Hi there! I am currently trying to run the snowball framework using the run_spider_large.sh, however the evaluation results for every epoch stored in saves/spider_snow_balllarge/generator/eval/epoch{}.json contains prediction results as empty strings like "pred": "". I did not modify any file within the framework, how can I possibly solve that? Thanks [DEBAF81B-5DA7-401C-8E8A-6F968C6A73AD]https://user-images.githubusercontent.com/95738049/145160667-699bec7e-ff33-4a14-bb4e-e88da7c67e51.png ks — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#1>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AFTNZMKRFBW4T5E6W3KDAXTUP34S7ANCNFSM5JTAQQUA. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Hi there, thanks for your reply. I just tried using the latest version of bart large and it seems to function normally. Perhaps the recommended version mentioned in readme is no longer actively maintained.

Hi,

Good to hear.

Best, Chang

Hi, there remains a personal question that if I want to augment my own Sql-Text dataset using snowball framework, which file in the project can I use to get the linearized sql-to-logical form data like you've offered in preprocessed here, thanks.