spider unified directory does not have database.

[Nutingnon]

Hi, I think there might be problems in your prepare_spider.py and data_download.sh for spider dataset.

• First, the url to download spider dataset provided in data_download.sh does not work anymore (404 Error)
• Second, after I download the spider from another place, I ran the prepare_spider.py, however, I notice the generated spider directory generated in unified folder, doesnot have a database folder like other datasets.

Files in the generated spider folder only contains:

• dev.jsonl
• tables.jsonl
• train_others.jsonl
• train_spider.jsonl

[lanwuwei]

Let me check the automatic download script, for your manual download, you need to put the database folder in an appropriate location.

Get Outlook for iOShttps://aka.ms/o0ukef

---

From: YiixiiN @.> Sent: Wednesday, June 26, 2024 11:18:24 PM To: awslabs/unified-text2sql-benchmark @.> Cc: Subscribed @.***> Subject: [awslabs/unified-text2sql-benchmark] spider unified directory does not have database. (Issue #7)

Hi, I think there might be problems in your prepare_spider.py and data_download.sh for spider dataset.

• First, the url to download spider dataset provided in data_download.sh does not work anymore (404 Error)
• Second, after I download the spider from another place, I ran the prepare_spider.py, however, I notice the generated spider directory generated in unified folder, doesnot have a database folder like other datasets.

Files in the generated spider folder only contains:

• dev.jsonl
• tables.jsonl
• train_others.jsonl
• train_spider.jsonl

— Reply to this email directly, view it on GitHubhttps://github.com/awslabs/unified-text2sql-benchmark/issues/7, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACDANXH7G3ROCJUTDZ6FSX3ZJOAABAVCNFSM6AAAAABJ7BLTQOVHI2DSMVQWIX3LMV43ASLTON2WKOZSGM3TMOBQGAZTANI. You are receiving this because you are subscribed to this thread.Message ID: @.***>

[lanwuwei]

Just checked the data_download script, the url link provided by huggingface is not working, we have to manually download it from the official website. As for database folder, our preprocessing script doesn’t change it, we just directly copy it into unified folder.