woven-visionai / wts-dataset

29 stars 1 forks source link

Confusion Regarding the Data Request Process and Suggestions for Improvement #11

Open shinsonwu opened 6 months ago

shinsonwu commented 6 months ago

Thanks for the great work. I am a participant in the AICITY competition, but due to a tight schedule with my courses, I didn't have the chance to download the data. Now that the competition has ended, I want to download the data to learn from the solutions of the outstanding participants. However, the way to obtain the data now confuses me : 1.The original Dropbox link provided for the AICITY Competition Track T2 for data download is no longer valid. 2.The competition page has additionally provided Google Drive links to download data after submit Google form. I submitted a form last month with my university's email, but there has been no response to date. When I directly accessed the corresponding Google Drive to request the data, the approver notified me that I need to request data using my university email ID.

So ,I followed the approver's advise, re-registered a new Google account with my university's email I found that if you want to use your university email as the account name to request goole drive data folder , y.ou cannot use the Google email service . Now I am facing two difficult choices: 1.Use the already new registered Google account (with my university's email as the ID) to request access to the data, but you will not be able to use the Google email service . 2.If I want to use the Google email reminder service, I need to go to the Google account settings to set up a new Gmail email address as the displayed ID(eg. "xxx@gmail.com" ), which would then make your university email an alternate email. At this point, when you apply for access to Google Drive data folder , it will display as "xxx@gmail.com" instead of your university account "xxxx@xxx.edu.cn".

Here is a suggested optimized application method can be provided,the followings are simpler approach, such as: Choice1、 the Google Form need to fill has already contains information about university email and google account . Therefore, data requesters can directly access the Google Drive link to request data. There is no need to require that the Google account used for access must be a university email, as this contradicts the full use of Google account services. Choice2、Directly reserve an official email, allowing data requesters to apply using their university email, indicating the purpose, etc. The final data download link can be replied via email, providing a corresponding Dropbox link with a similar download deadline.

shinsonwu commented 6 months ago

Following the instructions from the repository, I filled out the Google form, but I have not received any email feedback regarding the method to obtain the data. As a participant in the AICITY2024 competition, finally I directly used the Google Drive link provided on the AICITY website to apply for data access, which was approved this morning. However, upon downloading, I noticed several issues with the data:

  1. The AICITY2024 corresponding test dataset is missing.

    The test dataset and evaluation script used by our 2024 evaluation system are provided below: AIC24 Track 2 test dataset – link AIC24 Track 2 evaluation script – please visit https://github.com/woven-visionai/wts-dataset/ for details

  2. There are no video data files in the data; it only contains .json files. Total size is 18.9MB(very small)

  3. The format of the files in the downloaded Google Drive does not match what is described on GitHub. This is the download file tree:

    # [EXTERNAL]WTS_DATASET( root folder name in Google Drive)
    wts_dataset_zip
    ├─annotations.zip
    └─external
    └─BDD_PC_5K
        └─annotations
            ├─bbox_annotated
            ├─bbox_generated
            └─caption