I-GUIDE / catalog

The I-GUIDE Catalog is part of the I-GUIDE Platform and provides search, discovery, and dynamic interaction with resources created by or used by I-GUIDE researchers.
https://i-guide.io/platform/
BSD 3-Clause "New" or "Revised" License
0 stars 4 forks source link

"Failed to save submission" when trying to register a dataset hosted on AWS S3 #165

Open YunfanKang opened 1 month ago

YunfanKang commented 1 month ago

Hi! I encountered the "Failed to save submission" error after I filled the forms and click the submission button to register the twitter dataset we have to the data catalog. I tried both "Register" and "Contribute" and I filled in all the required text fields and the forms are attatched below. I would really appreciate it if you can take a look at the forms and let me know if I made any mistake with the forms. I-GUIDE _ Register Dataset.pdf I-GUIDE _ Contribute.pdf

pkdash commented 1 month ago

@YunfanKang Currently it is expecting bucket name as part of the AWS S3 endpoint url. Can you try putting this as endpoint url when registering the s3 dataset? https://twitterjson-210925to21096.s3.us-east-2.amazonaws.com

Later I will make a fix where bucket name is not needed as part of the endpoint url.

YunfanKang commented 1 month ago

@YunfanKang Currently it is expecting bucket name as part of the AWS S3 endpoint url. Can you try putting this as endpoint url when registering the s3 dataset? https://twitterjson-210925to21096.s3.us-east-2.amazonaws.com

Later I will make a fix where bucket name is not needed as part of the endpoint url.

Thanks for the reply! I replaced the endpoint url with "https://twitterjson-210925to21096.s3.us-east-2.amazonaws.com/" but still got the same error message. In addition, the "Contribute" form does not take the s3 info so I guess this error is caused by something else.

pkdash commented 1 month ago

@YunfanKang Thanks for doing the test again for us. We will be looking into this soon. After reviewing the code bit more I realized that the endpoint url has no requirement of bucket name as part of the url.

pkdash commented 2 weeks ago

@Maurier Were you able to reproduce this bug?

YunfanKang commented 2 weeks ago

@pkdash We tried to register the same data again yesterday and were able to successfully submit the form.

pkdash commented 2 weeks ago

@YunfanKang I am going to close this issue for now.