search

sciserver / scidrive-ui

Web UI for scidrive
http://www.scidrive.org
Apache License 2.0
0 stars 0 forks source link

Extracted metadata do not appear in MyDB #23

Closed raddick closed 8 years ago

raddick commented 9 years ago

I uploaded some files into SciDrive, right-clicked to extract metadata, and got an OK message. But the metadata did not appear in my CasJobs MyDB. I tried logging in and out of both sites - no luck.

Jai Won helped me set up the CasJobs/MyDB v2 metadata extractor, so this should have worked.

Screenshots below showing each stage of the process. Jai Won is experiencing exactly the same error.

It's possible that we are doing something wrong, in which case the test script needs to be updated, as well as the documentation on the site telling the user what to do.

But if this really is not working, then this is a real showstopper bug. Potential users are already asking why they should use SciDrive instead of Dropbox, and we're telling them "because SciDrive extracts your file metadata and stores it in your MyDB." If that's not working, people won't use SciDrive. Marking this as a showstopper for now.

scidrive_connection_1

scidrive_connection_2

scidrive_connection_3

jkim485 commented 9 years ago

I have tried two plugins: CasJobs/MyDB: endpoint CasJobs/MyDB v2: endpoints: http://scitest02.pha.jhu.edu.org/CasJobs/RestApi & http://scitest02.pha.jhu.edu.org/CasJobs/

All three cases failed to create tables in CasJobs.

jkim485 commented 9 years ago

Tested on scidrive 2: still doesn't work.

Related issue might be #28.

jkim485 commented 9 years ago

I closed the issue by mistake...

jkim485 commented 8 years ago

Tested with fits files, and worked. Tested with CSV files, and did not appear in MyDB of CasJobs: according to the scidrive log , the metadata extraction was a successful. But the CSV file does not appear on 'ExtrnResources' table. Its columns do not appear on "ExtrnKeyValue'' table.

jkim485 commented 8 years ago

Mitya enabled CSV file metadata extraction. Jai Won tested with a simple CSV file and the feature worked including creating a table & and inserting rows in the table in MyDB.

One observation is that not all CSV files can be handled.- This should be made clear in the help page.

jkim485 commented 8 years ago

Jai Won tested with 2 fits file including binary tables.

jkim485 commented 8 years ago

This is an issue for FITS table extractor.

How much testing has been done for FITS table extractor? Any test scripts exist?

jkim485 commented 8 years ago

Mitya,

Let's not worry about to fix this problem since the bug was to a specific FITS file.

jkim485 commented 8 years ago

Tested on pre-prod and confirmed the fix.