Stuartlab-UCSC / hexmap-view

MIT License
3 stars 3 forks source link

allow file URLs to be provided to create a map #61

Closed terraswat closed 6 years ago

terraswat commented 6 years ago

As an alternative to uploading files to create a map, allow URLs to be provided. In addition to making creating a map easier for users with existing files accessible via URLs, if a user has uploaded a file once, she could then use that same file, without another upload, to build another map. The URLs would be returned to the user after the map is created so they could be used in the future.

terraswat commented 6 years ago

data server changes:

Pandas can read a url into a dataframe, however there are checks up-front that require the first few lines of the file to be read to determine the format and validate the data. This means a bit of restructuring in the code to maybe read the url into the panda's dataframe first and do the checks there. It would be best if after doing the checks, the dataframe could be reconfigured for the particular format detected.

Another less optimal option that may work is to require the format type be declared by the user if a url is used.

terraswat commented 6 years ago

viewer changes: A draft of the needed viewer changes may be stashed in Teresa's git as: On dev: fileUrl

terraswat commented 6 years ago

URLs are now allowed for data input and files uploaded will have a URL generated and sent in the job completion email to the user.