elephantscale / datasets

1 stars 4 forks source link

generate an index.html file #2

Open sujee opened 4 years ago

sujee commented 4 years ago

write a simple python script to generate an index.html in this format

<h1> Dataset </h1>

- stocks
   - sp500.csv   (50 KB)
- house prices
   - house price-simple.csv  (10 kb)
sujee commented 4 years ago

tried the script, it only create links for for first level directories. we need to recursively list all the files.

IF you want to use bash

ls -lR 
# or
find

but I think you will probably be better off in python

mdani38 commented 4 years ago

I don't understand what you mean. It worked for me. When you click on a link for a first level directory, it will take you into the directory for whatever depth. All of the links to the data will download or open.

sujee commented 4 years ago

try this https://elephantscale-public.s3.amazonaws.com/data/index.html

click on any links.

S3 will not list directories. So we need to give links to all files

mdani38 commented 4 years ago

Ok. I will take a look.

On Mon, Mar 30, 2020 at 3:29 PM Sujee Maniyam notifications@github.com wrote:

try this https://elephantscale-public.s3.amazonaws.com/data/index.html

click on any links.

S3 will not list directories. So we need to give links to all files

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/elephantscale/datasets/issues/2#issuecomment-606231467, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJOLZPO7ZEBEYAUO47HWYVLRKD6L7ANCNFSM4LPTBV2A .

mdani38 commented 4 years ago

https://github.com/elephantscale/datasets/blob/master/create-index-new.sh Try this. Hopefully this works better.