BIDS-projects / scraper

Collects data from websites of data science institutions
2 stars 0 forks source link

Graph Visualization #8

Closed don-han closed 8 years ago

don-han commented 8 years ago

The graph will be represented in adjacency list under JSON format. The keys are the base urls and the values will be the destinations of hyperlinks.

The following is an example of the format. { "amplab.cs.berkeley.edu": [ "http://bids.berkeley.edu/", "http://bids.berkeley.edu/" ], "bids.berkeley.edu": [ "https://www.nersc.gov/news-publications/nersc-news/nersc-center-news/2015/shifter-makes-container-based-hpc-a-breeze/", "https://amplab.cs.berkeley.edu/" ], "dlab.berkeley.edu": [ "http://bids.berkeley.edu/resources/office-hours", "http://bids.berkeley.edu/" ] }