Just use the indices lists to start making some kind of something - Githubissues

jwzimmer-zz / tv-tropes

UVM Stat 287 Final Project repo - network of tropes from TV Tropes wiki

MIT License

2 stars 3 forks source link

Just use the indices lists to start making some kind of something #2

Closed jwzimmer-zz closed 3 years ago

jwzimmer-zz commented 3 years ago

Rather than start with the entire website, start with the pages that are lists of categories of tropes, and see what makes sense from there.

jwzimmer-zz commented 3 years ago

https://github.com/jwzimmer/tv-tropes/commit/77ce1cd72b1c983f2fcb34d7e483617ef322cab5

https://github.com/jwzimmer/tv-tropes/issues/3

jwzimmer-zz commented 3 years ago

https://github.com/jwzimmer/tv-tropes/commit/7512487e69c9992783be00b800ce88d8a06a6eaa

jwzimmer-zz commented 3 years ago

https://github.com/jwzimmer/tv-tropes/issues/5

jwzimmer-zz commented 3 years ago

i think done-ish in https://github.com/jwzimmer/tv-tropes/commit/68929caffbb8f7ddc712702a887af2132d248335

HOWEVER, I used this definition for "connection between things":

for the main index page --> make a dict with alphabet letter : tropes starting with that letter (as organized on the page)
for most of the index pages --> make a dict with headers : tropes (collapsing the structure within the tropes links, if they are subnested - so just a flat list of every trope link under that header)

jwzimmer-zz commented 3 years ago

(I manually downloaded all the indices pages visible on the website, the idea being it might help us check against what we got using wget)