search

jwzimmer-zz / tv-tropes

UVM Stat 287 Final Project repo - network of tropes from TV Tropes wiki
MIT License
2 stars 3 forks source link

Some dicts come back empty - why? #5

Closed jwzimmer-zz closed 3 years ago

jwzimmer-zz commented 3 years ago

<DirEntry 'Main Index Index - TV Tropes.htm'> <DirEntry 'Home Page YMMV - TV Tropes.htm'> <DirEntry 'Tropes Of Legend Just For Fun - TV Tropes.htm'> <DirEntry 'Audience Reactions - TV Tropes.htm'> <DirEntry 'The Oldest Ones in the Book - TV Tropes.htm'> <DirEntry 'Just For Fun - TV Tropes.htm'> <DirEntry 'Information Desk - TV Tropes.htm'> <DirEntry 'Contributors - TV Tropes.htm'> <DirEntry 'Language Indices - TV Tropes.htm'> <DirEntry 'Useful Notes - TV Tropes.htm'> <DirEntry 'Genres - TV Tropes.htm'> <DirEntry 'Media Tropes - TV Tropes.htm'> <DirEntry 'Topical Tropes - TV Tropes.htm'> <DirEntry 'Narrative Tropes - TV Tropes.htm'> <DirEntry 'Works - TV Tropes.htm'> <DirEntry 'Flame Bait - TV Tropes.htm'> <DirEntry 'Overdosed Tropes - TV Tropes.htm'>

jwzimmer-zz commented 3 years ago

The structure of the pages is different - some of them don't use h2 tags (e.g. media tropes has an h1 tag, then down the page a ul with all the trope links - those links have structure as well)

jwzimmer-zz commented 3 years ago

should check that the other pages (the ones that worked already) aren't collapsing link structure too, maybe?

jwzimmer-zz commented 3 years ago

i think all the index pages return dicts with their links now: https://github.com/jwzimmer/tv-tropes/commit/68929caffbb8f7ddc712702a887af2132d248335