search

jwzimmer-zz / tv-tropes

UVM Stat 287 Final Project repo - network of tropes from TV Tropes wiki
MIT License
2 stars 3 forks source link

is pickle a good way to save cleanish/ intermediate data? #3

Closed jwzimmer-zz closed 3 years ago

jwzimmer-zz commented 3 years ago

e.g. my output dict (from "Indices/Genre Tropes - TV Tropes.htm") looks like: {' Sub-indexes:': ['Action/Adventure Tropes', 'Advertising Tropes', 'Alternate History Tropes', 'Comedy Tropes', 'Recorded and Stand-Up Comedy', 'Crime and Punishment Tropes', 'Drama Tropes', 'Espionage Tropes', 'Fairy Tale Tropes', 'Game Show Tropes', 'Genre Title Grab Bag', 'Horror Tropes', 'Love Tropes', 'Military and Warfare Tropes', 'Mystery Tropes', 'News Broadcast', 'News Tropes', 'Ninja Tropes', 'Opera', 'Picaresque', 'Pirate Tropes', 'Post-9/11 Terrorism Movie', 'Professional Wrestling', 'Reality TV Tropes', 'Romance Novel Tropes', 'Speculative Fiction Tropes', 'Sports Story Tropes', 'Superhero Tropes', 'Thriller', 'Tragedy', 'Tokusatsu Tropes', 'Wild West Tropes'], ' Tropes related directly to Genres:': ['Contractual Genre Blindness', 'Death by Genre Savviness', 'From Clones to Genre', 'Functional Genre Savvy', 'Gameplay Roulette', 'Genre Adultery', 'Genre Blindness', 'Genre-Busting', 'Genre Deconstruction', 'Genre-Killer', 'Genre Mashup', 'Genre Motif', 'Genre Refugee', 'Genre Relaunch', 'Genre Roulette', 'Genre Savvy', 'Genre Shift', 'Genre Throwback', 'Genre Turning Point', 'Heavy Meta', 'Out-of-Genre Experience', 'Reality Show Genre Blindness', 'Sliding Scale of Comedy and Horror', 'Unexpected Gameplay Change', 'The Universal Genre Savvy Guide', 'Wrong Genre Savvy']}

which is an intermediate/ exploratory data structure... i saved it as a .pickle file, but i don't really know if that's a good strategy?

jwzimmer-zz commented 3 years ago

not totally sure still, but i also saved the files as json (which is human readable)

jwzimmer-zz commented 3 years ago

From discussion with @nguyenhphilip - we will use json.