eichblatt / deadstream

A time machine to play GD tapes from archive.org
GNU General Public License v3.0
51 stars 15 forks source link

Handle lists of collections #75

Closed eichblatt closed 3 years ago

eichblatt commented 3 years ago

The current timemachine program only looks at one collection at a time from archive.org.

I'd like to have multiple collections, but besides being tricky this creates some conceptual problems:

The archive.org collection called etree appears to contain all the audio collections. I could make the time machine download that archive and use the "collections" field from the options server as a filter. The records that are downloaded contain a collection field, which is in fact a list of all the collections that this identifier belongs to. So the GratefulDead items are in the etree collection as well. (The "favorite" function on archive puts the items into a collection. Mine are in "fav-steve101". This could in fact be used as a favorite methodology for the Time Machine)

The way forward is to stop downloading an _ids file for each collection, but just download etree_ids.json, and then filter it according to the collections chosen in the serve_options.py page.

Here's what the data for a tape id looks like in the _ids file:

{"date": "1969-02-28T00:00:00Z", "identifier": "gd69-02-28.sbd.16track.kaplan.3397.sbeok.shnf", "files_count": 125, "subject": "Live concert", "format": ["Archive BitTorrent", "Checksums", "Columbia Peaks", "Item Tile", "Metadata", "Ogg Vorbis", "PNG", "Shorten", "Text", "VBR MP3"], "num_favorites": 144, "source": "Soundboard", "collection": ["GratefulDead", "etree", "stream_only", "fav-djpeebs", "fav-toddrankin", "fav-grateful_roadmaster", "fav-jinxremoving", "fav-blinovitch", "fav-jerry_apos_skids", "fav-jahtom", "fav-ziggydamoe", "fav-alive_dead", "fav-bigpeach88", "fav-jseaborg", "fav-strangest_captain", "fav-alembicbass", "fav-gabegug", "fav-dusttizzle", "fav-patbrookz", "fav-laughinginlimbo", "fav-nolazag", "fav-kevindiacity", "fav-trangential", "fav-skydawg", "fav-heiki", "fav-deserthead", "fav-climbv7", "fav-hamsangwich", "fav-cjport", "fav-alexheminway", "fav-deadhedjed", "fav-dsellers5", "fav-jtreid14", "fav-elxmasxchingon", "fav-tore_up", "fav-jar13", "fav-txkinebud", "fav-mjb4phish", "fav-spece46", "fav-kboyxxx", "fav-tjb1510", "fav-rambleonbaby3", "fav-stevenjna", "fav-blue777", "fav-steve101", "fav-geoffreydean", "fav-udistbill", "fav-schneebly1", "fav-throwback_doug", "fav-moxed", "fav-nephils", "fav-eyeballjackson", "fav-gregor_macdonald", "fav-elleopardo8777", "fav-husker_dead", "fav-beauregard_t", "fav-sdesmond", "fav-s_reng", "fav-timcampbell", "fav-gmvecellio", "fav-haroldchasen", "fav-kingrimmy", "fav-fncaesar", "fav-eventhjam", "fav-dc2", "fav-scodimaka", "fav-fox_schanzer", "fav-fred_h", "fav-gogojonah", "fav-thebrownacid", "fav-roughgod44", "fav-papaphunk", "fav-jpp1727", "fav-jahcos2", "fav-augustwest1013", "fav-stanleym27", "fav-topperco", "fav-karl_benedek", "fav-hanshan12", "fav-elric17_optonline_net", "fav-everly_grateful", "fav-kboyxxx123", "fav-topher98", "fav-wlmbrm", "fav-carchase", "fav-deadheadnedwhite", "fav-jacksonstraw", "fav-davidjacob", "fav-rlyn74", "fav-nutrabear", "fav-james_hatari", "fav-twwifosnumber9", "fav-bruceallan73_1", "fav-jon_spruce", "fav-jrrtokein", "fav-rolling", "fav-philatticus", "fav-eyeiser", "fav-gumballgd", "fav-jasonatkin", "fav-pschumach", "fav-jasonwlangley", "fav-brandon_padron", "fav-2wheelsandagrin", "fav-ovaltinejenkins", "fav-bluerunner", "fav-vcant973", "fav-stata184", "fav-mediaspinner", "fav-nicholas_a_osella", "fav-jonstorm716", "fav-david_goldman", "fav-vdiaco1976", "fav-joshua-mccord", "fav-mz11378", "fav-pattoons", "fav-thomatz_n", "fav-kidcombsie", "fav-dannydread", "fav-willb112275", "fav-orinmark", "fav-muddle_one", "fav-stronz1", "fav-buildarope", "fav-phodge", "fav-faberglas", "fav-gracejonestown", "fav-todd1022", "fav-adlight74", "fav-pilgrim1621", "fav-critter9292", "fav-jrfhoutx", "fav-aepst", "fav-pyromonoxide", "fav-kpav", "fav-darkstarsky", "fav-rigu66", "fav-njpg", "fav-awerhsn", "fav-tboyd99", "fav-jeff_cowan", "fav-doombadead", "fav-scottk812", "fav-mojo26", "fav-malus", "fav-ghengisk78", "fav-deadhead78"], "stars": [5, 3, 1, 0], "type": "sound", "downloads": 48343, "avg_rating": 4.67, "num_reviews": 44}
eichblatt commented 3 years ago

This still needs a lot of work.

eichblatt commented 3 years ago

I added an element to the "score" of the tape, such that the first collection will nearly always get the highest scores, etc. So I think that may be closed.