search

PaulKlinger / Enhance-GoodReads-Export

Small tool to add additional data to .csv library exports from goodreads
GNU Affero General Public License v3.0
48 stars 5 forks source link

I'm so sorry do do this #13

Closed Rellwood1221 closed 3 months ago

Rellwood1221 commented 3 months ago

Did you do something to change the tacked on start/finish dates are ordered?

They are presented in ascending read date order instead of descending.

It has messed up my ability to import the dates because when I separate the columns they used to fall into the correct orders in the row. ie. the first groupings were the first time I read the book, and so on making it easy to put the groupings into DS1 (date started 1) and DF1(Date finished 1) and so on down the line. Normally this wouldn't bother many people, but I have over 1900 read books with over 400 multiple read dates with some going up to 11 dates total.

If I read one book 10 times and another one 2 times the latest date I read both books will end up on the first column as the first date I read them.

I don't have the brain power to move the cells around to put the dates in order.

Like I asked, did you change the way the dates are grabbed, or is this a new way GR is presenting them?

PaulKlinger commented 3 months ago

I haven't touched that part of the code recently, so I suppose it's a change on the goodreads end.

Do you mean you want the dates to be in ascending order? That would mean when you split it into columns the first one is always the first read date.

I've changed the tool to sort the read dates now, so from version v0.11 they are always in ascending order, e.g.

2023-04-13,2023-04-16;2023-07-16,2023-07-25

does that work for you?

Rellwood1221 commented 3 months ago

Yes, that is great. I had to do some gymnastics to get them in order. Basically they need to go DS1, DF1;DS2,DF2;DS3,DF3; Then all I have to do is split the columns and they fall in the order. I believe that is what you did here. I THANK YOU SO MUCH...Please, I would very much like to donate to your cause. I have asked for and received such great responses from you that I must offer some kind of compensation, even if this is a labor of love and not a huge problem for you. Can I Zelle or PayPal?

ALSO, you really need to promote this plugin to Mobile Read because I use it to import into my Calibre Library and others will want this as well.

Thanks Again!

Robin

On Sun, May 12, 2024 at 3:24 AM Paul Klinger @.***> wrote:

I haven't touched that part of the code recently, so I suppose it's a change on the goodreads end.

Do you mean you want the dates to be in ascending order? That would mean when you split it into columns the first one is always the first read date.

I've changed the tool to sort the read dates now, so from version v0.11 https://github.com/PaulKlinger/Enhance-GoodReads-Export/releases/tag/v0.11 they are always in ascending order, e.g.

2023-04-13,2023-04-16;2023-07-16,2023-07-25

does that work for you?

— Reply to this email directly, view it on GitHub https://github.com/PaulKlinger/Enhance-GoodReads-Export/issues/13#issuecomment-2106198062, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVU56BXT7D6VUYNHATPTZTDZB47OHAVCNFSM6AAAAABHRV7U36VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGE4TQMBWGI . You are receiving this because you authored the thread.Message ID: @.***>

PaulKlinger commented 3 months ago

Great! Nice to see I could help

even if this is a labor of love and not a huge problem for you. Can I Zelle or PayPal?

Definitely don't feel like you have to give anything, but here's a PayPal link if you really want to 😊: paypal.me/PaulSKlinger

Rellwood1221 commented 3 months ago

Thanks, I sent you $50

Again, thanks for the work!

On Sun, May 19, 2024, 11:36 PM Paul Klinger @.***> wrote:

Great! Nice to see I could help

even if this is a labor of love and not a huge problem for you. Can I Zelle or PayPal?

Definitely don't feel like you have to give anything, but here's a PayPal link if you really want to 😊: paypal.me/PaulSKlinger

— Reply to this email directly, view it on GitHub https://github.com/PaulKlinger/Enhance-GoodReads-Export/issues/13#issuecomment-2119767444, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVU56BTQFNKNAORH6MTE2GDZDGKX7AVCNFSM6AAAAABHRV7U36VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMJZG43DONBUGQ . You are receiving this because you authored the thread.Message ID: @.***>

Rellwood1221 commented 2 months ago

Hello,

I don't know how else to email you, but I had a question. If I use the "old' export with the new export to save time, will the updated dates show or is it just going to exclude them since they are already showing with the old export. Example: I just re-read a book that already has been processed in the old export. Will the additional read-dates show up in the newly processed export?

Thanks!

Robin

On Sun, May 19, 2024 at 11:36 PM Paul Klinger @.***> wrote:

Great! Nice to see I could help

even if this is a labor of love and not a huge problem for you. Can I Zelle or PayPal?

Definitely don't feel like you have to give anything, but here's a PayPal link if you really want to 😊: paypal.me/PaulSKlinger

— Reply to this email directly, view it on GitHub https://github.com/PaulKlinger/Enhance-GoodReads-Export/issues/13#issuecomment-2119767444, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVU56BTQFNKNAORH6MTE2GDZDGKX7AVCNFSM6AAAAABHRV7U36VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMJZG43DONBUGQ . You are receiving this because you authored the thread.Message ID: @.***>

PaulKlinger commented 2 months ago

Hi Robin,

It will skip all books that already have any of the additional columns, so the new dates won't be added. You'll have to either not select the old export, or check the "process all" option to reprocess everything when you want to update previously processed books.

Rellwood1221 commented 2 months ago

Hi Paul,

No, I was fine with the dates. I wanted to figure out how to get better genre pulls. Goodreads has changed their genre gathering to rely on user shelves, which has caused some problems in the genre data your program pulls. Specifically, when there are only a few readers for a book, this method results in fewer genres being captured.

I understand that your program only pulls genres that have at least 10 users. This is leading to missing genres for books with fewer readers. For example:

"Lord of the Abyss / Desert Warrior" by Nalini Singh:

"Saving Evangeline" by Nancee Cain:

For books without many readers, significant genres are being missed. Conversely, books with more readers are getting genres that aren't useful, such as: "Awakened" by P.C. Cast & Kristin Cast:

Genres like "House Of Night", "Ya", "My Books", "P C Cast", "House Of Night Series", "Read In 2011", "Wishlist", "Owned Books", "Series" are not actual genres and need to be weeded out.

Here are my suggestions:

  1. Allow the program to pull genres for books with fewer shelves if those shelves have fewer users, to avoid missing genres for less-read books.
  2. Implement a way to ignore shelves with specific keywords or proper names (e.g., "Ya", "Read in", "Own", "Wishlist", etc.).
  3. Allow users to input specific shelves to ignore and adjust the tag threshold based on the number of total shelves available for a book.

This approach could help capture more accurate genre data and weed out irrelevant shelves.

Thank you for your attention to this matter.

Best regards, Robin

PaulKlinger commented 2 months ago

I'll take a look this weekend. I can definitely make the number of users configurable, maybe as the the higher of a fixed threshold or a percentage of the highest users per category (after filtering).

There's already some fitering of invalid genres (configured here), I can add your suggestions there. But that will never be perfect.

Rellwood1221 commented 2 months ago

Ok, so I went through my most recent output and entered it into Calibre. I was able to weed out the "good" genres, and left all the "bad" ones. There are some definite ways of isolating them. For example any tag that has "read" in it should be gone. Also, the majority of tags have the name of the author or series or both. If there was some way of saying "if tag includes author name or title" exclude it. Also, there should be some find/replace or skip. For example "uf" and "ya" and "na" would also show up in the same book with "urban-fantasy", "new-adult" and "young-adult" so again, there are redundancies.

I am going to take a crack at it myself to see if it can't be done. I use ChatGPT and it has been really helpful in doing stuff.

I have python and git on my computer too.

Anyway, at least there is a list of the genres, as well as the count in my library. Those numbers represent the amount of times that genre appears in my most recent 4500 list of books.

Let me know your opinions

Thanks! Robin

On Wed, Jul 3, 2024 at 3:11 AM Paul Klinger @.***> wrote:

I'll take a look this weekend. I can definitely make the number of users configurable, maybe as the the higher of a fixed threshold or a percentage of the highest users per category (after filtering).

There's already some fitering of invalid genres (configured here https://github.com/PaulKlinger/Enhance-GoodReads-Export/blob/dacadeb5c8ca9c62e6ecb207c1d197e3a8094a16/enhance_goodreads_export/config.py#L25-L61), I can add your suggestions there. But that will never be perfect.

— Reply to this email directly, view it on GitHub https://github.com/PaulKlinger/Enhance-GoodReads-Export/issues/13#issuecomment-2205668276, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVU56BU4TTTYJPZ65XHVDTDZKPE37AVCNFSM6AAAAABHRV7U36VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBVGY3DQMRXGY . You are receiving this because you authored the thread.Message ID: @.***>

1888,series 676,kindle-unlimited 394,audiobooks 367,audio 271,audible 265,5-stars 243,arc 233,ku 231,wishlist 203,ebooks 157,owned-books 153,physical-tbr 104,my-library 94,my-books 92,read-in-2014 88,4-stars 86,freebie 72,read-in-2013 70,favorite 67,e-book 66,0-needs-cleaning 60,read-in-2015 49,2023-reads 49,free 45,kindle-books 45,laurell-k-hamilton 43,ilona-andrews 41,k-webster 41,read-in-2016 39,tiffany-reisz 39,nalini-singh 37,read-in-2017 37,freebies 36,anita-blake 35,pepper-winters 34,read-in-2012 34,re-read 34,joey-w-hill 34,anita-blake-series 34,sherrilyn-kenyon 33,dark-hunter 32,karen-chance 32,sylvia-day 31,kindle-tbr 31,jasinda-wilder 30,read-in-2018 30,dark-hunter-series 30,dark-hunters 29,read-in-2022 29,kenyon 28,patricia-briggs 28,book-club 28,2021-reads 28,s-m-reine 27,red-phoenix 26,read-in-2019 26,read-in-2021 26,jeaniene-frost 26,first-in-series 26,shannon-mayer 24,anne-bishop 24,audio-books 23,read-in-2020 23,audio-book 22,2022-reads 22,part-of-a-series 22,amelia-hutchins 22,2024-reads 22,favorite-series 22,koontz 22,dean-koontz 22,read-2014 22,outlander 22,jennifer-estep 22,elemental-assassin 22,anne-rice 22,p-c-cast 21,read-in-2023 21,diana-gabaldon 21,larissa-ione 20,kresley-cole 19,koontz-dean 19,stephanie-hudson 19,shayla-black 19,jim-butcher 19,demonica 19,darynda-jones 18,k-f-breene 18,tillie-cole 18,karen-marie-moning 18,read-2023 18,abandoned 18,guild-hunter 18,night-huntress 18,laurelin-paige 18,charley-davidson 18,dresden-files 17,read-2022 17,foxtrot 17,alexa-riley 17,chloe-neill 17,outlander-series 17,read-2013 17,meghan-march 17,sm-reine 17,dresden 16,0-a-favorite-author 16,0-a-favorite-series 16,nook 16,the-dresden-files 16,psy-changeling 16,thea-harrison 16,house-of-night 15,read-2015 15,jade-west 15,karina-halle 15,charlaine-harris 15,elder-races 14,mercy-thompson 14,bertrice-small 14,chicagoland-vampires 14,kristen-ashley 14,tymber-dalton 14,cd-reiss 14,c-d-reiss 14,immortals-after-dark 14,l-j-shen 14,d-b-reynolds 14,sookie-stackhouse 14,vampire-chronicles 14,pc-cast 13,kate-daniels 13,sierra-simone 13,suzanne-wright 13,r-k-lilley 13,need-to-buy 13,left-behind-series 13,left-behind 13,lexi-blake 13,vampires-in-america 13,rhyannon-byrd 12,cassandra-palmer 12,sarah-j-maas 12,e-books 12,lauren-rowe 12,rylee-adamson 12,sookie 12,house-of-night-series 12,tim-lahaye 12,michelle-sagara 11,fever 11,paperback 11,madison-faye 11,jodi-ellen-malpas 11,want-to-buy 11,roxy-sloane 11,the-vampire-chronicles 11,chronicles-of-elantra 10,fever-series 10,v-c-andrews 10,vc-andrews 10,read-2021 10,read-in-2011 10,anita-blake-vampire-hunter 10,king 10,stephen-king 10,day-sylvia 10,not-interested 10,pam-godwin 10,rice 10,t-m-frazier 10,penelope-sky 10,highlander 9,read-2016 9,ka 9,stacia-kane 9,laurann-dohner 9,elizabeth-hoyt 9,kate-pearce 9,allyson-james 9,gabaldon 9,highlanders 9,midnight-dynasty 9,dannika-dark 8,read-2017 8,read-2019 8,throne-of-glass 8,black-shayla 8,sawyer-bennett 8,odd-thomas 8,trilogy 8,merry-gentry 8,meredith-gentry 8,2019-reads 8,raine-miller 8,2017-reads 7,ruby-dixon 7,booktok 7,jackie-collins 7,read-2018 7,bookshelf 7,nashoda-rose 7,kindle-freebie 7,sarah-maclean 7,2015-reads 7,lj-shen 7,elizabeth-amber 7,black-company 7,g-a-aiken 7,dragon-kin 7,hoopla 7,serial 7,diana-rowland 7,kara-gillian 7,duet 7,kenyon-sherrilyn 7,experiment-in-terror 6,2020-reads 6,cherise-sinclair 6,read-in-2024 6,not-yet-released 6,have 6,black-jewels 6,virginia-andrews 6,ivy-asher 6,0-a-favorite-book 6,lucian-bane 6,on-my-kindle 6,wicked-lovers 6,evangeline-anderson 6,penelope-douglas 6,all-time-favorites 6,jr-ward 6,j-r-ward 6,selena-kitt 6,lords-of-deliverance 6,glen-cook 6,doomsday-brethren 6,dorina-basarab 6,the-hollows 6,kim-harrison 6,2016-reads 6,skye-warren 6,clarissa-wild 6,j-a-huss 6,goddess-summoning 6,highlander-series 5,read-2020 5,delilah-devlin 5,judith-krantz 5,2021-releases 5,r-l-mathewson 5,ann-aguirre 5,calibre 5,sirantha-jax 5,heather-killough-walden 5,kitty-thomas 5,black-dagger-brotherhood 5,keri-arthur 5,scott-hildreth 5,audible-escape 5,2014-reads 5,crossfire 5,aly-martinez 5,hailey-edwards 5,ja-huss 5,lili-st-germain 5,milly-taiden 5,dream-hunter 5,elantra 4,2024-tbr 4,vampire-queen 4,night-prince 4,i-own 4,annabel-joseph 4,mimi-jean-pamfiloff 4,charlotte-featherstone 4,dan-brown 4,sylvain-reynard 4,box-set 4,aleatha-romig 4,lendable 4,blood-singer 4,cat-adams 4,db-reynolds 4,jess-michaels 4,annie-bellet 4,kalayna-price 4,alex-craft 4,mary-jo-putney 4,ann-mayburn 4,3-stars 4,hades-hangmen 4,j-kenner 4,true-blood 4,owned-tbr 4,home-library 4,shantel-tessier 4,stormwalker 4,kelly-gay 3,fifty-shades 3,e-l-james 3,cassandra-palmer-series 3,favorite-authors 3,james-herbert 3,ciencia-ficción 3,men-in-uniform 3,tessa-bailey 3,read-me-romance 3,robert-langdon 3,waiting-for-release 3,to-be-released 3,kendall-ryan 3,julia-mills 3,sabrina-paige 3,addison-cain 3,2023-books 3,rebecca-donovan 3,seasons-of-the-moon 3,olivia-cunning 3,renegade-angels 3,lord-john-grey 3,kathleen-woodiwiss 3,kathleen-e-woodiwiss 3,rory-gilmore-reading-challenge 3,lora-leigh 3,books-i-have 3,demonica-series 3,putney-mary-jo 3,the-black-company 3,1001-dark-nights 3,sydney-landon 3,own-kindle 3,vi-keeland 3,tm-frazier 3,tucker-max 3,ibooks 3,fall-away 3,crossfire-series 3,coming-soon 3,callie-hart 3,eric-van-lustbader 3,k-bromberg 3,riley-jenson 3,stark-trilogy 3,harold-robbins 3,meredith-wild 3,kf-breene 3,favs 3,fiona-cole 3,2018-reads 3,acotar 3,kele-moon 3,misadventures 3,legacy-of-the-nine-realms 3,charlie-madigan 2,next-in-series 2,2024-releases 2,read-2024 2,collins-jackie 2,2021-books 2,terry-mcmillan 2,the-fae-chronicles 2,fae-chronicles 2,king-stephen 2,night-huntress-world 2,m-never 2,paperbacks-from-hell 2,dark-tower 2,maya-banks 2,botm 2,sadie-matthews 2,penny-wylder 2,aurora-rose-reynolds 2,club-destiny 2,nicole-edwards 2,lesley-jones 2,megan-hart 2,bookclub 2,lainey-reese 2,brides-of-the-kindred 2,jamie-mcguire 2,lauren-dane 2,mayfair-witches 2,woodiwiss 2,robin-schone 2,eloisa-james 2,1001-books 2,tir-alainn 2,bishop-anne 2,to-read-fantasy 2,bishop 2,jack-ketchum 2,lisa-valdez 2,elementals 2,meredith-duran 2,stuff-your-kindle 2,one-night 2,jean-sasson 2,shay-savage 2,jessica-gadziala 2,fall-away-series 2,tijan 2,ker-dukey 2,odd-thomas-series 2,jessica-hawkins 2,lili-valente 2,cora-reilly 2,edward-lee 2,gail-mchugh 2,m-pierce 2,my-favorites 2,must-read 2,cards-of-love 2,m-s-parker 2,2013-reads 2,kelly-jamieson 2,read-in-2010 2,2022-books 2,christina-lauren 2,georgia-cates 2,kindle-freebies 2,lendable-kindle 2,giana-darling 2,2019-read 2,hate-to-love 2,laura-thalassa 2,the-bargainer 2,cole-kresley 2,victoria-quinn 2,nope 1,hannibal 1,thomas-harris 1,hannibal-lecter 1,arcs 1,read-2012 1,5-star-reads 1,sophie-lark 1,night-huntress-series 1,avoid 1,april-2016 1,up-in-the-air 1,the-original-sinners 1,anita-gray 1,twilight 1,stephenie-meyer 1,masters-of-the-shadowlands 1,elle-kennedy 1,lol 1,kym-grosso 1,victoria-ashley 1,jenika-snow 1,kelley-armstrong 1,women-of-the-otherworld 1,2016-read 1,j-s-scott 1,ainsley-booth 1,ella-fox 1,jenna-jacob 1,author-charlotte-featherstone 1,pocketbook 1,belle-aurora 1,january-2016 1,setta-jay 1,kristen-callihan 1,omnibus 1,read-me-romance-podcast 1,nicole-snow 1,elemental-assassin-series 1,guild-hunter-series 1,free-read 1,free-online 1,zorn-warriors 1,lisa-marie-rice 1,october-daye 1,seanan-mcguire 1,trista-ann-michaels 1,woodiwiss-kathleen 1,dollanganger 1,trisha-telep 1,christine-feehan 1,feehan 1,feehan-christine 1,lucky-santangelo 1,acro 1,sydney-croft 1,candace-bushnell 1,nora-roberts 1,in-death-series 1,jd-robb 1,in-death 1,j-d-robb 1,james-eloisa 1,brown-dan 1,banks-maya 1,for-school 1,19th-century 1,read-for-school 1,the-dark-tower 1,barbara-taylor-bradford 1,elemental-series 1,jane-hawk 1,rk-lilley 1,hoyt-elizabeth 1,lost-lords 1,kate-douglas 1,meredith-gentry-series 1,gilmore-girls-reading-list 1,rory-gilmore-reading-list 1,rory-gilmore 1,gilmore-girls 1,gilmore 1,rory 1,rory-gilmore-challenge 1,winter-renshaw 1,march-2017 1,kindle-library 1,m-malone 1,the-tudors 1,alexandra-ivy 1,jacquelyn-frank 1,jason-luke 1,reto-rita-la-cantaora 1,amanda-m-lee 1,river-savage 1,bound-hearts 1,cover-love 1,emma-holly 1,jessica-clare 1,jaymin-eve 1,r-e-butler 1,february-2017 1,melanie-harlow 1,celia-aaron 1,lily-white 1,michael-crichton 1,crichton 1,crichton-michael 1,2020-releases 1,born-in-blood-mafia-chronicles 1,casteel-series 1,grace-draven 1,wraith-kings 1,ella-frank 1,loved 1,harper-sloan 1,sandi-lynn 1,2014-release 1,2014-releases 1,top-tbr 1,kenner-j 1,pamela-palmer 1,downside-ghosts 1,may-2015 1,lisa-kleypas 1,m-leighton 1,masters-and-mercenaries 1,lorelei-james 1,k-m-scott 1,t-k-leigh 1,katy-evans 1,joanna-wylde 1,conquer-my-tbr-in-2015 1,not-your-average-erotica 1,cheryl-mcintyre 1,sierra-cartwright 1,alice-clayton 1,favoritos 1,ella-james 1,on-my-shelf 1,opal-carew 1,ilsa-madden-mills 1,whitney-g 1,midnight-breed 1,midnight-breed-series 1,lara-adrian 1,sookie-stackhouse-series 1,owned-kindle 1,stacey-kennedy 1,sequels 1,j-a-redmerski 1,first-reads 1,samantha-young 1,gabriel-s-inferno 1,game-of-thrones 1,a-song-of-ice-and-fire 1,asoiaf 1,george-r-r-martin 1,steel-danielle 1,danielle-steele 1,steel 1,danielle-steel 1,morgan-kingsley 1,jenna-black 1,flesh-and-fire 1,jennifer-l-armentrout 1,lindsay-buroker 1,2023-releases 1,2023-read 1,form 1,of 1,gena-showalter 1,lords-of-the-underworld 1,lani-lynn-vale 1,leah-brooke 1,kate-baxter 1,2018-releases 1,ice-planet-barbarians 1,rosemary-rogers 1,buy 1,t-a-grey 1,the-protectors 1,teresa-gabelman 1,rice-anne 1,immortals-after-dark-series 1,kristen-painter 1,cynthia-eden 1,unreleased 1,not-out-yet 1,waiting 1,not-yet-published 1,not-released 1,upcoming 1,preston-child 1,pendergast 1,pendergast-series 1,gabaldon-diana 1,completed-series 1,razorland 1,s-e-lund 1,riley-jenson-guardian 1,royal-bastards-mc 1,willow-winters 1,matt-shaw 1,celia-kyle 1,sinners-of-saint 1,september-2016 1,pal 1,september-2015 1,red-queen 1,red-queen-series 1,victoria-aveyard 1,july-2015 1,l-h-cosway 1,november-2015 1,lords-of-satyr 1,séries 1,m-robinson 1,sam-crescent 1,november-2017 1,tate-james 1,edelweiss 1,zara-cox 1,unfinished-series 1,t-s-joyce 1,annette-marie 1,charlene-hartnady 1,siobhan-davis 1,kendra-elliot 1,kobo 1,raven-kennedy 1,2014-read 1,may-2014 1,sherri-hayes

PaulKlinger commented 2 months ago

Didn't have much time, but I added a few exclusions (including the author name, not book title because that seems a bit riskier if it's a common word). I've also added an option to specify the required number of votes to add a genre, either a fixed number or a percentage of the votes for the most voted genre.