beville / ComicStreamer

Apache License 2.0
167 stars 92 forks source link

Library limited to 5600 comic books? #5

Open vicenzo75 opened 10 years ago

vicenzo75 commented 10 years ago

Hi, I have tried your comicStreamer App under Windows seven. Ios Chunky comic reader developper gave me this address. English is not my native language, so i'm sorry in advance if my english is not fluent.

I have configuered A very big library (more than 100000 comics), and the scan freezed at 2500 comics scanned. Then I have deleted within the configuration the folder of 100000 comics and added just 4 folders (total of 5800 digital comics), and the scan stopped at 5600 comics. I did same thing for a folder of 700 comics, it worked fine.

This app is promising, keep up the good work, and maybe library size will expand :)

Thank you and best regards

beville commented 10 years ago

You've come across a major issue with the way scanning works right now. Wow, 100,000 comics! Good test.

Hopefully I will find time in the next few weeks to work on this.

beville commented 10 years ago

I created a new release which should address this. I actually tested on a Raspberry PI with 256MB of memory. It was slow, but got through over 9000 files.

Give 0.0.6 a try, and see how it goes. I am curious to find out how long it takes on your machine. How much memory do you have and what kind of CPU?

vicenzo75 commented 10 years ago

Hi,  I have W7 SP1 64 bits, CPU i3-3225 @3.30 Ghz, 8Go Ram

 I rebuilt my database with 7800 comics (5 folders). It got stuck on "Monitor: sorting recursive file list"

With just one folder of 678 comics, ok (about 1 minute to scan them) Then I have added another folder of 3300 comics... stuck again on the message  "Monitor: sorting recursive file list" I have removed it and added a folder of 1150 comics... ok (about 3 minutes to scan them) Finally I added 3 folders of 1000 comics each (total 3000 comics)... ok ( about 7 minutes to scan them) The I have added 3 folders, one 400, other 600 and last 1400... It scanned 1200 comics and then froze... It froze when 4700 comics were already in the database, and at 1200 comics scanned... so at 5900 comics, like before  and the program did not answer to any manipulation... I can not anymore launch the process (except i guess if i restart my computer)

hope it helps...

Le Vendredi 4 juillet 2014 21h32, beville notifications@github.com a écrit :

I created a new release which should address this. I actually tested on a Raspberry PI with 256MB of memory. It was slow, but got through over 9000 files. Give 0.0.6 a try, and see how it goes. I am curious to find out how long it takes on your machine. How much memory do you have and what kind of CPU? — Reply to this email directly or view it on GitHub.

beville commented 10 years ago

Well, your computer has plenty of horsepower, so I don't understand what's going on.

I'd like you to try a few things:

First, reset the database. You can start CS, and go to "Config", and remove any folders from the list, and save. Then go to "Control" and click "Rebuild Database". Then quit CS by using the Windows system tray icon.

Then, restart CS, and add your 5 folders with 7800 comics, and restart again. After it seems to get stuck, use windows explorer to go to %APPDATA%\ComicStreamer\logs. Email me all the log files in that folder to comictagger@gmail.com. Maybe there is an error there that will help me understand this.

Thanks!

vicenzo75 commented 10 years ago

I had to restart my pc, because comicstreamer was not available (see error attached) When I opened again comicstreamer... it scanned the remaining 1400 files... strange. note that the scan is more and more longer (5 minutes for the scan of these 1400 remaining comics).

So I deleted all the folders... and added the same folder of 3000 comics which provoke the stuck on the message "Monitor: sorting recursive file list" I attach the 3 log files i have, most recent one being ComicStreamer.log

I'm in vacation tomorrow, i won't be able to do more tests. good luck, and keep up the good work.

Le Samedi 5 juillet 2014 0h05, beville notifications@github.com a écrit :

Well, your computer has plenty of horsepower, so I don't understand what's going on. I'd like you to try a few things: First, reset the database. You can start CS, and go to "Config", and remove any folders from the list, and save. Then go to "Control" and click "Rebuild Database". Then quit CS by using the Windows system tray icon. Then, restart CS, and add your 5 folders with 7800 comics, and restart again. After it seems to get stuck, use windows explorer to go to %APPDATA%\ComicStreamer\logs. Email me all the log files in that folder to comictagger@gmail.com. Maybe there is an error there that will help me understand this. Thanks! — Reply to this email directly or view it on GitHub.

jt196 commented 9 years ago

Guys I don't know if it's my place to hijack here but I've got the same issue.

I got a collection of, well, over 5000 comics. What's happening is that after about 5500, I rebooted to initiate a scan, and the scan just got stuck at 100 - as per the image attached.

I rebuilt the DB and it's now down to 4400 comics. Same issue, starts the scan, then gets stuck on 100, status "Scanning".

Running is on a Mac Mini i5 2.5Ghz with 16GB RAM.

screenshot 2014-12-02 12 05 29

Sparrwhawk commented 9 years ago

Check to see if any files in the comics have webp pictures. It will fail on these types. I did have them, once I removed them, it started working.

goldengaines commented 9 years ago

Hello,

I have a database of over 60,000 digital comics in which I manage in the frontend with the comic database program comicrack. The backend of my database is an organized into three main folders Marvel, DC, and Other, which, all have many subdirectories of individual series that fall under each catergory. Currently, I have successfully loaded more than 32,000 comics into comicstreamer, which is just about all of the comics in my DC, and Marvel folders except for about 200 give or take 5 or 10. At one point I had pretty much my whole library but managing my database with Comicrack, I did something that altered my comicstreanmer database. Recently, I ran some test and I successfully recreated the issue.I found that when I use the "Library Organizer" plugin, the target digital comics will be no longer able to be read by comicstreamer, removing them from comicstreamer. This also jogged my memory, as I used the "Library Organizer" plugin on my complete database, and from that point I no longer get my complete database on comicstreamer. Also, keep in mind while I used Library Organizer on my complete DB, I can still see all the comic in my Marvel, and DC folders. I also continually add to Marvel, and DC folders, and use the Library Organizer plugin, and they still render to comicstreamer. However, when I use the plugin on comics in the "Other" folder they will not render to comicsteamer, or the comics will be deleted from comicstreamer if already rendered (Pre-plugin use). So, once I figure out what exactly about this issue that is preventing my last folder from being properly added I will successfully load all of my library.

I hope this helps Cheers!

comicstreamer