Closed AtariBaby closed 11 years ago
That happens because you have a comic that is in 'Loading' status due to an error of some kind, or was in loading status and never cleared out and it cant find the necessary field to populate the page. I have it fixed on my dev box, I should be able to commit the fix late tonight.
I see exactly the same, but it's following a crash on adding a comic. Just picked "Superior Spider-Man" from the Weekly list to test and got this in the console:
comicid: 55552
comicname: Superior Spider-Man
comicyear: 2013
comicissues: 4
comicimage: cache/blankcover.jpg
25-Feb-2013 07:07:38 - INFO :: CP Server Thread-5 : Quick match success..continuing.
25-Feb-2013 07:07:38 - DEBUG :: Thread-14 : number of issues I counted: 4
25-Feb-2013 07:07:38 - DEBUG :: Thread-14 : number of issues CV says it has: 4
25-Feb-2013 07:07:38 - DEBUG :: Thread-14 : vari is set to: no
25-Feb-2013 07:07:38 - INFO :: Thread-14 : Now adding/updating: Superior Spider-Man
Exception in thread Thread-14:
Traceback (most recent call last):
File "/volume1/@appstore/python/lib/python2.7/threading.py", line 551, in __bootstrap_inner
self.run()
File "/volume1/@appstore/python/lib/python2.7/threading.py", line 504, in run
self.__target(*self.__args, **self.__kwargs)
File "/usr/local/mylar/mylar/importer.py", line 91, in addComictoDB
gcdinfo=parseit.GCDScraper(comic['ComicName'], comic['ComicYear'], comic['ComicIssues'], comicid)
File "/usr/local/mylar/mylar/parseit.py", line 158, in GCDScraper
return GCDdetails(comseries=None, resultURL=resultURL, vari_loop=0, ComicID=ComicID, TotalIssues=TotalIssues, issvariation=issvariation, resultPublished=resultPublished)
File "/usr/local/mylar/mylar/parseit.py", line 218, in GCDdetails
resultFormat = subtxt9.findNext(text=True).rstrip()
AttributeError: 'NoneType' object has no attribute 'findNext'
This is coming up lots, with comics that I'd previously had working (Before Watchmen: Dr Manhattan, for example) as well as with new ones. But not all - "Thor: God of Thunder" (another random test) added just fine. This is in the up to date Dev branch.
Not sure what's going on - but 2 separate issues (at least the error messages).
AtariBaby: you need to shutdown Mylar entirely. The error about is there another process running means that the previous instance was never shutdown properly and is running in the background. You can do a 'ps -xg' from the command line to show the logged in user jobs and then just do a 'kill -9
TheLabRatt:I can't reduplicate this on my box - I was able to add in Superior Spider-Man with no issues whatsoever. You're obviously on the dev. branch, but try shutting down Mylar and starting it up again (not a restart, a shutdown). If you got an error prior to that error you posted, it's the error prior that would need to be addressed. Mylar is abit finicky - when it hits an error, it will try to chug along, but the stability of it's processing comes heavily into question.
I wasn't meaning to hijack another report, just to add context - if I try to visit the main page after the error I get exactly the same error as AtariBaby.
Anyway, this was from a fresh start. I'm using a Synology box, but this is a clean git pull. Here's the full process from the start:
> python Mylar.py --verbose
25-Feb-2013 09:03:45 - INFO :: MainThread : cache set to : /usr/local/mylar/cache
25-Feb-2013 09:03:45 - INFO :: MainThread : Checking to see if the database has all tables....
25-Feb-2013 09:03:45 - INFO :: MainThread : Populating Base Exception listings into Mylar....
25-Feb-2013 09:03:45 - INFO :: MainThread : Populating Custom Exception listings into Mylar....
25-Feb-2013 09:03:45 - INFO :: MainThread : Ensuring DB integrity - Removing all Erroneous Comics (ie. named None)
25-Feb-2013 09:03:46 - DEBUG :: MainThread : Trying to execute: "git rev-parse HEAD" with shell in /usr/local/mylar
25-Feb-2013 09:03:46 - DEBUG :: MainThread : Git output: ea6d704d67f43ead0f0bf9f0598d4660477e58cf
25-Feb-2013 09:03:46 - INFO :: MainThread : Retrieving latest version information from github
25-Feb-2013 09:03:46 - INFO :: MainThread : Comparing currently installed version with latest github version
25-Feb-2013 09:03:47 - INFO :: MainThread : Mylar is up to date
25-Feb-2013 09:03:47 - INFO :: MainThread : Starting Mylar on port: 8090
25-Feb-2013 09:03:47 - INFO :: MainThread : Checking for existance of Weekly Comic listing...
25-Feb-2013 09:03:47 - INFO :: Thread-12 : Weekly pull list present - checking if it's up-to-date..
25-Feb-2013 09:03:48 - INFO :: Thread-12 : No new pull-list available - will re-check again in 24 hours.
25-Feb-2013 09:03:48 - INFO :: Thread-12 : Checking the Weekly Releases list for comics I'm watching...
25-Feb-2013 09:03:48 - DEBUG :: Thread-12 : You are watching for: 13 comics
25-Feb-2013 09:03:48 - DEBUG :: Thread-12 : There are 0 comics this week to get!
25-Feb-2013 09:03:48 - INFO :: Thread-12 : Finished checking for comics on my watchlist.
limityear: None
I'm here.
comicid: 55552
comicname: Superior Spider-Man
comicyear: 2013
comicissues: 4
comicimage: cache/blankcover.jpg
25-Feb-2013 09:04:17 - INFO :: CP Server Thread-3 : Quick match success..continuing.
25-Feb-2013 09:04:17 - DEBUG :: Thread-14 : number of issues I counted: 4
25-Feb-2013 09:04:17 - DEBUG :: Thread-14 : number of issues CV says it has: 4
25-Feb-2013 09:04:17 - DEBUG :: Thread-14 : vari is set to: no
25-Feb-2013 09:04:17 - INFO :: Thread-14 : Now adding/updating: Superior Spider-Man
Exception in thread Thread-14:
Traceback (most recent call last):
File "/volume1/@appstore/python/lib/python2.7/threading.py", line 551, in __bootstrap_inner
self.run()
File "/volume1/@appstore/python/lib/python2.7/threading.py", line 504, in run
self.__target(*self.__args, **self.__kwargs)
File "/usr/local/mylar/mylar/importer.py", line 91, in addComictoDB
gcdinfo=parseit.GCDScraper(comic['ComicName'], comic['ComicYear'], comic['ComicIssues'], comicid)
File "/usr/local/mylar/mylar/parseit.py", line 158, in GCDScraper
return GCDdetails(comseries=None, resultURL=resultURL, vari_loop=0, ComicID=ComicID, TotalIssues=TotalIssues, issvariation=issvariation, resultPublished=resultPublished)
File "/usr/local/mylar/mylar/parseit.py", line 218, in GCDdetails
resultFormat = subtxt9.findNext(text=True).rstrip()
AttributeError: 'NoneType' object has no attribute 'findNext'
For full disclosure, I am getting the same utf-8 problem with Invincible as others, and some strange behaviour on The Walking Dead that I'm trying to usefully format the output from, so it may well be a bunch of connected issues. I'll try it on a ubuntu machine and see what happens. Time to learn Python, methinks.
My problems were solved by installing python from optware in addition to the synology package and using that one to run Mylar. No idea if that helps AtariBaby or not.
Well that's good to know - I kinda figured it was either one of the other. I'm pretty sure AtariBaby isn't running on a Synology, however he's having alot of the same problems that many Synology users are having (I helped him with a parser problem at one point that seems to coincide with the problems herein). Thanks for the followup with the solution - I'm sure many other Synology users will hopefully be able to benefit from this :)
Related? Saw this on terminal while booting up:
25-Feb-2013 11:49:20 - INFO :: Thread-12 : Weekly pull list present - checking if it's up-to-date..
Exception in thread Thread-12:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 552, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 505, in run
self.__target(*self.__args, **self.__kwargs)
File "/home/misterfantastic/.mylar/mylar/weeklypull.py", line 288, in pullit
newtxtfile.write(str(shipdate) + '\t' + str(pub) + '\t' + str(issue) + '\t' + str(comicnm) + '\t' + str(comicrm) + '\tSkipped' + '\n')
UnboundLocalError: local variable 'shipdate' referenced before assignment
shut down mylar, ran your command and don't see mylar anywhere:
PID TTY STAT TIME COMMAND
1088 ? Sl 0:26 python /home/misterfantastic/.sickbeard/SickBeard.py -
1979 ? Sl 0:26 /usr/bin/python CouchPotato.py --daemon --pid_file=/va
2019 ? Ssl 0:00 gnome-session --session=ubuntu
2102 ? Ss 0:00 /usr/bin/ssh-agent /usr/bin/dbus-launch --exit-with-se
2105 ? S 0:00 /usr/bin/dbus-launch --exit-with-session gnome-session
2126 ? Sl 7:38 /usr/bin/python -OO /usr/bin/sabnzbdplus --daemon --se
2613 ? Ss 0:01 //bin/dbus-daemon --fork --print-pid 5 --print-address
2787 ? Sl 0:00 /usr/lib/at-spi2-core/at-spi-bus-launcher
2791 ? S 0:00 /bin/dbus-daemon --config-file=/etc/at-spi2/accessibil
2794 ? Sl 0:00 /usr/lib/at-spi2-core/at-spi2-registryd --use-gnome-se
2972 ? Sl 0:04 /usr/lib/gnome-settings-daemon/gnome-settings-daemon
2977 ? SLl 0:00 /usr/bin/gnome-keyring-daemon --start --components=ssh
3162 ? Sl 0:00 /usr/lib/gvfs/gvfsd
3166 ? Sl 0:00 /usr/lib/gvfs//gvfsd-fuse -f /run/user/misterfantastic
3260 ? Rl 0:56 compiz
3270 ? S 0:00 syndaemon -i 2.0 -K -R -t
3293 ? S<l 0:00 /usr/bin/pulseaudio --start --log-target=syslog
3373 ? Sl 0:00 /usr/lib/dconf/dconf-service
3378 ? Sl 0:00 /usr/lib/vino/vino-server --sm-disable
3379 ? Sl 0:00 /usr/lib/gnome-settings-daemon/gnome-fallback-mount-he
3380 ? Sl 0:00 bluetooth-applet
3385 ? Sl 0:01 nm-applet
3386 ? Sl 0:16 nautilus -n
3387 ? Sl 0:00 /usr/lib/policykit-1-gnome/polkit-gnome-authentication
3397 ? Sl 0:00 /usr/lib/gvfs/gvfs-udisks2-volume-monitor
3406 ? S 0:00 /bin/bash /usr/share/filebot/bin/filebot.sh
3424 ? Sl 0:14 transmission-gtk -m
3428 ? S 0:00 /usr/lib/pulseaudio/pulse/gconf-helper
3430 ? S 0:00 /usr/lib/x86_64-linux-gnu/gconf/gconfd-2
3433 ? Sl 0:27 java -Xmx256m -Dunixfs=false -DuseGVFS=true -DuseExten
3505 ? Sl 0:00 /usr/lib/gvfs/gvfs-gphoto2-volume-monitor
3513 ? Sl 0:00 /usr/lib/gvfs/gvfs-afc-volume-monitor
3552 ? Sl 0:00 /usr/lib/notify-osd/notify-osd
3581 ? Sl 0:00 /usr/lib/gvfs/gvfsd-trash --spawner :1.10 /org/gtk/gvf
3587 ? Sl 0:00 telepathy-indicator
3594 ? Sl 0:00 /usr/lib/telepathy/mission-control-5
3602 ? Sl 0:00 /usr/bin/signon-ui
3605 ? Sl 0:00 /usr/lib/gvfs/gvfsd-burn --spawner :1.10 /org/gtk/gvfs
3612 ? Sl 0:01 gnome-screensaver
3613 ? Sl 0:00 zeitgeist-datahub
3619 ? Sl 0:00 /usr/bin/zeitgeist-daemon
3633 ? Sl 0:00 /usr/lib/zeitgeist/zeitgeist-fts
3635 ? S 0:00 /bin/cat
3652 ? Sl 0:00 /usr/lib/gvfs/gvfsd-metadata
3660 ? Sl 0:00 /usr/lib/gvfs/gvfsd-http --spawner :1.10 /org/gtk/gvfs
3665 ? Sl 3:02 /usr/lib/firefox/firefox http://localhost:8090/
3691 ? Sl 0:01 /usr/lib/bamf/bamfdaemon
3718 ? Sl 0:00 /usr/lib/libunity-webapps/unity-webapps-service
3756 ? Ss 0:00 /bin/sh -c /usr/bin/gtk-window-decorator
3757 ? Sl 0:00 /usr/bin/gtk-window-decorator
3769 ? Sl 0:06 /usr/lib/unity/unity-panel-service
3771 ? Sl 0:02 /usr/lib/indicator-appmenu/hud-service
3798 ? Sl 0:01 /usr/bin/python /usr/lib/ubuntuone-client/ubuntuone-sy
3806 ? Sl 0:00 /usr/lib/indicator-session/indicator-session-service
3807 ? Sl 0:00 /usr/lib/x86_64-linux-gnu/indicator-application-servic
3808 ? Sl 0:00 /usr/lib/indicator-printers/indicator-printers-service
3810 ? Sl 0:00 /usr/lib/indicator-sound/indicator-sound-service
3811 ? Sl 0:00 /usr/lib/indicator-messages/indicator-messages-service
3852 ? Sl 0:00 /usr/lib/evolution/evolution-source-registry
3877 ? Sl 0:00 update-notifier
3889 ? Sl 0:00 /usr/lib/gnome-online-accounts/goa-daemon
3891 ? Sl 0:00 /usr/lib/geoclue/geoclue-master
4000 ? Sl 0:00 /usr/lib/unity-lens-applications/unity-applications-da
4002 ? Sl 0:00 /usr/lib/unity-lens-files/unity-files-daemon
4003 ? Sl 0:00 /usr/lib/gwibber/unity-gwibber-daemon
4006 ? Sl 0:00 /usr/lib/x86_64-linux-gnu/unity-shopping-daemon
4008 ? Sl 0:00 /usr/bin/python3 /usr/lib/unity-lens-photos/unity-lens
4009 ? Sl 0:00 /usr/bin/python /usr/lib/unity-lens-video/unity-lens-v
4010 ? Sl 0:00 /usr/lib/x86_64-linux-gnu/unity-music-daemon
4077 ? Sl 0:00 /usr/bin/python /usr/lib/unity-scope-video-remote/unit
4079 ? Sl 0:00 /usr/bin/python3 /usr/lib/unity-lens-files/unity-scope
4106 ? Sl 0:00 /usr/lib/x86_64-linux-gnu/unity-musicstore-daemon
4147 ? SNl 0:13 /usr/bin/python3 /usr/bin/update-manager --no-update -
4170 ? Sl 0:00 /usr/lib/ubuntu-geoip/ubuntu-geoip-provider
4172 ? Sl 0:00 /usr/lib/indicator-datetime/indicator-datetime-service
4240 ? Sl 0:00 /usr/lib/x86_64-linux-gnu/deja-dup/deja-dup-monitor
11934 ? Sl 0:04 gnome-terminal
11942 ? S 0:00 gnome-pty-helper
11944 pts/2 Ss 0:00 bash
12778 pts/2 R+ 0:00 ps xg
If I start mylar and then run the command, there is only one instance:
misterfantastic@MisterFantastic:/home/misterfantastic/.yamj$ ps xg
PID TTY STAT TIME COMMAND
1088 ? Sl 0:27 python /home/misterfantastic/.sickbeard/SickBeard.py -
1979 ? Sl 0:26 /usr/bin/python CouchPotato.py --daemon --pid_file=/va
2019 ? Ssl 0:00 gnome-session --session=ubuntu
2102 ? Ss 0:00 /usr/bin/ssh-agent /usr/bin/dbus-launch --exit-with-se
2105 ? S 0:00 /usr/bin/dbus-launch --exit-with-session gnome-session
2126 ? Sl 7:59 /usr/bin/python -OO /usr/bin/sabnzbdplus --daemon --se
2613 ? Ss 0:01 //bin/dbus-daemon --fork --print-pid 5 --print-address
2787 ? Sl 0:00 /usr/lib/at-spi2-core/at-spi-bus-launcher
2791 ? S 0:00 /bin/dbus-daemon --config-file=/etc/at-spi2/accessibil
2794 ? Sl 0:00 /usr/lib/at-spi2-core/at-spi2-registryd --use-gnome-se
2972 ? Sl 0:04 /usr/lib/gnome-settings-daemon/gnome-settings-daemon
2977 ? SLl 0:00 /usr/bin/gnome-keyring-daemon --start --components=ssh
3162 ? Sl 0:00 /usr/lib/gvfs/gvfsd
3166 ? Sl 0:00 /usr/lib/gvfs//gvfsd-fuse -f /run/user/misterfantastic
3260 ? Sl 0:59 compiz
3270 ? S 0:00 syndaemon -i 2.0 -K -R -t
3293 ? S<l 0:00 /usr/bin/pulseaudio --start --log-target=syslog
3373 ? Sl 0:00 /usr/lib/dconf/dconf-service
3378 ? Sl 0:00 /usr/lib/vino/vino-server --sm-disable
3379 ? Sl 0:00 /usr/lib/gnome-settings-daemon/gnome-fallback-mount-he
3380 ? Sl 0:00 bluetooth-applet
3385 ? Sl 0:01 nm-applet
3386 ? Sl 0:16 nautilus -n
3387 ? Sl 0:00 /usr/lib/policykit-1-gnome/polkit-gnome-authentication
3397 ? Sl 0:00 /usr/lib/gvfs/gvfs-udisks2-volume-monitor
3406 ? S 0:00 /bin/bash /usr/share/filebot/bin/filebot.sh
3424 ? Sl 0:15 transmission-gtk -m
3428 ? S 0:00 /usr/lib/pulseaudio/pulse/gconf-helper
3430 ? S 0:00 /usr/lib/x86_64-linux-gnu/gconf/gconfd-2
3433 ? Sl 0:27 java -Xmx256m -Dunixfs=false -DuseGVFS=true -DuseExten
3505 ? Sl 0:00 /usr/lib/gvfs/gvfs-gphoto2-volume-monitor
3513 ? Sl 0:00 /usr/lib/gvfs/gvfs-afc-volume-monitor
3552 ? Sl 0:00 /usr/lib/notify-osd/notify-osd
3581 ? Sl 0:00 /usr/lib/gvfs/gvfsd-trash --spawner :1.10 /org/gtk/gvf
3587 ? Sl 0:00 telepathy-indicator
3594 ? Sl 0:00 /usr/lib/telepathy/mission-control-5
3602 ? Sl 0:00 /usr/bin/signon-ui
3605 ? Sl 0:00 /usr/lib/gvfs/gvfsd-burn --spawner :1.10 /org/gtk/gvfs
3612 ? Sl 0:01 gnome-screensaver
3613 ? Sl 0:00 zeitgeist-datahub
3619 ? Sl 0:00 /usr/bin/zeitgeist-daemon
3633 ? Sl 0:00 /usr/lib/zeitgeist/zeitgeist-fts
3635 ? S 0:00 /bin/cat
3652 ? Sl 0:00 /usr/lib/gvfs/gvfsd-metadata
3660 ? Sl 0:00 /usr/lib/gvfs/gvfsd-http --spawner :1.10 /org/gtk/gvfs
3665 ? Sl 3:32 /usr/lib/firefox/firefox http://localhost:8090/
3691 ? Sl 0:01 /usr/lib/bamf/bamfdaemon
3718 ? Sl 0:00 /usr/lib/libunity-webapps/unity-webapps-service
3756 ? Ss 0:00 /bin/sh -c /usr/bin/gtk-window-decorator
3757 ? Sl 0:00 /usr/bin/gtk-window-decorator
3769 ? Sl 0:07 /usr/lib/unity/unity-panel-service
3771 ? Sl 0:02 /usr/lib/indicator-appmenu/hud-service
3798 ? Sl 0:01 /usr/bin/python /usr/lib/ubuntuone-client/ubuntuone-sy
3806 ? Sl 0:00 /usr/lib/indicator-session/indicator-session-service
3807 ? Sl 0:00 /usr/lib/x86_64-linux-gnu/indicator-application-servic
3808 ? Sl 0:00 /usr/lib/indicator-printers/indicator-printers-service
3810 ? Sl 0:00 /usr/lib/indicator-sound/indicator-sound-service
3811 ? Sl 0:00 /usr/lib/indicator-messages/indicator-messages-service
3852 ? Sl 0:00 /usr/lib/evolution/evolution-source-registry
3877 ? Sl 0:00 update-notifier
3889 ? Sl 0:00 /usr/lib/gnome-online-accounts/goa-daemon
3891 ? Sl 0:00 /usr/lib/geoclue/geoclue-master
4000 ? Sl 0:00 /usr/lib/unity-lens-applications/unity-applications-da
4002 ? Sl 0:00 /usr/lib/unity-lens-files/unity-files-daemon
4003 ? Sl 0:00 /usr/lib/gwibber/unity-gwibber-daemon
4006 ? Sl 0:00 /usr/lib/x86_64-linux-gnu/unity-shopping-daemon
4008 ? Sl 0:00 /usr/bin/python3 /usr/lib/unity-lens-photos/unity-lens
4009 ? Sl 0:00 /usr/bin/python /usr/lib/unity-lens-video/unity-lens-v
4010 ? Sl 0:00 /usr/lib/x86_64-linux-gnu/unity-music-daemon
4077 ? Sl 0:00 /usr/bin/python /usr/lib/unity-scope-video-remote/unit
4079 ? Sl 0:00 /usr/bin/python3 /usr/lib/unity-lens-files/unity-scope
4106 ? Sl 0:00 /usr/lib/x86_64-linux-gnu/unity-musicstore-daemon
4147 ? SNl 0:13 /usr/bin/python3 /usr/bin/update-manager --no-update -
4170 ? Sl 0:00 /usr/lib/ubuntu-geoip/ubuntu-geoip-provider
4172 ? Sl 0:00 /usr/lib/indicator-datetime/indicator-datetime-service
4240 ? Sl 0:00 /usr/lib/x86_64-linux-gnu/deja-dup/deja-dup-monitor
11934 ? Sl 0:06 gnome-terminal
11942 ? S 0:00 gnome-pty-helper
11944 pts/2 Ss 0:00 bash
12961 pts/2 Sl+ 0:00 python /home/misterfantastic/.mylar/Mylar.py
12977 ? Zs 0:00 [xdg-open] <defunct>
13025 pts/3 Ss 0:00 bash
13111 pts/3 R+ 0:00 ps xg
If I run kill -9 and then start the program again from the command line, everything is repeatable.
i also applied your latest update before starting all this.
Might I have a bad init.d file or something? Just a guess. Here it is:
#! /bin/sh
### BEGIN INIT INFO
# Provides: mylar
# Required-Start: $local_fs $network $remote_fs
# Required-Stop: $local_fs $network $remote_fs
# Should-Start: $NetworkManager
# Should-Stop: $NetworkManager
# Default-Start: 2 3 4 5
# Default-Stop: 0 1 6
# Short-Description: starts instance of mylar
# Description: starts instance of mylar using start-stop-daemon
### END INIT INFO
############### EDIT ME ##################
# path to app
APP_PATH=/home/misterfantastic/.mylar/Mylar.py
# path to python bin
DAEMON=/usr/bin/python
# startup args
DAEMON_OPTS=" Mylar.py -q"
# script name
NAME=mylar
# app name
DESC=mylar
# user
RUN_AS=misterfantastic
PID_FILE=/var/run/mylar.pid
the related issue was due to some recent ( as in today ) changes to the site that mylar pulls the pullist from. Latest dev. commit fixes this. I can't replicate your problem tho...well the lower one I can..is that the issue now?
I think I'm all fixed up now!
Regarding your question, I'm not sure if they were connected or unrelated. I'll tell you later how things are going regarding error messages.
Earlier today, I seemed to be able to add "Avenging Spider-Man" with no problems. Moments later, when I attempted to then add "Superior Spider-Man", I got the crash. I tried adding a different comic, "Superman Family", just for testing, and it crashed again. It appears to now be 100% repeatable.
After clicking "add this comic" it just keeps "loading"; no issues or title graphic appear. Then I went back out to the main page by clicking the book and arrow icon and it crashes. In order to get mylar running again, I Have to use the "python Mylar.py" command. It says "is something already running", but that is required for it to be accessible again.
100% repeatable.