search

digitalec / deemon

Monitor specified artists for new releases
GNU General Public License v3.0
177 stars 15 forks source link

refresh only refreshes 1 artist, despite having more monitored #43

Closed mathiasfoster closed 3 years ago

mathiasfoster commented 3 years ago 
> deemon refresh
Initializing deemon 2.4.4

Starting database refresh
:: Fetching artist release data for 1 artist(s), please wait... 100%
:: Checking for new releases... 100%

+ Artists monitored: 276
+ Playlists monitored: 10
+ Releases seen: 9,828
+ Pending future releases: 5

Operation completed in 00:00:02
Database is up-to-date. No new releases were found.

In the logs:

2021-10-29 07:38:17 [DEBUG] deemon.cli: deemon 2.4.4
2021-10-29 07:38:17 [DEBUG] deemon.cli: command: "refresh"
2021-10-29 07:38:17 [DEBUG] deemon.cli: Python 3.8.10
2021-10-29 07:38:17 [DEBUG] deemon.cli: Linux-5.10.60.1-microsoft-standard-WSL2-x86_64-with-glibc2.29
2021-10-29 07:38:17 [DEBUG] deemon.cli: deemon appdata is located at /home/mathias/.config/deemon
2021-10-29 07:38:17 [DEBUG] deemon.core.config: Loading configuration, please wait...
2021-10-29 07:38:17 [DEBUG] deemon.core.config: Attempting to locate deemix's .arl file
2021-10-29 07:38:17 [DEBUG] deemon.core.config: Successfully loaded ARL
2021-10-29 07:38:17 [DEBUG] deemon.core.db: Database version 3.5
2021-10-29 07:38:17 [DEBUG] deemon.core.db: DATABASE UPGRADE IN PROGRESS!
2021-10-29 07:38:17 [DEBUG] deemon.core.config: Loaded config for profile 1 (default)
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > check_update: 1
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > debug_mode: False
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > release_channel: stable
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > query_limit: 5
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > rollback_view_limit: 10
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > prompt_duplicates: False
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > prompt_no_matches: True
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > new_releases/by_release_date: 1
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > new_releases/release_max_age: 90
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > global/bitrate: 320
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > global/alerts: False
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > global/record_type: all
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > global/download_path:
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > global/email:
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > deemix/path:
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > deemix/arl: ********
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > smtp_settings/server:
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > smtp_settings/port: ********
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > smtp_settings/username:
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > smtp_settings/password:
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > smtp_settings/from_addr:
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > plex/base_url:
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > plex/token:
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > plex/library:
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > profile_id: 1
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > tid: 30
2021-10-29 07:38:17 [DEBUG] deemon.core.config: > profile_name: default
2021-10-29 07:38:17 [INFO] deemon.cli: Starting database refresh
2021-10-29 07:38:18 [DEBUG] deemon.core.api: Login OK, max_threads set to 50
2021-10-29 07:38:18 [DEBUG] deemon.core.api: API in use: deezer-gw, thread count set to: 50
2021-10-29 07:38:18 [DEBUG] deemon.cmd.refresh: There are 0 playlist(s) and 1 artist(s) waiting to be refreshed.
2021-10-29 07:38:18 [DEBUG] deemon.cmd.refresh: Standby, starting refresh...
2021-10-29 07:38:18 [DEBUG] deemon.cmd.refresh: Fetching artist release data...
2021-10-29 07:38:19 [INFO] deemon.utils.performance: Operation completed in 00:00:02
2021-10-29 07:38:19 [INFO] deemon.cmd.refresh: Database is up-to-date. No new releases were found.

I'm not sure what additional troubleshooting/information-gathering I can do, happy to try anything you suggest!

digitalec commented 3 years ago

I'm not able to reproduce this but most likely there is an artist flagged as not having been refreshed yet: 2021-10-29 07:38:18 [DEBUG] deemon.cmd.refresh: There are 0 playlist(s) and 1 artist(s) waiting to be refreshed.

Try running refresh again to see if it clears (it should only show the above message directly after monitoring an artist).

mathiasfoster commented 3 years ago

Running deemon refresh multiple times doesn't change the result.

Is there any way I can manually mark the artist as having been refreshed?

digitalec commented 3 years ago

First set debug_mode to true in the config and rerun refresh. This will log some info related to the artist/release that's holding things up.

You may have found a bug related to some specific condition produced by that artist.

Please post the debug output from the log here so I can patch it if needed.

Edit: from this output you can determine which artist and remove them -or- open the database using "DB Browser for SQLite" and manually mark the artist as refreshed in the monitor table (is_refreshed = 1).

mathiasfoster commented 3 years ago

Excellent, debug_mode: true exposed the name of the artist, I simply removed the artist, ran deemon refresh, then re-added!

(not sure whether this is the same issue or not) It appears that playlists get downloaded multiple times. E.g. if there are 15 new tracks in a playlist, the entire playlist gets downloaded 15 times.

From queue.csv:

artist_name,album_id,album_title,track_id,track_title,url,playlist_title,bitrate,download_path
Armin van Buuren,268483722,ASOT 1040 - A State Of Trance Episode 1040,None,None,https://www.deezer.com/album/268483722,>None,None,None,None,None,https://deezer.com/playlist/3153080842,Afrobeats,320,
None,None,None,None,None,https://deezer.com/playlist/3153080842,Afrobeats,320,
None,None,None,None,None,https://deezer.com/playlist/3153080842,Afrobeats,320,
None,None,None,None,None,https://deezer.com/playlist/1902101402,Electronic Hits,320,
None,None,None,None,None,https://deezer.com/playlist/1902101402,Electronic Hits,320,
None,None,None,None,None,https://deezer.com/playlist/1902101402,Electronic Hits,320,
None,None,None,None,None,https://deezer.com/playlist/1902101402,Electronic Hits,320,
None,None,None,None,None,https://deezer.com/playlist/1902101402,Electronic Hits,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320,
None,None,None,None,None,https://deezer.com/playlist/6682665064,Fresh Rap,320
...and so on
digitalec commented 3 years ago

Glad to hear! That playlist issue is something new. I'll close this and open a new issue for that one.