KurtzPT
commented
3 years ago Just had the same happening now with other streamers that came online.
Closed KurtzPT closed 3 years ago
KurtzPT
commented
3 years ago Just had the same happening now with other streamers that came online.
MrBrax
commented
3 years ago check the streamlink logs in the software subfolder of logs
KurtzPT
commented
3 years ago Logs:
$ /usr/bin/streamlink --hls-live-restart --hls-live-edge 99999 --hls-timeout 200 --hls-segment-timeout 200 --hls-segment-threads 5 --twitch-disable-hosting --twitch-disable-ads --retry-streams 10 --retry-max 5 -o /var/www/twitchautomator/src/../public/vods/TimTheTatman/TimTheTatman_2020-12-26T21_28_37Z_41087739598.ts --url twitch.tv/TimTheTatman --default-stream best [cli][info] Found matching plugin twitch for URL twitch.tv/TimTheTatman [cli][info] Found matching plugin twitch for URL twitch.tv/TimTheTatman [cli][error] Unable to open URL: https://usher.ttvnw.net/api/channel/hls/timthetatman.m3u8?player=twitchweb&p=829442&type=any&allow_source=true&allow_audio_only=true&allow_spectre=false&sig=7b86747a05ac6d87f9435eecace29a333b05a4d0&token=%7B%22adblock%22%3Afalse%2C%22authorization%22%3A%7B%22forbidden%22%3Afalse%2C%22reason%22%3A%22%22%7D%2C%22blackout_enabled%22%3Afalse%2C%22channel%22%3A%22timthetatman%22%2C%22channel_id%22%3A36769016%2C%22chansub%22%3A%7B%22restricted_bitrates%22%3A%5B%5D%2C%22view_until%22%3A1924905600%7D%2C%22ci_gb%22%3Afalse%2C%22geoblock_reason%22%3A%22%22%2C%22device_id%22%3Anull%2C%22expires%22%3A1609019365%2C%22extended_history_allowed%22%3Afalse%2C%22game%22%3A%22%22%2C%22hide_ads%22%3Afalse%2C%22https_required%22%3Atrue%2C%22mature%22%3Afalse%2C%22partner%22%3Afalse%2C%22platform%22%3A%22web%22%2C%22player_type%22%3A%22embed%22%2C%22private%22%3A%7B%22allowed_to_view%22%3Atrue%7D%2C%22privileged%22%3Afalse%2C%22role%22%3A%22%22%2C%22server_ads%22%3Atrue%2C%22show_ads%22%3Atrue%2C%22subscriber%22%3Afalse%2C%22turbo%22%3Afalse%2C%22user_id%22%3Anull%2C%22user_ip%22%3A%2294.62.22.82%22%2C%22version%22%3A2%7D&fast_bread=True (403 Client Error: Forbidden for url: https://usher.ttvnw.net/api/channel/hls/timthetatman.m3u8?player=twitchweb&p=829442&type=any&allow_source=true&allow_audio_only=true&allow_spectre=false&sig=7b86747a05ac6d87f9435eecace29a333b05a4d0&token=%7B%22adblock%22%3Afalse%2C%22authorization%22%3A%7B%22forbidden%22%3Afalse%2C%22reason%22%3A%22%22%7D%2C%22blackout_enabled%22%3Afalse%2C%22channel%22%3A%22timthetatman%22%2C%22channel_id%22%3A36769016%2C%22chansub%22%3A%7B%22restricted_bitrates%22%3A%5B%5D%2C%22view_until%22%3A1924905600%7D%2C%22ci_gb%22%3Afalse%2C%22geoblock_reason%22%3A%22%22%2C%22device_id%22%3Anull%2C%22expires%22%3A1609019365%2C%22extended_history_allowed%22%3Afalse%2C%22game%22%3A%22%22%2C%22hide_ads%22%3Afalse%2C%22https_required%22%3Atrue%2C%22mature%22%3Afalse%2C%22partner%22%3Afalse%2C%22platform%22%3A%22web%22%2C%22player_type%22%3A%22embed%22%2C%22private%22%3A%7B%22allowed_to_view%22%3Atrue%7D%2C%22privileged%22%3Afalse%2C%22role%22%3A%22%22%2C%22server_ads%22%3Atrue%2C%22show_ads%22%3Atrue%2C%22subscriber%22%3Afalse%2C%22turbo%22%3Afalse%2C%22user_id%22%3Anull%2C%22user_ip%22%3A%2294.62.22.82%22%2C%22version%22%3A2%7D&fast_bread=True) [cli][info] Waiting for streams, retrying every 10.0 second(s) [cli][error] Unable to open URL: https://usher.ttvnw.net/api/channel/hls/timthetatman.m3u8?player=twitchweb&p=729133&type=any&allow_source=true&allow_audio_only=true&allow_spectre=false&sig=7b86747a05ac6d87f9435eecace29a333b05a4d0&token=%7B%22adblock%22%3Afalse%2C%22authorization%22%3A%7B%22forbidden%22%3Afalse%2C%22reason%22%3A%22%22%7D%2C%22blackout_enabled%22%3Afalse%2C%22channel%22%3A%22timthetatman%22%2C%22channel_id%22%3A36769016%2C%22chansub%22%3A%7B%22restricted_bitrates%22%3A%5B%5D%2C%22view_until%22%3A1924905600%7D%2C%22ci_gb%22%3Afalse%2C%22geoblock_reason%22%3A%22%22%2C%22device_id%22%3Anull%2C%22expires%22%3A1609019365%2C%22extended_history_allowed%22%3Afalse%2C%22game%22%3A%22%22%2C%22hide_ads%22%3Afalse%2C%22https_required%22%3Atrue%2C%22mature%22%3Afalse%2C%22partner%22%3Afalse%2C%22platform%22%3A%22web%22%2C%22player_type%22%3A%22embed%22%2C%22private%22%3A%7B%22allowed_to_view%22%3Atrue%7D%2C%22privileged%22%3Afalse%2C%22role%22%3A%22%22%2C%22server_ads%22%3Atrue%2C%22show_ads%22%3Atrue%2C%22subscriber%22%3Afalse%2C%22turbo%22%3Afalse%2C%22user_id%22%3Anull%2C%22user_ip%22%3A%2294.62.22.82%22%2C%22version%22%3A2%7D&fast_bread=True (403 Client Error: Forbidden for url: https://usher.ttvnw.net/api/channel/hls/timthetatman.m3u8?player=twitchweb&p=729133&type=any&allow_source=true&allow_audio_only=true&allow_spectre=false&sig=7b86747a05ac6d87f9435eecace29a333b05a4d0&token=%7B%22adblock%22%3Afalse%2C%22authorization%22%3A%7B%22forbidden%22%3Afalse%2C%22reason%22%3A%22%22%7D%2C%22blackout_enabled%22%3Afalse%2C%22channel%22%3A%22timthetatman%22%2C%22channel_id%22%3A36769016%2C%22chansub%22%3A%7B%22restricted_bitrates%22%3A%5B%5D%2C%22view_until%22%3A1924905600%7D%2C%22ci_gb%22%3Afalse%2C%22geoblock_reason%22%3A%22%22%2C%22device_id%22%3Anull%2C%22expires%22%3A1609019365%2C%22extended_history_allowed%22%3Afalse%2C%22game%22%3A%22%22%2C%22hide_ads%22%3Afalse%2C%22https_required%22%3Atrue%2C%22mature%22%3Afalse%2C%22partner%22%3Afalse%2C%22platform%22%3A%22web%22%2C%22player_type%22%3A%22embed%22%2C%22private%22%3A%7B%22allowed_to_view%22%3Atrue%7D%2C%22privileged%22%3Afalse%2C%22role%22%3A%22%22%2C%22server_ads%22%3Atrue%2C%22show_ads%22%3Atrue%2C%22subscriber%22%3Afalse%2C%22turbo%22%3Afalse%2C%22user_id%22%3Anull%2C%22user_ip%22%3A%2294.62.22.82%22%2C%22version%22%3A2%7D&fast_bread=True)
(It repeats about 12 times the same stuff)
Just noticed streamlink was updated 5 days ago (Version 2.0.0), maybe it's something on their end.
MrBrax
commented
3 years ago i haven't updated yet and it works, it's as if you can't access the stream, banned or some cache server is malfunctioning
KurtzPT
commented
3 years ago i haven't updated yet and it works, it's as if you can't access the stream, banned or some cache server is malfunctioning
Docker streamlink version is 2.0.0, just checked:
I'm not banned since I can manually force the recording in the app itself. Also I can watch fine the stream too. Not sure about the cache server.
MrBrax
commented
3 years ago oh yeah i never input a version into the dockerfile, makes sense
does running the exact same command outside docker do the same thing?
KurtzPT
commented
3 years ago Isn't the command exactly the same when using the "force record" option on twitch automator? Because that always work (but I only tried like 2-3 times and the stream was at least 5-10 minutes uptime).
I can try and be on the look out for more of these errors so when they happen I'll try the command outside of docker.
MrBrax
commented
3 years ago Isn't the command exactly the same when using the "force record" option on twitch automator?
mostly, but i just want to make sure it can be reproduced i can't really account this to something else than streamlink though, very strange error
KurtzPT
commented
3 years ago I just updated the TwitchAutomator, had a stream just record 1-2 minutes and stopped for no reason. Logs:
$ /usr/bin/streamlink --hls-live-restart --hls-live-edge 99999 --hls-timeout 200 --hls-segment-timeout 200 --hls-segment-threads 5 --twitch-disable-hosting --twitch-disable-ads --retry-streams 10 --retry-max 5 --twitch-disable-reruns -o /var/www/twitchautomator/src/../public/vods/MOONMOON/MOONMOON_2020-12-27T23_05_03Z_41100805822.ts --url twitch.tv/MOONMOON --default-stream best [cli][info] Found matching plugin twitch for URL twitch.tv/MOONMOON [cli][info] Found matching plugin twitch for URL twitch.tv/MOONMOON [cli][info] Available streams: audio_only, 160p (worst), 360p, 480p, 720p, 720p60, 1080p60 (best) [cli][info] Opening stream: 1080p60 (hls) [cli][info] Available streams: audio_only, 160p (worst), 360p, 480p, 720p, 720p60, 1080p60 (best) [plugins.twitch][info] Will skip ad segments [cli][info] Opening stream: 1080p60 (hls) [plugins.twitch][info] Will skip ad segments [cli][error] File /var/www/twitchautomator/src/../public/vods/MOONMOON/MOONMOON_2020-12-27T23_05_03Z_41100805822.ts already exists, use --force to overwrite it. [cli][info] Closing currently open stream...
Feels like streamlink is running two instances or something of the sort, info is duplicated.
EDIT: It is running two times, per TwitchAutomator logs:
2020-12-27 23:07:36.171 automator INFO Starting capture with filename MOONMOON_2020-12-27T23_05_03Z_41100805822.ts 2020-12-27 23:07:36.172 automator SUCCESS Game updated on MOONMOON to Bloons TD 6 (bloons > yakuza > Shattered Crowns @ 7) 2020-12-27 23:07:36.172 vodclass INFO Refreshing JSON on MOONMOON_2020-12-27T23_05_03Z_41100805822! 2020-12-27 23:07:36.173 vodclass SUCCESS Saving JSON of MOONMOON_2020-12-27T23_05_03Z_41100805822 (dt_capture_started set) 2020-12-27 23:07:36.173 automator INFO Starting capture with filename MOONMOON_2020-12-27T23_05_03Z_41100805822.ts 2020-12-27 23:07:36.174 job INFO Save job capture_MOONMOON_2020-12-27T23_05_03Z_41100805822 with PID 290 2020-12-27 23:07:36.174 automator INFO Using process wait method 1 2020-12-27 23:07:36.176 job INFO Save job capture_MOONMOON_2020-12-27T23_05_03Z_41100805822 with PID 291 2020-12-27 23:07:36.177 automator INFO Using process wait method 1
MrBrax
commented
3 years ago yeah that shouldn't be possible due to the job system, i'm really at a loss here
MrBrax
commented
3 years ago i started a recording for moonmoon just fine, must be something with streamlink on your end
KurtzPT
commented
3 years ago I can also start the record manually without a problem, heck even automatically works sometimes too. This is not 100% occurrence (hence why it is hard to replicate) and I doubt my streamlink has something wrong, I didn't change anything else on the docker image.
No idea why it duplicated the mp4 tho, as you can see above.
KurtzPT
commented
3 years ago Example of today forsen stream that started the record automatically (without any problem):
2020-12-28 18:06:14.292 | hook |
Hook called 2020-12-28 18:06:14.300 | hook | Dumping payload... 2020-12-28 18:06:14.306 | hook | Run handle... 2020-12-28 18:06:14.328 | automator | Handle called 2020-12-28 18:06:14.338 | job | Loading job capture_forsen_2020-12-28T18_03_29Z_40520418380 failed, no json file 2020-12-28 18:06:14.345 | vodclass | Create VOD JSON: forsen_2020-12-28T18_03_29Z_40520418380.json 2020-12-28 18:06:14.350 | vodclass | Saving JSON of forsen_2020-12-28T18_03_29Z_40520418380 with no chapters!! 2020-12-28 18:06:14.356 | vodclass | Saving JSON of forsen_2020-12-28T18_03_29Z_40520418380 (create json) 2020-12-28 18:06:14.363 | helper | Fetched channel data from cache for forsen 2020-12-28 18:06:14.368 | vodclass | JSON has been changed since loading of forsen_2020-12-28T18_03_29Z_40520418380 2020-12-28 18:06:14.374 | vodclass | Saving JSON of forsen_2020-12-28T18_03_29Z_40520418380 with no chapters!! 2020-12-28 18:06:14.379 | vodclass | Saving JSON of forsen_2020-12-28T18_03_29Z_40520418380 (stream download) 2020-12-28 18:06:14.385 | vodclass | Refreshing JSON on forsen_2020-12-28T18_03_29Z_40520418380! 2020-12-28 18:06:14.391 | vodclass | Loading VOD Class for /var/www/twitchautomator/src/../public/vods/forsen/forsen_2020-12-28T18_03_29Z_40520418380.json 2020-12-28 18:06:14.397 | helper | Fetched channel data from cache for forsen 2020-12-28 18:06:14.402 | vodclass | No chapters on forsen_2020-12-28T18_03_29Z_40520418380! 2020-12-28 18:06:14.408 | vodclass | Saving JSON of forsen_2020-12-28T18_03_29Z_40520418380 with no chapters!! 2020-12-28 18:06:14.414 | vodclass | Saving JSON of forsen_2020-12-28T18_03_29Z_40520418380 (is_capturing set) 2020-12-28 18:06:14.419 | automator | Update game for forsen_2020-12-28T18_03_29Z_40520418380 2020-12-28 18:06:14.425 | vodclass | Refreshing JSON on forsen_2020-12-28T18_03_29Z_40520418380! 2020-12-28 18:06:14.430 | vodclass | Loading VOD Class for /var/www/twitchautomator/src/../public/vods/forsen/forsen_2020-12-28T18_03_29Z_40520418380.json 2020-12-28 18:06:14.437 | helper | Fetched channel data from cache for forsen 2020-12-28 18:06:14.443 | vodclass | No chapters on forsen_2020-12-28T18_03_29Z_40520418380! 2020-12-28 18:06:14.449 | vodclass | Adding chapter to forsen_2020-12-28T18_03_29Z_40520418380 2020-12-28 18:06:14.455 | vodclass | Saving JSON of forsen_2020-12-28T18_03_29Z_40520418380 (game update) 2020-12-28 18:06:14.460 | automator | Game updated on forsen to Just Chatting (Easing into it!) 2020-12-28 18:06:14.466 | vodclass | Refreshing JSON on forsen_2020-12-28T18_03_29Z_40520418380! 2020-12-28 18:06:14.475 | vodclass | Loading VOD Class for /var/www/twitchautomator/src/../public/vods/forsen/forsen_2020-12-28T18_03_29Z_40520418380.json 2020-12-28 18:06:14.480 | helper | Fetched channel data from cache for forsen 2020-12-28 18:06:14.486 | vodclass | Saving JSON of forsen_2020-12-28T18_03_29Z_40520418380 (dt_capture_started set) 2020-12-28 18:06:14.492 | automator | Starting capture with filename forsen_2020-12-28T18_03_29Z_40520418380.ts 2020-12-28 18:06:14.506 | automator | Capture forsen_2020-12-28T18_03_29Z_40520418380.ts has PID 436 2020-12-28 18:06:14.512 | job | Save job capture_forsen_2020-12-28T18_03_29Z_40520418380 with PID 436 2020-12-28 18:06:14.524 | automator | Using process wait method 1 2020-12-28 18:06:21.360 | automator | Stream resolution for forsen_2020-12-28T18_03_29Z_40520418380: 1080p60 2020-12-28 18:06:21.367 | automator | Capturing of forsen_2020-12-28T18_03_29Z_40520418380, will try to remove ads!
MrBrax
commented
3 years ago do you have dual subscriptions for the webhooks?
KurtzPT
commented
3 years ago do you have dual subscriptions for the webhooks?
I'm not sure what you mean by dual subscriptions. Using the /subs API call on TwitchAutomator I noticed I have some subscriptions using the old app url and some with the new app url (I changed the app url from using the external IP to use my domain). This might be a problem?
I have atm 8 streamers on the app, but while calling /subs it says I have 18.
["total"]=> int(18)
EDIT: I'm not seeing anywhere on TwitchAutomator to remove these subscriptions or a tool to remove every single subscription.
KurtzPT
commented
3 years ago moonmoon started streaming and it failed again, with the two instances of streamlink going off at the same time.
The issue above while I guess it shouldn't happen, it's not the cause for this issue.
I noticed streamers_v2.json has two moonmoon somehow:
{ "moonmoon": { "id": "121059319", "login": "moonmoon", "display_name": "MOONMOON", "type": "", "broadcaster_type": "partner", "description": "penis", "profile_image_url": "https://static-cdn.jtvnw.net/jtv_user_pictures/3973e918fe7cc8c8-profile_image-300x300.png", "offline_image_url": "https://static-cdn.jtvnw.net/jtv_user_pictures/70773a4f-3d96-40a4-9957-8b3bdc067eb3-channel_offline_image-1920x1080.png", "view_count": 79480365, "created_at": "2016-04-06T04:12:40.993797Z" }, "MOONMOON": { "id": "121059319", "login": "moonmoon", "display_name": "MOONMOON", "type": "", "broadcaster_type": "partner", "description": "penis", "profile_image_url": "https://static-cdn.jtvnw.net/jtv_user_pictures/3973e918fe7cc8c8-profile_image-300x300.png", "offline_image_url": "https://static-cdn.jtvnw.net/jtv_user_pictures/70773a4f-3d96-40a4-9957-8b3bdc067eb3-channel_offline_image-1920x1080.png", "view_count": 79480365, "created_at": "2016-04-06T04:12:40.993797Z" },
Can this be the issue?
MrBrax
commented
3 years ago yeah could very well be
the streamers_v2.json is just a cache for streamers though, not the actual subbed ones
the subs should run out, i don't really have a tool for it, since you need to know the urls to unsubscribe
KurtzPT
commented
3 years ago yeah could very well be
the streamers_v2.json is just a cache for streamers though, not the actual subbed ones
the subs should run out, i don't really have a tool for it, since you need to know the urls to unsubscribe
I created a new application on twitch and changed api key/client_id, so basically I started from scratch regarding the twitch api. Now I'm just subscribed without having duplicated streamers, I'll be taking a look for next streams to see if anything changes.
KurtzPT
commented
3 years ago It didn't work, I had three streams failed to record automatically with the duplicated instance of streamlink issue. I'm out of ideas.
MrBrax
commented
3 years ago the only other thing i can think of is using process wait method 2, otherwise it must be on your end/connection
KurtzPT
commented
3 years ago I'm going to delete everything start from scratch building the image with docker compose and install it. If it happens again I'll change the process wait method to 2.
KurtzPT
commented
3 years ago Just started from scratch, still the same issue. Going to try wait method 2
MrBrax
commented
3 years ago it's not just a permissions issue then?
KurtzPT
commented
3 years ago I'm not seeing what permission issue would be, TwitchAutomator starts two instances without any problem, the problem is that both streamlink instances can't be running on the same output filename, which is why one of the instances says:
[cli][error] File /var/www/twitchautomator/src/../public/vods/MOONMOON/MOONMOON_2020-12-29T23_31_38Z_41125587614.ts already exists, use --force to overwrite it. [cli][info] Closing currently open stream...
All volumes have permissions too, since I can record everything manually without a problem.
So basically what happens is the first instance records over 1-2 minutes (maybe something related to ad segments, I'm not sure why it stops since the logs don't show anything about it) then it stops. The 2nd instance that runs basically at the same time stops immediately because the output file already exists.
EDIT: For me this issue starts when TwitchAutomator creates duplicated jobs for the same stream recording. I'm not proficient in PHP to debug this myself but duplicated jobs should not happen at all.
2020-12-29 23:32:47.389 | vodclass |
Saving JSON of MOONMOON_2020-12-29T23_31_38Z_41125587614 (dt_capture_started set) 2020-12-29 23:32:47.389 | automator | Starting capture with filename MOONMOON_2020-12-29T23_31_38Z_41125587614.ts 2020-12-29 23:32:47.441 | job | 2020-12-29 23:32:47.557 | helper |Save job capture_MOONMOON_2020-12-29T23_31_38Z_41125587614 with PID 814 2020-12-29 23:32:47.442 | automator | Using process wait method 1 New game saved to cache: Bloons TD 6 2020-12-29 23:32:47.557 | vodclass | JSON has been changed since loading of MOONMOON_2020-12-29T23_31_38Z_41125587614 2020-12-29 23:32:47.565 | vodclass | Saving JSON of MOONMOON_2020-12-29T23_31_38Z_41125587614 (game update) 2020-12-29 23:32:47.576 | automator | Game updated on MOONMOON to Bloons TD 6 (BGL (bloons gambling league) > yakuza) 2020-12-29 23:32:47.578 | vodclass | Refreshing JSON on MOONMOON_2020-12-29T23_31_38Z_41125587614! 2020-12-29 23:32:47.578 | vodclass | Saving JSON of MOONMOON_2020-12-29T23_31_38Z_41125587614 (dt_capture_started set) 2020-12-29 23:32:47.590 | automator | Starting capture with filename MOONMOON_2020-12-29T23_31_38Z_41125587614.ts 2020-12-29 23:32:47.597 | job | 2020-12-29 23:32:54.000 | automator |Save job capture_MOONMOON_2020-12-29T23_31_38Z_41125587614 with PID 815 2020-12-29 23:32:47.598 | automator | Using process wait method 1 Stream resolution for MOONMOON_2020-12-29T23_31_38Z_41125587614: 1080p60 2020-12-29 23:32:54.001 | automator | Capturing of MOONMOON_2020-12-29T23_31_38Z_41125587614, will try to remove ads! 2020-12-29 23:32:54.028 | automator | Stream resolution for MOONMOON_2020-12-29T23_31_38Z_41125587614: 1080p60 2020-12-29 23:32:54.029 | automator | Capturing of MOONMOON_2020-12-29T23_31_38Z_41125587614, will try to remove ads! 2020-12-29 23:32:55.570 | automator | Finished capture with filename MOONMOON_2020-12-29T23_31_38Z_41125587614.ts <<- 1st PID stops capturing for some reason. 2020-12-29 23:32:55.570 | automator |Unexplainable, MOONMOON_2020-12-29T23_31_38Z_41125587614.ts could not be captured due to existing file already. <<- 2nd PID streamlink errors out because of existing file 2020-12-29 23:32:55.613 | job |Clear job capture_MOONMOON_2020-12-29T23_31_38Z_41125587614 with PID 815 2020-12-29 23:32:55.614 | automator | Add end timestamp for MOONMOON_2020-12-29T23_31_38Z_41125587614 2020-12-29 23:32:55.615 | vodclass | Refreshing JSON on MOONMOON_2020-12-29T23_31_38Z_41125587614! 2020-12-29 23:32:55.615 | vodclass | Saving JSON of MOONMOON_2020-12-29T23_31_38Z_41125587614 (stream capture end) 2020-12-29 23:32:57.576 | automator | VOD exists but isn't capturing anymore on MOONMOON_2020-12-29T23_31_38Z_41125587614 2020-12-29 23:33:05.093 | automator | VOD exists but isn't capturing anymore on MOONMOON_2020-12-29T23_31_38Z_41125587614 2020-12-29 23:33:05.103 | automator | VOD exists but isn't capturing anymore on MOONMOON_2020-12-29T23_31_38Z_41125587614
KurtzPT
commented
3 years ago By the way, I didn't had this problem before, so something on the code changed that started making this issue appear.
MrBrax
commented
3 years ago yep, it really is unexplainable
KurtzPT
commented
3 years ago wait method 2 does not solve the issue, it still created duplicated instances. I'm out of ideas. Enabled debug mode to dump the payloads, noticed I get two hook calls (despite having just one subscription for that streamer), see below:
Maybe this is why TwitchAutomator starts two instances basically at the same time? The files are exactly the same:
KurtzPT
commented
3 years ago unsub_all is not working too:
I feel like I'm being a pest so let me know if you don't want me to test things out.
MrBrax
commented
3 years ago the unsub page was to be expected to not work without being tested yeah
have you tried using wget or curl to start the presumably force recording instead of using a web browser?
KurtzPT
commented
3 years ago the unsub page was to be expected to not work without being tested yeah
have you tried using wget or curl to start the presumably force recording instead of using a web browser?
Force recording via TwitchAutomator webpage works, me using the exact same streamlink command that TwitchAutomator uses when auto recording also works (after I delete the old .ts file that is left behind from the double instance issue)
MrBrax
commented
3 years ago yeah but does wget/curl also create two requests/payloads?
KurtzPT
commented
3 years ago Which wget/curl you want me to do? Not sure how can I make TwitchAutomator start via it.
Also I have an update. I thought to myself maybe old API applications that I deleted on Twitch were somehow still having subscriptions working on them. (Makes zero sense, but somehow I noticed getting duplicated hook calls while not having duplicated subscriptions on my actual twitch api application) So I just changed the port of TwitchAutomator to a new port never used before, changed app url and subscribed to all streamers again.
So now I have loads of subscriptions on this twitch api application I'm using, but just the last subs using the right port will work.
After I did this, every single stream started recording without a problem (4 at the moment).
I'm going to leave this up and check tomorrow if next streams start without any issue.
MrBrax
commented
3 years ago yeah it sounds like old subscriptions are still triggering was thinking of using wget on the force recording, but if that's a natural recording then it should be fine
KurtzPT
commented
3 years ago Well today I still didn't have any problem. So I'm going to assume that this issue is because twitch api apps when deleted, they don't remove active subscriptions from their side associated with that twitch app. Which is totally weird behavior if that is true.
Couldn't we do some checking on the payloads received by the TwitchAutomator hook api, to make sure that payload came from the correct app url we have defined? So basically every single payload that does not have the current app url would be ignored.
The above and maybe something to check if we have duplicated subscriptions (not sure if its possible having duplicated subscriptions with the same app url) and this should not happen.
MrBrax
commented
3 years ago yeah there's some stuff with the hub challenge that could probably be used, i'll have to look into it
KurtzPT
commented
3 years ago I'll shall take a look at that commit later on, everything is going fine atm. I noticed just one little issue that probably will rarely happen again:
One of the streamers I'm recording is doing a 24h+ stream. The recording was fine until it reach exactly 24h. Then it stopped. I tried to force record it manually but it says:
2021-01-01 20:16:05.769 | helper |
Querying streams for streamer id 12585713 2021-01-01 20:16:05.773 | automator | VOD is finalized, but wanted more info on Threedogg_2020-12-31T18_25_51Z_40561688940
Any idea?
MrBrax
commented
3 years ago known issue with streamlink, devs don't have anything reliable to test on
KurtzPT
commented
3 years ago known issue with streamlink, devs don't have anything reliable to test on
I wasn't aware of it, that sucks. It's rare when one streams for over 24h hours anyway, but still sucks.
MrBrax
commented
3 years ago i could make it repeat the capture but as with those devs, it's hard to test it
MrBrax
commented
3 years ago KurtzPT
commented
3 years ago i could make it repeat the capture but as with those devs, it's hard to test it
Well 4 years later I doubt they'll do anything as they said it's out of streamlink scope. That should be the best alternative even if it makes a new video file.
MrBrax
commented
3 years ago it's a huge rewrite, some day maybe
KurtzPT
commented
3 years ago it's a huge rewrite, some day maybe
I wouldn't worry to be honest, very rarely one streams over 24h. Your app is already very good like this 👍
MrBrax
commented
3 years ago i'm currently working on youtube livestream support, i might be able to use some public api's since youtube's own is so locked down with accounts and apps
MrBrax
commented
3 years ago anyway, since this is solved and getting offtopic, there's the new discussions thing
Just noticed this happening today, timthetatman stream started and since I have notifications turned on on TwitchAutomator it warned me of it. After a couple of minutes, TwitchAutomator was not recording it anymore. Logs below: