[Error] if there are too many VODs in the list, the recording does not work

[devpanda0]

if about 170 VODs in the list, recording no longer works properly.

[MrBrax]

what is "not properly"? does it just cut out or not at all? any logs when it happens?

[devpanda0]

He wants to start recording, but then stops and doesn't say what's wrong. It just doesn't work anymore

[devpanda0]

and since yesterday I have this problem that the stream just stops for no reason. I have not changed anything on the system

[MrBrax]

can you check the capture logs in the data/logs/software directory?

[devpanda0]

capture_katarkim_41685229720_stdout.log

here the log file. any problem with playlist refresh

[MrBrax]

i've updated streamlink, it could be the issue along with #486

[devpanda0]

Thanks, had already seen it and directly pulled it from docker but unfortunately no success

[MrBrax]

i feel like it must either be a streamlink error or your network connection, but i guess it could also be some kind of system stall. does it use up 100% cpu?

[devpanda0]

The CPU chills its life with 10% maximum load I have check it and i have no network problems

[MrBrax]

i mistakenly set the new queue threshold to disable itself at 0, you could try raising it to a higher number as well as the stream timeout, if it's at all related to #486

[devpanda0]

okay, i try it with the new build :)

[devpanda0]

okay, doesn't stop more but is come this error and he record only in 360p but i have choose best and 360p is not the best xD

[MrBrax]

you're gonna have to check the logs for all of these things, seems to be an unique error for your setup unless someone else reports in too

[devpanda0]

I have been using the tool for almost 2 years now and the problems started after an update. I just can't remember exactly which one. I can reinstall the recorder, but this didn't help last time

LiveStreamDVR-2024-01-15.log capture_pnation_42217575609_stdout.log

[MrBrax]

leaning more towards streamlink or twitch then if it returns weird resolution choices like that, could it be rate limiting even?

[devpanda0]

In what way do you mean ratelimit? From Twitch?

[MrBrax]

preventing abuse by too many requests from twitch yes, i tried running the same command and it seems to capture just fine

[devpanda0]

Okay, it worked fine for me for about 10 minutes, then it stopped (error). I only record one streamer and the server also has an IP for itself.

[MrBrax]

it's going on for 23 minutes for me so far, no problems. i feel like it must be on your end somehow. could your country be rate limiting too?

[devpanda0]

I am Germany and so is the server. I don't know that we have a limit on Twitch. It's been running for almost the last 2 years and we've accumulated 16 TB of VOD material

[MrBrax]

In that case I'm out of ideas for now, I'm guessing it's more of a streamlink problem, and that can happen if twitch changes something, being a coincidence.

[devpanda0]

Okay, I'll now set up a second instance of the recorder and test it with a different IP

[MrBrax]

I am getting the [stream.hls][warning] Encountered a stream discontinuity. This is unsupported and will result in incoherent output data. error on this test capture intermittently but that's probably just the ads. Try it with a vpn to another country if you can.

[devpanda0]

VPN is on Linux server not so easy :(

[Serph91P]

VPN is on Linux server not so easy :(

since you are using docker you can use something like gluetun and connect this docker through gluetun and let it use the vpn connection from it.

[devpanda0]

But that can't be THE solution. There must be another way. I don't want to spend money on a VPN service now.

[MrBrax]

try changing the dns server

[Serph91P]

But that can't be THE solution. There must be another way. I don't want to spend money on a VPN service now.

@MrBrax shouldn't the ttv lol plugin help with that? I mean it's not working ATM but it should help or?

[MrBrax]

if the proxy is having issues then so will you

[Serph91P]

if the proxy is having issues then so will you

but one could test if this works, the solution to the problem it is not.

@devpanda0 iam located in germany aswell as is my server and I dont have these kind of problems with far more streams than you have so dunno what is different for you.

[MrBrax]

it could be an isp issue that's blocking things or just functioning incorrectly, using a public dns could help with that. it being the video-weaver.waw02.hls.ttvnw.net address which probably is just a common cdn url it shouldn't have a problem

[Serph91P]

it could be an isp issue that's blocking things or just functioning incorrectly, using a public dns could help with that. it being the video-weaver.waw02.hls.ttvnw.net address which probably is just a common cdn url it shouldn't have a problem

hmmm true.

@devpanda0 where is your server hosted?

[devpanda0]

@Serph91P ActiveServers - Interwerk https://active-servers.com/

[devpanda0]

video-weaver.waw02.hls.ttvnw.net

I always use the dns from Cloudflare

[Serph91P]

@Serph91P ActiveServers - Interwerk https://active-servers.com/

never heard of them but does not mean they are bad. Cannot find anything out of the ordinary from them. What server hardware did you rent?

[devpanda0]

I have a BareMetal server there (i9-7920X, 128 GB memory, 250 Gb nvme systemplate, 2x 2TB nvme for VM space, 4x 16 TB HDD for VOD space and OS Proxmox) I've been with them for over 4 years now, no problems. I don't think it has anything to do with the IP or the server

[MrBrax]

there's certainly something blocking or throttling the requests to twitch on your end though

[Serph91P]

I have a BareMetal server there (i9-7920X, 128 GB memory, 250 Gb nvme systemplate, 2x 2TB nvme for VM space, 4x 16 TB HDD for VOD space and OS Proxmox) I've been with them for over 4 years now, no problems. I don't think it has anything to do with the IP or the server

how many streamer do you have subscribed to?

[devpanda0]

one

[Serph91P]

one

yeah then @MrBrax got it right something is definetly blocking or throttling. What reverse proxy are you using because this is the only thing I can think of what could come from your end and block or throttle.

[devpanda0]

I use nginx as a reverse proxy

[MrBrax]

reverse proxy wouldn't block anything as that's on the inverse, but is the ttv lol plugin active, or any other kind of proxy?

[Serph91P]

reverse proxy wouldn't block anything as that's on the inverse, but is the ttv lol plugin active, or any other kind of proxy?

Some reverse proxy can have some kind of firewall etc so they can def block stuff.

[MrBrax]

reverse proxy wouldn't block anything as that's on the inverse, but is the ttv lol plugin active, or any other kind of proxy?

Some reverse proxy can have some kind of firewall etc so they can def block stuff.

the reverse proxy only handles incoming traffic, the software inside your nat can use any socket and port to communicate outwards

[devpanda0]

I still use an opnSense firewall but I allow port 80 and 443 to the server for the Nginx webserver.

I can try it again without the firewall but it didn't cause any problems either

I tried my Twitch bot on the server and it has no problem communicating with Twitch using the IP

[MrBrax]

a regular bot probably wouldn't be affected as it doesn't fetch video content, but if you have a firewall that might affect things i suppose?

[devpanda0]

It worked for 2 years with the firewall. Nothing was changed in the firewall. So I think no, it doesn't affect it

[MrBrax]

twitch might have changed things. when you use external services, anything can change at any time. with an issue as odd as this, you gotta expect anything.

[devpanda0]

So do I really have to get a VPN or a new IP address for this?

[MrBrax]

ci is currently building a new version with streamlink updated, they released something two days ago, might be worth trying out later. but anything that changes the network would be closer, like external firewall changes, internal firewall, dns, ip address, geolocation, abuse blacklist checks.

after all this if it doesn't work, it might be worth trying to get help or make an issue at streamlink