tvtv.us failing

[SoftwareSamurai]

Guide

https://iptv-org.github.io/epg/guides/us-local/tvtv.us.epg.xml.gz

Description

It appears that tvtv.us is failing again - twice in a row now as of today (10/9/22). (https://github.com/iptv-org/epg/actions/workflows/tvtv.us.yml)

[Kev506]

Same here, no data?

[hanke69]

FYI - Same for me...no data!

[dcole819]

Same here…been failing a lot lately

[firestickkev]

I'm in uk and lost epg sat midnight, this happend last week as well, seemed to come back Monday morning last time. Hopefully same will happen again. If anyone has a work around this issue please advise

[jamboy3]

It's failing again for me too, but it's maybe 20% of the channels with No Information instead of all of them like last time. Is there any reason behind all the issues lately?

[eightifact]

Attached recent grab of https://iptv-org.github.io/epg/guides/us/tvtv.us.epg.xml.gz as TXT. Not sure if anyone notices something that is odd. tvtv.us.epg.txt

[firestickkev]

Is there any update to this issue yet or has anyone got another solution. Many thanks

[SoftwareSamurai]

The nightly build appears to be failing with: "Error: No programs found" I'm guessing that means the website scraping didn't work.

[Kev506]

Is there any update to this issue yet or has anyone got another solution. Many thanks

Temporarily I'm using https://guidexl.tv4.live/ in Tivimate all seems ok at the moment.

[Generator]

There's also epgshare01/share01 with US and other countries

[Kev506]

There's also epgshare01/share01 with US and other countries

That's unfortunately also down.

[dcole819]

Yea that’s down too

[dcole819]

Is there any update to this issue yet or has anyone got another solution. Many thanks

Temporarily I'm using https://guidexl.tv4.live/ in Tivimate all seems ok at the moment.

If I use this epg will I manually have to assign channels in tivimate?

[Kev506]

Is there any update to this issue yet or has anyone got another solution. Many thanks

Temporarily I'm using https://guidexl.tv4.live/ in Tivimate all seems ok at the moment.

If I use this epg will I manually have to assign channels in tivimate?

Yes but better than no data.

[firestickkev]

Is there any update to this issue yet or has anyone got another solution. Many thanks

Temporarily I'm using https://guidexl.tv4.live/ in Tivimate all seems ok at the moment.

Thanks kev506, like you say better than nothing, just assigned channels to it and il see how that goes. Many thanks kev506 for you help

[dcole819]

This still not fixed?

[ac3nl]

Still not fixed

[Generator]

Please stop spamming the comments if you don't have any new information. Keeping asking "is it fixed", "please fix" won't fox the issue, only spam everyone with useless comments

[freearhey]

A bit more about the error:

Since October 8, 2022, the tvtv.us server began to return an HTTP error 503 (Service Unavailable) on every request.

https://github.com/iptv-org/epg/actions/runs/3278905005/jobs/5397838939

...
[1/4808] tvtv.us (en) - 3ABNEnglish.us - Oct 19, 2022 (0 programs)
Request failed with status code 503
[2/4808] tvtv.us (en) - 3ABNEnglish.us - Oct 20, 2022 (0 programs)
Request failed with status code 503
...

This error occurs only if the request is made from GitHub servers. The same request sent from another IP works as before:

...
[1/4808] tvtv.us (en) - 3ABNEnglish.us - Oct 19, 2022 (37 programs)
[2/4808] tvtv.us (en) - 3ABNEnglish.us - Oct 20, 2022 (37 programs)
...

The config used for parsing the guide did not change in any way and still works fine.

So the only option is blocking by tvtv.us. Since there is nothing we can do about it, we will have to remove this guide from the list.

But if something changes in the future and the guide becomes available again, we will definitely bring it back.

[ac3nl]

Is it possible to run the parser from a remote server? This will definitely have an other ip

[freearhey]

The parser itself can be run on any computer, but in order to continue providing the guide to everyone this parser needs to be run through GitHub Actions.

[SoftwareSamurai]

Could the fetches be routed through a proxy?

[freearhey]

Yes, it is possible. Here are instructions on how to add its settings to the config: https://github.com/freearhey/epg-grabber#site-config

[ian10951]

So for clarification, is this going to be fixed or has it now gone for good ?

[ac3nl]

Disapointing how low feedback actually is on this project. Seems like nobody cares

[freearhey]

@ian10951 If a working solution is found the guide will be returned to the list, but until then I think the topic can be closed.

[charlieglue]

using a proxy isn't a solution?

[freearhey]

@charlieglue if you find such a proxy let us know.

[SoftwareSamurai]

Would this help? https://github.com/TheSpeedX/PROXY-List

[freearhey]

@SoftwareSamurai Have you tested any of them?

[SoftwareSamurai]

@SoftwareSamurai Have you tested any of them?

Scanned a few. Yeah, that list contains dead/unresponsive proxy servers. (To be fair, some do work fine. Would probably need to ping/test that list first before every run just to pick one. Bit of a PITA.)

Looking over this list (https://www.proxynova.com/proxy-server-list/elite-proxies/) maybe we can just select a few prime entries, such as Thailand, Mexico, or France?

[freearhey]

Well, in this case, the location of the proxy does not matter, so I suppose any proxy will do as long as it works reliably.

[spotanjo3]

I added WSBKDT4.us for Charge! and tv guide didnt show up at all! I have this:

https://iptv-org.github.io/epg/guides/us/tvtv.us.epg.xml.gz

Whats wrong ?

[GlamoramaAttack]

I added WSBKDT4.us for Charge! and tv guide didnt show up at all! I have this:

https://iptv-org.github.io/epg/guides/us/tvtv.us.epg.xml.gz

Whats wrong ?

The link isn't working any longer. Right now you get the EPG for Charge! via

https://iptv-org.github.io/epg/guides/us.xml.gz

where it is:

EXTINF:-1 tvg-id="Charge.us" tvg-name="Charge" tvg-logo="https://i.imgur.com/fuw0hHE.png" group-title="US",Charge!

if you use .xmltv

But if you use .m3u then you need https://raw.githubusercontent.com/matthuisman/i.mjh.nz/master/Stirr/all.xml.gz and find it here:

EXTINF:-1 tvg-id="externallinearfeed-01-15-2020-201540715-01-15-2020" tvg-name="Charge" tvg-logo="https://i.mjh.nz/Stirr/.images/8b4d0a3429.png" group-title="US",Charge!

You'll find other links for Samsung, Plex etc. here: https://i.mjh.nz/

[PopeyeTheSai10r]

Do we know whether they are blocking the IPs that Github assign to the runners or whether they are rate limiting the runners?

[freearhey]

The error appears on the first request, so it is most likely the IP.

[PopeyeTheSai10r]

I was able to get the site to response while using Github servers by changing the user-agent to Chrome and Firefox.

@freearhey Anyway to create a test config and add user-agent to it?

[freearhey]

Unfortunately, changing the user-agent to a different one did not help: https://github.com/iptv-org/epg/actions/runs/3564535799/jobs/5988608573

Test config: https://github.com/iptv-org/epg/blob/fix-tvtv.us/sites/tvtv.us/tvtv.us.config.js

[PopeyeTheSai10r]

Here's how I got it it to work.

curl -A "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/81.0" https://www.tvtv.us/api/v1/lineup/COUNTRY-ZIPCODE-DEFAULT/grid/DATE -X GET

https://github.com/PopeyeTheSai10r/epg/actions/runs/3569918495/jobs/6000371378

[freearhey]

And this is the response if the request is sent from the iptv-org/epg:

https://github.com/iptv-org/epg/actions/runs/3582752373/jobs/6027348290

[PopeyeTheSai10r]

Getting the same response now. We will need a different solution.

Cloudflare protection is enabled for the website as discussed below https://www.reddit.com/r/webscraping/comments/qjpt8k/comment/hirn6ey/?utm_source=share&utm_medium=web2x&context=3

[PopeyeTheSai10r]

After looking into this for a while, it seems like mimicking a browser can be the a possible solution since we only get responses from the server while doing that. This will mean adding a bunch of headers to the request to make it possible. Here is a direct call I made and was able to get the response we are looking for: https://github.com/PopeyeTheSai10r/epg/actions/runs/3625555510/jobs/6113723053

There is a github project that does this but I don't think it will feasible to implement that info the current configurations and configs https://github.com/lwthiker/curl-impersonate. There's more information how to do this at the following links https://stackoverflow.com/a/31597823, https://unix.stackexchange.com/q/703599 and https://lwthiker.com/reversing/2022/02/17/curl-impersonate-firefox.html

[freearhey]

Closed due to lack of activity.