cabernetwork / provider_epg_tvguide

Provides an interface to the TVGuide
MIT License
2 stars 0 forks source link

epg failes to update on clients #2

Closed vortex91 closed 5 months ago

vortex91 commented 6 months ago

Based on testing i have done it would seem taht its not the size or lenght but probably invaalid charachters picked up. As example if epg data for 2/12/2024 is used then it fails.

rocky4546 commented 6 months ago

The url has changed. pushing out a version update 0.1.13 today.

vortex91 commented 6 months ago

I am not sure if thats the only reason. Epg seems to still udpate. What im stating is from time to time it stops and size of epg is not related to when it stops. For example on 2/12/24 update failed for 16:00 data (pacific time) and after that it worked. My best guess is that program data might have some invalid charachters in description such as < > ' " & and maybe others which im not aware of?

rocky4546 commented 6 months ago

ElementTree auto encodes the strings, so no issues with special characters.

vortex91 commented 6 months ago

Well what i am certain of is that the size of xml does not matter and that its a preticular item within which causes issue. I can provide ither cabernet logs or client log if you like. test i have done so far

  1. epg of xumo/pluto/daddy all in 1 request: works fine sometimes fails. when a. split epg into 3 request 1 per plugin. xumo/pluto work daddy fails. b. when daddy fails look at client side last time of epg data and try to update 1 hour after last time epg data made to client. this works. this tells me that in the timeframe in question something is causing epg update to fail on daddy/tvguide side.
  2. when epg for daddy works again on 2 days increase time frame to 5 days. (works) a. when 5day epg for daddy fials to update to client reduce to 2 days and cleare data on server b. 2 days works untill 3 days later when 5 days of data is reached at which point it fails.

Let me know if you want logs from client or server

vortex91 commented 6 months ago

updated to latest and still same issue. As of now 2/18/2024 4:00pm pacific time is last epg data which will update. Log below

2024-02-18 23:24:48 2024-02-18 23:24:48,297-INFO:plugin_epg DaddyLive:default EPG update completed 2024-02-18 23:24:54 2024-02-18 23:24:54,300-DEBUG:web_handler [172.17.0.1] "GET /channels.m3u HTTP/1.1" 200 - 2024-02-18 23:24:54 2024-02-18 23:24:54,543-DEBUG:web_handler [172.17.0.1] "GET /xmltv.xml HTTP/1.1" 200 - 2024-02-18 23:24:54 2024-02-18 23:24:54,715-WARNING:epg2xml b'<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE tv SYSTEM "xmltv.dtd"><tv source-info-url="https://github.com/cabernetwork/cabernet" source-info-name="cabernet" generator-info-name' 2024-02-18 23:24:54 2024-02-18 23:24:54 2024-02-18 23:24:54,716-WARNING:epg2xml #### b'<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE tv SYSTEM "xmltv.dtd"><tv source-info-url="https://github.com/cabernetwork/cabernet" source-info-name="cabernet" generator-info-name' 2024-02-18 23:24:54 2024-02-18 23:24:54 2024-02-18 23:24:54,716-WARNING:epg2xml $$$$ b'<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE tv SYSTEM "xmltv.dtd"><tv source-info-url="https://github.com/cabernetwork/cabernet" source-info-name="cabernet" generator-info-name' 2024-02-18 23:24:54 2024-02-18 23:24:55 2024-02-18 23:24:55,516-DEBUG:epg2xml Processing EPG data PlutoTV:default 2024-02-18 2024-02-18 23:24:55 2024-02-18 23:24:55,765-WARNING:epg2xml $$$$ b'Yo Gabba Gabba!S03E10 Treasure<' 2024-02-18 23:24:55 2024-02-18 23:24:55 2024-02-18 23:24:55,928-DEBUG:epg2xml Processing EPG data XUMO:default 2024-02-18 2024-02-18 23:25:01 2024-02-18 23:25:01,932-WARNING:epg2xml $$$$ b'Dateline NBCS24E43 The Girl With the Red Shoes<' 2024-02-18 23:25:01 2024-02-18 23:25:02 2024-02-18 23:25:02,136-DEBUG:epg2xml Processing EPG data DaddyLive:default 2024-02-18 2024-02-18 23:25:29 2024-02-18 23:25:29,811-WARNING:epg2xml $$$$ b'The First 48S23E13 Back Street<desc lang' 2024-02-18 23:25:29 2024-02-18 23:25:29 2024-02-18 23:25:29,912-DEBUG:epg2xml Processing EPG data PlutoTV:default 2024-02-19 2024-02-18 23:25:42 2024-02-18 23:25:42,726-WARNING:epg2xml $$$$ b'Yo Gabba Gabba!S01E09 Scary</su' 2024-02-18 23:25:42 2024-02-18 23:25:42 2024-02-18 23:25:42,981-DEBUG:epg2xml Processing EPG data XUMO:default 2024-02-19 2024-02-18 23:26:19 2024-02-18 23:26:19,492-WARNING:epg2xml $$$$ b'Dateline NBCS28E12 While They Were Sleeping</su' 2024-02-18 23:26:19 2024-02-18 23:26:19 2024-02-18 23:26:19,680-DEBUG:epg2xml Processing EPG data DaddyLive:default 2024-02-19 2024-02-18 23:26:34 2024-02-18 23:26:34,936-DEBUG:web_handler [172.17.0.1] "GET /xmltv.xml HTTP/1.1" 200 - 2024-02-18 23:26:35 2024-02-18 23:26:35,296-WARNING:epg2xml b'<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE tv SYSTEM "xmltv.dtd"><tv source-info-url="https://github.com/cabernetwork/cabernet" source-info-name="cabernet" generator-info-name' 2024-02-18 23:26:35 2024-02-18 23:26:35 2024-02-18 23:26:35,297-WARNING:epg2xml #### b'<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE tv SYSTEM "xmltv.dtd"><tv source-info-url="https://github.com/cabernetwork/cabernet" source-info-name="cabernet" generator-info-name' 2024-02-18 23:26:35 2024-02-18 23:26:35 2024-02-18 23:26:35,297-WARNING:epg2xml $$$$ b'<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE tv SYSTEM "xmltv.dtd"><tv source-info-url="https://github.com/cabernetwork/cabernet" source-info-name="cabernet" generator-info-name' 2024-02-18 23:26:35 2024-02-18 23:26:36 2024-02-18 23:26:36,472-DEBUG:epg2xml Processing EPG data PlutoTV:default 2024-02-18 2024-02-18 23:26:37 2024-02-18 23:26:37,039-WARNING:epg2xml $$$$ b'Yo Gabba Gabba!S03E10 Treasure<' 2024-02-18 23:26:37 2024-02-18 23:26:37 2024-02-18 23:26:37,293-DEBUG:epg2xml Processing EPG data XUMO:default 2024-02-18 2024-02-18 23:26:53 2024-02-18 23:26:53,398-WARNING:epg2xml $$$$ b'Dateline NBCS24E43 The Girl With the Red Shoes<' 2024-02-18 23:26:53 2024-02-18 23:26:53 2024-02-18 23:26:53,675-DEBUG:epg2xml Processing EPG data DaddyLive:default 2024-02-18 2024-02-18 23:28:05 2024-02-18 23:28:05,405-WARNING:epg2xml $$$$ b'The First 48S23E13 Back Street<desc lang' 2024-02-18 23:28:05 2024-02-18 23:28:05 2024-02-18 23:28:05,584-DEBUG:epg2xml Processing EPG data PlutoTV:default 2024-02-19 2024-02-18 23:28:31 2024-02-18 23:28:31,860-WARNING:epg2xml $$$$ b'Biography: WWE LegendsS03E01 NWO<desc la' 2024-02-18 23:28:31 2024-02-18 23:28:31 2024-02-18 23:28:31,874-INFO:epg2xml Connection dropped by client [Errno 32] Broken pipe 2024-02-18 23:28:34 2024-02-18 23:28:34,230-WARNING:epg2xml $$$$ b'Yo Gabba Gabba!S01E09 Scary</su' 2024-02-18 23:28:34 2024-02-18 23:28:34 2024-02-18 23:28:34,233-INFO:epg2xml Connection dropped by client [Errno 32] Broken pipe

vortex91 commented 6 months ago

so after 4:00 pm pacific time i was able to update epg without any issues. im guessing that its specific guide data causing the issue and once that time period is gone then it works.

rocky4546 commented 6 months ago

log shows no issues

vortex91 commented 6 months ago

2024-02-18 23:28:34,233-INFO:epg2xml Connection dropped by client [Errno 32] Broken pipe

this is due to somethign in body of xml which causes issue. WHen this happens i have deleted entire data folder and re-updated entire db but its fails again on same time. I have also tried with 3 different clients.

vortex91 commented 6 months ago

K it seems like client is timeing out from looking at client logs. How can i edit either gui or options or code directly to remove EPG data of channels which do not have epg data. Currently they are filling up the XML with channel name. I want it to be blank in XML.

rocky4546 commented 6 months ago

Use the channel editor to disable channels.

vortex91 commented 6 months ago

I do not want to disable. I want to be able to watch the channel. I just dont want that channel to have epg info in XML since its just repeating its name over and over.

I remember you had mentioned grouping instances. is that a feature now? are there docs on how to set that up?

rocky4546 commented 6 months ago

yes. Create multiple instances and disable channels in each one. Example, disable last 50 channels in instance 1 and first 50 channels in instance 2. Then you can request either the m3u or xmtv file using the plugin name/instance name.