Closed halfagascan closed 1 year ago
Forgot some. tv_grep foxnews my_test.xml
It has info, just not displaying
Hi there, thank you for your issue report.
fyi the way that the script matches m3u lines to epg entries is based on m3u line tvg-id attribute value to epg programme element channel attribute value matching.
My guess is that what you're experiencing is a data quality issue, this is the best that I have without being able to see the data that you're working with.
If you're willing to strip out any/all sensitive values from your m3u and epg files (passwords, hostnames etc) and attach the files here, I'll take a look to see if I can see anything obviously wrong. Being able to see your generated output process.log will help me understand how you're executing the script too.
Ok, here you go test_greyridge.zip
Thanks, will run some tests asap and will let you know what I find.
Hi there, I've taken a look at what you've supplied in your attached https://github.com/bebo-dot-dev/m3u-epg-editor/files/10290876/test_greyridge.zip.
As far as I can tell, you've supplied script generated m3u and epg xml files in this zip file, not sanitised source m3u and epg xml files prior to being processed by the script.
I need sanitised source m3u and epg xml files in the state that they're in prior to being processed by the script to stand any chance of reproducing the problem that you're seeing.
Back to you, thanks.
Thanks, restarting analysis
Analysis result:
greyridge.json
configuration from the first supplied https://github.com/bebo-dot-dev/m3u-epg-editor/files/10290876/test_greyridge.zip fileI see no issue for this specific channel.
Perhaps your problem needs to be better described with more specific details.
I did see info in m3u/xml for nbc and foxnews. Let me redo my tvheadend and nextpvr dockers and see if that cures the problem, maybe there's a problem with those apps. On tvh web, a search for those two channels, nothing, nextpvr displays nothing at all. Using a wget m3u/xml, works fine, but then so many channels I don't want or need. Thanks for taking time to look at this. I follow up later
ok, clean nextpvr, still nothing but channel list, no epg data, error logs having issues with icons, cannot find. Looking at the xml, lots of termination locations, ie missing"", mostly at the end or incorrect addressing. Removed all icon references, no change. In looking at the m3u8, issues with incorrect icon references ie: https:/, missing the second /. Not sure if these errors are part of the cause or not. There was a program for editing m3u/xml, where you could select where the icons were used, m3u8 or xml, what do you think about an option to select xml, m3u8 or none? Thanks
Ok, addressing the sentences that you have written in your last comment one by one:
Ok, still troubleshooting. I've checked several iptv xml documents using tv_validate_file. Most fail the validation check for one reason or another, one because the
So far as EPG XML goes, it's a reasonably simple XML schema / standard, the DTD schema is documented and maintained here: https://github.com/XMLTV/xmltv/blob/master/xmltv.dtd
It sounds like you've read this spec and you've found that most of the elements and attributes within an EPG XML document are optional and in reality, EPG XML supplier/vendors generally only populate the bare minimum requirement into their EPG XML documents to make their doc valid and viable/usable.
If you read the spec closely you'll see that the icon element within a channel element is a required element and an icon element is expected to contain a src attribute that points to a url (a channel icon image). There is no way to drop or ignore this icon element entirely because it's a required element and if the icon element wasn't present you could expect processing applications to not accept the EPG XML as valid. Similarly if the icon element contains an invalid src attribute url I think it would be fair to expect processing applications to not accept the EPG XML as valid for that channel and that channel not fully work as expected.
Taking this further if you were to receive an EPG XML document and it happened to contain completely invalid XML i.e. unclosed elements / unclosed attribute quotes etc and you were to attempt to process that EPG XML document with the Python script in this repo, I would expect that to not work as expected. With the Python script as it stands, you'd probably end up with no programme elements or missing programme elements for some channels in the resulting EPG XML file.
I'm not surprised that you're not getting far talking to your provider, they're all pretty much universally the same when it comes to customer support and they generally don't care :)
Reading between the lines, I think what you're asking for / hoping for is for the Python script in this repo to somehow be able to patch and cope with the data quality issues that you're seeing in your m3u and epg files. If so, I'm afraid this isn't going to happen because attempting to code around any number of different data quality issue types that could occur is a path that I'm not willing to go down.
There is no bug to address here and no viable feature request either because the issue that you have is a data quality issue.
One thing you could consider doing is preprocessing your m3u and epg files before having them processed by this Python script, one way to do this would be to use sed
.
If you were to do something like this you could attempt to fix up any data quality issues that you might have in your files in any way you like.
I appreciate the help, and agree that its a provider issue. Interesting comments about the icon element, I've deleted those lines containing it and it validates fine, have yet to load into tvh or nextpvr, thats my project for today. I'll close this, but update on the icon logo pass or fail, for future reference. Again, thanks for the help and feed back.
edit the m3u8 and remove all http links, I left this in place: tvg-logo="" edit the xml file and removed http links and left this: in place
That outcome sounds normal in my experience of any IPTV supplier that I've ever been near.
There's never willingness to fix anything, if you report a problem you're an irritation that needs to be culled :)
Using the script to trim down a m3u/xml. Some channels have no epg data associated, they do not appear in no_epg_channels.txt. Using tv_validate_file providers.xml shows: Line 1 Invalid channel-id 'NBCEast_WNBC.us' Line 1 Invalid channel-id 'FoxEast_WNYW.us' Line 1 Invalid channel-id 'CBSEast_WCBS.us' Line 1 Invalid channel-id 'ABCEast_WABC.us' After using the script to process the downloaded xml, it reports this: Line 23 Invalid channel-id 'nbceast_wnbc.us' Line 47 Invalid channel-id 'foxeast_wnyw.us' Line 67 Invalid channel-id 'cbseast_wcbs.us' Line 75 Invalid channel-id 'abceast_wabc.us' Line 275 Invalid channel-id 'foxwest_kttv.us' Line 279 Invalid channel-id 'cbswest_kcbs.us' Line 283 Invalid channel-id 'nbcwest_knbc.us' Line 291 Invalid channel-id 'abcwest_kabc.us' Line 1067 Empty description . . Line 32729 Empty description
cat my_test.my.m3u8 | grep abcwest_kabc.us
EXTINF:-1 tvh-chnum="299" tvg-id="abcwest_kabc.us" tvg-name="ABC WEST" tvg-logo="https:/my.stream/backup/1052303.png" group-title="US-ENTERTAINMENT",ABC WEST
me@thunder:~/media/provider/wget$ cat my_test.provider.m3u8 | grep nbcwest_knbc.us
EXTINF:-1 tvh-chnum="303" tvg-id="nbcwest_knbc.us" tvg-name="NBC WEST" tvg-logo="https:/my.stream/backup/1052294.png" group-title="US-ENTERTAINMENT",NBC WEST
cat my_test.m3u8 | grep nbceast
EXTINF:-1 tvh-chnum="302" tvg-id="nbceast_wnbc.us" tvg-name="NBC EAST" tvg-logo="https:/my.stream/backup/1000100.png" group-title="US-ENTERTAINMENT",NBC EAST
NBC EAST is one channel there is no epg, FOX NEWS is another. I am wondering if the underscore in tvg-id=nbceast_wnbc.us, is causing the issue. I have edited the xml file and replaced nbceast_wnbc.us with nbceast.us, but it reverts back to having the underscore after using the script. In looking at the providers xml with tv_validate_file, there are many Line Empty description, there seems to be an , but no closing , anyway to just delete the empties?
Anything you could suggest, been at this for awhile, and seems like I'm spinning my wheels.
Thanks
.