Closed basrieter closed 7 years ago
Original comment by Bas Rieter (Bitbucket: basrieter, GitHub: basrieter).
Could you enable component specific logging for ffmpeg? So I can see that they are indeed passing the headers?
You could also try upgrading to Kodi 17.x based on LibreElec? Perhaps just a spare SD Card for trying it out? I am on a Ziggo connection and thus cannot validate for you.
Original comment by segil (Bitbucket: segil, GitHub: segil).
I enabled that in my last log. "Verbose logging for FFMPEG libraries", right? I also see in the logfile:
#!python
18:29:03 T:140123744220928 DEBUG: ffmpeg[7F7119FFB700]: Using network protocols without global network initialization. Please use avformat_network_init(), this will become mandatory later.
18:29:03 T:140123744220928 DEBUG: Previous line repeats 2 times.
18:29:03 T:140123744220928 ERROR: ffmpeg[7F7119FFB700]: [tls] Unable to negotiate TLS/SSL session
18:29:03 T:140123744220928 DEBUG: Error, could not open file
Doesn't that suggest that ffmpeg logging is turned on?
I'll ask on GoT if others experience the same issue. I can test with LibreElec, but that will probably be after the weekend, since I will be away the next couple of days.
Original comment by Bas Rieter (Bitbucket: basrieter, GitHub: basrieter).
I pushed some more updates, so more will work, including the NPO login: http://www.rieter.net/content/2017/03/10/net-rieter-xot-channel-npo-4-1-3-3/
Original comment by Burrge (Bitbucket: Burrge, ).
Hee Bas. I've had the same problem as Segil. I'm on Telfort network (kpn). your final update fixed it and NPO livestreams work again! keep up the good work!
Original comment by Burrge (Bitbucket: Burrge, ).
one small issue though. on NPO3 live tv, subtitles are being read out loud by a male voice.
Original comment by rnijenhu (Bitbucket: rnijenhu, GitHub: rnijenhu).
still got some issues with kpn/npo1-2-3 radio stream with video:
grabed the latest version from git and replaced the old one: /addons/net.rieter.xot.channel.nos/nosnl/chn_nosnl.py (4.1.3.3)
retrospect.log:
#!ksh
20170311 11:07:06 - [DEBUG ] - chn_nos2010.py - 1009 - Starting UpdateVideoItem: NPO Radio 2
20170311 11:07:06 - [DEBUG ] - chn_nos2010.py - 1023 - Fetching live stream data from item url
20170311 11:07:06 - [INFO ] - urihandler.py - 561 - Opening requested uri: http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8 (callback=False, timeout=30)
20170311 11:07:06 - [DEBUG ] - urihandler.py - 901 - Adding header 'Accept-Encoding: gzip, deflate'
20170311 11:07:07 - [DEBUG ] - urihandler.py - 955 - No Content-Encoding header found
20170311 11:07:07 - [DEBUG ] - urihandler.py - 901 - Adding header 'Accept-Encoding: gzip, deflate'
20170311 11:07:07 - [DEBUG ] - urihandler.py - 955 - No Content-Encoding header found
20170311 11:07:07 - [DEBUG ] - urihandler.py - 578 - Determining number of bytes to fetch
20170311 11:07:07 - [DEBUG ] - urihandler.py - 582 - ByteSize is known (fileSize=625)
20170311 11:07:07 - [INFO ] - urihandler.py - 655 - Url http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8 was opened successfully
20170311 11:07:07 - [DEBUG ] - chn_nos2010.py - 1031 - Finding the actual metadata url from http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8
20170311 11:07:07 - [WARNING ] - chn_nos2010.py - 1036 - Cannot update live item: MediaItem: NPO Radio 2 [Type=audio, Complete=False, IsLive=True, Date=, Downloadable=False, Geo/DRM=False/False]
20170311 11:07:07 - [WARNING ] - chn_nos2010.py - 1036 - + MediaPart: NPO Radio 2 [CanStream=True, HttpHeaders={}]
20170311 11:07:07 - [WARNING ] - plugin.py - 574 - UpdateVideoItem returned an item that had item.complete = False:
20170311 11:07:07 - [WARNING ] - plugin.py - 574 - | MediaItem: NPO Radio 2 [Type=audio, Complete=False, IsLive=True, Date=, Downloadable=False, Geo/DRM=False/False]
wget on http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8
#EXTM3U
#EXT-X-VERSION:1
## Created with Unified Streaming Platform(version=1.7.6)
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=347680,CODECS="mp4a.40.2,avc1.66.30",RESOLUTION=384x216
radio2-audio=128000-video=200000.m3u8
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=665680,CODECS="mp4a.40.2,avc1.66.31",RESOLUTION=480x270
radio2-audio=128000-video=500000.m3u8
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=877680,CODECS="mp4a.40.2,avc1.66.32",RESOLUTION=640x360
radio2-audio=128000-video=700000.m3u8
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=1195680,CODECS="mp4a.40.2,avc1.66.41",RESOLUTION=768x432
radio2-audio=128000-video=1000000.m3u8
and mplayer opening the same string: mplayer -v -prefer-ipv4 http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8
MPlayer 1.2.1 (Debian), built with gcc-5.3.1 (C) 2000-2016 MPlayer Team
CPU vendor name: GenuineIntel max cpuid level: 10
CPU: Intel(R) Core(TM)2 Duo CPU T5870 @ 2.00GHz (Family: 6, Model: 15, Stepping: 13)
extended cpuid-level: 8
extended cache-info: 134242368
Detected cache-line size is 64 bytes
CPUflags: MMX: 1 MMX2: 1 3DNow: 0 3DNowExt: 0 SSE: 1 SSE2: 1 SSE3: 1 SSSE3: 1 SSE4: 0 SSE4.2: 0 AVX: 0
Compiled with runtime CPU detection.
get_path('codecs.conf') -> '/home/rob/.mplayer/codecs.conf'
Reading optional codecs config file /home/rob/.mplayer/codecs.conf: No such file or directory
Reading optional codecs config file /etc/mplayer/codecs.conf: No such file or directory
Using built-in default codecs.conf.
init_freetype
Using MMX (with tiny bit MMX2) Optimized OnScreenDisplay
get_path('fonts') -> '/home/rob/.mplayer/fonts'
Configuration: --prefix=/usr --confdir=/etc/mplayer --enable-debug --enable-xvmc --enable-menu --disable-arts --language=all --disable-libmpeg2-internal --disable-ffmpeg_a --extra-cflags=-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 --extra-ldflags=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,--as-needed --enable-runtime-cpudetection --enable-joystick --enable-radio --enable-radio-capture --disable-gui
CommandLine: '-v' '-prefer-ipv4' 'http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8'
Using nanosleep() timing
get_path('input.conf') -> '/home/rob/.mplayer/input.conf'
Reading optional input config file /home/rob/.mplayer/input.conf: No such file or directory
Parsing input config file /etc/mplayer/input.conf
Input config file /etc/mplayer/input.conf parsed: 92 binds
Setting up LIRC support...
get_path('radio2.m3u8.conf') -> '/home/rob/.mplayer/radio2.m3u8.conf'
Playing http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8.
get_path('sub/') -> '/home/rob/.mplayer/sub/'
Filename for url is now http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8
Filename for url is now http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8
STREAM_HTTP(1), URL: http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8
Resolving livestreams.omroep.nl for AF_INET...
Connecting to server livestreams.omroep.nl[145.58.50.127]: 80...
--- HTTP DEBUG HEADER --- START ---
protocol: [HTTP/1.1]
http minor version: [1]
uri: [(null)]
method: [(null)]
status code: [302]
reason phrase: [Found]
body size: [0]
Fields:
0 - Date: Sat, 11 Mar 2017 10:18:53 GMT
1 - Server: Apache/2.4.23 (Unix) PHP/5.3.29
2 - X-Powered-By: PHP/5.3.29
3 - Location: http://pedgewarea25b.video.kpnstreaming.nl:80/session/20b3b3b8-0644-11e7-ac45-1458d0420170/fqimjj/b2b/live/npo/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8?token=fd6efa3d152323deeb8b30df42dac012_1489313933_1489313933
4 - Pragma: no-cache
5 - Cache-Control: no-cache
6 - Content-Length: 0
7 - X-WorkerInstancename: live2c
8 - Content-Type: text/html
9 - Set-Cookie: smshield=salt:f36b36919eeee7ada5c9968f77c4d6bb|created:58c3cf0d|remoteIp:86.81.95.69|expires:58c3f93d|sessid:d9110921ecc09306e16f7e25142da1de|hash:e77c0cf4ef46c85bfa5a07924f2328e3; Domain=omroep.nl; Path=/; Expires=Sat, 11 Mar 2017 14:18:53 GMT
10 - X-ProxyInstancename: live1b
11 - Set-Cookie: balancer://live2cluster=balancer.live2c; path=/;
12 - Connection: close
--- HTTP DEBUG HEADER --- END ---
Filename for url is now http://pedgewarea25b.video.kpnstreaming.nl:80/session/20b3b3b8-0644-11e7-ac45-1458d0420170/fqimjj/b2b/live/npo/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8?token=fd6efa3d152323deeb8b30df42dac012_1489313933_1489313933
Resolving pedgewarea25b.video.kpnstreaming.nl for AF_INET...
Connecting to server pedgewarea25b.video.kpnstreaming.nl[195.121.70.11]: 80...
--- HTTP DEBUG HEADER --- START ---
protocol: [HTTP/1.1]
http minor version: [1]
uri: [(null)]
method: [(null)]
status code: [200]
reason phrase: [OK]
body size: [0]
Fields:
0 - Content-Length: 625
1 - Cache-Control: no-cache
2 - Date: Sat, 11 Mar 2017 10:18:52 GMT
3 - Access-Control-Allow-Origin: *
4 - Access-Control-Allow-Methods: GET,PUT,POST,DELETE,OPTIONS
5 - Access-Control-Allow-Headers: Content-Type
6 - Content-Type: application/vnd.apple.mpegurl
--- HTTP DEBUG HEADER --- END ---
Content-Length: [625]
Content-Type: [application/vnd.apple.mpegurl]
Cache size set to 320 KBytes
STREAM: [null] http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8
STREAM: Description: http streaming
STREAM: Author: Bertrand, Albeau, Reimar Doeffinger, Arpi?
STREAM: Comment: plain http
CACHE_PRE_INIT: 0 [0] 0 pre:65536 eof:0
Cache fill: 0.00% (0 bytes)
Cache fill: 0.19% (625 bytes)
libavformat version 56.40.101 (external)
Configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
LAVF_check: Apple HTTP Live Streaming
Checking for YUV4MPEG2
ASF_check: not ASF guid!
Checking for REAL
Checking for SMJPEG
Searching demuxer type for filename http://livestreams.omroep.nl/live/npo/visualradio/radio2/radio2.isml/radio2.m3u8 ext: .m3u8
Checking for Nullsoft Streaming Video
Checking for MOV
Checking for VIVO
header block 1 size: 69
Checking for PVA
Checking for MPEG-TS...
COULDN'T READ ENOUGH DATA, EXITING TS_CHECK
Checking for LMLM4 Stream Format
Invalid packet in LMLM4 stream: ch=9029 size=1295209730
LMLM4 Stream Format not found
MPEG Stream reached EOF
MPEG packet stats: p100: 0 p101: 0 p1B6: 0 p12x: 0 sli: 0 a: 0 b: 0 c: 0 idr: 0 sps: 0 pps: 0 PES: 0 MP3: 0, synced: 0
Not MPEG System Stream format... (maybe Transport Stream?)
MPEG Stream reached EOF
MPEG packet stats: p100: 0 p101: 0 p1B6: 0 p12x: 0 sli: 0 a: 0 b: 0 c: 0 idr: 0 sps: 0 pps: 0 PES: 0 MP3: 0, synced: 3
Not MPEG System Stream format... (maybe Transport Stream?)
ds_fill_buffer: EOF reached (stream: video)
LAVF_check: Apple HTTP Live Streaming
libavformat file format detected.
Checking for DV
demux_aac_probe, failed to detect an AAC stream
It looks like kpnstreaming.nl is messing things up: Connecting to server pedgewarea25b.video.kpnstreaming.nl[195.121.70.11]: 80...
Original comment by Bas Rieter (Bitbucket: basrieter, GitHub: basrieter).
@Burrge are you sure that was not just within the show/stream? I really don't do anything for that, just pass streams.
@rnijenhu that is indeed the case. KPN is using some SSL scheme that is rather incompatible at the moment. They are most likely rather fast with implementing new security standards and many other tools just lack behind.
Original comment by Bas Rieter (Bitbucket: basrieter, GitHub: basrieter).
Out of curiosity: who could use the FireFox developer toolbar to "Resend" one of the live M3u8 URL's (the https://livestreams.omroep.nl/live/npo/tvlive/npo2/npo2.isml/npo2.m3u8?hash=................) request and add the following header:
X-Forwarded-For: 94.209.190.72
and see if they do not end up with KPN? to see if they are b
Original comment by Burrge (Bitbucket: Burrge, ).
Yes, spoken subtitle is gone. thank you.
Only, the video quality for NPO3 is lower than NPO 1 and 2. I noticed on the NPO website, max video quality with spoken subtitles turned on, is dropped from 576p to 432p. for NPO 1 and 2 this is the case. For NPO3 however, this is switched. 576p with spoken subs, 432p without spoken subs. something NPO.nl must fix.
Original comment by segil (Bitbucket: segil, GitHub: segil).
Bas, I tried you suggestion from 2 days ago, this one:
#!python
Out of curiosity: who could use the FireFox developer toolbar to "Resend" one of the live M3u8 URL's (the https://livestreams.omroep.nl/live/npo/tvlive/npo2/npo2.isml/npo2.m3u8?hash=................) request and add the following header:
X-Forwarded-For: 94.209.190.72
and see if they do not end up with KPN? to see if they are b
Does it matter where the additional line is placed? I get the following result:
#!python
GET /session/7e6cfe5e-07ea-11e7-9129-9cb654975bc0/fqimjj/b2b/live/npo/live/npo/tvlive/npo1/npo1.isml/npo1-audio=128000-video=1400000.m3u8 HTTP/1.1
Host: pedgewarea27a.video.kpnstreaming.nl
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:51.0) Gecko/20100101 Firefox/51.0
Accept: */*
Accept-Language: en-US,en;q=0.5
Accept-Encoding: gzip, deflate, br
Referer: http://www.npo.nl/live/npo-1
Origin: http://www.npo.nl
Connection: keep-alive
X-Forwarded-For: 94.209.190.72
Pragma: no-cache
Cache-Control: no-cache
HTTP/1.1 403 Forbidden
Content-Length: 0
Date: Mon, 13 Mar 2017 12:43:25 GMT
Access-Control-Allow-Origin: *
Access-Control-Allow-Methods: GET,PUT,POST,DELETE,OPTIONS
Access-Control-Allow-Headers: Content-Type
Status Code 403 Forbidden
Original comment by Hans van der Marel (Bitbucket: Hansvdm, GitHub: Hansvdm).
Live stream radio NPO 1 works fine now! Anyway got same errors in advance. See part of kodi.log on my Rpi 3, Krypton (V17):
13:23:06.312 T:1394770928 ERROR: Traceback (most recent call last):
File "/home/osmc/.kodi/addons/net.rieter.xot/resources/libs/addonsettings.py", line 286, in UpdateUserAgent
version, git = completeVersion.split(" ")
ValueError: need more than 1 value to unpack
13:23:06.314 T:1394770928 ERROR: Traceback (most recent call last):
File "/home/osmc/.kodi/addons/net.rieter.xot/resources/libs/helpers/statistics.py", line 182, in __RegisterHit
userAgent = AddonSettings.GetUserAgent()
File "/home/osmc/.kodi/addons/net.rieter.xot/resources/libs/addonsettings.py", line 333, in GetUserAgent
AddonSettings.UpdateUserAgent()
File "/home/osmc/.kodi/addons/net.rieter.xot/resources/libs/addonsettings.py", line 302, in UpdateUserAgent
userAgent = "Kodi/%s (%s;
Original comment by segil (Bitbucket: segil, GitHub: segil).
Bas, Friday you asked me to use LibreElec to see if the live streaming works. I can confirm that booting my HTPC with LibreElec results in a working live video streaming from npo1-3. Only OpenElec still doesn't work. You said it had something to do with the used SSL library?
Original comment by Bas Rieter (Bitbucket: basrieter, GitHub: basrieter).
@segil that is good to hear. LibreElec (or OSMC) implement some newer SSL libraries and newer Python.
@Hansvdm Please attach a full DEBUG retrospect.log, don't paste it. There is an issue with user-agent updating, but it should not hinder playback.
Original comment by Hans van der Marel (Bitbucket: Hansvdm, GitHub: Hansvdm).
Hi, today is Mon Mar 13 22:49:13 CET 2017 22:47:40.872 T:1958986672 NOTICE: ----------------------------------------------------------------------- 22:47:40.872 T:1958986672 NOTICE: Starting Kodi (17.1-RC1). Platform: Linux ARM (Thumb) 32-bit 22:47:40.872 T:1958986672 NOTICE: Using Release Kodi x32 build (version for Raspberry Pi) 22:47:40.872 T:1958986672 NOTICE: Kodi compiled Feb 7 2017 by GCC 4.9.2 for Linux ARM (Thumb) 32-bit version 3.16.36 (200740) 22:47:40.872 T:1958986672 NOTICE: Running on Open Source Media Center 2017.02-2, kernel: Linux ARM 32-bit version 4.4.27-7-osmc 22:47:40.872 T:1958986672 NOTICE: FFmpeg version/source: ffmpeg-3.1-kodi 22:47:40.872 T:1958986672 NOTICE: Host CPU: ARMv7 Processor rev 4 (v7l), 4 cores available 22:47:40.872 T:1958986672 NOTICE: ARM Features: Neon disabled
Original comment by Bas Rieter (Bitbucket: basrieter, GitHub: basrieter).
I just pushed the fix for the NPO 3 spoken subs: http://www.rieter.net/content/2017/03/13/net-rieter-xot-channel-npo-4-1-3-4/
Original report by TM55 (Bitbucket: Tm55, GitHub: Tm55).
hello, i have retrospect on a raspberry pi 3, using openelec 7.0.1
i have been using uitzendinggemist for 3 days now without a problem until now. I cannot see a single stream and get a retrospect error message. all other channels are woring fine. can you please check my log?
my standard ip adress is from belgium. i changed it to a dutch one with vpn, but same result. thank you for your help.