piratfm / eti-tools

ETI conversion software
Mozilla Public License 2.0
53 stars 18 forks source link

Satellite sources of DAB feeds - part 2 #28

Closed newspaperman closed 4 years ago

newspaperman commented 6 years ago

Hi!

thank you Serge for fixing the edi2eti converter. However it seems one of those streams (239.16.242.14:60014) still is a little different then all the other muxes and is not decoded. All those packets have fragement count=1

newspaperman commented 6 years ago

Ok it seems in function pushPFTFrag this statement is wrong: //last packet can be smaller if no FEC, ignore it. if(!pf->_FEC && pf->_Findex+1 == pf->_Fcount) return 0;

I removed it and it is working now :) But I'm still wondering how the correct statement has to be

andimik commented 6 years ago

You are meaning lines 255 and 256 in pf_parser.c?.

If you do so, this only works for 60014, and the others seem not to work any more.

andimik commented 6 years ago

Well, I still get some errors and therefore dropouts and odr-dabmod does not transmit regularly.

[06/03/18 15:56:30] EDI-PF: too far from behind/not enought packets collected pseq: 31728 with fragments: 2/3
[06/03/18 15:56:30] EDI-AF: Packet sequence error

and

 ETI FCT discontinuity, expected 112 received 113
athoik commented 6 years ago

Hi,

Thanks for the recent fixes in edi2eti!

I would like to bring your attention also to another issue noticed on stream 239.16.242.17:60017

In order to get those streams under Enigma2 we created a new too "fedi2eti", that reads stream from 7E. Then it filters the PID 101. Finally it filters the selected stream and passes UDP data to HandleEDIPacket.

See here: https://github.com/satdreamgr/eti-tools/commit/d75c1eae553885eb3c0a896023f8a32b2bbacb27

With above tool, we can simply pass stream data from Enigma2, without setting up dvbnet (not all drivers have dvb net enabled, also it's not easy for normal enigma2 users to setup dvbnet).

So with above tool we can construct a pipeline, such as "wget | fedi2eti | ni2http" and get results back to enigma2 (https://github.com/satdreamgr/dabstreamer/commit/4aea38e31e32e9ea792da19d63d15d6235ca82fd).

Although we have a problem with stream 239.16.242.17:60017. Usually after 1 minute and 20 seconds, the stream stops.

Any idea why this happens?

Here is a TS dump of PIP 101 from Enigma2 in case it helps.

https://mega.nz/#!6JURzJhI!qJdwtp__WR5Gzu9IrYtY17eWawBufodzjI3oAz27AOk

(I don't signal at 12572V@7E so @MCelliotG was kind enough to offer some samples and perform tests using fedi2eti)

PS. In case you find that tool useful for eti-tools I can create a commit, to include it.

piratfm commented 6 years ago

Hi @athoik, Thank You for ts-input for edi2eti, I suggest we can integrate it to the original app by adding "-p or --pid" argument and if it's provided, to switch network input to file input with stdin as default (or other file input if -i or --input) is provided.

I will look for that stream more detaily later...

athoik commented 6 years ago

In the meanwhile there are few more radios, using DVB-MPE, but not idea what protocol.

Those readios can be extracted using a new tool mpe2aac (https://github.com/satdreamgr/eti-tools/blob/master/mpe2aac.c).

You can find those here:

7.0Ε 12634 1303 DVB-S 3/4 Samples: https://mega.nz/#!zcFQXSyD!9N43Tn5qrLjoUV1QOWF4nWmqTe9Wq4PIPZKB94OpB84

39E 11479Η 1000 DVB-S2/IP Samples: https://mega.nz/#!uI9jRTJR!Zhka-5cqZzpxbuKRtA8n5SkHRoLJO8_4YzaZ8yAhyZA

Thanks @MCelliotG for the samples.

k-otixxx commented 6 years ago

Hi, did you know how to fix this error:

user@user-LIFEBOOK-AH531:~$ ts2na -h
usage: ts2na [-p pid] [-s offset] [-i <inputfile>] [-o <outputfile>]
user@user-LIFEBOOK-AH531:~$ na2ni -h
na2ni: error while loading shared libraries: libfec.so.3: cannot open shared object file: No such file or directory
user@user-LIFEBOOK-AH531:~$ edi2eti
edi2eti: error while loading shared libraries: libfec.so.3: cannot open shared object file: No such file or directory
user@user-LIFEBOOK-AH531:~$ 

Ubuntu 18.04 LTS

andimik commented 6 years ago

Have you changed https://github.com/piratfm/eti-tools/blob/master/Makefile in lines 24 and 25? Have you followed https://github.com/piratfm/eti-tools#prerequisitions ?

k-otixxx commented 6 years ago

Of course i followed prerequisitions. For line 24 and 25 i will test , thanks!

P.S. It works :)

andimik commented 6 years ago

@athoik

Hi, the 2nd stream seems to be from Hellassat on 39 East? Thanks for the file, the position is too far east for my dish. https://www.flysat.com/hellassat.php

The other one is on 7 East, I also tried to find out the type when I found them. https://www.flysat.com/e7.php With TS Reader I could extract them, but this is not mp2.

athoik commented 6 years ago

@andimik, one sample is from 39E and the other from 7E.

The samples containing AAC (MPEG2 or MPEG4).

Eg. AAC MPEG2 (FF F9)

90 63 FD 02 62 E4 02 EE  00 01 3D 3C 56 85 00 12  |  .c..b.....=<V...
00 00 00 03 00 08 00 00  00 02 00 00 00 00 02 05  |  ................
68 00 00 00 00 01 0E 84  00 09 00 00 53 30 32 23  |  h...........S02#
53 30 32 23 0A 00 00 00  00 00 00 00 00 00 00 00  |  S02#............
00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |  ................
00 00 00 00 00 00 00 00  FF F9 4C 80 42 A1 B8 21  |  ..........L.B..!
1A 4F FA CF F8 20 3A 76  E1 49 41 D0 94 26 40 10  |  .O... :v.IA..&@.

Eg. AAC MPEG4 (FF F1)

90 63 E2 B6 C8 1A 66 EE  00 01 3E 3D 56 85 00 12  |  .c....f...>=V...
00 00 00 03 00 08 00 00  00 00 00 00 00 00 02 05  |  ................
00 00 00 00 00 01 08 A7  00 03 00 00 67 5B FF 00  |  ............g[..
00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |  ................
00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |  ................
00 00 00 00 00 00 00 00  FF F1 4C 80 4D C1 A0 20  |  ..........L.M..
9B 1B 97 7A 4B 0C 16 CF  6F 3D 7C 79 EE 4D F9 D6  |  ...zK...o=|y.M..

The 90 63 .... header is from what protocol? (RTP?)

andimik commented 6 years ago

The 90 63 .... header is from what protocol? (RTP?)

I googled a lot, but could not find that out.

k-otixxx commented 6 years ago

My question is : is there a possibility to add fedi2eti and mpe2aac . In linux these commands is not available and no possibility to play streams from Enigma2 receiver via DABlin player. DAB feeds from 7E Bavaria and Poland 7E and 39E. Thanks!

andimik commented 6 years ago

Have you tried the fork https://github.com/satdreamgr/eti-tools/ ?

k-otixxx commented 6 years ago

Thanks! I need to change fork source within installation or something else...

andimik commented 6 years ago

Sure. But you know, it's all unsupported. You are not a broadcaster.

k-otixxx commented 6 years ago

Thanks! Works ! OK

newspaperman commented 6 years ago

Ok there was still some space left for one additional mux 239.16.242.14:60014 BR Obf 239.16.242.16:60016 BR Nby

andimik commented 6 years ago

Yes, this was expected ;-)

andimik commented 6 years ago

I could not find 239.16.242.14:60014 (BR Oberfranken), seems they disappeared.

The table is updated and I also have reformatted it.

k-otixxx commented 6 years ago

Confirmed: 239.16.242.14:60014 OFF 239.16.242.16:60016 Niederbayern Work

newspaperman commented 6 years ago

I'm unable to lock 12537V | 996 2/3 on 7°East. Seems they switched it off as the stream is also in the MPE mux.

andimik commented 6 years ago

Me too. But I thought it is related to my dish size.

MCelliotG commented 6 years ago

I was never able to receive this stream too!

andimik commented 6 years ago

No, I have made some captures some time ago.

See https://github.com/piratfm/eti-tools/files/1786782/7.0E_12536V_Bayern_ETIv11.ts.zip

andimik commented 6 years ago

Although we have a problem with stream 239.16.242.17:60017. Usually after 1 minute and 20 seconds, the stream stops.

No, I don't have a problem. I am using a Notebook with a DVB card.

andimik commented 6 years ago

Seems on 12634MHz 7E PID 2050, IP 230.0.0.50:10050 there are two Radio programs, one on the left and the other on the right channel.

andimik commented 6 years ago

I still have problems with the EDI stream on 7 East, after a while I have to restart everything.

[07/12/18 18:47:38] EDI-PF: undecodeable pseq: 51551 with fragments: 3/3 [07/12/18 18:47:38] EDI-PF: CRC error to reconstruct AF [07/12/18 18:47:38] EDI-PF: undecodeable pseq: 51552 with fragments: 3/3 [07/12/18 18:47:39] EDI-PF: CRC error to reconstruct AF [07/12/18 18:47:39] EDI-PF: undecodeable pseq: 51553 with fragments: 3/3 [07/12/18 18:47:39] EDI-PF: CRC error to reconstruct AF [07/12/18 18:47:39] EDI-PF: undecodeable pseq: 51554 with fragments: 3/3 [07/12/18 18:47:39] EDI-AF: bad tag! [07/12/18 18:47:39] EDI-AF: bad tag!

Seems to be still a bug in af_parser.

piratfm commented 6 years ago

Maybe there is a chance to catch that event to dump file? It seems like some garbage traffic is going on that port too.

andimik commented 6 years ago

Should I dump the complete TS? Because I have severe problems with the network connection and so I use the Greek fork with fedi2eti Therefore I am not sure if my wireshark dump would help.

piratfm commented 6 years ago

Yes, TS - is ok. I'm planning to embed fedi2eti's functionality.

andimik commented 6 years ago

Ok, will investigate next week and only crop the problematic parts in the TS

Hope this works with TS Doctor...

k-otixxx commented 6 years ago

Can these eti streams to put in EasyDab board direct? Or may be is needed some pipe with Odr-dabmod. Anybody with experience witjlh this ...

piratfm commented 6 years ago

Hi, this all works fine. You just need to send eti-ni stream to EasyDABv2 by using tcp-client, tcp-server, or zeromq client mode on board, and netcat or eti2zmq application.

wget <stream_from_dreambox> -q -O- | ts2na -p 1061 -s 12 | na2ni | eti2zmq -o "zmq+tcp://*:<port_to_listen>"

k-otixxx commented 6 years ago

Thanks for the perfect answer!

k-otixxx commented 6 years ago

Anybody knows how to listen mpe2aac based dab feeds(7E and 39E) ? Eutelsat 7A/7B DVB-S 12634V 1303 3/4 Polskie Radio Jedynka | 2010/230.0.0.10 Polskie Radio Dwojka | 2020/230.0.0.20 Polskie Radio Trójka | 2030/230.0.0.30 Polskie Radio Czwórka | 2040/230.0.0.40

For now i only could listen them on satellite receiver with enigma2 ... tool == "mpe2aac": _, sref, pid, ip, port = parameters cmd = "wget http://127.0.0.1:8001/%s -q -O- | mpe2aac %s %s %s" % (sref, pid, ip, port)

I dont know trick for Dablin player. Another feeds playing fine with.

andimik commented 6 years ago

These feeds have nothing to do with DAB. I suppose they are needed for FM.

andimik commented 6 years ago

On 5 West I found a datapackage (PID 1000) of 2 MBit CBR on the RAI Multistream TP on 11.012 Vertical.

Could anyone try if this has to do with DAB? I did not find out so far.

https://we.tl/t-OKBQtsk0UV

PS. In the meanwhile I've updated the Readme, because on 5W there are EuroDAB and DAB Italia (seem to switch off soon on 12.5W) and the German EDI transponder on 7E changed the Symbol rate.

MCelliotG commented 6 years ago

I have also managed to decode all AAC radios on Hispasat 30W via mpe2aac.

PRISA MUSIC GROUP 12518 H DVB-S2/QPSK/IP 1125 2/3 Cadena SER1+SER2 PID 1001 IP:229.0.0.1 PORT:10017 Los 40 PID 1002 IP:229.0.0.2 PORT:10017 M80 Radio PID 1003 IP:229.0.0.3 PORT:10017 Cadena Dial PID 1004 IP:229.0.0.4 PORT:10017 Radiolé PID 1005 IP:229.0.0.5 PORT:10017 Máxima FM PID 1006 IP:229.0.0.6 PORT:10017 Cadena SER1 PID 1007 IP:229.0.0.7 PORT:10017

PRISA MUSIC GROUP CAT 12519 H DVB-S2/QPSK/IP 718 3/4 Cadena SER Cat PID 2001 IP:230.0.0.1 PORT:10017 Los 40 Principales Cat PID 2002 IP:230.0.0.2 PORT:10017 Cadéna Dial Cat PID 2003 IP:230.0.0.3 PORT:10017 Máxima FM Cat PID 2004 IP:230.0.0.4 PORT:10017

SAPO 12518 V DVB-S2/QPSK/IP 704 3/4 Radio Renascenca PID 1001 IP:229.0.0.1 PORT:10001 RFM PID 1002 IP:229.0.0.2 PORT:10002 Mega FM PID 1003 IP:229.0.0.3 PORT:10003 Radio SIM Sul PID 1004 IP:229.0.0.1 PORT:10004 Radio SIM Norte PID 1005 IP:229.0.0.5 PORT:10005

Media Capital 12530 V DVB-S2/QPSK/IP 1041 3/4 Rádio Comercial PID 1001 IP:230.0.0.1 PORT:10100 Rádio M80 PID 1002 IP:230.0.0.2 PORT:10100 Rádio Cidade PID 1003 IP:230.0.0.3 PORT:10100 Smooth FM PID 1004 IP:230.0.0.4 PORT:10100 Vodafone FM PID 1005 IP:230.0.0.5 PORT:10001

basicmaster commented 6 years ago

On 5 West I found a datapackage (PID 1000) of 2 MBit CBR on the RAI Multistream TP on 11.012 Vertical.

Could anyone try if this has to do with DAB? I did not find out so far.

This is the ensemble "DAB+ RAI" packaged as ETI-NA 5376. Usable with ./ts2na -p 1000 -s 0.

andimik commented 6 years ago

THANKS! I knew it!

MCelliotG commented 6 years ago

Yeap!!!! root@hd51:~# ts2na -i /hdd/movie/rai.ts -p 1000 -s 0 | na2ni | ni2out --list WARN: Forward error correction (FEC) disabled (NOT COMPILED) INFO: Using pid: 0x03e8 (1000) INFO: E1 Sync found at bit: 384, inverted: no DEBUG: seek: B:48, b:0 DEBUG: pre-readed output 14 frames (15 bytes left): DEBUG: MULTIFRAME FILLING: 206 INFO: ETI Sync found at pos: 0 INFO: ETI Multiframe sync found at blockId: 4 .DAB+ RAI (0x5001) 0 : Rai Radio3 (0x5203) Pri subch= 3 start=144 CUs= 72 PL=eep-3a bitrate= 96 DAB+ 1 : Rai GrParlamento (0x5206) Pri subch= 4 start=630 CUs= 36 PL=eep-3a bitrate= 48 DAB+ 2 : Rai Radio Kids (0x52f3) Pri subch=12 start=582 CUs= 48 PL=eep-3a bitrate= 64 DAB+ 3 : Rai Radio2 Indie (0x520a) Pri subch=13 start=726 CUs= 72 PL=eep-3a bitrate= 96 DAB+ 4 : Rai Radio Live (0x52f2) Pri subch=11 start=534 CUs= 36 PL=eep-3a bitrate= 48 DAB+ 5 : RaiTuttaItaliana (0x5207) Pri subch= 6 start=300 CUs= 72 PL=eep-3a bitrate= 96 DAB+ 6 : Rai R Classica (0x5205) Pri subch= 7 start=372 CUs= 72 PL=eep-3a bitrate= 96 DAB+ 7 : Rai R Techete' (0x52f1) Pri subch=10 start=486 CUs= 48 PL=eep-3a bitrate= 64 DAB+ 8 : Rai Isoradio (0x5209) Pri subch= 5 start=252 CUs= 48 PL=eep-3a bitrate= 64 DAB+ 9 : Rai Radio1 Sport (0x520f) Pri subch= 8 start=678 CUs= 48 PL=eep-3a bitrate= 64 DAB+ 10 : Rai Radio2 (0x5202) Pri subch= 2 start= 72 CUs= 72 PL=eep-3a bitrate= 96 DAB+ 11 : Rai Radio1 (0x5201) Pri subch= 1 start= 0 CUs= 72 PL=eep-3a bitrate= 96 DAB+

k-otixxx commented 6 years ago

i found this PID 1000.Which software to use to record stream. With Crazyscan i didnt find how. With Transedit i try with no result.

MCelliotG commented 6 years ago

The stream is on IS11 inside RAI3 TGR Piemonte. On Enigma2 I added PID 1000 manually on the channel via dreamboxedit using c:1503e8. Then I created the stream package to use with dabstreamer on SDG images. `#NAME RAI DAB+ (5.0W)

SERVICE 1:64:91:0:0:0:0:0:0:0::Rai DAB+

DESCRIPTION Rai DAB+

SERVICE 4097:0:2:1:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x5201:Rai Radio1

DESCRIPTION Rai Radio1

SERVICE 4097:0:2:2:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x5202:Rai Radio2

DESCRIPTION Rai Radio2

SERVICE 4097:0:2:3:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x5203:Rai Radio3

DESCRIPTION Rai Radio3

SERVICE 4097:0:2:4:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x5206:Rai GrParlamento

DESCRIPTION Rai GrParlamento

SERVICE 4097:0:2:5:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x5209:Rai Isoradio

DESCRIPTION Rai Isoradio

SERVICE 4097:0:2:6:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x5207:RaiTuttaItaliana

DESCRIPTION RaiTuttaItaliana

SERVICE 4097:0:2:7:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x5205:Rai R Classica

DESCRIPTION Rai R Classica

SERVICE 4097:0:2:8:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x520f:Rai Radio1 Sport

DESCRIPTION Rai Radio1 Sport

SERVICE 4097:0:2:9:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x52f1:Rai R Techete

DESCRIPTION Rai R Techete

SERVICE 4097:0:2:A:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x52f2:Rai Radio Live

DESCRIPTION Rai Radio Live

SERVICE 4097:0:2:B:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x52f3:Rai Radio Kids

DESCRIPTION Rai Radio Kids

SERVICE 4097:0:2:C:2B05:32:0:0:0:0:http%3a//localhost%3a5237/ts2na/1%3a0%3a1%3aC83%3aFA%3aC8%3aDDEAB05%3a0%3a0%3a0%3a/1000/0/0x520a:Rai Radio2 Indie

DESCRIPTION Rai Radio2 Indie

SERVICE 1:64:92:0:0:0:0:0:0:0::Rai DAB+ (Stop Relay)

DESCRIPTION Rai DAB+ (Stop Relay)

SERVICE 1:0:1:C83:FA:C8:DDEAB05:0:0:0:`

k-otixxx commented 6 years ago

Thanks a lot! i addpid 1000 also with dreamboxedit, have signal on this "fake" service but no list of services with ni2out -- list command. Could you post your lamedb for this transponder. Thanks! On 5w everithing is OK with new frequency DAB Italia.

1009:0dde3192:0001:0000:1:0:0 Dab Italia p:Dab Italia,c:151009,f:5

/ 0dde3192:0001:0000
s 12690000:29950000:1:3:-50:2:0:1:2:0:2

MCelliotG commented 6 years ago

You don't have to create a fake service for this. Just add PID 1000 on TGR Piemonte on Dreamboxedit and use its reference for feeding the package 1:0:1:C83:FA:C8:DDEAB05:0:0:0: Make sure to check the K (Keep).

k-otixxx commented 6 years ago

Thanks, i understand now! I am user "plevel" from SDG forum. Appreciate.

andimik commented 6 years ago

Transedit is very easy. Click on the line with that stream and save it.

I have used this tool and sorted every transponder by bitrate. So I found them. But in the Hexeditor I didn't find any text like "RAI" oder "eti". Not so for EuroDAB, there you will see "RTL" and other service IDs. For DAB Italia there were no words, although it is v11 as well.

This transponder requires hardware which can handle ACM and Multistream.

I will change the readme later.

Does anyone receive Hispasat 30W? Maybe the Spanish DAB can be found there?

Danish, Swedish and Dutch streams might NOT be on satellite.

Slovene, Croatian, Austrian, Hungarian, Romanian, Ukrainian, and Bulgarian ensembles are - obviously - NOT on satellite. They are only single sites or microlink based.

MCelliotG commented 6 years ago

I will search inside the TLS encapsulated encrypted feeds of Abertis for any 2mbps streams but it's highly unlikely they'll use it this way, even if they did this solution is very limited to those who can access it! However the MPE streams I posted above could be as well used for feeding DAB...

andimik commented 6 years ago

We learned for EDI the bitrate can be less than 2 MBit, like v11.