David Roberts
Aug 29, 2024, 15:56 PDT
Hi (again)
I'm trying to get a prototype of streaming directly from a Quest headset (via the MillicastPublisher Unreal plugin) up and running. (my test proto works on my windows build, so trying to build it on headset now - i.e. Android ) I am publishing to a to manualy created test token that is set active.
First issue (that should probaby be more obvious as a requirement):
---- It would not build with the standard webRTC, so I did some digging and found the MillicastwebRTC module and added it into my engine's Source/ThirdParty area.
Now building and linking, so on run I get a log file and I see the following error:
LogMillicastPublisher: Millicast WebSocket new Message : {"type":"error","transId":531904929,"data":"Error initializing feed"}
[2024.08.29-20.42.10:365][ 20]LogMillicastPublisher: Error: WebSocket error : Error initializing feed
The log file leading up to that is as follows -- and the full log file is attached to this ticket. - search for MillicastPublisher. You'll also see some badly formed error / warnings - that must be some other UTF format. - My grep through the code didn't turn up where the unreadable error messages are coming from or what they are trying to convey.
David Roberts Aug 29, 2024, 15:56 PDT Hi (again) I'm trying to get a prototype of streaming directly from a Quest headset (via the MillicastPublisher Unreal plugin) up and running. (my test proto works on my windows build, so trying to build it on headset now - i.e. Android ) I am publishing to a to manualy created test token that is set active.
First issue (that should probaby be more obvious as a requirement): ---- It would not build with the standard webRTC, so I did some digging and found the MillicastwebRTC module and added it into my engine's Source/ThirdParty area.
Now building and linking, so on run I get a log file and I see the following error: LogMillicastPublisher: Millicast WebSocket new Message : {"type":"error","transId":531904929,"data":"Error initializing feed"} [2024.08.29-20.42.10:365][ 20]LogMillicastPublisher: Error: WebSocket error : Error initializing feed
The log file leading up to that is as follows -- and the full log file is attached to this ticket. - search for MillicastPublisher. You'll also see some badly formed error / warnings - that must be some other UTF format. - My grep through the code didn't turn up where the unreadable error messages are coming from or what they are trying to convey.
[2024.08.29-20.42.10:186][ 9]LogMillicastPublisher: Millicast WebSocket Connected [2024.08.29-20.42.10:186][ 9]LogMillicastPublisher: Creating FWebRTCPeerConnectionFactory [2024.08.29-20.42.10:190][ 9]LogMillicastPublisher: Start capture [2024.08.29-20.42.10:190][ 9]LogMillicastPublisher: Created video track [2024.08.29-20.42.10:191][ 9]LogMillicastPublisher: OnRenegociationNeeded [2024.08.29-20.42.10:191][ 9]LogMillicastPublisher: Add transceiver for video track : render-target-track [2024.08.29-20.42.10:191][ 9]LogMillicastPublisher: Add transceiver for audio track : audio [2024.08.29-20.42.10:191][ 9]LogMillicastPublisher: Create offer [2024.08.29-20.42.10:198][ 10]LogMillicastPublisher: Warning: 氨湩㌹⤶›䕒⁄潣敤敲獩洠獩楳杮愠獡潳楣瑡摥瀠祡潬摡琠灹 췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍朒潯ⵧ敲扭Ȁz [2024.08.29-20.42.10:198][ 10]LogMillicastPublisher: Warning: 氨湩㔵㨩䐠灵楬慣整椠潦湵删慥獳杩楮杮映潲〱‰潴ㄠ㜲 췍췍@ [2024.08.29-20.42.10:198][ 10]LogMillicastPublisher: Warning: 氨湩㔵㨩䐠灵楬慣整椠潦湵删慥獳杩楮杮映潲‱潴ㄠ촀췍췍췍@ [2024.08.29-20.42.10:198][ 10]LogMillicastPublisher: Display: pc.createOffer() | sucess sdp : v=0 o=- 6029375835327544081 2 IN IP4 127.0.0.1 s=- t=0 0 a=group:BUNDLE 0 1 a=extmap-allow-mixed a=msid-semantic: WMS unrealstream m=video 9 UDP/TLS/RTP/SAVPF 96 97 98 99 127 101 102 c=IN IP4 0.0.0.0 a=rtcp:9 IN IP4 0.0.0.0 a=ice-ufrag:Hcxr a=ice-pwd:7jsQNLkNXaMdl0WXgCklO4zg a=ice-options:trickle renomination a=fingerprint:sha-256 49:A1:7F:5C:06:4F:4F:2B:20:33:1C:DC:06:69:5A:75:19:AB:31:49:E3:71:A4:F0:87:06:F2:9A:0B:FF:5F:F2 a=setup:actpass a=mid:0 a=extmap:1 urn:ietf:params:rtp-hdrext:toffset a=extmap:2 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time a=extmap:3 urn:3gpp:video-orientation a=extmap:4 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01 a=extmap:5 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay a=extmap:6 http://www.webrtc.org/experiments/rtp-hdrext/video-content-type a=extmap:7 http://www.webrtc.org/experiments/rtp-hdrext/video-timing a=extmap:8 http://www.webrtc.org/experiments/rtp-hdrext/color-space a=extmap:9 urn:ietf:params:rtp-hdrext:sdes:mid a=extmap:10 urn:ietf:params:rtp-hdrext:sdes:rtp-stream-id a=extmap:11 urn:ietf:params:rtp-hdrext:sdes:repaired-rtp-stream-id a=sendonly a=msid:unrealstream render-target-track a=rtcp-mux a=rtcp-rsize a=rtpmap:96 VP8/90000 a=rtcp-fb:96 goog-remb a=rtcp-fb:96 transport-cc a=rtcp-fb:96 ccm fir a=rtcp-fb:96 nack a=rtcp-fb:96 nack pli a=rtpmap:97 rtx/90000 a=fmtp:97 apt=96 a=rtpmap:98 VP9/90000 a=rtcp-fb:98 goog-remb a=rtcp-fb:98 transport-cc a=rtcp-fb:98 ccm fir a=rtcp-fb:98 nack a=rtcp-fb:98 nack pli a=rtpmap:99 rtx/90000 a=fmtp:99 apt=98 a=rtpmap:127 red/90000 a=rtpmap:101 rtx/90000 a=fmtp:101 apt=127 a=rtpmap:102 ulpfec/90000 a=ssrc-group:FID 2425301203 2733141840 a=ssrc:2425301203 cname:9+gHTRHXFW3Mpw3N a=ssrc:2425301203 msid:unrealstream render-target-track a=ssrc:2425301203 mslabel:unrealstream a=ssrc:2425301203 label:render-target-track a=ssrc:2733141840 cname:9+gHTRHXFW3Mpw3N a=ssrc:2733141840 msid:unrealstream render-target-track a=ssrc:2733141840 mslabel:unrealstream a=ssrc:2733141840 label:render-target-track m=audio 9 UDP/TLS/RTP/SAVPF 111 63 110 c=IN IP4 0.0.0.0 a=rtcp:9 IN IP4 0.0.0.0 a=ice-ufrag:Hcxr a=ice-pwd:7jsQNLkNXaMdl0WXgCklO4zg a=ice-options:trickle renomination a=fingerprint:sha-256 49:A1:7F:5C:06:4F:4F:2B:20:33:1C:DC:06:69:5A:75:19:AB:31:49:E3:71:A4:F0:87:06:F2:9A:0B:FF:5F:F2 a=setup:actpass a=mid:1 a=extmap:14 urn:ietf:params:rtp-hdrext:ssrc-audio-level a=extmap:2 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time a=extmap:4 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01 a=extmap:9 urn:ietf:params:rtp-hdrext:sdes:mid a=sendonly a=msid:unrealstream audio a=rtcp-mux a=rtpmap:111 opus/48000/2 a=rtcp-fb:111 transport-cc a=fmtp:111 minptime=10;useinbandfec=1 a=rtpmap:63 red/48000/2 a=fmtp:63 111/111 a=rtpmap:110 telephone-event/48000 a=ssrc:947831068 cname:9+gHTRHXFW3Mpw3N a=ssrc:947831068 msid:unrealstream audio a=ssrc:947831068 mslabel:unrealstream a=ssrc:947831068 label:audio [2024.08.29-20.42.10:198][ 10]LogMillicastPublisher: Warning: 氨湩㜸⤰›潃普杩椠湩慶楬㩤洠湩扟瑩慲整扟獰ⴽ㬱洠硡扟瑩慲整扟獰ⴽ㬱戠瑯硥数瑣摥朠敲瑡牥漠煥慵潴〠 췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍췍À [2024.08.29-20.42.10:198][ 10]LogMillicastPublisher: Warning: 氨湩〹⤴›牦浡彥敬杮桴牟湡敧 獩渠瑯猠瑥 췍췍0 [2024.08.29-20.42.10:198][ 10]LogMillicastPublisher: pc.setLocalDescription() | sucess [2024.08.29-20.42.10:198][ 10]LogMillicastPublisher: WebSocket publish payload : { "type": "cmd", "transId": 531904929, "name": "publish", "data": { "name": "Test_1234", "sdp": "v=0\r\no=- 6029375835327544081 2 IN IP4 127.0.0.1\r\ns=-\r\nt=0 0\r\na=group:BUNDLE 0 1\r\na=extmap-allow-mixed\r\na=msid-semantic: WMS unrealstream\r\nm=video 9 UDP/TLS/RTP/SAVPF 96 97 98 99 127 101 102\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:Hcxr\r\na=ice-pwd:7jsQNLkNXaMdl0WXgCklO4zg\r\na=ice-options:trickle renomination\r\na=fingerprint:sha-256 49:A1:7F:5C:06:4F:4F:2B:20:33:1C:DC:06:69:5A:75:19:AB:31:49:E3:71:A4:F0:87:06:F2:9A:0B:FF:5F:F2\r\na=setup:actpass\r\na=mid:0\r\na=extmap:1 urn:ietf:params:rtp-hdrext:toffset\r\na=extmap:2 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:3 urn:3gpp:video-orientation\r\na=extmap:4 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:5 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay\r\na=extmap:6 http://www.webrtc.org/experiments/rtp-hdrext/video-content-type\r\na=extmap:7 http://www.webrtc.org/experiments/rtp-hdrext/video-timing\r\na=extmap:8 http://www.webrtc.org/experiments/rtp-hdrext/color-space\r\na=extmap:9 urn:ietf:params:rtp-hdrext:sdes:mid\r\na=extmap:10 urn:ietf:params:rtp-hdrext:sdes:rtp-stream-id\r\na=extmap:11 urn:ietf:params:rtp-hdrext:sdes:repaired-rtp-stream-id\r\na=sendonly\r\na=msid:unrealstream render-target-track\r\na=rtcp-mux\r\na=rtcp-rsize\r\na=rtpmap:96 VP8/90000\r\na=rtcp-fb:96 goog-remb\r\na=rtcp-fb:96 transport-cc\r\na=rtcp-fb:96 ccm fir\r\na=rtcp-fb:96 nack\r\na=rtcp-fb:96 nack pli\r\na=rtpmap:97 rtx/90000\r\na=fmtp:97 apt=96\r\na=rtpmap:98 VP9/90000\r\na=rtcp-fb:98 goog-remb\r\na=rtcp-fb:98 transport-cc\r\na=rtcp-fb:98 ccm fir\r\na=rtcp-fb:98 nack\r\na=rtcp-fb:98 nack pli\r\na=rtpmap:99 rtx/90000\r\na=fmtp:99 apt=98\r\na=rtpmap:127 red/90000\r\na=rtpmap:101 rtx/90000\r\na=fmtp:101 apt=127\r\na=rtpmap:102 ulpfec/90000\r\na=ssrc-group:FID 2425301203 2733141840\r\na=ssrc:2425301203 cname:9+gHTRHXFW3Mpw3N\r\na=ssrc:2425301203 msid:unrealstream render-target-track\r\na=ssrc:2425301203 mslabel:unrealstream\r\na=ssrc:2425301203 label:render-target-track\r\na=ssrc:2733141840 cname:9+gHTRHXFW3Mpw3N\r\na=ssrc:2733141840 msid:unrealstream render-target-track\r\na=ssrc:2733141840 mslabel:unrealstream\r\na=ssrc:2733141840 label:render-target-track\r\nm=audio 9 UDP/TLS/RTP/SAVPF 111 63 110\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:Hcxr\r\na=ice-pwd:7jsQNLkNXaMdl0WXgCklO4zg\r\na=ice-options:trickle renomination\r\na=fingerprint:sha-256 49:A1:7F:5C:06:4F:4F:2B:20:33:1C:DC:06:69:5A:75:19:AB:31:49:E3:71:A4:F0:87:06:F2:9A:0B:FF:5F:F2\r\na=setup:actpass\r\na=mid:1\r\na=extmap:14 urn:ietf:params:rtp-hdrext:ssrc-audio-level\r\na=extmap:2 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:4 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:9 urn:ietf:params:rtp-hdrext:sdes:mid\r\na=sendonly\r\na=msid:unrealstream audio\r\na=rtcp-mux\r\na=rtpmap:111 opus/48000/2\r\na=rtcp-fb:111 transport-cc\r\na=fmtp:111 minptime=10;stereo=1;useinbandfec=1\r\na=rtpmap:63 red/48000/2\r\na=fmtp:63 111/111\r\na=rtpmap:110 telephone-event/48000\r\na=ssrc:947831068 cname:9+gHTRHXFW3Mpw3N\r\na=ssrc:947831068 msid:unrealstream audio\r\na=ssrc:947831068 mslabel:unrealstream\r\na=ssrc:947831068 label:audio\r\n", "codec": "h264", "events": [ "active", "inactive", "viewercount" ] } } [2024.08.29-20.42.10:198][ 10]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:217][ 11]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:231][ 12]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:246][ 13]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:263][ 14]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:280][ 15]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:297][ 15]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:297][ 15]LogPrecisionPlayerCamera: Display: Fade finished. [2024.08.29-20.42.10:297][ 15]LogPrecisionPlayerCamera: Display: Setting camera overlay visibility to: TRUE [2024.08.29-20.42.10:314][ 17]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:330][ 18]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:345][ 19]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:360][ 20]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:362][ 20]LogPrecision: 638605609303610000 (+4330000) [2024.08.29-13.42.10]: HandleRequestProgress: bytesSent=0 byteReceived=41 [2024.08.29-20.42.10:362][ 20]LogPrecision: 638605609303620000 (+10000) [2024.08.29-13.42.10]: HandleHeaderReceived: header=Content-Type value=text/plain; charset=utf-8 [2024.08.29-20.42.10:363][ 20]LogPrecision: 638605609303620000 (+0) [2024.08.29-13.42.10]: HandleHeaderReceived: header=Date value=Thu, 29 Aug 2024 20:42:08 GMT [2024.08.29-20.42.10:363][ 20]LogPrecision: 638605609303630000 (+10000) [2024.08.29-13.42.10]: HandleHeaderReceived: header=Server value=Kestrel [2024.08.29-20.42.10:364][ 20]LogPrecision: 638605609303630000 (+0) [2024.08.29-13.42.10]: HandleHeaderReceived: header=Transfer-Encoding value=chunked [2024.08.29-20.42.10:364][ 20]LogPrecision: 638605609303640000 (+10000) [2024.08.29-13.42.10]: HandleHeaderReceived: header=Request-Context value=appId=cid-v1:8faa1f5d-1a33-4244-b142-a94de00d154c [2024.08.29-20.42.10:364][ 20]LogPrecision: 638605609303640000 (+0) [2024.08.29-13.42.10]: RequestResponse: 0.43 https://mediaapi.precisionostech.com/api/manifest?code=xdfMbdJxkCvsgAIK2jF6Gp0WRHPFOdCBEqtTLftFWIu2AzFuZ-q3BQ==&user=&app=PrecisionAnatomy code: 400 1 [2024.08.29-20.42.10:365][ 20]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584 [2024.08.29-20.42.10:365][ 20]LogPrecision: Error: 638605609303640000 (+0) [2024.08.29-13.42.10]: Failed Request! URL: https://mediaapi.precisionostech.com/api/manifest?code=xdfMbdJxkCvsgAIK2jF6Gp0WRHPFOdCBEqtTLftFWIu2AzFuZ-q3BQ==&user=&app=PrecisionAnatomy Code: 400 [2024.08.29-20.42.10:365][ 20]LogPrecision: Error: 638605609303650000 (+10000) [2024.08.29-13.42.10]: ManifestQuery: Request was not successful! code=400 [2024.08.29-20.42.10:365][ 20]LogCallbackFunctors: Executed Callback Functor: LoadManifest [2024.08.29-20.42.10:365][ 20]LogMillicastPublisher: Millicast WebSocket new Message : {"type":"error","transId":531904929,"data":"Error initializing feed"} [2024.08.29-20.42.10:365][ 20]LogMillicastPublisher: Error: WebSocket error : Error initializing feed [2024.08.29-20.42.10:391][ 22]LogRenderer: Warning: Resizing VR buffer to 1536 by 1584
Attachment(s) PrecisionAnatomy2_6.log
PrecisionAnatomy2_6.log