olli991 / mib-std2-pq-zr-toolbox

Toolbox for MIB STD2 PQ/ZR Technisat/Preh units.
https://discord.gg/YU3rjatWjT
MIT License
484 stars 78 forks source link

Video playback in MIB STD2 PQ/ZR research #29

Closed mattcabb closed 8 months ago

mattcabb commented 3 years ago

After looking this issue: https://github.com/olli991/mib-std2-pq-zr-toolbox/issues/22 I've dig a little bit in system files, developer mode, and on YT. Here's what I've found.

General info

  1. MIB STD2 PQ/ZR does not have the option to play video files on the display. This feature is reserved for MIB2 HIGH.
  2. .mcf skin files contain all the necessary GUI elements for video playback. Most likely GUI was developed for both STD and HIGH, it's shared between them and that's why there's a lot of unused assets there.
  3. MIB pinout shows that there are 2 FBAS video inputs at the back of the main unit. One for the rear view camera (quadlock, socket B, pin6 for signal; pin12 for shield), one for iPod interface (quadlock, socket C, pin9 for signal, pin10 for shield).
  4. And you can jailbreak your iPhone or root your Android phone to force it to show video apps over CarPlay/AndroidAuto on the MIB display. There are also devices like Z6-PLUS that will act like an iPhone when connected to MIB to gain control over the screen, and will let you play videos and more (eg. https://www.youtube.com/watch?v=s2e2GwWk8mQ )

About the FBAS input

  1. Old MIB1STD with MEDIA-IN interface can play video from connected iPod/iPhone/iPad. https://www.youtube.com/watch?v=_25KHKoeYrI https://www.youtube.com/watch?v=4owggs3izRE https://www.youtube.com/watch?v=OAU9I_9RItI
  2. MIB STD2 PQ/ZR with the CarPlay-enabled USB socket (eg. 5G0 035 222 E) detects Apple devices as iPods if you disable CarPlay. This way you can access iPhone media library from the MIB STD2 PQ/ZR screen.
  3. If you connect old iPhone (for example iPhone 3GS with 30-pin dock connector) to MIB STD2 PQ/ZR with the mentioned CarPlay-enabled port, you will additionally see music video section in the media library. When selected you can only hear the audio stream. I believe that's because iPhone will send analog video signal over the dedicated pin in the 30-pin dock connector. Additionally if you select music video from the iPhone screen while it's connected to the MIB, you will not see the video on the display - just the controls.

About MP4 video playback in MIB STD2 PQ/ZR

  1. MIB STD2 PQ/ZR can handle MP4 files for sure, because we can see them in the media library and we can play the audio scream from them.
  2. If I'm not mistaken, MIB STD2 PQ/ZR can handle H.264 video codec as well since MirrorLink and CarPlay are both based on it.
  3. If you enable diagnostic mode, there are some mentions of the video playback feature:
    • Const Values > MediaVideoNumberOfAvailableSources = 0
    • Feature Flags > isSystem_DigitalVideo = 0
    • HMI Diag data > Testmode Video Geschwindigkeitsabschaltung - Parameter Entwickletmenu = 0
    • HMI Diag data > Geschwindingkeitsabschaltschwellen - Video = 0

Now what?

  1. What would be needed to change stored values? VCP parametrization? Some kind of EEPROM access?
  2. And even if there's a way to set isSystem_DigitalVideo = 1, would the media player just magically start playing video files?
  3. Is it possible to install old MEDIA-IN interface on a MIB STD2 PQ/ZR?
lprot commented 3 years ago

Do I understand you correct that MIB2 STD=Delphi in your case? As MIB STD2 PQ/ZR are Technisats/Preh and differ from Delphi in software and hardware.

For example RCC cpu on MIB STD2 PQ/ZR is J5 Eco and on MIB2 STD is J6 Eco.

mattcabb commented 3 years ago

I'm talking about MIB2 Technisat (since this toolbox is supporting Technisat only). By MIB2STD I'm referring to the MIB2 Standard units in general. Not the Delphi unit alone. Sorry for the confusion.

To be precise my unit is MIB STD2 ZR, VW Discover Media, SW:0245 HW: H24, installed in 2015/16 VW Golf MK7.

majonezz commented 2 years ago

Feature flags are stored in the special file called configurationmanager.res . By modyfing this file someone managed to enable CAR menu in PQ units. About the video playback - is it possible that NAR units have it unlocked by factory? Recently i looked at the owner's manual of late 2021 NMS Passat and i remember the chapter about media playback - it says that video can be played (only at stationary).

mattcabb commented 2 years ago

Not sure if late 2021 Passat will have mib std2. And more playback freedom in NAR cars is the last thing that I expect 😅

majonezz commented 2 years ago

Well i bet it has std2 onboard. Ross Tech has a very useful forum with reference VCDS scans -> https://forums.ross-tech.com/index.php?threads/29900/ . VIN of this car is 1VWMA7A35NC005570. Just enter it when looking for the owner's manual on their site and you'll see "Video and DVD mode" section. P.S. I don't believe them (VW) too, but i didn't have a unit like this in my hands so i can't confirm or deny this.

Address 5F: Information Electr. (J794) Labels:* None Part No SW: 5C0 035 684 F HW: 5C0 035 684 F Component: MU-S-NS-US H62 0605
Serial number: VWZAZ2Y1270255 Coding: 02140102AA00000041220003001808009F0106D400200105C6 Shop #: WSC 06050 062 00200 ASAM Dataset: EV_MUStd4CTSAT 001022 ROD: EV_MUStd4CTSAT_VW26.rod VCID: A80213EA0270021B435-80FC

No fault code found.

mattcabb commented 2 years ago

Isn't HW: 5C0 035 684 F a PQ all-in-one unit? How is it installed in Passat?

majonezz commented 2 years ago

Yes it is. NAR version of Passat is still build around PQ platform. The unit is all-in-one version, but with a glass-front to look similar to that modern MQB versions.

mattcabb commented 2 years ago

OK, so there's a NMS Passat, which is very different from the MQB Passat B8. There's an all-in-one PQ main unit in it, running something like MST2_US_VW_PQ_R0604T. On a well known server which I will not link, there's a MST2_EU_VW_PQ_R0604T version available to download for further investigation. T, so I assume it's made by Technisat. 06, so I assume it's running Hardware H6x. Would love to find and SSP document for this unit. NMS Passat is for NAR/China only, but since there's an EU version of the firmware, I believe this unit will also be installed in other VW cars that are available in Europe (Polo? Crafter?).

mattcabb commented 2 years ago

Looks like someone have done 02xx to 06xx firmware conversion already: https://www.drive2.com/l/559054384797843558/ No info about video playback yet.

lprot commented 8 months ago

We can consider that videoplaying is not possible on MST2.