flybywiresim / docs

https://docs.flybywiresim.com/
36 stars 79 forks source link

Implementing a Taxi Camera Feature in the FBW A380X Using Garmin-Inspired Synthetic Vision Systems #1037

Closed NeosDumb closed 3 weeks ago

NeosDumb commented 3 weeks ago

Background The real-world Airbus A380 is equipped with a built-in taxi camera system that enhances pilot visibility during ground operations. However, replicating this feature in the current FBW A380X has presented challenges. To address this, I propose leveraging technology similar to the synthetic vision systems (SVS) found in smaller aircraft Garmin PFDs, such as those in Marwan Gharib’s HJet.

Core Concept Garmin's synthetic vision mode projects a runway or taxiway visualization onto the Primary Flight Display (PFD), improving situational awareness during ground operations. This mode blends real-time data, terrain mapping, and pre-rendered visuals to provide a pilot with a clear understanding of their position relative to the taxiways and runways.

Proposed Implementation Strategy Data Input and Integration:

Camera/Overlay Simulation: While a true taxi camera requires external video feeds, synthetic solutions can leverage pre-rendered visualizations from the simulator's ground mapping data (e.g., Bing Maps or other photogrammetry sources). SVS Framework: Integrate an SVS-like module into the A380's cockpit displays, allowing the PFD or MFD to switch to a 'taxi cam' view that displays a rendered ground view in real time.

Coordinate System: Ensure synchronization with the aircraft’s GPS position data and attitude information to create accurate runway and taxiway overlays. Rendering and Display:

HUD and Display Overlays: Develop a display mode on the A380X’s screens that mimics the Garmin SVS’s ability to show synthetic ground textures. This could involve repurposing elements from the existing SVS logic within MSFS or crafting a custom overlay renderer.

Visual Detail: Include critical elements such as taxiway lines, runway borders, and key airport markings, ensuring the overlay's visual fidelity aligns with the simulator's airport layouts. Performance Considerations:

Resource Management: Ensure that the new feature does not negatively impact simulator performance. This could be achieved through optimizing rendering techniques, using pre-processed lower-resolution images for certain elements, or culling unneeded visuals outside the camera’s immediate range.

Asynchronous Loading: Implement a way to asynchronously load ground textures or reduce processing load during active taxiing phases to maintain smooth FPS. User Customization:

Display Options: Provide the ability for users to toggle the taxi camera mode or adjust the display settings (e.g., transparency, field of view). Integration with Avionics: Seamlessly incorporate the taxi camera into the existing flight deck systems, making it an intuitive part of the pilot workflow.

Technical Feasibility The FBW team could explore MSFS SDK capabilities related to external camera feeds and overlays, leveraging existing rendering pipelines for synthetic elements already supported in the Garmin implementations or by third-party avionics suites. Utilizing MSFS’s 3D rendering tools and the XML/JS frameworks for gauge displays would facilitate creating a non-intrusive, performant feature that fits within the current A380X cockpit structure.

Benefits Enhanced Realism: Bringing this feature to the A380X would replicate the real-world taxiing experience more accurately. Improved Situational Awareness: Pilots would benefit from better ground navigation, reducing the likelihood of errors during taxiing. Community and Developer Engagement: Introducing an innovative, adapted SVS solution could inspire more contributions and discussions around cockpit technology in flight simulators.

Research Feasibility: Evaluate existing Garmin SVS systems in MSFS and their code structures for potential adaptation. Prototype Development: Build a basic synthetic camera overlay using MSFS’s ground rendering capabilities and test its integration with the A380’s PFD. Community Feedback: Engage with other developers to refine the concept and gather input on potential challenges or enhancements.

frankkopp commented 3 weeks ago

This is not the correct repo for this. Will close. You can add this here: https://github.com/flybywiresim/aircraft/issues/8800