Derivative works — US Patent 9843786

Defensive Disclosure Document: Enhancements and Diversifications of US Patent 9843786

This defensive disclosure document outlines a series of derivative variations and extensions of the technologies described in US Patent 9843786, "Transport of stereoscopic image data over a display interface." The goal is to establish prior art for future incremental improvements by competitors, focusing on the core inventive concepts of multiplexing stereoscopic image data within a digital display interface and using auxiliary data channels for signaling and additional data. The derivations explore material and component substitution, operational parameter expansion, cross-domain applications, integration with emerging technologies, and inverse/failure modes.

The core claim being expanded upon is Claim 1, which describes an interface part for a first audio-visual device capable of formatting and transmitting both 2D and multiplexed stereoscopic image data over an uncompressed pixel information interface, utilizing auxiliary data elements for signaling information related to the stereoscopic multiplexing scheme.

Derivative Variations for US9843786 (based on Claim 1)

1. Material & Component Substitution

Derivative 1.1: Fiber Optic Transport Layer with Custom ASIC for Multiplexing

Enabling Description: This variation replaces the traditional copper-based HDMI (TMDS) transmission lines with a multi-mode or single-mode fiber optic transport layer, such as active optical cables (AOCs) conforming to the SFP+ or QSFP standards adapted for display interfaces. The formatter and de-formatter functions, including the multiplexing/demultiplexing of stereoscopic image data into higher bit-depth data elements and the generation/extraction of auxiliary signaling, are implemented within a dedicated Application-Specific Integrated Circuit (ASIC). This ASIC would handle the electro-optical conversion, protocol encapsulation (e.g., converting HDMI TMDS streams to a packetized fiber optic protocol), and the specific logic for interleaving left/right eye data or 2D/depth data within the higher bandwidth fiber channel. The auxiliary data elements for signaling, instead of HDMI Data Island Packets, would be encapsulated in dedicated control packets within the fiber optic protocol, or within reserved fields in the video data packets, ensuring robust transmission and identification of stereoscopic modes.

Mermaid.js Diagram:

flowchart LR
    A[Image Data Input] --> B{ASIC Formatter};
    B -- 2D Mode --> C[Packetizer for Fiber Optic];
    B -- Stereo Mode (Multiplex) --> C;
    C --> D[Electro-Optical Converter];
    D --> E[Fiber Optic Cable];
    E --> F[Electro-Optical Converter];
    F --> G[De-packetizer];
    G -- Demultiplex --> H[Stereoscopic Image Output];
    B -- Signaling to Auxiliary Data --> I[Control Packet Generator];
    I --> D;
    F --> J[Control Packet Extractor];
    J --> H;

Derivative 1.2: Liquid Crystal Polymer (LCP) Coaxial Cables with FPGA-based Formatter

Enabling Description: The transmission interface utilizes miniature, high-frequency LCP-insulated coaxial cables (e.g., micro-coaxial or twin-coaxial) known for superior signal integrity and reduced crosstalk at very high data rates compared to conventional copper wiring, especially for differential signaling. The formatter logic is implemented on a Field-Programmable Gate Array (FPGA), allowing for flexible and reconfigurable multiplexing schemes. The FPGA can dynamically adjust the bit-allocation for 2D/depth or left/right eye components within the high-bandwidth data elements, and reconfigure the auxiliary data structure (e.g., packet size, header information) on the fly based on display device capabilities or content requirements. The auxiliary signaling can be embedded using a custom low-voltage differential signaling (LVDS) side channel within the LCP cable assembly, separate from the primary video data lines, or time-multiplexed within the video blanking intervals using custom packet structures.

Mermaid.js Diagram:

graph TD
    A[Image Data Input] --> B(FPGA Formatter);
    B -- Configures --> C{Multiplexing Logic (L/R or 2D+D)};
    B -- Generates --> D[Auxiliary Signaling Packets];
    C --> E[LCP Coaxial Cable Driver];
    D --> F[LVDS Side Channel Driver];
    E --> G[LCP Coaxial Cable Link];
    F --> G;
    G --> H[LCP Coaxial Cable Receiver];
    H --> I[LVDS Side Channel Receiver];
    H --> J{De-multiplexing Logic (FPGA)};
    I --> J;
    J --> K[Stereoscopic Image Output];

Derivative 1.3: Gallium Nitride (GaN) Power Stage for High-Frequency Modulators in Wireless Display Interface

Enabling Description: This variation applies to a wireless digital display interface (e.g., WirelessHD, WiGig, 802.11ay) operating in the millimeter-wave (mmWave) spectrum for uncompressed pixel transmission. The formatter's output is fed into a high-frequency modulator, where the power amplification stages utilize Gallium Nitride (GaN) transistors. GaN offers significantly higher power efficiency and linearity at mmWave frequencies compared to traditional silicon-based components, enabling robust transmission of high-bandwidth multiplexed stereoscopic data over greater distances or with reduced power consumption. The auxiliary data, including mode identification and multiplexing schemes, is embedded in a separate sub-carrier modulation scheme (e.g., OFDM subcarriers) within the mmWave link, ensuring independent and reliable delivery of control information.

Mermaid.js Diagram:

sequenceDiagram
    participant A as Source AV Device (Formatter)
    participant B as GaN Modulator/Amplifier
    participant C as Wireless mmWave Link
    participant D as Receiver (Demodulator/Processor)
    participant E as Sink AV Device

    A->>B: Multiplexed Stereoscopic Data
    A->>B: Auxiliary Signaling (Control)
    B->>C: Modulated mmWave Signal (High Power)
    C->>D: Received mmWave Signal
    D->>E: Decoded Stereoscopic Data
    D->>E: Decoded Auxiliary Signaling

2. Operational Parameter Expansion

Derivative 2.1: Ultra-High-Resolution (8K/16K) Stereoscopic Data Transport at Terahertz Frequencies

Enabling Description: The interface is designed to transport stereoscopic image data at resolutions beyond current standards, such as 8K (7680x4320) or 16K (15360x8640) per eye, requiring massive bandwidth. This is achieved using a terahertz (THz) frequency wireless interface (e.g., using T-rays for short-range, line-of-sight communication). The formatter multiplexes the components (e.g., 2D+depth for 16K at 120Hz frame rate, or dual 8K left/right images) into THz pulses. Auxiliary data elements are embedded as modulation patterns within the leading edge of each THz pulse or within specific frequency sub-bands, containing metadata for resolution, frame rate, 3D format, and compression parameters. The THz system would utilize advanced multiplexing techniques like orbital angular momentum (OAM) multiplexing or spatial multiplexing with multiple THz beams to carry the dense stereoscopic information.

Mermaid.js Diagram:

graph LR
    A[8K/16K Left/Right Images] --> B{THz Formatter};
    B -- Multiplexes --> C[THz Pulse Generator];
    B -- Generates --> D[Auxiliary THz Modulator];
    C --> E[THz Emitter];
    D --> E;
    E --> F(THz Wireless Link);
    F --> G[THz Detector];
    G --> H[THz Demodulator];
    H --> I[THz De-multiplexer];
    I --> J[8K/16K Stereoscopic Output];

Derivative 2.2: Extreme Temperature Operation for Industrial Stereoscopic Vision Systems

Enabling Description: This variation adapts the digital display interface for use in harsh industrial environments, such as furnaces, cryogenic chambers, or outer space applications. The interface parts (formatter, processor) are constructed with radiation-hardened components (e.g., silicon-on-insulator CMOS, wide-bandgap semiconductors like SiC) and designed to operate reliably from -200°C to +300°C. The display interface itself employs robust cabling (e.g., mineral-insulated cables, high-temperature fiber optics) or specialized wireless links (e.g., high-frequency radio in vacuum). Signaling information for the stereoscopic mode and decoding scheme is made redundant and transmitted with error correction codes in auxiliary data packets, which are also temperature-compensated, ensuring robust communication under extreme thermal cycling and radiation exposure.

Mermaid.js Diagram:

stateDiagram-v2
    [*] --> Initializing
    Initializing --> Operational_2D: 2D Mode Selected
    Initializing --> Operational_Stereo: Stereo Mode Selected
    Operational_2D --> Processing_2D
    Operational_Stereo --> Processing_Stereo
    Processing_2D --> Transmitting_2D: Stream First Data Elements
    Processing_Stereo --> Transmitting_Stereo: Stream Second Data Elements (Multiplexed)
    Transmitting_2D --> Transmitting_Aux_Signaling: Send 2D Mode Info (Auxiliary)
    Transmitting_Stereo --> Transmitting_Aux_Signaling: Send Stereo Mode Info (Auxiliary)
    Transmitting_Aux_Signaling --> Stable_Operation_Extreme_Temp: Data Link Active
    Stable_Operation_Extreme_Temp --> Error_Detection: Fault or Degradation
    Error_Detection --> Recovery_Routine: Initiate Error Correction
    Recovery_Routine --> Stable_Operation_Extreme_Temp: If Recovered
    Recovery_Routine --> Fail_Safe_Mode: If Unrecoverable
    Fail_Safe_Mode --> [*]

Derivative 2.3: High-Pressure Submersible Stereoscopic Inspection Interface

Enabling Description: This system is for deep-sea or subterranean applications, requiring the digital display interface to withstand extreme hydrostatic pressures (e.g., >100 MPa). The interface utilizes pressure-compensated optical fiber links with specialized connectors and pressure-resistant housings for the AV devices. The data elements and auxiliary signaling are transmitted using frequency-shift keying (FSK) over an acoustically coupled underwater communication channel as a secondary, redundant auxiliary link, alongside the primary optical fiber. The primary optical link handles the high-bandwidth uncompressed stereoscopic image data, while the FSK acoustic channel carries robust, low-bandwidth signaling for mode identification, depth calibration, and emergency override commands, including explicit instructions for stereoscopic demultiplexing in case of primary link degradation.

Mermaid.js Diagram:

graph TD
    A[Stereoscopic Camera Input (Submersible)] --> B{Pressure-Hardened Formatter};
    B -- Primary Image Data (Multiplexed) --> C[Optical Fiber Transmitter];
    B -- Auxiliary Signaling --> D[Acoustic FSK Modulator];
    C --> E[Optical Fiber Link (Primary)];
    D --> F[Acoustic Transducer (Secondary)];
    E --> G[Optical Fiber Receiver];
    F --> H[Acoustic Hydrophone];
    G --> I{Pressure-Hardened Processor};
    H --> J[Acoustic FSK Demodulator];
    J --> I;
    I --> K[Stereoscopic Display Output (Surface/Control)];

3. Cross-Domain Application

Derivative 3.1: Medical Robotics for Minimally Invasive Surgery (MIS)

Enabling Description: In MIS, a surgeon operates using a remote robotic system guided by a stereoscopic view from an endoscope. This derivative applies the patent's core concept by using a specialized medical-grade digital display interface (e.g., a variant of SMPTE 2022 or a custom proprietary medical interface) to transmit uncompressed stereoscopic video from the endoscopic camera to the surgical console. The formatter in the endoscope controller multiplexes left/right eye feeds, or a 2D view with depth map data, into a high-bandwidth stream. Auxiliary data elements, embedded as DICOM header extensions or within blanking intervals, carry critical signaling: the current stereoscopic mode (e.g., 3D anaglyph, active shutter, 2D+depth), instrument tracking data (e.g., position, orientation of robotic tools), and patient physiological telemetry, enabling the surgical console to accurately render the 3D surgical field and overlay contextual information.

Mermaid.js Diagram:

flowchart LR
    A[Endoscopic L/R Cameras] --> B{Medical Formatter};
    B -- Multiplexes Stereoscopic Video --> C[Medical Display Interface Tx];
    B -- Integrates Instrument Tracking/Telemetry --> D[Auxiliary Data Encoder (DICOM)];
    D --> C;
    C --> E[Medical-Grade Cable/Fiber];
    E --> F[Medical Display Interface Rx];
    F --> G[Auxiliary Data Decoder];
    F --> H{Surgical Console Processor};
    G --> H;
    H --> I[Stereoscopic Surgical Display];

Derivative 3.2: Autonomous Agricultural Vehicle Guidance Systems

Enabling Description: Autonomous agricultural vehicles (e.g., tractors, harvesters) use stereoscopic vision for obstacle detection, crop analysis, and precision navigation. This derivative integrates the display interface for real-time stereoscopic data feedback to a human operator or for internal machine vision processing. The formatter on the agricultural vehicle's sensor array (comprising multiple stereo cameras) multiplexes images (e.g., visible light stereo, IR stereo, or 2D visible + LiDAR depth data) into data elements suitable for transmission over a ruggedized industrial Ethernet (e.g., EtherCAT over shielded fiber). The auxiliary data elements, conforming to an ISOBUS-like data packet structure or a custom agricultural standard, carry crucial signaling: sensor fusion parameters, vehicle kinematics, GPS/RTK location, and the specific stereoscopic rendering mode for on-board displays or remote monitoring stations.

Mermaid.js Diagram:

graph LR
    A[Stereo Camera Array (Visible/IR)] --> B{Agricultural Formatter};
    C[LiDAR Sensor] --> B;
    B -- Multiplexes Image/Depth --> D[Ethernet Encapsulator];
    B -- Encodes Kinematics/GPS/Sensor Fusion --> E[ISOBUS Auxiliary Data Packetizer];
    D --> F[Ruggedized Ethernet Tx];
    E --> F;
    F --> G[Industrial Ethernet Link];
    G --> H[Ruggedized Ethernet Rx];
    H --> I[ISOBUS Auxiliary Data Decoder];
    H --> J{Machine Vision/Display Processor};
    I --> J;
    J --> K[Operator HMI / Autonomy Module];

Derivative 3.3: Augmented Reality (AR) HUD for Aerospace Cockpits

Enabling Description: In an aerospace cockpit, pilots use head-up displays (HUDs) for critical flight information. This derivative extends the concept to an AR HUD providing stereoscopic contextual data (e.g., 3D terrain maps, target designations, flight path vectors projected onto the real world). The formatter within the avionics system multiplexes real-time camera feeds (for AR overlay registration) with synthetically generated 3D graphics elements and depth information into a specialized avionics bus (e.g., ARINC 818 or a high-speed MIL-STD-1553 derivative for video). Auxiliary data elements, complying with ARINC standards or proprietary aerospace data structures, carry signaling for: AR calibration data, symbology projection parameters, 3D object metadata, sensor data fusion status, and flight-critical warnings, ensuring accurate and timely stereoscopic presentation in the pilot's field of view.

Mermaid.js Diagram:

sequenceDiagram
    participant A as Avionics System (Source)
    participant B as Formatter (ARINC 818)
    participant C as ARINC 818 Interface Link
    participant D as AR HUD Processor (Sink)
    participant E as AR HUD Display

    A->>B: Camera Feed (Real-World)
    A->>B: 3D Graphics/Depth Data (Synthetic)
    A->>B: Flight Data/Warnings
    B->>C: Multiplexed Stereoscopic AR Data (Video Stream)
    B->>C: Auxiliary ARINC Data (Signaling, Calibration, Symbology)
    C->>D: Received ARINC 818 Stream
    D->>E: Rendered Stereoscopic AR Overlay

4. Integration with Emerging Tech

Derivative 4.1: AI-Driven Optimization of Stereoscopic Multiplexing with Real-time IoT Feedback

Enabling Description: The formatter integrates with an AI module that dynamically optimizes the stereoscopic multiplexing scheme based on real-time feedback from IoT sensors. These sensors, strategically placed around the display environment (e.g., eye-tracking cameras, ambient light sensors, user biometric sensors for fatigue detection), provide input to the AI. The AI evaluates factors like viewer position, ambient lighting, display capabilities, and viewer comfort/engagement. Based on this, it instructs the formatter to adapt the stereoscopic data encoding (e.g., switching between full L/R, 2D+depth with varying depth resolution, or even adjusting color depth for specific visual areas). The signaling information sent in the auxiliary data elements then explicitly communicates these AI-determined, dynamically optimized multiplexing parameters (e.g., variable bit allocation, adaptive frame packing schemes) to the sink device, ensuring optimal 3D experience with minimal bandwidth waste.

Mermaid.js Diagram:

graph TD
    A[Stereoscopic Image Data] --> B{Formatter};
    C[IoT Sensors (Eye-tracking, Ambient Light)] --> D(AI Optimization Module);
    D --> B;
    B -- Dynamically Optimized Multiplexed Data --> E[Digital Display Interface Tx];
    B -- Adaptive Signaling (Auxiliary Data) --> E;
    E --> F[Digital Display Interface Rx];
    F --> G{Sink Processor};
    F --> H[Auxiliary Signaling Decoder];
    H --> G;
    G --> I[Stereoscopic Display];
    G --> J[IoT Feedback Loop to AI];

Derivative 4.2: Blockchain-Verified Content Integrity for Stereoscopic Data in Secure Environments

Enabling Description: For applications requiring high-assurance content integrity (e.g., military simulation, secure medical imaging, digital forensics), the stereoscopic image data and its associated metadata (including the multiplexing scheme) are cryptographically hashed and linked to a blockchain. The formatter calculates a hash of each frame or field of the multiplexed stereoscopic data and includes this hash, along with a timestamp and a digital signature, in the auxiliary data elements. The auxiliary data elements are structured as "blockchain transaction packets." The sink device, upon reception, verifies the integrity of the stereoscopic data by re-calculating the hash and comparing it against the blockchain-verified hash received in the auxiliary data. This ensures that both the 2D/stereoscopic content and the signaling information (mode, multiplexing scheme) have not been tampered with during transmission over the digital display interface.

Mermaid.js Diagram:

sequenceDiagram
    participant A as Source AV Device (Formatter)
    participant B as Hash/Signer Module
    participant C as Blockchain Network
    participant D as Digital Display Interface
    participant E as Sink AV Device (Processor)

    A->>B: Multiplexed Stereoscopic Data
    B->>C: Submit Data Hash/Signature
    C-->>B: Transaction Confirmation (Blockchain Reference)
    B->>A: Append Blockchain Reference to Auxiliary Data
    A->>D: Stream Data + Auxiliary (with Blockchain Ref)
    D->>E: Received Stream
    E->>C: Verify Data Hash/Signature against Blockchain
    C-->>E: Verification Result
    E->>E: Display or Reject (based on verification)

Derivative 4.3: Real-time Adaptive Stereoscopic Streaming with Edge AI Processing

Enabling Description: This derivative focuses on optimizing stereoscopic content delivery in environments with varying network conditions or display capabilities. Edge AI nodes are integrated into both the source and sink AV devices. The source-side formatter, guided by an edge AI module, dynamically adjusts the stereoscopic multiplexing strategy (e.g., frame packing, resolution reduction for one eye, 2D+depth vs. full L/R) based on real-time network bandwidth, CPU/GPU load on the sink, and predicted user interaction. The auxiliary data elements carry not only the mode signaling but also AI-generated "hinting" information (e.g., predicted frame drops, recommended decoding complexity, quality-of-service metrics). The sink-side processor, also equipped with an edge AI, uses this signaling and hinting information to adapt its demultiplexing and rendering, potentially applying super-resolution or depth-estimation AI models locally to reconstruct a higher quality 3D image from a lower-bandwidth multiplexed stream.

Mermaid.js Diagram:

graph LR
    A[Stereoscopic Content Store] --> B{Source Edge AI};
    B --> C[Formatter (Adaptive Multiplexing)];
    C -- Multiplexed Data (Variable Quality) --> D[Digital Display Interface];
    C -- Signaling + AI Hints (Auxiliary) --> D;
    D --> E[Sink Edge AI];
    E --> F{Processor (Adaptive Demultiplexing/Rendering)};
    F --> G[Stereoscopic Display];
    E -- Feedback (Network/Display Status) --> B;

5. The "Inverse" or Failure Mode

Derivative 5.1: Fail-Safe 2D Fallback with Limited Depth Visualization

Enabling Description: In the event of a detected error or degradation in the stereoscopic transmission (e.g., high bit error rate, loss of synchronization, sink device overheating), the formatter automatically switches from the second (stereoscopic) mode to a fail-safe first (2D) mode. The auxiliary data elements, in this failure scenario, are immediately updated to signal the 2D mode, but also include a "limited functionality" depth visualization mode. Instead of full 3D, the depth information is conveyed as a grayscale overlay or contour lines on the 2D image, allowing the sink device to render a degraded but still informative output. This allows critical depth perception (e.g., for industrial inspection, medical diagnosis) to persist even when full stereoscopic rendering is impossible, preventing complete loss of crucial information.

Mermaid.js Diagram:

stateDiagram-v2
    [*] --> Normal_Stereo_Mode
    Normal_Stereo_Mode --> Formatter_Multiplexes_3D
    Formatter_Multiplexes_3D --> Transmit_Stereo_Data_Aux_Signaling
    Transmit_Stereo_Data_Aux_Signaling --> Check_Link_Integrity
    Check_Link_Integrity --> Normal_Stereo_Mode: Link OK
    Check_Link_Integrity --> Error_Detected: Link Degraded/Failed
    Error_Detected --> Fail_Safe_2D_Fallback
    Fail_Safe_2D_Fallback --> Formatter_Generates_2D_with_Depth_Overlay
    Formatter_Generates_2D_with_Depth_Overlay --> Transmit_2D_Data_Limited_Depth_Signaling
    Transmit_2D_Data_Limited_Depth_Signaling --> Operational_Degraded_Mode
    Operational_Degraded_Mode --> Check_Link_Integrity_Retry: Periodically check for recovery
    Check_Link_Integrity_Retry --> Normal_Stereo_Mode: Link Recovered
    Check_Link_Integrity_Retry --> Operational_Degraded_Mode: Still Degraded

Derivative 5.2: Low-Power, Limited-Functionality Stereoscopic Mode for Battery-Operated Devices

Enabling Description: For battery-powered first audio-visual devices (e.g., portable media players, VR/AR headsets), the formatter includes a low-power stereoscopic mode. In this mode, the stereoscopic multiplexing sacrifices resolution, color depth, or frame rate to minimize power consumption. For instance, it might switch from full 48-bit color per pixel to 24-bit color, or interleave left/right frames at half the normal frame rate, or transmit only a monochrome depth map alongside a full-color 2D image. The auxiliary data elements explicitly signal this "eco-mode" or "low-power stereoscopic mode" along with the reduced parameters, instructing the sink device to adjust its demultiplexing and rendering accordingly to conserve energy, prolonging battery life.

Mermaid.js Diagram:

flowchart LR
    A[Battery-Powered AV Source] --> B{Power Management Unit};
    B --> C{Formatter};
    C -- Full Power Mode --> D[High-Res Stereo Data];
    C -- Low Power Mode --> E[Reduced-Res Stereo Data];
    D --> F[Interface Tx (Full Power)];
    E --> F[Interface Tx (Low Power)];
    C -- Signaling (Power Mode, Params) --> F;
    F --> G[Interface Rx];
    G --> H{Sink Processor};
    H --> I[Stereoscopic Display];

Derivative 5.3: Diagnostic Mode for Interface Health Monitoring in Stereoscopic Transmission

Enabling Description: This variation introduces a diagnostic or "health monitoring" mode. When activated (e.g., by a user, automatically during idle periods, or upon detecting performance issues), the formatter generates a predefined test pattern for stereoscopic image data (e.g., alternating checkerboards for L/R, or a grayscale depth ramp for 2D+D). Crucially, the auxiliary data elements are flooded with detailed diagnostic information: bit error rates per TMDS channel, synchronization status, detected signal reflections, voltage levels, and temperature readings of the interface components. This allows the sink device to perform comprehensive self-diagnosis of the entire stereoscopic transmission path, identifying exact points of failure or degradation and facilitating proactive maintenance or troubleshooting without interrupting normal content delivery.

Mermaid.js Diagram:

graph TD
    A[Stereoscopic Image Data Source] --> B{Formatter};
    C[Diagnostic Control] --> B;
    B -- Normal Mode --> D[Multiplexed Stereoscopic Stream];
    B -- Diagnostic Mode (Test Patterns) --> D;
    B -- Normal Signaling --> E[Auxiliary Data Elements];
    B -- Diagnostic Data (BER, Sync, Temp) --> E;
    D --> F[Digital Display Interface];
    E --> F;
    F --> G[Sink Processor];
    G --> H[Diagnostic Reporter];
    G --> I[Stereoscopic Display (if in normal mode)];
    H --> J[Maintenance/User Interface];

Combination Prior Art Scenarios with Open-Source Standards

US9843786 + DisplayPort Alternate Mode over USB-C (VESA Alternate Mode for USB Type-C)
- Description: The inventions of US9843786, specifically the multiplexing of stereoscopic image components into data elements and the use of auxiliary data for signaling, are applied to the DisplayPort Alternate Mode over USB-C. In this scenario, the formatter within the first AV device (e.g., a laptop or smartphone) multiplexes stereoscopic content (e.g., L/R or 2D+depth) into the DisplayPort video stream carried over the USB-C cable. The auxiliary data elements, instead of HDMI Data Island Packets, would be implemented within DisplayPort's Main Link Auxiliary Channel (AUX CH) using VESA-defined DisplayPort Sideband Message (DP_SBM) structures or custom vendor-specific messages. These AUX CH messages would signal the specific stereoscopic format, multiplexing scheme, and decoding parameters to the second AV device (e.g., a monitor or VR headset) receiving the DisplayPort stream over USB-C. This combines the patent's core concept with a widely adopted open standard for flexible display connectivity.
US9843786 + AVB/TSN (Audio Video Bridging/Time-Sensitive Networking) for Professional AV
- Description: The principles of US9843786 are integrated into a professional Audio/Video (AV) distribution system utilizing IEEE 802.1 AVB/TSN standards over Ethernet. The formatter, acting as an AVB talker, would multiplex stereoscopic image data (e.g., SMPTE 2110-like uncompressed video essences for L/R or 2D+depth) into AVB/TSN packets, which are then transmitted over a managed Ethernet network. The auxiliary data elements, carrying the stereoscopic mode identification and decoding instructions, are encapsulated within IEEE 1722.1 (AVDECC) messages or other AVB control messages. These messages are transmitted with guaranteed latency and bandwidth provided by TSN mechanisms, ensuring synchronized and high-fidelity delivery of stereoscopic content across a professional AV network. This extends the patent's utility beyond point-to-point display interfaces to networked AV applications.
US9843786 + OpenXR for VR/AR Headsets (Khronos Group Open Standard)
- Description: The invention is applied to the rendering and transmission pipeline for virtual reality (VR) and augmented reality (AR) headsets compatible with the OpenXR standard. The formatter, located in a host PC or standalone VR device, takes stereoscopic image data (left-eye and right-eye renders, potentially with depth buffers) generated by an OpenXR application. This data is then multiplexed according to US9843786's principles into a high-bandwidth internal display interface (e.g., eDP or MIPI DSI variants adapted for VR displays). The auxiliary data elements, structured according to OpenXR's compositor layers or custom extensions for display signaling, carry information about the specific stereoscopic projection (e.g., equirectangular, cubemap), interpupillary distance (IPD) corrections, distortion parameters, and lens compensation metadata, in addition to the base multiplexing scheme. This enables standardized, efficient transport of rendered stereoscopic frames to the headset's display panels.