US 9843786

US patent 9843786, titled "Transport of stereoscopic image data over a display interface," was originally assigned to Koninklijke Philips NV and is currently assigned to General Video LLC. The patent's sole inventor is Nicoll Burleigh Shepherd. The application was filed on September 6, 2016, and the patent was issued on December 12, 2017.

Abstract:
The patent describes a digital display interface (40) that connects a first audio-visual device (10) to a second audio-visual device (20) for transmitting stereoscopic image data. Components of the stereoscopic image data are multiplexed and inserted into existing image data-carrying elements, potentially reusing deep color modes. Signaling information, essential for identifying or decoding the stereoscopic image data, is carried in auxiliary data elements. The stereoscopic image data can be distributed between image data-carrying elements and auxiliary data-carrying elements. These auxiliary data elements can be transmitted during horizontal or vertical blanking periods, specifically as HDMI Data Island Packets. Additionally, stereoscopic image data can be transmitted over an auxiliary data channel, which may be part of the primary cable, a separate cable, or a wireless link.

Plain-Language Overview of Independent Claims:

• Claim 1 (Interface Part - Sender Side): This claim describes an interface component within a source audio-visual device. This component can operate in two distinct modes. In a first mode, it formats standard 2D image data. In a second mode, active at different times, it formats multiplexed components of a stereoscopic (3D) image. The interface part transmits signaling information (contained within auxiliary data elements, such as HDMI Data Island Packets) to the receiving device. This signaling information indicates which mode is in use and provides details about the specific multiplexing scheme and stereoscopic image format, enabling the receiving device to correctly decode the 3D content.
• Claim 13 (Interface Part - Receiver Side): This claim describes an interface component within a receiving audio-visual device (e.g., a display). It receives formatted image data and processes it in one of two modes. In a first mode, it extracts pixel data for a 2D image. In a second mode, active at different times, it demultiplexes components of a stereoscopic image. The interface part receives signaling information (also in auxiliary data elements) that specifies the active mode and the multiplexing scheme, allowing the processor to determine the appropriate decoding method for the stereoscopic image format.
• Claim 17 (Method - Sender Side): This claim outlines a method performed by an interface part in a first audio-visual device for formatting image data. The method involves receiving image data and formatting it according to either a first mode (generating 2D image data) or a second mode (generating multiplexed stereoscopic image components). The second mode operates at different times than the first. Crucially, the method includes sending signaling information (within auxiliary data elements) that identifies the current mode and provides details about the multiplexing scheme, guiding the second audio-visual device in decoding the stereoscopic image format.
• Claim 18 (Method - Receiver Side): This claim details a method performed by an interface part in a receiving audio-visual device for processing image data. The method involves receiving formatted image data and extracting it by either a first mode (extracting 2D image data) or a second mode (demultiplexing stereoscopic image components). The second mode operates at different times. The method includes receiving signaling information (in auxiliary data elements) that identifies the mode and contains information about the multiplexing scheme, which is then used to determine the correct decoding scheme for the stereoscopic image format.

Legal Status and Litigation:
US patent 9843786 is currently "Active" and has an anticipated expiration date of December 15, 2028.

According to available information, the patent is involved in several litigation cases:

• Multiple US cases have been filed in the Texas Eastern District Court.
• Multiple US cases have been filed in the Texas Western District Court.
• One US case has been filed in the Delaware District Court.
• A PTAB Inter Partes Review (IPR2025-01037) was filed but listed as "Not Instituted - Procedural" with Intel Corp., Dell, Inc., and Dell Technologies, Inc. as opponents, effective May 23, 2025.
• First worldwide family litigation has also been filed.

No specific dockets for the US Court of Appeals for the Federal Circuit (CAFC) in 2026 were found during the search, although ongoing district court cases could potentially lead to CAFC appeals in the future.US patent 9843786, titled "Transport of stereoscopic image data over a display interface," was originally assigned to Koninklijke Philips NV and is currently assigned to General Video LLC. The patent's sole inventor is Nicoll Burleigh Shepherd. The application was filed on September 6, 2016, and the patent was issued on December 12, 2017.

Abstract:
The patent describes a digital display interface (40) that connects a first audio-visual device (10) to a second audio-visual device (20) for transmitting stereoscopic image data. Components of the stereoscopic image data are multiplexed and inserted into existing image data-carrying elements, potentially reusing deep color modes. Signaling information, essential for identifying or decoding the stereoscopic image data, is carried in auxiliary data elements. The stereoscopic image data can be distributed between image data-carrying elements and auxiliary data-carrying elements. These auxiliary data elements can be transmitted during horizontal or vertical blanking periods, specifically as HDMI Data Island Packets. Additionally, stereoscopic image data can be transmitted over an auxiliary data channel, which may be part of the primary cable, a separate cable, or a wireless link.

Plain-Language Overview of Independent Claims:

• Claim 1 (Interface Part - Sender Side): This claim describes an interface component within a source audio-visual device. This component can operate in two distinct modes. In a first mode, it formats standard 2D image data. In a second mode, active at different times, it formats multiplexed components of a stereoscopic (3D) image. The interface part transmits signaling information (contained within auxiliary data elements, such as HDMI Data Island Packets) to the receiving device. This signaling information indicates which mode is in use and provides details about the specific multiplexing scheme and stereoscopic image format, enabling the receiving device to correctly decode the 3D content.
• Claim 13 (Interface Part - Receiver Side): This claim describes an interface component within a receiving audio-visual device (e.g., a display). It receives formatted image data and processes it in one of two modes. In a first mode, it extracts pixel data for a 2D image. In a second mode, active at different times, it demultiplexes components of a stereoscopic image. The interface part receives signaling information (also in auxiliary data elements) that specifies the active mode and the multiplexing scheme, allowing the processor to determine the appropriate decoding method for the stereoscopic image format.
• Claim 17 (Method - Sender Side): This claim outlines a method performed by an interface part in a first audio-visual device for formatting image data. The method involves receiving image data and formatting it according to either a first mode (generating 2D image data) or a second mode (generating multiplexed stereoscopic image components). The second mode operates at different times than the first. Crucially, the method includes sending signaling information (within auxiliary data elements) that identifies the current mode and provides details about the multiplexing scheme, guiding the second audio-visual device in decoding the stereoscopic image format.
• Claim 18 (Method - Receiver Side): This claim details a method performed by an interface part in a receiving audio-visual device for processing image data. The method involves receiving formatted image data and extracting it by either a first mode (extracting 2D image data) or a second mode (demultiplexing stereoscopic image components). The second mode operates at different times. The method includes receiving signaling information (in auxiliary data elements) that identifies the mode and contains information about the multiplexing scheme, which is then used to determine the correct decoding scheme for the stereoscopic image format.

Legal Status and Litigation:
US patent 9843786 is currently "Active" and has an anticipated expiration date of December 15, 2028.

According to available information, the patent is involved in several litigation cases:

• Multiple US cases have been filed in the Texas Eastern District Court.
• Multiple US cases have been filed in the Texas Western District Court.
• One US case has been filed in the Delaware District Court.
• A PTAB Inter Partes Review (IPR2025-01037) was filed but listed as "Not Instituted - Procedural" with Intel Corp., Dell, Inc., and Dell Technologies, Inc. as opponents, effective May 23, 2025.
• First worldwide family litigation has also been filed.

A review of the US Court of Appeals for the Federal Circuit (CAFC) scheduled cases for April, May, and June 2026 did not reveal any dockets specifically listing US patent 9843786. It is possible that ongoing district court cases related to this patent could lead to CAFC appeals in the future, but no such appeals are currently scheduled for 2026 based on the provided information.

US patent 9843786 has been involved in multiple litigation cases. The current assignee, General Video LLC, is actively asserting this patent.

Here's a summary of the known litigation:

1. Inter Partes Review (PTAB)

• Plaintiff(s) / Petitioner(s): Intel Corp., Dell, Inc., and Dell Technologies, Inc.
• Defendant(s) / Patent Owner(s): General Video LLC
• Jurisdiction: Patent Trial and Appeal Board (PTAB)
• Case Number: IPR2025-01037
• Filing Date: May 23, 2025
• Outcome / Current Status: Not Instituted - Procedural.

2. District Court Cases (Patent Infringement)

General Video LLC has filed multiple infringement lawsuits in the Eastern District of Texas, asserting US9843786 along with other patents related to display technology. These cases generally target products compliant with various DisplayPort standards.

• Plaintiff(s): General Video LLC

  • Defendant(s): Hewlett-Packard (HP)

  • Jurisdiction: Texas Eastern District Court

  • Case Number: 5:24-cv-00123

  • Filing Date: August 30, 2024 (approximate, cases filed in late August 2024)

  • Outcome / Current Status: Concluded via Joint Stipulation and Motion of Voluntary Dismissal Pursuant to Fed. R. Civ. P. 41(a)(1)(A)(ii), with prejudice. Each party agreed to bear its own attorneys' fees and costs. No damages or injunctive relief were awarded. This outcome typically signals a negotiated resolution or settlement.

  • Defendant(s): Acer Inc.

  • Jurisdiction: Texas Eastern District Court

  • Case Number: 5:24-cv-00125

  • Filing Date: August 30, 2024 (approximate, cases filed in late August 2024)

  • Outcome / Current Status: Active (as of current search data, likely ongoing).

  • Defendant(s): ASUSTek

  • Jurisdiction: Texas Eastern District Court

  • Case Number: 5:24-cv-00126

  • Filing Date: August 30, 2024 (approximate, cases filed in late August 2024)

  • Outcome / Current Status: Active (as of current search data, likely ongoing).

  • Defendant(s): Dell

  • Jurisdiction: Texas Eastern District Court

  • Case Number: 5:24-cv-00124

  • Filing Date: August 30, 2024 (approximate, cases filed in late August 2024)

  • Outcome / Current Status: Active (as of current search data, likely ongoing).

  • Defendant(s): Lenovo

  • Jurisdiction: Texas Eastern District Court

  • Case Number: 5:24-cv-00122

  • Filing Date: August 30, 2024 (approximate, cases filed in late August 2024)

  • Outcome / Current Status: Active (as of current search data, likely ongoing).

Additional District Court cases mentioned in the provided patent information, but for which specific defendant details were not explicitly found in the search snippets:

• US case filed in Texas Western District Court

  • Jurisdiction: Texas Western District Court
  • Case Number: 1:24-cv-01530
  • Filing Date: 2024 (year only from patent text)
  • Outcome / Current Status: Active (based on recent filing year).

• US case filed in Texas Western District Court

  • Jurisdiction: Texas Western District Court
  • Case Number: 1:25-cv-02143
  • Filing Date: 2025 (year only from patent text)
  • Outcome / Current Status: Active (based on recent filing year).

• US case filed in Delaware District Court

  • Jurisdiction: Delaware District Court
  • Case Number: 1:25-cv-01065
  • Filing Date: 2025 (year only from patent text)
  • Outcome / Current Status: Active (based on recent filing year).

Please note that for the District Court cases (excluding the HP case, which has a reported outcome), the "Outcome / Current Status" is listed as "Active" as detailed information beyond the case number and jurisdiction was not available in the provided search results to determine exact filing dates or more specific current statuses. The patent text itself lists these cases as having been "filed" in the respective jurisdictions.

Proceedings overview

One AIA trial proceeding has been filed against US patent 9843786, resulting in an institution denial. This leaves all claims of the patent untested by PTAB. For a defendant, this means the patent has not been subjected to IPR scrutiny, and all claims are presumed valid from a PTAB perspective.

IPR2025-01037 — Intel Corp. et al. v. General Video LLC

• Type: Inter Partes Review
• Filed: 2025-05-23
• Status: Discretionary Denial — the petition for IPR was denied institution by the PTAB.
• Judge panel: As of the current date, the specific judge panel for this discretionary denial is not publicly available in the provided information or easily retrievable through general search without access to the full PTAB filings for IPR2025-01037.
• Petition grounds: The detailed petition grounds (claims, art, statutory basis) are not publicly available in the provided information or easily retrievable through general search without access to the full PTAB filings for IPR2025-01037.
• Institution decision: Denied (date not specified in the provided information, but the "last modified" date of 2026-03-10 indicates activity post-filing that could relate to the decision). The reason for the denial was "Procedural", implying the denial was not based on the merits of patentability but on a procedural issue or discretion.
• Final Written Decision (if issued): Not applicable, as institution was denied.
• Settlement / termination: Not applicable, as institution was denied before trial.
• Appeal: No appeal to the Federal Circuit, as institution was denied.
• Defensive value: The petition for IPR2025-01037 was denied institution on procedural grounds, meaning the patent claims themselves were not evaluated for patentability in this proceeding. Therefore, this IPR has no direct impact on the validity of the patent's claims for a defendant. It indicates that the specific arguments and prior art presented in this petition were not advanced to a full trial.

Strategic summary

All claims of US9843786 remain untested by PTAB proceedings. IPR2025-01037 was denied institution on procedural grounds, meaning the merits of the patentability of the claims were not addressed. This implies that no claims have been canceled or sustained by the PTAB in this particular proceeding, and all claims are currently presumed valid.

The estoppel landscape for future petitioners remains largely open. Since IPR2025-01037 was denied institution, the petitioner (Intel Corp. et al.) and its privies are not estopped under 35 U.S.C. § 315(e)(2) from raising any grounds that were raised or reasonably could have been raised in this petition, as no final written decision was issued. This means that a defendant facing assertion of this patent still has a full range of prior-art grounds available for a potential future IPR.

Regarding pattern signals, only one IPR has been filed against US9843786, and it was denied institution. The petitioner, Intel Corp. et al., is a known entity that engages in patent challenges, suggesting a defensive aggregator like Unified Patents might be involved or that the patent has attracted attention from operating companies. The denial on "procedural" grounds suggests a potential technicality in the petition filing rather than a strong affirmation of the patent's validity on the merits.

Recommended next steps

If you are a defendant and are being asserted against with US9843786, the absence of a substantive PTAB review means the patent's claims have not been formally challenged and upheld or invalidated by the Board.

It would be advisable to:

• Investigate the specific reasons for the "Discretionary Denial" in IPR2025-01037, as this could reveal weaknesses in the original petition that might be avoided in a future challenge, or specific procedural hurdles implemented by the PTAB that are worth noting. This information would typically be found in the PTAB's Institution Decision, which can be accessed through the USPTO PTAB E2E system by searching for IPR2025-01037.
• Conduct a thorough prior art search to assess the patentability of the claims independently. Since no claims were tested, a strong prior art defense remains a viable strategy.
• Consider filing your own IPR petition if a robust prior art basis is found, as there are no estoppel issues stemming from IPR2025-01037. Ensure any new petition addresses the procedural issues that led to the prior denial.
• Monitor for any further PTAB activity on US9843786.
• The status "Not Instituted - Procedural" is listed on the Google Patents page as well.

Inventors

• Nicoll Burleigh Shepherd. Employer not explicitly stated in the patent document.

Original assignee

The original assignee named on the issued patent US9843786B2 is Koninklijke Philips NV. Koninklijke Philips NV is a diversified technology company, primarily known for its products in healthcare, consumer lifestyle, and lighting. They are an operating company that has historically shipped products embodying various technologies. As of the current date (2026-05-15), Koninklijke Philips NV is an operating company.

Assignment timeline

• 2024-04-01 (executed) / recorded 2024-07-04 — Reel 067912/0351
  • Conveyance: Assignment
  • Assignor: KONINKLIJKE PHILIPS N.V.
  • Assignee: GENERAL VIDEO, LLC
  • Correspondent: Not specified in the provided patent text.
  • Context: Transfer-to-asserter

If the USPTO Assignment Center has additional records, they would be listed here. Based on the provided patent text, only one assignment post-grant is directly listed.

Timeline diagram

timeline
    title Ownership of US 9843786
    2007 : Priority Date
    2016 : Application filed by Koninklijke Philips NV
    2017 : Granted to Koninklijke Philips NV
    2024 : Assigned to General Video LLC

NPE / troll-pattern signals

1. Shell-entity transfer — present. The patent was transferred from Koninklijke Philips N.V., a large operating company, to General Video, LLC. The "LLC" suffix and the lack of readily apparent product offerings from "General Video, LLC" suggest a licensing-focused entity.

2. Known asserter in the chain — present. General Video LLC has been identified in litigation data as a patent asserter.

3. Repeat correspondent across the chain — unclear. The correspondent for the 2024-07-04 assignment is not specified in the provided patent text.

4. Cascading transfers — not present. Only one assignment is listed in the provided patent text after the patent grant.

5. Pre-litigation transfer — present. The assignment to General Video, LLC was executed on 2024-04-01 and recorded on 2024-07-04. The Google Patents legal events section shows multiple litigation cases filed in late 2024 and early 2025 (e.g., 5:24-cv-00126, 1:24-cv-01530), which is within 6 months of the assignment.

6. Bankruptcy fire-sale — not present. Koninklijke Philips N.V. is an active operating company, and there is no indication of bankruptcy.

7. Privateering — unclear. While the transfer is from an operating company to a likely NPE, the specific details of whether Koninklijke Philips N.V. retains any interest or directs the assertion are not available in the provided patent text.

8. Defensive aggregator (anti-NPE) — not present. The chain ends with General Video, LLC, which is an asserter.

Verdict

NPE — high confidence. The transfer from Koninklijke Philips N.V. to General Video, LLC, combined with the timing of this assignment closely preceding multiple litigation filings against various defendants, are strong indicators of an NPE assertion strategy. General Video, LLC's name and lack of apparent product sales further support its likely role as a licensing or assertion entity.

Verification: https://assignmentcenter.uspto.gov/

Here is an analysis of the most relevant prior art for US Patent 9843786, based on the citations provided within the patent text itself.

US Patent 9843786B2 Details:

• Title: Transport of stereoscopic image data over a display interface
• Publication Number: US9843786B2
• Publication Date: 2017-12-12
• Filing Date: 2016-09-06
• Priority Date: 2007-12-18
• Current Assignee: General Video LLC
• Original Assignee: Koninklijke Philips NV

The following patents are identified as prior art through the "Citations" section of US9843786B2. For each, details regarding full citation, relevant dates, a brief description, and potential anticipation of claims under 35 U.S.C. § 102 are provided. The analysis of potential anticipation is based on the descriptions available in the US9843786B2 text and the titles of the cited references; a definitive assessment would require full access to the cited prior art documents.

---

Prior Art References:

1. US6914637B1

   • Full Citation: US6914637B1 to Silicon Image, Inc., published 2005-07-05.
   • Publication/Filing Date: Priority date: 2001-12-24; Publication date: 2005-07-05.
   • Brief Description: This patent describes a method and system for video and auxiliary data transmission over a serial link. This is directly relevant to the mechanisms described in US9843786B2 for carrying auxiliary data alongside image data.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 13, 17, 18: These claims relate to sending and receiving signaling information in auxiliary data elements within a data stream. US6914637B1's focus on transmitting "video and auxiliary data over a serial link" suggests it may anticipate the general concept of using auxiliary data for transmission, potentially including signaling. The specific application to stereoscopic data and the multiplexing schemes of US9843786B2 would need closer examination against the full text of US6914637B1.

2. WO2006137006A2

   • Full Citation: WO2006137006A2 to Koninklijke Philips Electronics N.V., published 2006-12-28.
   • Publication/Filing Date: Priority date: 2005-06-23; Publication date: 2006-12-28.
   • Brief Description: This reference, from the same original assignee as US9843786B2, describes the "Transmission of 3d image using 2d image and depth data". The background of US9843786B2 specifically mentions the "WOWvx format developed by Koninklijke Philips Electronics N.V." which divides an overall display frame into sub-frames for 2D image data and depth information, and adds a header for identification.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 10, 11, 13, 17, 18: This patent directly addresses the transmission of 3D image data using 2D image and depth data, a format explicitly covered by US9843786B2's second mode (claim 10). The concept of using a portion of data elements for 2D image data and another for depth data (claim 11) is also likely anticipated. The signaling for such a format (as described in claims 1, 13, 17, 18) could also be anticipated if this prior art includes such identification mechanisms.

3. WO2007069195A2

   • Full Citation: WO2007069195A2 to Koninklijke Philips Electronics N.V., published 2007-06-21.
   • Publication/Filing Date: Priority date: 2005-12-13; Publication date: 2007-06-21.
   • Brief Description: This patent describes an "Autostereoscopic display device". The background section of US9843786B2 references this specific patent application as an example of an auto stereoscopic display technique using a flat panel display with multisided slanted ventricular lenses.
   • Potential Anticipation (35 U.S.C. § 102):
     • While this reference primarily focuses on the display device itself rather than the transport method, it establishes the context and need for stereoscopic content delivery, especially for autostereoscopic displays. It doesn't directly anticipate the claims of US9843786B2 regarding data formatting and signaling over a display interface, but it defines the problem space and the target technology for which US9843786B2 provides a solution.

4. US20060279750A1

   • Full Citation: US20060279750A1 to [[Samsung Electronics Co.](/litigations/by-defendant/Samsung%20Electronics%20Co.), Ltd.](/litigations/by-plaintiff/Samsung%20Electronics%20Co.%2C%20Ltd.), published 2006-12-14.
   • Publication/Filing Date: Priority date: 2005-06-14; Publication date: 2006-12-14.
   • Brief Description: This application describes an "Apparatus and method for converting image display mode". This could potentially involve converting between 2D and 3D modes or different 3D formats.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 13, 17, 18: If the "image display mode" conversion includes handling of stereoscopic data formats and signaling for such conversions, it might anticipate aspects of US9843786B2's dual-mode formatter and receiver, especially the signaling for identifying the mode. More detailed comparison against the full text of US20060279750A1 would be needed.

5. US20070296859A1

   • Full Citation: US20070296859A1 to Sony Corporation, published 2007-12-27.
   • Publication/Filing Date: Priority date: 2006-05-16; Publication date: 2007-12-27.
   • Brief Description: This patent application is titled "Communication method, communication system, transmission method, transmission apparatus, receiving method and receiving apparatus". This broad title suggests it could cover various aspects of multimedia communication, potentially including stereoscopic image data.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 13, 17, 18: Given its broad scope in communication methods and systems, this reference could potentially touch upon methods of transmitting different types of image data and associated signaling. Without more specific details, it is hard to pinpoint exact anticipatory elements, but the general concept of handling different data types in a communication system might be present.

6. US20060044388A1

   • Full Citation: US20060044388A1 to Sung-Sik Kim, published 2006-03-02.
   • Publication/Filing Date: Priority date: 2004-08-26; Publication date: 2006-03-02.
   • Brief Description: This application describes a "Method of generating stereoscopic image signal and method of scaling the same". This deals with the creation and manipulation of stereoscopic image signals.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 6, 10, 17: While focused on generating and scaling, this could potentially involve how stereoscopic signals (L+R or 2D+depth) are structured before transmission, which might relate to the "components of a stereoscopic image" in US9843786B2's claims. It doesn't directly address the transport over a digital display interface with specific signaling as prominently as other citations, but it lays groundwork for stereoscopic image data handling.

7. US20060192776A1

   • Full Citation: US20060192776A1 to Toshio Nomura, published 2006-08-31.
   • Publication/Filing Date: Priority date: 2003-04-17; Publication date: 2006-08-31.
   • Brief Description: This patent application describes a "3-Dimensional image creation device, 3-dimensional image reproduction device, 3-dimensional image processing device, 3-dimensional image processing program, and recording medium containing the program".
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 13, 17, 18, 19, 20, 21, 22: The broad scope covering creation, reproduction, and processing of 3D images, including programs and recording media, indicates a comprehensive approach to 3D image handling. This could potentially anticipate the functional aspects of formatting and processing stereoscopic image data (Claims 1, 13, 17, 18) and the computer-readable medium/control structures (Claims 19-22), depending on how "processing" and "reproduction" are described in detail in the full document.

Other cited references (JPH0530538A, US20020009137A1, JP2003111101A, US20050146521A1, JP2006295289A, US20070139769A1, JP2007325101A, JP2008117289A) have titles indicating general image recording/reproducing, 3D video broadcasting, or communication systems. While they contribute to the general state of the art, their titles do not suggest direct anticipation of the specific methods for multiplexing stereoscopic image components into existing high-bandwidth display interface modes (like deep color) and carrying signaling in auxiliary data elements, as explicitly claimed in US9843786B2. A thorough analysis would still require reviewing their full texts.

Under 35 U.S.C. § 103, a patent claim is considered obvious if the differences between the claimed invention and the prior art are such that the subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary skill in the art (PHOSITA). The motivation to combine prior art references is a key aspect of an obviousness analysis.

US Patent 9843786B2 describes methods and apparatuses for transporting stereoscopic image data over a digital display interface, such as HDMI. The core claims revolve around a formatter operating in different modes (2D or multiplexed stereoscopic), transmitting signaling information identifying the mode and multiplexing scheme, and carrying this signaling information in auxiliary data elements (e.g., HDMI Data Island Packets).

The patent itself outlines relevant prior art in its Background and Definitions sections:

• Existing Stereoscopic Display Techniques: The patent describes various known schemes for displaying 3D images, including those that simultaneously display left and right eye images (e.g., using polarization or colors) and those that sequentially present left and right eye images (e.g., using shuttered glasses) [cite: "One well-known scheme simultaneously displays two images which are encoded for the left eye and right eye by means of different optical polarizations, or colors (e.g. red and green).", "Another stereoscopic display technique sequentially presents an image intended for the left eye, and an image intended for the right eye."]. It also mentions autostereoscopic displays [cite: "Auto stereoscopic display techniques remove the need for a viewer to wear special glasses."].
• The WOWvx Format (by Koninklijke Philips Electronics N.V.): This format is described as dividing an overall display frame into sub-frames, with one sub-frame carrying 2D image data and another carrying depth information. A header is added to identify this format. A display extracts depth data to create a 3D image, which is then stretched. A significant characteristic of this method, as noted by the patent, is that it "tended to sacrifice part of the active portion of an image to carry additional data necessary to render a stereoscopic image" [cite: "The WOWvx format developed by Koninklijke Philips Electronics N.V. divides the overall display frame into a number of separate regions where different data can be carried.", "The overall frame is divided into two sub-frames, arranged side-by-side: a first of the sub-frames carries 2D image data and a second of the sub-frames carries depth information. A header is added to the beginning of the upper left-hand corner of the frame."].
• HDMI Interface and Deep Color Modes: Digital display interfaces like HDMI are acknowledged. Critically, the patent notes that "Improvements to HDMI from version 1.3 have allowed HDMI to carry more bits per pixel, with the options of carrying 10, 12 and 16 bits per color per pixel, i.e. up to 48-bit color. HDMI describes Deep Color Pixel Packing modes (HDMI 1.3a, section 6.5.3) which allow the higher color depths just described" [cite: "Improvements to HDMI from version 1.3 have allowed HDMI to carry more bits per pixel, with the options of carrying 10, 12 and 16 bits per color per pixel, i.e. up to 48-bit color. HDMI describes Deep Color Pixel Packing modes (HDMI 1.3a, section 6.5.3) which allow the higher color depths just described."].
• HDMI Data Island Packets: The patent explicitly defines that "Data Island Packets are carried within these periods [horizontal or vertical blanking periods], and certain Data Island Packets can be identified as carrying depth data" [cite: "Data Island Packets are carried within these periods, and certain Data Island Packets can be identified as carrying depth data."]. It also states that "In HDMI, Data Island Packets are sent in horizontal and vertical line blanking periods. The signaling information can conveniently be carried within a Data Island Packet" [cite: "In HDMI, Data Island Packets are sent in horizontal and vertical line blanking periods. The signaling information can conveniently be carried within a Data Island Packet."].

Obviousness Analysis based on Claim 1:

Claim 1 describes an interface part with a formatter operable in a first mode (2D image data) and a second mode (multiplexed stereoscopic image components). It further specifies sending signaling information (identifying the mode and multiplexing scheme) carried in auxiliary data elements that are generated at intervals in the data stream.

Combination of Prior Art References:

A PHOSITA would find the core concepts of Claim 1 obvious by combining the following known elements:

1. The general knowledge of transmitting stereoscopic image data: The patent's background describes several methods (e.g., left/right eye data, 2D + depth data, as exemplified by WOWvx) [cite: "The two main methods for transferring 3D image data across an interface are: to transmit two complete, separate, stereoscopic images representing the left and right views as seen by human eyes; and a normal 2D image with associated depth information that can be used to generate the stereoscopic images within the display."].
2. The availability and capabilities of HDMI Deep Color Pixel Packing modes (HDMI 1.3a, section 6.5.3): These modes provide increased bandwidth (e.g., 48-bit color) [cite: "Improvements to HDMI from version 1.3 have allowed HDMI to carry more bits per pixel, with the options of carrying 10, 12 and 16 bits per color per pixel, i.e. up to 48-bit color. HDMI describes Deep Color Pixel Packing modes (HDMI 1.3a, section 6.5.3) which allow the higher color depths just described."].
3. The known use of HDMI Data Island Packets for carrying auxiliary data and signaling information in blanking periods: This includes conveying depth data and general control information [cite: "Data Island Packets are carried within these periods, and certain Data Island Packets can be identified as carrying depth data.", "In HDMI, Data Island Packets are sent in horizontal and vertical line blanking periods. The signaling information can conveniently be carried within a Data Island Packet."].

Motivation for Combination:

A PHOSITA facing the challenge of delivering stereoscopic images in a consumer electronics environment (as identified by the patent [cite: "an issue with delivering stereoscopic images in a consumer electronics environment is that conventional displays, and display interfaces which connect displays or projectors to media players, have been designed specifically for the display of conventional 2D images."]) would be motivated to combine these known elements for the following reasons:

• Overcoming Limitations of Existing Methods: The WOWvx format, while providing 3D, "sacrifice[s] part of the active portion of an image to carry additional data" [cite: "Schemes for conveying stereoscopic image data within the confines of existing display interfaces have tended to sacrifice part of the active portion of an image to carry additional data necessary to render a stereoscopic image."]. A PHOSITA would be motivated to find a way to transmit stereoscopic data without this drawback.
• Utilizing Available, Underutilized Bandwidth: The HDMI 1.3+ Deep Color modes provide significantly increased bandwidth that, while intended for higher color depth 2D images, represent "higher capacity transport modes" [cite: "the higher capacity transport modes which are intended to transport higher color depth data can be re-used to carry the multiplexed stereoscopic image data."]. It would be obvious to a PHOSITA to re-purpose this available capacity to carry multiplexed stereoscopic image data (e.g., left/right eye data or 2D+depth data, as conceptually shown in FIGS. 4 and 5 of the patent) to achieve a "good color depth for the stereoscopic content" [cite: "Therefore, no additional capacity is required from the interface to carry the stereoscopic data, while still allowing good color depth for the stereoscopic content."]. This allows stereoscopic content "with a resolution which is significantly higher than schemes which sacrifice part of the active image area to carry the stereo image data" [cite: "It also allows stereoscopic image content to be sent with a resolution which is significantly higher than schemes which sacrifice part of the active image area to carry the stereo image data."].
• Ensuring Interoperability and Proper Decoding: Since the digital display interface would need to support both conventional 2D content and new stereoscopic content, a mechanism for the source device to inform the display device of the current mode (2D or stereo) and the specific multiplexing scheme used for stereoscopic data is essential for proper decoding and rendering. The WOWvx format already used a "header" for this purpose [cite: "A header is added to the beginning of the upper left-hand corner of the frame."]. HDMI Data Island Packets are a known and "convenient" vehicle for carrying such "signaling information" in blanking periods without interfering with active video data [cite: "In HDMI, Data Island Packets are sent in horizontal and vertical line blanking periods. The signaling information can conveniently be carried within a Data Island Packet."]. This provides a straightforward way to communicate the necessary decoding parameters to the receiving device, akin to how EDID communicates sink capabilities [cite: "In HDMI, the capability of a sink device can use the Display Data Channel (DDC) channel, with capability data being stored in an Extended Display Identification Data (EDID) ROM at a sink."].

Therefore, a PHOSITA would have been motivated to combine these known elements—leveraging the unused capacity of HDMI Deep Color modes for multiplexed stereoscopic data and using HDMI Data Island Packets for the necessary mode and decoding signaling—to address the problem of efficient stereoscopic image transmission over existing digital display interfaces without sacrificing active image area.

US patent 9843786, titled "Transport of stereoscopic image data over a display interface," was granted on December 12, 2017, from an application filed on September 6, 2016. The patent claims priority to an earlier application filed on December 18, 2007.

Patent Term Adjustments (PTA) and Patent Term Extensions (PTE)

Specific Patent Term Adjustment (PTA) or Patent Term Extension (PTE) amounts for US patent 9843786 were not directly retrievable from the conducted searches of the USPTO database. The USPTO does not calculate expiration dates for patents but provides resources like a downloadable patent term calculator to assist in estimation, which requires specific patent information.

Generally, PTA is granted to utility or plant patents to compensate for certain administrative delays by the USPTO during prosecution, such as failing to issue a first Office Action within 14 months of filing, failing to respond to an applicant's reply within four months, or failing to issue the patent within four months of the issue fee payment. PTA can be reduced by periods of applicant-caused delays.

PTE, under 35 U.S.C. § 156, is available for patents on certain human drugs, food or color additives, medical devices, animal drugs, and veterinary biological products to restore patent term lost during premarket government approval processes. Given the technical nature of US9843786 (stereoscopic image data transport), it is unlikely to be eligible for PTE, as these are typically related to regulatory approval for products like pharmaceuticals.

Continuation and Divisional Applications

The patent text indicates that US9843786 is part of a larger patent family, showing a clear continuity chain:

• Parent Application: US15/256,839 (the direct application for US9843786).
• Earlier Applications/Family Members: US9843786 claims priority to US15/256,839, which itself claims priority to US14/629,642 (now U.S. Pat. No. 9,462,258), and US12/808,685 (now U.S. Pat. No. 9,036,010). These demonstrate a lineage through continuation applications. The earliest priority date for this family is December 18, 2007.

Related Family Members

The patent explicitly lists the following related applications and patents in its priority and related applications sections:

• US15/256,839 (application leading to US9843786)
• US14/629,642 (resulted in US Pat. No. 9,462,258)
• US12/808,685 (resulted in US Pat. No. 9,036,010)
• PCT/IB2008/055305 (international application)
• EP07123461.1 (foreign priority application)

Projected Expiration Date

The standard term for a U.S. utility patent (other than a design patent) issued from an application filed on or after June 8, 1995, is 20 years from the date on which the earliest application for which a benefit is claimed was filed. In the case of US9843786, the earliest priority date is December 18, 2007.

Therefore, without any PTA, the patent term would extend 20 years from December 18, 2007. This would result in an unadjusted expiration date of December 18, 2027.

However, the Google Patents page for US9843786 lists an "Anticipated expiration" date of December 15, 2028. This anticipated expiration date, being later than the unadjusted 20-year term from the earliest priority date, suggests that the patent likely received approximately one year of Patent Term Adjustment (PTA). This difference typically accounts for delays in prosecution by the USPTO. While the exact PTA calculation is not available, the Google Patents information serves as an indicator of the adjusted term.

Defensive Disclosure Document: Enhancements and Diversifications of US Patent 9843786

This defensive disclosure document outlines a series of derivative variations and extensions of the technologies described in US Patent 9843786, "Transport of stereoscopic image data over a display interface." The goal is to establish prior art for future incremental improvements by competitors, focusing on the core inventive concepts of multiplexing stereoscopic image data within a digital display interface and using auxiliary data channels for signaling and additional data. The derivations explore material and component substitution, operational parameter expansion, cross-domain applications, integration with emerging technologies, and inverse/failure modes.

The core claim being expanded upon is Claim 1, which describes an interface part for a first audio-visual device capable of formatting and transmitting both 2D and multiplexed stereoscopic image data over an uncompressed pixel information interface, utilizing auxiliary data elements for signaling information related to the stereoscopic multiplexing scheme.

---

Derivative Variations for US9843786 (based on Claim 1)

1. Material & Component Substitution

Derivative 1.1: Fiber Optic Transport Layer with Custom ASIC for Multiplexing

• Enabling Description: This variation replaces the traditional copper-based HDMI (TMDS) transmission lines with a multi-mode or single-mode fiber optic transport layer, such as active optical cables (AOCs) conforming to the SFP+ or QSFP standards adapted for display interfaces. The formatter and de-formatter functions, including the multiplexing/demultiplexing of stereoscopic image data into higher bit-depth data elements and the generation/extraction of auxiliary signaling, are implemented within a dedicated Application-Specific Integrated Circuit (ASIC). This ASIC would handle the electro-optical conversion, protocol encapsulation (e.g., converting HDMI TMDS streams to a packetized fiber optic protocol), and the specific logic for interleaving left/right eye data or 2D/depth data within the higher bandwidth fiber channel. The auxiliary data elements for signaling, instead of HDMI Data Island Packets, would be encapsulated in dedicated control packets within the fiber optic protocol, or within reserved fields in the video data packets, ensuring robust transmission and identification of stereoscopic modes.
• Mermaid.js Diagram:

  flowchart LR
      A[Image Data Input] --> B{ASIC Formatter};
      B -- 2D Mode --> C[Packetizer for Fiber Optic];
      B -- Stereo Mode (Multiplex) --> C;
      C --> D[Electro-Optical Converter];
      D --> E[Fiber Optic Cable];
      E --> F[Electro-Optical Converter];
      F --> G[De-packetizer];
      G -- Demultiplex --> H[Stereoscopic Image Output];
      B -- Signaling to Auxiliary Data --> I[Control Packet Generator];
      I --> D;
      F --> J[Control Packet Extractor];
      J --> H;
  

Derivative 1.2: Liquid Crystal Polymer (LCP) Coaxial Cables with FPGA-based Formatter

• Enabling Description: The transmission interface utilizes miniature, high-frequency LCP-insulated coaxial cables (e.g., micro-coaxial or twin-coaxial) known for superior signal integrity and reduced crosstalk at very high data rates compared to conventional copper wiring, especially for differential signaling. The formatter logic is implemented on a Field-Programmable Gate Array (FPGA), allowing for flexible and reconfigurable multiplexing schemes. The FPGA can dynamically adjust the bit-allocation for 2D/depth or left/right eye components within the high-bandwidth data elements, and reconfigure the auxiliary data structure (e.g., packet size, header information) on the fly based on display device capabilities or content requirements. The auxiliary signaling can be embedded using a custom low-voltage differential signaling (LVDS) side channel within the LCP cable assembly, separate from the primary video data lines, or time-multiplexed within the video blanking intervals using custom packet structures.
• Mermaid.js Diagram:

  graph TD
      A[Image Data Input] --> B(FPGA Formatter);
      B -- Configures --> C{Multiplexing Logic (L/R or 2D+D)};
      B -- Generates --> D[Auxiliary Signaling Packets];
      C --> E[LCP Coaxial Cable Driver];
      D --> F[LVDS Side Channel Driver];
      E --> G[LCP Coaxial Cable Link];
      F --> G;
      G --> H[LCP Coaxial Cable Receiver];
      H --> I[LVDS Side Channel Receiver];
      H --> J{De-multiplexing Logic (FPGA)};
      I --> J;
      J --> K[Stereoscopic Image Output];
  

Derivative 1.3: Gallium Nitride (GaN) Power Stage for High-Frequency Modulators in Wireless Display Interface

• Enabling Description: This variation applies to a wireless digital display interface (e.g., WirelessHD, WiGig, 802.11ay) operating in the millimeter-wave (mmWave) spectrum for uncompressed pixel transmission. The formatter's output is fed into a high-frequency modulator, where the power amplification stages utilize Gallium Nitride (GaN) transistors. GaN offers significantly higher power efficiency and linearity at mmWave frequencies compared to traditional silicon-based components, enabling robust transmission of high-bandwidth multiplexed stereoscopic data over greater distances or with reduced power consumption. The auxiliary data, including mode identification and multiplexing schemes, is embedded in a separate sub-carrier modulation scheme (e.g., OFDM subcarriers) within the mmWave link, ensuring independent and reliable delivery of control information.
• Mermaid.js Diagram:

  sequenceDiagram
      participant A as Source AV Device (Formatter)
      participant B as GaN Modulator/Amplifier
      participant C as Wireless mmWave Link
      participant D as Receiver (Demodulator/Processor)
      participant E as Sink AV Device
  
      A->>B: Multiplexed Stereoscopic Data
      A->>B: Auxiliary Signaling (Control)
      B->>C: Modulated mmWave Signal (High Power)
      C->>D: Received mmWave Signal
      D->>E: Decoded Stereoscopic Data
      D->>E: Decoded Auxiliary Signaling
  

2. Operational Parameter Expansion

Derivative 2.1: Ultra-High-Resolution (8K/16K) Stereoscopic Data Transport at Terahertz Frequencies

• Enabling Description: The interface is designed to transport stereoscopic image data at resolutions beyond current standards, such as 8K (7680x4320) or 16K (15360x8640) per eye, requiring massive bandwidth. This is achieved using a terahertz (THz) frequency wireless interface (e.g., using T-rays for short-range, line-of-sight communication). The formatter multiplexes the components (e.g., 2D+depth for 16K at 120Hz frame rate, or dual 8K left/right images) into THz pulses. Auxiliary data elements are embedded as modulation patterns within the leading edge of each THz pulse or within specific frequency sub-bands, containing metadata for resolution, frame rate, 3D format, and compression parameters. The THz system would utilize advanced multiplexing techniques like orbital angular momentum (OAM) multiplexing or spatial multiplexing with multiple THz beams to carry the dense stereoscopic information.
• Mermaid.js Diagram:

  graph LR
      A[8K/16K Left/Right Images] --> B{THz Formatter};
      B -- Multiplexes --> C[THz Pulse Generator];
      B -- Generates --> D[Auxiliary THz Modulator];
      C --> E[THz Emitter];
      D --> E;
      E --> F(THz Wireless Link);
      F --> G[THz Detector];
      G --> H[THz Demodulator];
      H --> I[THz De-multiplexer];
      I --> J[8K/16K Stereoscopic Output];
  

Derivative 2.2: Extreme Temperature Operation for Industrial Stereoscopic Vision Systems

• Enabling Description: This variation adapts the digital display interface for use in harsh industrial environments, such as furnaces, cryogenic chambers, or outer space applications. The interface parts (formatter, processor) are constructed with radiation-hardened components (e.g., silicon-on-insulator CMOS, wide-bandgap semiconductors like SiC) and designed to operate reliably from -200°C to +300°C. The display interface itself employs robust cabling (e.g., mineral-insulated cables, high-temperature fiber optics) or specialized wireless links (e.g., high-frequency radio in vacuum). Signaling information for the stereoscopic mode and decoding scheme is made redundant and transmitted with error correction codes in auxiliary data packets, which are also temperature-compensated, ensuring robust communication under extreme thermal cycling and radiation exposure.
• Mermaid.js Diagram:

  stateDiagram-v2
      [*] --> Initializing
      Initializing --> Operational_2D: 2D Mode Selected
      Initializing --> Operational_Stereo: Stereo Mode Selected
      Operational_2D --> Processing_2D
      Operational_Stereo --> Processing_Stereo
      Processing_2D --> Transmitting_2D: Stream First Data Elements
      Processing_Stereo --> Transmitting_Stereo: Stream Second Data Elements (Multiplexed)
      Transmitting_2D --> Transmitting_Aux_Signaling: Send 2D Mode Info (Auxiliary)
      Transmitting_Stereo --> Transmitting_Aux_Signaling: Send Stereo Mode Info (Auxiliary)
      Transmitting_Aux_Signaling --> Stable_Operation_Extreme_Temp: Data Link Active
      Stable_Operation_Extreme_Temp --> Error_Detection: Fault or Degradation
      Error_Detection --> Recovery_Routine: Initiate Error Correction
      Recovery_Routine --> Stable_Operation_Extreme_Temp: If Recovered
      Recovery_Routine --> Fail_Safe_Mode: If Unrecoverable
      Fail_Safe_Mode --> [*]
  

Derivative 2.3: High-Pressure Submersible Stereoscopic Inspection Interface

• Enabling Description: This system is for deep-sea or subterranean applications, requiring the digital display interface to withstand extreme hydrostatic pressures (e.g., >100 MPa). The interface utilizes pressure-compensated optical fiber links with specialized connectors and pressure-resistant housings for the AV devices. The data elements and auxiliary signaling are transmitted using frequency-shift keying (FSK) over an acoustically coupled underwater communication channel as a secondary, redundant auxiliary link, alongside the primary optical fiber. The primary optical link handles the high-bandwidth uncompressed stereoscopic image data, while the FSK acoustic channel carries robust, low-bandwidth signaling for mode identification, depth calibration, and emergency override commands, including explicit instructions for stereoscopic demultiplexing in case of primary link degradation.
• Mermaid.js Diagram:

  graph TD
      A[Stereoscopic Camera Input (Submersible)] --> B{Pressure-Hardened Formatter};
      B -- Primary Image Data (Multiplexed) --> C[Optical Fiber Transmitter];
      B -- Auxiliary Signaling --> D[Acoustic FSK Modulator];
      C --> E[Optical Fiber Link (Primary)];
      D --> F[Acoustic Transducer (Secondary)];
      E --> G[Optical Fiber Receiver];
      F --> H[Acoustic Hydrophone];
      G --> I{Pressure-Hardened Processor};
      H --> J[Acoustic FSK Demodulator];
      J --> I;
      I --> K[Stereoscopic Display Output (Surface/Control)];
  

3. Cross-Domain Application

Derivative 3.1: Medical Robotics for Minimally Invasive Surgery (MIS)

• Enabling Description: In MIS, a surgeon operates using a remote robotic system guided by a stereoscopic view from an endoscope. This derivative applies the patent's core concept by using a specialized medical-grade digital display interface (e.g., a variant of SMPTE 2022 or a custom proprietary medical interface) to transmit uncompressed stereoscopic video from the endoscopic camera to the surgical console. The formatter in the endoscope controller multiplexes left/right eye feeds, or a 2D view with depth map data, into a high-bandwidth stream. Auxiliary data elements, embedded as DICOM header extensions or within blanking intervals, carry critical signaling: the current stereoscopic mode (e.g., 3D anaglyph, active shutter, 2D+depth), instrument tracking data (e.g., position, orientation of robotic tools), and patient physiological telemetry, enabling the surgical console to accurately render the 3D surgical field and overlay contextual information.
• Mermaid.js Diagram:

  flowchart LR
      A[Endoscopic L/R Cameras] --> B{Medical Formatter};
      B -- Multiplexes Stereoscopic Video --> C[Medical Display Interface Tx];
      B -- Integrates Instrument Tracking/Telemetry --> D[Auxiliary Data Encoder (DICOM)];
      D --> C;
      C --> E[Medical-Grade Cable/Fiber];
      E --> F[Medical Display Interface Rx];
      F --> G[Auxiliary Data Decoder];
      F --> H{Surgical Console Processor};
      G --> H;
      H --> I[Stereoscopic Surgical Display];
  

Derivative 3.2: Autonomous Agricultural Vehicle Guidance Systems

• Enabling Description: Autonomous agricultural vehicles (e.g., tractors, harvesters) use stereoscopic vision for obstacle detection, crop analysis, and precision navigation. This derivative integrates the display interface for real-time stereoscopic data feedback to a human operator or for internal machine vision processing. The formatter on the agricultural vehicle's sensor array (comprising multiple stereo cameras) multiplexes images (e.g., visible light stereo, IR stereo, or 2D visible + LiDAR depth data) into data elements suitable for transmission over a ruggedized industrial Ethernet (e.g., EtherCAT over shielded fiber). The auxiliary data elements, conforming to an ISOBUS-like data packet structure or a custom agricultural standard, carry crucial signaling: sensor fusion parameters, vehicle kinematics, GPS/RTK location, and the specific stereoscopic rendering mode for on-board displays or remote monitoring stations.
• Mermaid.js Diagram:

  graph LR
      A[Stereo Camera Array (Visible/IR)] --> B{Agricultural Formatter};
      C[LiDAR Sensor] --> B;
      B -- Multiplexes Image/Depth --> D[Ethernet Encapsulator];
      B -- Encodes Kinematics/GPS/Sensor Fusion --> E[ISOBUS Auxiliary Data Packetizer];
      D --> F[Ruggedized Ethernet Tx];
      E --> F;
      F --> G[Industrial Ethernet Link];
      G --> H[Ruggedized Ethernet Rx];
      H --> I[ISOBUS Auxiliary Data Decoder];
      H --> J{Machine Vision/Display Processor};
      I --> J;
      J --> K[Operator HMI / Autonomy Module];
  

Derivative 3.3: Augmented Reality (AR) HUD for Aerospace Cockpits

• Enabling Description: In an aerospace cockpit, pilots use head-up displays (HUDs) for critical flight information. This derivative extends the concept to an AR HUD providing stereoscopic contextual data (e.g., 3D terrain maps, target designations, flight path vectors projected onto the real world). The formatter within the avionics system multiplexes real-time camera feeds (for AR overlay registration) with synthetically generated 3D graphics elements and depth information into a specialized avionics bus (e.g., ARINC 818 or a high-speed MIL-STD-1553 derivative for video). Auxiliary data elements, complying with ARINC standards or proprietary aerospace data structures, carry signaling for: AR calibration data, symbology projection parameters, 3D object metadata, sensor data fusion status, and flight-critical warnings, ensuring accurate and timely stereoscopic presentation in the pilot's field of view.
• Mermaid.js Diagram:

  sequenceDiagram
      participant A as Avionics System (Source)
      participant B as Formatter (ARINC 818)
      participant C as ARINC 818 Interface Link
      participant D as AR HUD Processor (Sink)
      participant E as AR HUD Display
  
      A->>B: Camera Feed (Real-World)
      A->>B: 3D Graphics/Depth Data (Synthetic)
      A->>B: Flight Data/Warnings
      B->>C: Multiplexed Stereoscopic AR Data (Video Stream)
      B->>C: Auxiliary ARINC Data (Signaling, Calibration, Symbology)
      C->>D: Received ARINC 818 Stream
      D->>E: Rendered Stereoscopic AR Overlay
  

4. Integration with Emerging Tech

Derivative 4.1: AI-Driven Optimization of Stereoscopic Multiplexing with Real-time IoT Feedback

• Enabling Description: The formatter integrates with an AI module that dynamically optimizes the stereoscopic multiplexing scheme based on real-time feedback from IoT sensors. These sensors, strategically placed around the display environment (e.g., eye-tracking cameras, ambient light sensors, user biometric sensors for fatigue detection), provide input to the AI. The AI evaluates factors like viewer position, ambient lighting, display capabilities, and viewer comfort/engagement. Based on this, it instructs the formatter to adapt the stereoscopic data encoding (e.g., switching between full L/R, 2D+depth with varying depth resolution, or even adjusting color depth for specific visual areas). The signaling information sent in the auxiliary data elements then explicitly communicates these AI-determined, dynamically optimized multiplexing parameters (e.g., variable bit allocation, adaptive frame packing schemes) to the sink device, ensuring optimal 3D experience with minimal bandwidth waste.
• Mermaid.js Diagram:

  graph TD
      A[Stereoscopic Image Data] --> B{Formatter};
      C[IoT Sensors (Eye-tracking, Ambient Light)] --> D(AI Optimization Module);
      D --> B;
      B -- Dynamically Optimized Multiplexed Data --> E[Digital Display Interface Tx];
      B -- Adaptive Signaling (Auxiliary Data) --> E;
      E --> F[Digital Display Interface Rx];
      F --> G{Sink Processor};
      F --> H[Auxiliary Signaling Decoder];
      H --> G;
      G --> I[Stereoscopic Display];
      G --> J[IoT Feedback Loop to AI];
  

Derivative 4.2: Blockchain-Verified Content Integrity for Stereoscopic Data in Secure Environments

• Enabling Description: For applications requiring high-assurance content integrity (e.g., military simulation, secure medical imaging, digital forensics), the stereoscopic image data and its associated metadata (including the multiplexing scheme) are cryptographically hashed and linked to a blockchain. The formatter calculates a hash of each frame or field of the multiplexed stereoscopic data and includes this hash, along with a timestamp and a digital signature, in the auxiliary data elements. The auxiliary data elements are structured as "blockchain transaction packets." The sink device, upon reception, verifies the integrity of the stereoscopic data by re-calculating the hash and comparing it against the blockchain-verified hash received in the auxiliary data. This ensures that both the 2D/stereoscopic content and the signaling information (mode, multiplexing scheme) have not been tampered with during transmission over the digital display interface.
• Mermaid.js Diagram:

  sequenceDiagram
      participant A as Source AV Device (Formatter)
      participant B as Hash/Signer Module
      participant C as Blockchain Network
      participant D as Digital Display Interface
      participant E as Sink AV Device (Processor)
  
      A->>B: Multiplexed Stereoscopic Data
      B->>C: Submit Data Hash/Signature
      C-->>B: Transaction Confirmation (Blockchain Reference)
      B->>A: Append Blockchain Reference to Auxiliary Data
      A->>D: Stream Data + Auxiliary (with Blockchain Ref)
      D->>E: Received Stream
      E->>C: Verify Data Hash/Signature against Blockchain
      C-->>E: Verification Result
      E->>E: Display or Reject (based on verification)
  

Derivative 4.3: Real-time Adaptive Stereoscopic Streaming with Edge AI Processing

• Enabling Description: This derivative focuses on optimizing stereoscopic content delivery in environments with varying network conditions or display capabilities. Edge AI nodes are integrated into both the source and sink AV devices. The source-side formatter, guided by an edge AI module, dynamically adjusts the stereoscopic multiplexing strategy (e.g., frame packing, resolution reduction for one eye, 2D+depth vs. full L/R) based on real-time network bandwidth, CPU/GPU load on the sink, and predicted user interaction. The auxiliary data elements carry not only the mode signaling but also AI-generated "hinting" information (e.g., predicted frame drops, recommended decoding complexity, quality-of-service metrics). The sink-side processor, also equipped with an edge AI, uses this signaling and hinting information to adapt its demultiplexing and rendering, potentially applying super-resolution or depth-estimation AI models locally to reconstruct a higher quality 3D image from a lower-bandwidth multiplexed stream.
• Mermaid.js Diagram:

  graph LR
      A[Stereoscopic Content Store] --> B{Source Edge AI};
      B --> C[Formatter (Adaptive Multiplexing)];
      C -- Multiplexed Data (Variable Quality) --> D[Digital Display Interface];
      C -- Signaling + AI Hints (Auxiliary) --> D;
      D --> E[Sink Edge AI];
      E --> F{Processor (Adaptive Demultiplexing/Rendering)};
      F --> G[Stereoscopic Display];
      E -- Feedback (Network/Display Status) --> B;
  

5. The "Inverse" or Failure Mode

Derivative 5.1: Fail-Safe 2D Fallback with Limited Depth Visualization

• Enabling Description: In the event of a detected error or degradation in the stereoscopic transmission (e.g., high bit error rate, loss of synchronization, sink device overheating), the formatter automatically switches from the second (stereoscopic) mode to a fail-safe first (2D) mode. The auxiliary data elements, in this failure scenario, are immediately updated to signal the 2D mode, but also include a "limited functionality" depth visualization mode. Instead of full 3D, the depth information is conveyed as a grayscale overlay or contour lines on the 2D image, allowing the sink device to render a degraded but still informative output. This allows critical depth perception (e.g., for industrial inspection, medical diagnosis) to persist even when full stereoscopic rendering is impossible, preventing complete loss of crucial information.
• Mermaid.js Diagram:

  stateDiagram-v2
      [*] --> Normal_Stereo_Mode
      Normal_Stereo_Mode --> Formatter_Multiplexes_3D
      Formatter_Multiplexes_3D --> Transmit_Stereo_Data_Aux_Signaling
      Transmit_Stereo_Data_Aux_Signaling --> Check_Link_Integrity
      Check_Link_Integrity --> Normal_Stereo_Mode: Link OK
      Check_Link_Integrity --> Error_Detected: Link Degraded/Failed
      Error_Detected --> Fail_Safe_2D_Fallback
      Fail_Safe_2D_Fallback --> Formatter_Generates_2D_with_Depth_Overlay
      Formatter_Generates_2D_with_Depth_Overlay --> Transmit_2D_Data_Limited_Depth_Signaling
      Transmit_2D_Data_Limited_Depth_Signaling --> Operational_Degraded_Mode
      Operational_Degraded_Mode --> Check_Link_Integrity_Retry: Periodically check for recovery
      Check_Link_Integrity_Retry --> Normal_Stereo_Mode: Link Recovered
      Check_Link_Integrity_Retry --> Operational_Degraded_Mode: Still Degraded
  

Derivative 5.2: Low-Power, Limited-Functionality Stereoscopic Mode for Battery-Operated Devices

• Enabling Description: For battery-powered first audio-visual devices (e.g., portable media players, VR/AR headsets), the formatter includes a low-power stereoscopic mode. In this mode, the stereoscopic multiplexing sacrifices resolution, color depth, or frame rate to minimize power consumption. For instance, it might switch from full 48-bit color per pixel to 24-bit color, or interleave left/right frames at half the normal frame rate, or transmit only a monochrome depth map alongside a full-color 2D image. The auxiliary data elements explicitly signal this "eco-mode" or "low-power stereoscopic mode" along with the reduced parameters, instructing the sink device to adjust its demultiplexing and rendering accordingly to conserve energy, prolonging battery life.
• Mermaid.js Diagram:

  flowchart LR
      A[Battery-Powered AV Source] --> B{Power Management Unit};
      B --> C{Formatter};
      C -- Full Power Mode --> D[High-Res Stereo Data];
      C -- Low Power Mode --> E[Reduced-Res Stereo Data];
      D --> F[Interface Tx (Full Power)];
      E --> F[Interface Tx (Low Power)];
      C -- Signaling (Power Mode, Params) --> F;
      F --> G[Interface Rx];
      G --> H{Sink Processor};
      H --> I[Stereoscopic Display];
  

Derivative 5.3: Diagnostic Mode for Interface Health Monitoring in Stereoscopic Transmission

• Enabling Description: This variation introduces a diagnostic or "health monitoring" mode. When activated (e.g., by a user, automatically during idle periods, or upon detecting performance issues), the formatter generates a predefined test pattern for stereoscopic image data (e.g., alternating checkerboards for L/R, or a grayscale depth ramp for 2D+D). Crucially, the auxiliary data elements are flooded with detailed diagnostic information: bit error rates per TMDS channel, synchronization status, detected signal reflections, voltage levels, and temperature readings of the interface components. This allows the sink device to perform comprehensive self-diagnosis of the entire stereoscopic transmission path, identifying exact points of failure or degradation and facilitating proactive maintenance or troubleshooting without interrupting normal content delivery.
• Mermaid.js Diagram:

  graph TD
      A[Stereoscopic Image Data Source] --> B{Formatter};
      C[Diagnostic Control] --> B;
      B -- Normal Mode --> D[Multiplexed Stereoscopic Stream];
      B -- Diagnostic Mode (Test Patterns) --> D;
      B -- Normal Signaling --> E[Auxiliary Data Elements];
      B -- Diagnostic Data (BER, Sync, Temp) --> E;
      D --> F[Digital Display Interface];
      E --> F;
      F --> G[Sink Processor];
      G --> H[Diagnostic Reporter];
      G --> I[Stereoscopic Display (if in normal mode)];
      H --> J[Maintenance/User Interface];
  

---

Combination Prior Art Scenarios with Open-Source Standards

1. US9843786 + DisplayPort Alternate Mode over USB-C (VESA Alternate Mode for USB Type-C)

   • Description: The inventions of US9843786, specifically the multiplexing of stereoscopic image components into data elements and the use of auxiliary data for signaling, are applied to the DisplayPort Alternate Mode over USB-C. In this scenario, the formatter within the first AV device (e.g., a laptop or smartphone) multiplexes stereoscopic content (e.g., L/R or 2D+depth) into the DisplayPort video stream carried over the USB-C cable. The auxiliary data elements, instead of HDMI Data Island Packets, would be implemented within DisplayPort's Main Link Auxiliary Channel (AUX CH) using VESA-defined DisplayPort Sideband Message (DP_SBM) structures or custom vendor-specific messages. These AUX CH messages would signal the specific stereoscopic format, multiplexing scheme, and decoding parameters to the second AV device (e.g., a monitor or VR headset) receiving the DisplayPort stream over USB-C. This combines the patent's core concept with a widely adopted open standard for flexible display connectivity.

2. US9843786 + AVB/TSN (Audio Video Bridging/Time-Sensitive Networking) for Professional AV

   • Description: The principles of US9843786 are integrated into a professional Audio/Video (AV) distribution system utilizing IEEE 802.1 AVB/TSN standards over Ethernet. The formatter, acting as an AVB talker, would multiplex stereoscopic image data (e.g., SMPTE 2110-like uncompressed video essences for L/R or 2D+depth) into AVB/TSN packets, which are then transmitted over a managed Ethernet network. The auxiliary data elements, carrying the stereoscopic mode identification and decoding instructions, are encapsulated within IEEE 1722.1 (AVDECC) messages or other AVB control messages. These messages are transmitted with guaranteed latency and bandwidth provided by TSN mechanisms, ensuring synchronized and high-fidelity delivery of stereoscopic content across a professional AV network. This extends the patent's utility beyond point-to-point display interfaces to networked AV applications.

3. US9843786 + OpenXR for VR/AR Headsets (Khronos Group Open Standard)

   • Description: The invention is applied to the rendering and transmission pipeline for virtual reality (VR) and augmented reality (AR) headsets compatible with the OpenXR standard. The formatter, located in a host PC or standalone VR device, takes stereoscopic image data (left-eye and right-eye renders, potentially with depth buffers) generated by an OpenXR application. This data is then multiplexed according to US9843786's principles into a high-bandwidth internal display interface (e.g., eDP or MIPI DSI variants adapted for VR displays). The auxiliary data elements, structured according to OpenXR's compositor layers or custom extensions for display signaling, carry information about the specific stereoscopic projection (e.g., equirectangular, cubemap), interpupillary distance (IPD) corrections, distortion parameters, and lens compensation metadata, in addition to the base multiplexing scheme. This enables standardized, efficient transport of rendered stereoscopic frames to the headset's display panels.