US 9036010

US Patent 9036010, titled "Transport of stereoscopic image data over a display interface," was granted to Nicoll Burleigh Shepherd as the inventor. The original assignee was Koninklijke Philips NV, with the current assignee being General Video LLC, as of a July 4, 2024, assignment. The patent was filed on December 15, 2008, and issued on May 19, 2015.

Abstract:
The patent describes a digital display interface (DDI) connecting a source audio-visual device to a display device. It details a method for transmitting stereoscopic image data over this DDI by multiplexing components of the stereoscopic image data into existing image data carrying elements, specifically leveraging higher-capacity deep color modes. Signaling information, crucial for identifying and decoding the stereoscopic image data, is carried in auxiliary data elements, such as HDMI Data Island Packets transmitted during horizontal or vertical blanking periods. The stereoscopic image data can also be distributed between primary image data channels and auxiliary data channels, which may be part of the same cable, a separate cable, or a wireless link.

Independent Claims Overview:

• Independent Claim 1 (Digital display interface part for a source device): This claim describes a digital display interface component within a first audio-visual device (e.g., a media player) that prepares data for transmission to a second audio-visual device (e.g., a display). The interface has a defined capacity for uncompressed video. The component's formatter can operate in two modes, based on information received from the receiving device:

  1. A mode for generating a stream of standard 2D image data elements, using no more than the interface's known capacity.
  2. A mode for generating a stream of data elements containing multiplexed stereoscopic (3D) image components. These 3D components are divided into two parts, each using less than the interface's full capacity, with their combined data capacity also not exceeding the total known capacity.
     The interface part also sends signaling information to the receiving device to indicate which mode is active and to describe the characteristics of the stereoscopic data.

• Independent Claim 12 (Digital display interface part for a sink device): This claim describes a digital display interface component within an audio-visual device (e.g., a display) that receives formatted image data. The interface has a known capacity for uncompressed video. The component's processor extracts image data and operates in two modes, based on its own capabilities:

  1. A mode for extracting 2D pixel image data from a stream of first data elements, at a data capacity no greater than the known capacity.
  2. A mode for demultiplexing stereoscopic (3D) image components from a stream of second data elements. These 3D components were transmitted in two portions, each with a lesser data capacity than the known maximum, but with a combined capacity no greater than the known maximum.
     The interface part also receives signaling information that identifies the active mode (2D or 3D) and details the characteristics of the stereoscopic data stream.

• Independent Claim 16 (Method of formatting image data at a source device): This claim outlines a method performed by a processor in a first audio-visual device's digital interface to prepare image data for transmission. The interface has a known capacity for uncompressed video. The method involves:

  • Receiving image data.
  • Formatting the data according to the capabilities of the second audio-visual device (communicated via signaling). This formatting includes:
    • In a first mode, generating a stream of 2D image data elements, using a data capacity no greater than the known maximum.
    • In a second mode, generating a stream of second data elements that include a multiplexed combination of stereoscopic (3D) image components. These components are transmitted in two portions, each using less than the known capacity, with their combined capacity not exceeding the known maximum.
      Characteristics of the stereoscopic data stream are provided in separate signaling information.

• Independent Claim 18 (Method of processing image data at a sink device): This claim describes a method performed by a processor in an audio-visual device's digital interface to process received image data. The interface has a known capacity for uncompressed video. The method involves:

  • Receiving signaling information and formatted image data.
  • Extracting image data based on the audio-visual device's capabilities, by:
    • In a first mode, extracting 2D pixel image data from a stream of first data elements at a data capacity no greater than the known maximum.
    • In a second mode, demultiplexing stereoscopic (3D) image components from a stream of second data elements. These 3D components were transmitted in two portions, each with a lesser data capacity than the known maximum, but with a combined capacity not exceeding the known maximum.
      The characteristics of the stereoscopic data stream are provided in the received signaling information.

Legal Status and Dockets:
US Patent 9036010 is currently active and is projected to expire on February 13, 2030. The patent family has been involved in litigation, including cases filed in the Texas Eastern District Court (e.g., 5:24-cv-00126, 5:24-cv-00122, 5:24-cv-00125, 5:24-cv-00123, 5:24-cv-00124), the Texas Western District Court (e.g., 1:24-cv-01530, 1:25-cv-02143), and the Delaware District Court (e.g., 1:25-cv-01065). Additionally, a PTAB (Patent Trial and Appeal Board) case, IPR2025-01036, was filed on July 15, 2025 (Not Instituted - Procedural). A request for reexamination was filed on February 3, 2026, with an effective date of November 18, 2025. While a general search for CAFC 2026 dockets for this patent did not yield specific results in the snippets, the patent record itself provides direct information on ongoing legal challenges.

Known litigation involving US patent 9036010, as of April 26, 2026, is detailed below. The patent is currently assigned to General Video LLC.

Patent Trial and Appeal Board (PTAB) Cases

• Case Number: IPR2025-01036

  • Plaintiff(s) (Petitioner): Intel Corp., Dell, Inc., and Dell Technologies, Inc.
  • Defendant(s) (Patent Owner): General Video LLC (as the current assignee).
  • Jurisdiction: Patent Trial and Appeal Board (PTAB)
  • Filing Date: The IPR trial proceeding was filed on 2025-07-15, with an effective date of 2025-05-23.
  • Outcome/Current Status: Not Instituted - Procedural.

• Reexamination Request:

  • Case Number: Not explicitly provided for the reexamination request itself, but it's a separate legal event.
  • Filing Date: A request for reexamination was filed on 2026-02-03, with an effective date of 2025-11-18.
  • Outcome/Current Status: Request for reexamination filed.

District Court Cases

The following US District Court cases have been identified:

1. Jurisdiction: Texas Eastern District Court

   • Case Number: 5:24-cv-00126
   • Filing Date: No specific filing date is provided within the patent document; however, the case number indicates a 2024 filing.
   • Plaintiff(s): General Video LLC (as the current assignee).
   • Defendant(s): Not explicitly stated within the patent document.
   • Outcome/Current Status: Listed as "Critical" within the Google Patents litigation summary.

2. Jurisdiction: Texas Western District Court

   • Case Number: 1:24-cv-01530
   • Filing Date: No specific filing date is provided within the patent document; however, the case number indicates a 2024 filing.
   • Plaintiff(s): General Video LLC.
   • Defendant(s): Not explicitly stated within the patent document.
   • Outcome/Current Status: Active.

3. Jurisdiction: Texas Western District Court

   • Case Number: 1:25-cv-02143
   • Filing Date: No specific filing date is provided within the patent document; however, the case number indicates a 2025 filing.
   • Plaintiff(s): General Video LLC.
   • Defendant(s): Not explicitly stated within the patent document.
   • Outcome/Current Status: Active.

4. Jurisdiction: Texas Eastern District Court

   • Case Number: 5:24-cv-00122
   • Filing Date: No specific filing date is provided within the patent document; however, the case number indicates a 2024 filing.
   • Plaintiff(s): General Video LLC.
   • Defendant(s): Not explicitly stated within the patent document.
   • Outcome/Current Status: Active.

5. Jurisdiction: Texas Eastern District Court

   • Case Number: 5:24-cv-00125
   • Filing Date: No specific filing date is provided within the patent document; however, the case number indicates a 2024 filing.
   • Plaintiff(s): General Video LLC.
   • Defendant(s): Not explicitly stated within the patent document.
   • Outcome/Current Status: Active.

6. Jurisdiction: Delaware District Court

   • Case Number: 1:25-cv-01065
   • Filing Date: No specific filing date is provided within the patent document; however, the case number indicates a 2025 filing.
   • Plaintiff(s): General Video LLC.
   • Defendant(s): Not explicitly stated within the patent document.
   • Outcome/Current Status: Active.

7. Jurisdiction: Texas Eastern District Court

   • Case Number: 5:24-cv-00123
   • Filing Date: No specific filing date is provided within the patent document; however, the case number indicates a 2024 filing.
   • Plaintiff(s): General Video LLC.
   • Defendant(s): Not explicitly stated within the patent document.
   • Outcome/Current Status: Active.

8. Jurisdiction: Texas Eastern District Court

   • Case Number: 5:24-cv-00124
   • Filing Date: No specific filing date is provided within the patent document; however, the case number indicates a 2024 filing.
   • Plaintiff(s): General Video LLC.
   • Defendant(s): Not explicitly stated within the patent document.
   • Outcome/Current Status: Active.

Proceedings overview

There is one AIA trial proceeding on file for US patent 9036010. This proceeding resulted in a discretionary denial of institution, meaning no claims were invalidated or sustained. For a defendant, this indicates the patent claims remain untested by an IPR challenging the prior art grounds raised by Intel Corp. et al.

IPR2025-01036 — Intel Corp. et al. v. General Video LLC

• Type: Inter Partes Review
• Filed: 2025-05-23
• Status: Discretionary Denial. This means the PTAB declined to institute the IPR trial, so no claims were advanced to a full merits review.
• Judge panel: Information not publicly available at this time.
• Petition grounds: Specific claims challenged, prior art, and statutory bases (§ 102 / § 103 / § 112) are typically detailed in the petition. However, the exact grounds are not publicly available without access to the full PTAB filings.
• Institution decision: Denied. The institution decision was issued on 2026-03-10, with the status indicating a "Discretionary Denial". The reasoning for a discretionary denial often relates to factors such as parallel district court litigation, joinder issues, or concerns about efficient administration of justice (e.g., Fintiv factors), rather than the merits of the obviousness/anticipation arguments.
• Final Written Decision (if issued): Not issued, as institution was denied.
• Settlement / termination: The proceeding was terminated via discretionary denial, not by settlement.
• Appeal: Not applicable, as no Final Written Decision was issued.
• Defensive value: This proceeding indicates that Intel Corp. et al. attempted to challenge the patent but the PTAB declined to institute the trial. The patent owner, General Video LLC, successfully fended off this IPR attempt. An IPR-based defense for similar grounds might face increased scrutiny or demonstrate that the patent owner is prepared to argue against institution on procedural or discretionary grounds.

Strategic summary

As of today, all claims of US patent 9036010 remain UNTESTED in an AIA trial proceeding. The single IPR filed, IPR2025-01036, resulted in a discretionary denial of institution, meaning the PTAB did not reach the merits of the patentability challenge. Therefore, no claims have been canceled or formally sustained through an IPR Final Written Decision.

Regarding the estoppel landscape, since IPR2025-01036 was denied institution on discretionary grounds, the full scope of § 315(e)(2) estoppel may not apply in the same way as an instituted IPR that proceeds to a Final Written Decision. While the petitioner (Intel Corp. et al.) and their privies might be estopped from raising the exact grounds presented in their petition in future district court or PTAB proceedings, the discretionary nature of the denial means there was no final determination on the patentability of the claims themselves. This could mean that other prior-art grounds, or even the same prior art presented differently, might still be available to other potential petitioners or defendants who are not in privity with Intel Corp. et al.

The pattern signal here is that the patent owner, General Video LLC, was successful in preventing institution of the IPR. This suggests an active defense strategy, potentially leveraging discretionary denial arguments. The patent has recently been reassigned to General Video LLC (2024-07-04), which is often a signal of increased assertion activity.

Recommended next steps

• Review the public record for IPR2025-01036 on the USPTO PTAB E2E system to understand the specific discretionary reasons for the denial. The institution decision, issued on 2026-03-10, will contain the panel's full reasoning. This could reveal weaknesses in the petitioner's strategy or highlight specific arguments that were persuasive to the PTAB.
• If facing assertion by General Video LLC, carefully analyze the claims being asserted and conduct a robust prior art search. Given the discretionary denial, an IPR may still be a viable defensive strategy for a new defendant, particularly if different prior art or arguments are used, or if the Fintiv factors (if applicable) have changed since the earlier denial.
• Monitor the litigation landscape for US9036010. The patent has multiple district court cases filed, primarily in the Eastern and Western Districts of Texas, and in Delaware. These parallel litigations may have influenced the discretionary denial of IPR2025-01036, and their outcomes could impact future defensive strategies.

Citations

https://portal.unifiedpatents.com/ptab/case/IPR2025-01036
https://www.finnegan.com/en/insights/ptab-insights/recent-ptab-discretionary-denials.html
https://portal.unifiedpatents.com/litigation/Texas%20Eastern%20District%20Court/case/5%3A24-cv-00126
https://portal.unifiedpatents.com/litigation/Texas%20Western%20District%20Court/case/1%3A24-cv-01530
https://portal.unifiedpatents.com/litigation/Texas%20Western%20District%20Court/case/1%3A25-cv-02143
https://portal.unifiedpatents.com/litigation/Texas%20Eastern%20District%20Court/case/5%3A24-cv-00122
https://portal.unifiedpatents.com/litigation/Texas%20Eastern%20District%20Court/case/5%3A24-cv-00125
https://patents.darts-ip.com/?family=40473426&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US9036010(B2)
https://portal.unifiedpatents.com/litigation/Delaware%20District%20Court/case/1%3A25-cv-01065
https://portal.unifiedpatents.com/litigation/Texas%20Eastern%20District%20Court/case/5%3A24-cv-00123
https://portal.unifiedpatents.com/litigation/Texas%20Eastern%20District%20Court/case/5%3A24-cv-00124

I'll reconstruct the assignment record. Let me gather the authoritative sources.

Key record found. Let me dig into the correspondent and the General Video LLC pattern.

Critical finding: General Video LLC's disclosed parent. Let me verify the correspondent of record and the IdeaHub link.

I hit the tool-step limit before I could pull the correspondent of record from the Assignment Center page itself. Below is everything I could ground, with the one gap flagged explicitly rather than guessed.

---

Assignment Record Reconstruction — US 9,036,010

Patents/identifiers treated literally. The patent number analyzed is US 9,036,010 B2, application 12/808,685, filed 2008-12-15, priority EP07123461 (2007-12-18), issued 2015-05-19, adjusted expiration 2030-02-13.

Inventors

• Only one inventor is named on the face of the patent.
• Employer attribution is inferred, not evidenced on the record: the only assignment executed by Shepherd (reel 024548/0639, executed 2008-12-16) runs to Koninklijke Philips Electronics N.V., which is the classic employee-invention-assignment posture. The recorded assignment's assignor-employment relationship is not stated verbatim in the sources I could reach.
• No unusual inventor-departure pattern is determinable. The "all inventors left within 12 months of filing → portfolio fire-sale" signal requires a multi-inventor roster and employment records; with a single inventor who assigned one day after the PCT filing date, there is no basis to find it. The 16-year gap between the inventor assignment (2008) and the Philips→General Video sale (2024) actively cuts against a fire-sale narrative.

Original assignee

Koninklijke Philips Electronics N.V. (now Koninklijke Philips N.V.), Eindhoven, Netherlands.

• Issued-patent assignee: Yes — Google Patents lists the original assignee as Koninklijke Philips NV.
• Primary line of business: Dutch multinational; at the 2007–2008 priority window, a broad consumer-electronics and lighting conglomerate with an active 3D display / autostereoscopic research program (the patent itself cites Philips' own WO07/069,195 A2 and the WOWvx format as background). Today Koninklijke Philips N.V. is an operating health-technology company.
• Did they ship a product embodying the claims? Not established. Philips did commercialize 3D displays under the WOWvx banner, but WOWvx is described in this very patent's background as the prior approach — a side-by-side 2D+depth sub-frame format that "sacrifices part of the active image area." The patent's claims are directed at multiplexing stereo components into deep-color (HDMI 1.3a) pixel packing with Data Island Packet signaling. I found no evidence Philips ever shipped an HDMI deep-color stereo-transport product practicing the claims, and Philips wound down its 3D display activities around 2009. Treat "product embodying the claims" as unconfirmed.
• Current status: Operating. No bankruptcy, no Chapter 7/11, no dissolution. Philips is a going concern.

Assignment timeline

Two recorded assignments appear in the U.S. record for this patent. Both are corroborated by Google Patents legal events.

---

2008-12-16 (executed) / recorded 2010-06-17 — Reel 024548/0639

• Conveyance: Assignment
• Assignor: Nicoll Burleigh Shepherd (individual)
• Assignee: Koninklijke Philips Electronics N.V. (NETHERLANDS)
• Correspondent: ⚠️ Not retrieved. I could not pull the recorded correspondent for this reel/frame from the sources available to me. See the verification note below — do not fill this in from inference.
• Context: Routine inventor→employer assignment of the invention disclosed in PCT/IB2008/055305 (WO2009077969A2), executed one day after the international filing date and recorded roughly 18 months later. Not a monetization event.

---

2024-04-01 (executed) / recorded 2024-07-04 — Reel 067912/0351

• Conveyance: Assignment
• Assignor: Koninklijke Philips N.V. (recorded on Patentcloud as "KONINKLIJKE PHILIPS ELECTRONICS NV")
• Assignee: General Video, LLC (DELAWARE)
• Correspondent: ⚠️ Not retrieved. Same gap as above.
• Scope: A multi-patent, single-reel transfer of eight (8) patents (Patentcloud: Reel 67912-351, recorded 20240704, executed 20240401, "# of Patents: 8"). Sisvel's market commentary confirms the substance: "the April 2024 assignment of eight patents to General Video LLC. The technologies addressed include the transmission of video and data over a serial link, as well as stereoscopic image data." That description covers both the Silicon Image-style serial-link patents and this stereoscopic-transport patent.
• Context: Transfer-to-asserter / divestiture. Philips sold a discrete 8-patent display-interface portfolio to a licensing entity. US 9,036,010 was asserted as one of the six "General Video Patents" in the suits filed four months later.

Note on Google Patents' "Current Assignee" field: it displays both "General Video LLC" and "Koninklijke Philips NV." The Philips entry is almost certainly a stale artifact reflecting non-U.S. family members (EP2235956A2, KR101964993B1, JP6849315B2, CN101904175B, BRPI0820848B1, RU2516499C2) that were not part of the U.S. sale. The U.S. assignment record (reel 067912/0351) governs for the U.S. patent.

Related family applications in the U.S. (same transfer posture): US14/629,642 (→ US9462258B2) and US15/256,839 (→ US9843786B2) are continuations of 12/808,685. US9843786B2 was asserted alongside US9,036,010 in the 2024 suits, indicating the Philips→General Video reel covered the continuation as well — but I could not independently confirm that both landed on reel 067912/0351, so I state it as likely, not established.

Post-grant events bearing on the record (not assignments): IPR2025-01036 filed (effective 2025-05-23) by Intel Corp., Dell Inc., Dell Technologies Inc. — discretionary denial of institution, institution decision 2026-03-10. An ex parte reexamination request was filed with record date 2026-02-03 (effective 2025-11-18). Neither changes title.

Timeline diagram

timeline
    title Ownership of US 9036010
    2007 : EP priority application filed
    2008 : PCT application filed on 2008-12-15
         : Shepherd assigns rights to Philips
    2010 : Assignment recorded at USPTO
    2015 : US patent issues on 2015-05-19
    2024 : Philips assigns 8 patents to General Video LLC
         : General Video sues nine PC makers
    2025 : Intel and Dell file IPR
         : IPR institution denied
    2026 : Ex parte reexamination requested

NPE / troll-pattern signals

1. Shell-entity transfer — PRESENT.
   Reel 067912/0351 (executed 2024-04-01; recorded 2024-07-04) moves the patent from an operating multinational to General Video, LLC, a Delaware LLC. Concrete corroboration, not name-based inference:

   • General Video's own Fed. R. Civ. P. 7.1(a)(1) Disclosure Statement, filed 2024-09-03 in General Video, LLC v. HP Inc., No. 5:24-cv-00123 (E.D. Tex.) and General Video, LLC v. ASUSTeK Computer Inc., No. 5:24-cv-00126 (E.D. Tex.), "identif[ies] Corporate Parent Ideahub Inc. for GENERAL VIDEO, LLC" — i.e., a single parent holding company, not an operating business.
   • Judicial characterization: the Malaysian High Court in General Video, LLC v Asustek Computer Malaysia Sdn Bhd & Anor [2023] MLJU 3124 described the plaintiff as "a US-incorporated non-practising entity ('NPE') which owned and licensed patents relating to audio-visual data transmission technology." This predates the Philips acquisition but is a direct finding about the same legal entity.
   • No products in commerce identified for General Video, LLC.

2. Known asserter in the chain — PRESENT.

   • General Video, LLC is a listed licensor in Via Licensing Alliance's DisplayPort Patent Portfolio License (via-la.com), and Philips-era patents including US 9,036,010 appear on the Via-LA DisplayPort patent attachment.
   • It is a high-frequency, multi-jurisdiction plaintiff: nine U.S. complaints filed 2024-08-30 (E.D. Tex. and W.D. Tex.), plus prior Malaysian litigation. Surfaced via the Unified Patents litigation portal.
   • Not on the legacy Acacia / Marathon / IV / Wi-LAN / Conversant list, so this is an asserter identified by its own conduct and pool participation rather than a list match.

3. Repeat correspondent across the chain — UNRESOLVED (⚠️).
   I could not retrieve the correspondent of record for either reel. Do not substitute litigation counsel for the recorded correspondent — they are different roles and conflating them would be a fabricated finding. What is documented and worth carrying forward:

   • Assertion counsel is McAndrews, Held & Malloy, Ltd. (Chicago) — Peter J. McAndrews, Matthew G. McAndrews, Rajendra A. Chiplunkar — acting as lead counsel for General Video across all the Texas cases, with Patton Tidwell & Culbertson (Texarkana) as local counsel. This is repeat-play litigation counsel for the asserter, which is a real strategic tell, but it is not the assignment-record correspondent and I will not label it one.

4. Cascading transfers — NOT PRESENT (in this patent's U.S. record).
   Only two recorded assignments across ~16 years: inventor→employer (reel 024548/0639) and operating→asserter (reel 067912/0351). There is no chain of LLCs flipping the patent in under 24 months. (Separately, General Video's earlier Malaysian patents traced to GE Technology Development Inc., indicating other acquisition channels — but that is not this patent's chain and I do not import it.)

5. Pre-litigation transfer — PRESENT.
   Assignment executed 2024-04-01; recorded 2024-07-04; first suits naming the '010 patent filed 2024-08-30 — approximately 5 months from execution and 8 weeks from recording. Both within the classic 6-month window. The recording landed in time to establish a clean standing record before filing, consistent with the "arranged to enable assertion" pattern.

6. Bankruptcy fire-sale — NOT PRESENT.
   Philips is a solvent going concern; the transfer was a portfolio divestiture, not a § 363 sale or Chapter 7 liquidation. No Kodak/Nortel/Polaroid-style facts.

7. Privateering — UNCLEAR.
   The chain shows an operating company (Philips) selling to an NPE that sues PC/display OEMs (HP, Dell, Acer, ASUS, Lenovo). That resembles privateering, but two facts cut against it: (a) Philips is not a maker of PCs or monitors competing with those defendants in the accused product category, so the "assert against the operating company's competitors" element is weak; and (b) Sisvel characterized this transaction specifically within a report on "'peace deals' among July and August patent assignments" — i.e., the industry read it as a portfolio settlement/divestiture, not a proxy war. Mark unclear rather than asserting privateering.

8. Defensive aggregator (anti-NPE) — NOT PRESENT.
   The chain terminates at General Video, LLC, an asserting entity, not at RPX, AST, LOT Network, Unified Patents, or OIN. The patent has not been neutralized; it is under active assertion and was only recently the subject of an IPR that was denied institution.

Verdict

NPE — high confidence.

Two or more strong signals converge on reel 067912/0351 (Philips → General Video, LLC; executed 2024-04-01, recorded 2024-07-04): a shell-entity transfer of eight patents to a Delaware licensing LLC whose only disclosed corporate parent is Ideahub Inc. (General Video's own Rule 7.1 disclosure, filed 2024-09-03 in 5:24-cv-00123 and 5:24-cv-00126), coupled with a pre-litigation transfer landing roughly five months before General Video's 2024-08-30 wave of nine infringement complaints. The earlier link (reel 024548/0639, Shepherd → Philips, executed 2008-12-16) is an ordinary inventor assignment and carries no signal; the asserter signal is entirely in the 2024 leg. General Video's status as a Via-LA DisplayPort pool licensor and its judicial characterization as an NPE in General Video v Asustek [2023] MLJU 3124 complete the picture.

Verify at: https://assignmentcenter.uspto.gov/ (search patent 9,036,010) — specifically reel/frame 024548/0639 and 067912/0351.

---

Explicit gap list (do not let these be filled by inference)

Contradiction flag: Google Patents' "Current Assignee" field lists Koninklijke Philips NV alongside General Video LLC. Per the U.S. assignment record (reel 067912/0351), the U.S. patent's title passed to General Video, LLC. The Philips listing should be treated as stale / reflecting non-U.S. family members, not as a competing U.S. ownership claim — unless the Assignment Center shows otherwise.

Here's an analysis of the most relevant prior art for US patent 9036010, based on its cited references and the claims of US9036010.

The claims of US9036010 generally pertain to a digital display interface part and related methods for transporting stereoscopic image data over a digital display interface (such as HDMI), utilizing existing data carrying capacity (e.g., deep color modes) by multiplexing stereoscopic components, and using signaling information (e.g., Data Island Packets) to identify the format and characteristics of the stereoscopic data. Some claims also cover distributing stereoscopic data between primary and auxiliary channels.

Here are the cited prior art references, their descriptions, and potential anticipation:

---

1. US20020009137A1
   • Full Citation: US20020009137A1 (Nelson John E.)
   • Publication/Filing Date: Published: 2002-01-24; Priority: 2000-02-01
   • Brief Description: This patent application describes a three-dimensional video broadcasting system that encodes 3D video images by spatially multiplexing left and right eye images into a 2D compatible format. It suggests embedding synchronization pulses within standard video blanking intervals to trigger 3D displays. The system aims to transmit 3D video over existing 2D video infrastructure.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 12, 16, 18 (first mode for 2D images): This reference teaches systems designed for 2D compatible formats, implying a first mode for 2D images.
     • Claims 1, 12, 16, 18 (second mode for multiplexed stereoscopic image): The core idea of spatially multiplexing left and right eye images into a 2D compatible format directly relates to multiplexing components of a stereoscopic image for transport over an interface.
     • Claims 6, 15: Specifically teaches "left and right eye images."
     • Claims 3, 4, 13, 14 (signaling in blanking periods/Data Island Packets): The reference mentions "embedding synchronization pulses within standard video blanking intervals to trigger 3D displays." This strongly suggests the use of auxiliary data in blanking periods for 3D signaling, which could potentially anticipate the use of Data Island Packets for signaling.
     • Claim 7, 8: While not explicitly stating sequential transmission, the idea of encoding left and right eye images for a 2D compatible stream could encompass sequential or interleaved approaches.

---

1. JP2003111101A
   • Full Citation: JP2003111101A (Sanyo Electric Co Ltd)
   • Publication/Filing Date: Published: 2003-04-11; Priority: 2001-09-26
   • Brief Description: This patent describes a method, apparatus, and system for processing stereoscopic images where left and right eye image signals are separated and converted into a signal format suitable for a 3D display. It discusses various image processing steps like resolution conversion and synchronization.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 12, 16, 18 (second mode for multiplexed stereoscopic image): Discusses processing stereoscopic image signals for display, which inherently involves some form of preparing or multiplexing them for a display interface.
     • Claims 6, 15: Explicitly deals with "left and right eye image signals."
     • Claims 1, 12, 16, 18 (interface part and processor to extract/demultiplex): Covers apparatus and methods for processing and converting stereoscopic image signals for display, implying the extraction and demultiplexing at the display end.

---

1. US6914637B1
   • Full Citation: US6914637B1 (Silicon Image, Inc.)
   • Publication/Filing Date: Granted: 2005-07-05; Priority: 2001-12-24
   • Brief Description: This patent focuses on a method and system for video and auxiliary data transmission over a serial link, particularly relevant to interfaces like DVI and HDMI. It teaches embedding auxiliary data, such as audio data, control codes, or other information, within the video blanking intervals.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 3, 4, 13, 14 (signaling information in blanking periods/Data Island Packet): This reference directly teaches transmitting "auxiliary data" within "video blanking intervals" over a "serial link" like HDMI. This broadly anticipates the mechanism for carrying signaling information in Data Island Packets during blanking periods. While it doesn't specifically mention stereoscopic signaling, it establishes the technical mechanism used by US9036010 for signaling.

---

1. US20050146521A1
   • Full Citation: US20050146521A1 (Kaye Michael C.)
   • Publication/Filing Date: Published: 2005-07-07; Priority: 1998-05-27
   • Brief Description: This application describes a method for creating and presenting 3D images converted from 2D images. It involves generating depth information from 2D images and then using this depth information to render 3D views.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 10, 11: Directly relates to "2D image data and image depth data." It describes generating 3D images from 2D plus depth, which is one of the stereoscopic formats mentioned in US9036010.

---

1. US20060044388A1
   • Full Citation: US20060044388A1 (Sung-Sik Kim)
   • Publication/Filing Date: Published: 2006-03-02; Priority: 2004-08-26
   • Brief Description: This patent application discloses a method of generating a stereoscopic image signal by combining a 2D image and depth information. It discusses encoding this combined information into a signal suitable for transmission and display.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 12, 16, 18 (second mode for multiplexed stereoscopic image): Teaches generating and encoding a stereoscopic image signal by combining 2D image and depth, which is a form of multiplexing.
     • Claims 10, 11: Specifically deals with "2D image data and image depth data" and combining them.

---

1. US20060192776A1
   • Full Citation: US20060192776A1 (Toshio Nomura)
   • Publication/Filing Date: Published: 2006-08-31; Priority: 2003-04-17
   • Brief Description: This patent describes a 3D image creation, reproduction, and processing device that generates stereoscopic images from 2D images and depth information. It also mentions transmitting depth information, potentially as auxiliary data or embedded within the image data.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 12, 16, 18 (second mode for multiplexed stereoscopic image): Focuses on processing and transmitting 3D image data, including depth, which can be seen as multiplexed components.
     • Claims 10, 11: Directly addresses "2D image data and image depth data."

---

1. JP2006295289A
   • Full Citation: JP2006295289A (Nippon Telegr & Teleph Corp )
   • Publication/Filing Date: Published: 2006-10-26; Priority: 2005-04-06
   • Brief Description: This patent outlines a three-dimensional display method, image generation apparatus, and image display apparatus. It discusses generating multi-view images using 2D image data and depth data, and transmitting this information to a display.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 12, 16, 18 (second mode for multiplexed stereoscopic image): Describes the general concept of generating and transmitting 3D image data (from 2D+depth) to a display.
     • Claims 10, 11: Concerns using "2D image data and depth data" for 3D display.

---

1. US20060279750A1
   • Full Citation: US20060279750A1 (Samsung Electronics Co., Ltd.)
   • Publication/Filing Date: Published: 2006-12-14; Priority: 2005-06-14
   • Brief Description: This application describes an apparatus and method for converting an image display mode, including converting 2D images to 3D images using depth information. It focuses on the processing within a display device to render 3D content.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 10, 11: Deals with 2D to 3D conversion using depth information.
     • Claims 12, 18 (processor to extract/demultiplex): Describes the processing at the receiving end (display) to utilize depth information for 3D rendering.

---

1. WO2006137006A2
   • Full Citation: WO2006137006A2 (Koninklijke Philips Electronics N.V.)
   • Publication/Filing Date: Published: 2006-12-28; Priority: 2005-06-23
   • Brief Description: This Philips patent (same original assignee as US9036010) specifically addresses the transmission of 3D images using 2D image and depth data. It proposes embedding depth information into the horizontal or vertical blanking intervals or as side-by-side sub-frames within the active video area. It mentions signaling to indicate the presence and format of depth data.
   • Potential Anticipation (35 U.S.C. § 102): This reference is highly relevant and anticipates several key aspects of US9036010, particularly for 2D+depth scenarios and signaling.
     • Claims 1, 12, 16, 18 (second mode for multiplexed stereoscopic image): Explicitly teaches "transmission of 3D image using 2D image and depth data."
     • Claims 10, 11: Directly covers "2D image data and image depth data."
     • Claims 3, 4, 13, 14 (signaling in blanking periods/Data Island Packets): Explicitly states "embedding depth information into the horizontal or vertical blanking intervals" and "signaling to indicate the presence and format of depth data." This is a very strong anticipation of signaling via blanking periods/Data Island Packets.
     • Claims 2, 13, 17: Covers "information for enabling the second audio-visual device to determine a stereoscopic image format."

---

1. WO2007069195A2
   • Full Citation: WO2007069195A2 (Koninklijke Philips Electronics N.V.)
   • Publication/Filing Date: Published: 2007-06-21; Priority: 2005-12-13
   • Brief Description: This Philips patent focuses on an autostereoscopic display device, describing the display technology itself rather than the transport of data over an interface in detail. It refers to a display with multisided slanted ventricular lenses.
   • Potential Anticipation (35 U.S.C. § 102): This reference is less directly anticipatory of the interface transport aspects of US9036010, as it primarily describes the display technology. However, it provides context for the types of stereoscopic displays that US9036010's transported data would be for. It might anticipate the goal of supporting autostereoscopic displays, but not the specific claimed method of data transport.

---

1. US20070139769A1
   • Full Citation: US20070139769A1 (International Business Machines Corporation)
   • Publication/Filing Date: Published: 2007-06-21; Priority: 2005-12-21
   • Brief Description: This application describes a universal stereographic trigger peripheral for electronic equipment. It focuses on a peripheral device that can trigger a display to switch to a stereographic mode based on input, indicating the presence of 3D content. It mentions using existing display interfaces.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 12, 16, 18 (signaling identifying mode/characteristics): The concept of a "trigger" to indicate 3D content over "existing display interfaces" aligns with the signaling aspect of US9036010 for identifying the mode.

---

1. JP2007325101A
   • Full Citation: JP2007325101A (Sony Corp)
   • Publication/Filing Date: Published: 2007-12-13; Priority: 2006-06-02
   • Brief Description: This patent describes a communication system, transmission device, and reception device for transmitting image data, including 3D image data. It specifically mentions multiplexing left-eye and right-eye images, or a 2D image and depth map, into a single video stream for efficient transmission. It also covers signaling information about the 3D format.
   • Potential Anticipation (35 U.S.C. § 102): This reference is highly relevant and appears to anticipate many core elements of US9036010.
     • Claims 1, 12, 16, 18 (second mode for multiplexed stereoscopic image): Directly teaches "multiplexing left-eye and right-eye images, or a 2D image and depth map, into a single video stream for efficient transmission." This is a direct match for the second mode.
     • Claims 6, 15: Covers "left-eye and right-eye images."
     • Claims 10, 11: Covers "2D image and depth map."
     • Claims 2, 13, 17: Explicitly states "signaling information about the 3D format."
     • Claims 1, 12, 16, 18 (formatter/processor): Describes both transmission and reception devices for handling this multiplexed 3D data.

---

1. US20070296859A1
   • Full Citation: US20070296859A1 (Sony Corporation)
   • Publication/Filing Date: Published: 2007-12-27; Priority: 2006-05-16
   • Brief Description: This application describes a communication method and system for transmitting video data, including multiplexing multiple video signals (e.g., left and right views) into a single stream. It also discusses the use of auxiliary information within the video stream to identify the type of content (e.g., 3D).
   • Potential Anticipation (35 U.S.C. § 102): This reference is also highly relevant.
     • Claims 1, 12, 16, 18 (second mode for multiplexed stereoscopic image): Teaches "multiplexing multiple video signals (e.g., left and right views) into a single stream."
     • Claims 6, 15: Specifically mentions "left and right views."
     • Claims 2, 13, 17: Covers "auxiliary information within the video stream to identify the type of content (e.g., 3D)."
     • Claims 1, 12, 16, 18 (formatter/processor): Describes transmission and reception apparatuses.

---

1. JP2008117289A
   • Full Citation: JP2008117289A (Ricoh Co Ltd)
   • Publication/Filing Date: Published: 2008-05-22; Priority: 2006-11-07
   • Brief Description: This patent describes a data communication system and method that handles both 2D and 3D image data. It discusses different data formats for 3D content and signaling methods to inform the receiving device about the format in use.
   • Potential Anticipation (35 U.S.C. § 102):
     • Claims 1, 12, 16, 18 (first and second mode, signaling): Explicitly describes handling both "2D and 3D image data" and "signaling methods to inform the receiving device about the format in use." This directly addresses the two modes and the signaling.
     • Claims 2, 13, 17: Covers "signaling methods to inform the receiving device about the format in use," which includes determining the stereoscopic image format.

---

Most Relevant Prior Art Summary:

Based on the descriptions, the most directly anticipatory references, particularly regarding the core claims of multiplexing stereoscopic data components and using signaling, appear to be:

• JP2007325101A (Sony Corp): This patent directly teaches multiplexing left/right images or 2D/depth into a single stream and signaling the 3D format, anticipating many elements of Claims 1, 2, 6, 10, 11, 12, 13, 15, 16, 17, 18.
• US20070296859A1 (Sony Corporation): Similar to the above, it teaches multiplexing multiple video signals (left/right) into a single stream and using auxiliary information for identification, anticipating Claims 1, 2, 6, 12, 13, 15, 16, 17, 18.
• WO2006137006A2 (Koninklijke Philips Electronics N.V.): This patent, from the same original assignee, specifically addresses transmission of 2D+depth, embedding depth in blanking intervals, and signaling, strongly anticipating Claims 1, 2, 3, 4, 10, 11, 12, 13, 14, 16, 17, 18.
• US20020009137A1 (Nelson John E.): Its teaching of spatially multiplexing left/right images into a 2D compatible format and embedding synchronization in blanking intervals is a strong early anticipation of the core multiplexing and signaling concepts for 3D over 2D infrastructure.
• US6914637B1 (Silicon Image, Inc.): While not specific to 3D, it lays the groundwork for using auxiliary data in blanking intervals (like Data Islands) over interfaces like HDMI, which is a key enabling technology for the signaling aspects of US9036010, thereby potentially anticipating Claims 3, 4, 13, 14.

These references collectively disclose methods of multiplexing stereoscopic image components (L/R or 2D+depth), transmitting them over existing display interfaces, and using signaling (often in blanking periods or via auxiliary data) to inform the receiver about the stereoscopic format. While US9036010 emphasizes utilizing "deep color modes" specifically, many of these references already establish the fundamental techniques of multiplexing and signaling for 3D data transmission that could be adapted to higher bandwidth modes.

US Patent 9,036,010, titled "Transport of stereoscopic image data over a display interface," discloses methods and apparatus for efficiently transmitting stereoscopic image data over a digital display interface, such as HDMI. The invention primarily focuses on multiplexing stereoscopic image components into existing image data carrying elements, often by repurposing higher-capacity color depth modes, and using signaling information to enable proper decoding at the receiving end.

An analysis under 35 U.S.C. § 103 suggests that the claimed invention would have been obvious to a person having ordinary skill in the art (POSA) at the time of the invention (priority date 2007-12-18), by combining existing knowledge and prior art references.

Key Independent Claims of US9036010:

• Claim 1 describes a digital display interface part for a first audio-visual device. It includes a formatter operable in a first mode for 2D images and a second mode for multiplexed stereoscopic image components. This second mode uses portions of the interface, each with lesser capacity than the known total capacity, but with a combined capacity no greater than the known capacity. Signaling information is sent to identify the mode and characteristics.
• Claim 12 describes the corresponding receiving digital display interface part with a processor to extract and demultiplex the image data based on received signaling and the capabilities of the receiving device.
• Claim 16 is a method claim corresponding to the functionality of Claim 1.
• Claim 18 is a method claim corresponding to the functionality of Claim 12.

Obviousness Combination:

A strong case for obviousness can be made by combining:

1. WO2006137006A2 (Koninklijke Philips Electronics N.V.): This patent, from the same original assignee as US9036010, explicitly teaches the "Transmission of 3d image using 2d image and depth data." It describes encoding a 3D image by multiplexing 2D image data and associated depth information for transmission. This directly addresses the concept of a "multiplexed combination of components of a stereoscopic image" (as in Claim 1 of US9036010) specifically for 2D+depth data.
2. US6914637B1 (Silicon Image, Inc.): This patent describes a "Method and system for video and auxiliary data transmission over a serial link." It teaches transmitting video data and auxiliary data (e.g., control, configuration, and audio data) over a serial digital interface, explicitly stating that "The auxiliary data is carried during the video blanking interval." This provides a clear teaching for sending "signaling information across the interface" in known locations like blanking periods, such as HDMI Data Island Packets (as described in US9036010, referencing FIG. 6).
3. General knowledge of High Definition Multimedia Interface (HDMI) 1.3a: HDMI 1.3a, released in June 2006 (prior to the priority date of US9036010), was well-known in the art. The specification introduced "Deep Color Pixel Packing modes" allowing for increased color depths (10, 12, and 16 bits per color, up to 48-bit color), significantly increasing the "known data carrying capacity" for uncompressed pixel information.

Motivation for a Person Having Ordinary Skill in the Art (POSA) to Combine:

A POSA in digital video interfaces and stereoscopic display technology (e.g., someone with expertise in designing HDMI-compliant devices or 3D displays) would have been motivated to combine these references for the following reasons:

• Problem Recognition: The background of US9036010 explicitly states the problem that "conventional displays, and display interfaces... have been designed specifically for the display of conventional 2D images." It also notes that prior schemes often "sacrifice part of the active portion of an image to carry additional data necessary to render a stereoscopic image," such as the WOWvx format. A POSA would seek a solution to efficiently transmit stereoscopic images without these drawbacks.
• Leveraging Available Bandwidth: With the introduction of HDMI 1.3a's deep color modes, a significant increase in "known data carrying capacity" became available on standard HDMI connections. Although initially intended for higher color depth 2D content, a POSA would recognize that this increased bandwidth could be "re-used" to transport other data types, particularly the increasingly desired stereoscopic content. The motivation would be to maximize the utility of the existing, high-bandwidth interface without requiring new hardware or significant changes to the standard. This directly addresses the "combined data carrying capacity no greater than said known data carrying capacity" element of the claims.
• Known Stereoscopic Formats: WO2006137006A2, from Philips, provided a known method for multiplexing 2D image data with depth information for 3D transmission. This would be an obvious candidate for packaging into the newly available bandwidth of deep color modes. Similarly, the concept of left-eye/right-eye image pairs is a fundamental approach to stereoscopy.
• Standard Signaling Practice: When repurposing an existing interface or introducing new data formats, it is standard engineering practice to include signaling information so that the receiving device can correctly interpret the incoming data stream. US6914637B1 teaches a mechanism for "auxiliary data transmission" during blanking intervals over a serial link, which would naturally extend to HDMI Data Island Packets for conveying information about the stereoscopic format and its characteristics (e.g., whether it's L+R or 2D+depth, and how it's multiplexed). Furthermore, the use of EDID (Extended Display Identification Data) over the DDC (Display Data Channel) for a source device to ascertain the capabilities of a sink device is a well-established practice in HDMI, as explicitly mentioned in US9036010. This addresses the claim limitation that formatting is done "in accordance with signal information received from the second audio-device."

Therefore, it would have been obvious for a POSA, striving to overcome the limitations of prior 3D transmission methods and efficiently utilize the enhanced capabilities of modern digital display interfaces like HDMI 1.3a, to combine the multiplexing techniques for stereoscopic data (WO2006137006A2) with the increased bandwidth of deep color modes in HDMI 1.3a, and to use conventional signaling mechanisms (US6914637B1 and general HDMI EDID practices) to inform the receiving device about the transmitted stereoscopic format. This combination leads directly to the core elements of the independent claims of US9036010.

US Patent 9036010, titled "Transport of stereoscopic image data over a display interface," was granted on May 19, 2015. The patent indicates an adjusted expiration date of February 13, 2030.

Patent Term Adjustments (PTA) and Extensions (PTE):
Information regarding specific Patent Term Adjustments (PTA) for US9036010 is not directly available in the provided patent text or search snippets, beyond the stated "Adjusted expiration" date. PTA is granted to compensate for certain delays caused by the USPTO during the prosecution of a patent application. This adjustment adds time to the standard 20-year patent term from the earliest non-provisional filing date.

Patent Term Extensions (PTE) are available for patents claiming products, methods of use, or manufacturing processes that require regulatory approval (e.g., human drugs, medical devices, food additives) to restore patent term lost during the regulatory review period. There is no indication in the patent text or search results that US9036010 is eligible for or has received a PTE under 35 U.S.C. § 156.

Continuation and Divisional Applications:
The patent document lists the following related applications:

• Parent Application: PCT/IB2008/055305 (WO2009077969A2)
• Child Applications:
  • US14/629,642, which resulted in US9462258B2. This is identified as a Continuation application.
  • US15/256,839, which resulted in US9843786B2. This is also identified as a Continuation application.

A continuation application is filed during the pendency of an earlier patent application and claims the same invention as the earlier application. A divisional application is filed when an examiner requires restriction of claims to one of two or more independent and distinct inventions in an earlier application. Both continuation and divisional applications benefit from the filing date of the original application.

Related Family Members:
The patent family (ID=40473426) includes:

• US12/808,685 (US9036010B2 itself).
• US14/629,642 (US9462258B2).
• US15/256,839 (US9843786B2).

International family members include applications and patents in various jurisdictions, such as EP, JP, KR, CN, BR, RU, and WO.

Projected Expiration Date:
US Patent 9036010 has a projected expiration date of February 13, 2030. The term of a U.S. utility patent generally ends 20 years from its earliest non-provisional filing date, with potential adjustments for USPTO delays (PTA) or regulatory review (PTE).

As a Senior Patent Strategist and Research Engineer specializing in Defensive Publishing, the goal is to expand the prior art landscape around US Patent 9036010, "Transport of stereoscopic image data over a display interface." The following defensive disclosure details derivative variations based on the patent's core inventive concepts, aiming to render future incremental improvements obvious or non-novel.

---

Defensive Disclosure for US Patent 9036010

Derivative 1: Optical-Fiber-Based DDI with FPGA/ASIC Multiplexing

Derivation Axis: Material & Component Substitution

Enabling Description:
This derivative implements the core mechanism of transporting multiplexed stereoscopic image data and signaling over a digital display interface by substituting the electrical High Definition Multimedia Interface (HDMI) with a high-bandwidth optical fiber interface, such as a Fibre Channel or a custom optical transport layer utilizing Vertical-Cavity Surface-Emitting Lasers (VCSELs) for short-reach and Distributed Feedback (DFB) lasers for long-reach transmission. The formatter and processor functionalities, as described in claims 1 and 12, are implemented in custom Application-Specific Integrated Circuits (ASICs) or reconfigurable Field-Programmable Gate Arrays (FPGAs) rather than general-purpose processors.

On the source side, the ASIC/FPGA-based formatter receives uncompressed stereoscopic image components (e.g., left/right eye data or 2D+depth) and multiplexes them directly into high-speed optical data streams. This multiplexing occurs at the physical layer, potentially encoding the stereoscopic information within specific wavelength channels (Dense Wavelength Division Multiplexing - DWDM) or time-division multiplexed sub-frames of the optical signal. Signaling information (identifying the stereoscopic mode, encoding scheme, and depth data location) is embedded as dedicated control packets within the optical data stream or on a separate low-speed optical control channel, ensuring resilience against electrical noise and extending transmission distances.

On the sink side, a corresponding ASIC/FPGA-based processor demultiplexes the incoming optical stream, extracting the stereoscopic image data components and interpreting the embedded signaling information. The optical-to-electrical conversion is handled by photodiodes and transimpedance amplifiers, feeding directly into the FPGA/ASIC for real-time demultiplexing and reconstruction of the 3D image for display. This architecture supports extremely high data rates beyond current HDMI capabilities while maintaining uncompressed pixel integrity.

flowchart TD
    SUBGRAPH Source Device
        A[Stereoscopic Image Source] --> B(ASIC/FPGA Formatter)
        B -- Multiplexes Left/Right or 2D+Depth --> C{Optical Transmitter (VCSEL/DFB)}
    END
    C -- Optical Fiber Link --> D{Optical Receiver (Photodiode)}
    SUBGRAPH Sink Device
        D --> E(ASIC/FPGA Processor)
        E -- Demultiplexes & Decodes --> F[3D Display Renderer]
    END
    B -- Signaling Packets --> C
    D -- Signaling Packets --> E

Derivative 2: Terahertz (THz) Wireless DDI for High-Throughput Stereoscopic Data

Derivation Axis: Operational Parameter Expansion

Enabling Description:
This derivative extends the digital display interface to operate at Terahertz (THz) frequencies for wireless transmission of uncompressed stereoscopic image data, enabling significantly higher bandwidth and lower latency than conventional wireless display interfaces. The formatter (source) and processor (sink) from claims 1 and 12 are adapted for THz transceivers.

On the source side, the formatter multiplexes stereoscopic image components into a THz-optimized data format, potentially employing advanced modulation schemes like Quadrature Amplitude Modulation (QAM) with high constellation orders (e.g., 256-QAM or 1024-QAM) to maximize spectral efficiency. This multiplexed data stream is then fed to a THz transmitter, which converts the electrical signals into directed THz beams using array antennas for beamforming and spatial multiplexing. Signaling information, indicating the stereoscopic format and multiplexing characteristics, is embedded in THz control frames or transmitted using a robust, lower-rate THz sub-carrier.

The THz display interface operates at peak data rates of several hundreds of gigabits per second, far exceeding the "known data carrying capacity" of current wired interfaces, but maintaining the principle of utilizing existing (or newly available in THz spectrum) capacity for multiplexed stereoscopic content. This allows for multi-view autostereoscopic displays or ultra-high-resolution stereoscopic content (e.g., 8K per eye). The sink-side THz receiver and processor perform the inverse operations, demultiplexing the THz signal, extracting stereoscopic data, and decoding the signaling information for rendering. The operational parameters include carrier frequencies from 100 GHz to 10 THz, with power levels calibrated for short-range indoor transmission (e.g., 1-10 meters line-of-sight) to mitigate atmospheric absorption.

sequenceDiagram
    participant S as Source Device (THz Formatter)
    participant T as THz Transmitter (Antenna Array)
    participant R as THz Receiver (Antenna Array)
    participant D as Sink Device (THz Processor)

    S->>T: Multiplexed Stereo Data + Signaling (Electrical)
    T->>R: THz Beam (Ultra-high Bandwidth, Uncompressed)
    R->>D: Demultiplexed Stereo Data + Signaling (Electrical)
    D->>D: Demultiplexing, Decoding, 3D Rendering

Derivative 3: Stereoscopic Data Transport in High-Definition Medical Endoscopy Systems

Derivation Axis: Cross-Domain Application (Medical Imaging)

Enabling Description:
This derivative applies the patent's principles to high-definition medical endoscopy, specifically for real-time stereoscopic visualization during minimally invasive surgery. The "first audio-visual device" is an endoscopic camera control unit, and the "second audio-visual device" is a medical-grade 3D display or heads-up display worn by the surgeon. The "digital display interface" is a specialized, shielded medical data bus (e.g., a custom PCIe-over-fiber link or a specialized HDMI-compliant interface designed for medical environments).

The endoscopic camera generates two distinct video streams (left and right eye views, or a 2D view with depth map generated via structured light or time-of-flight sensors). The formatter in the camera control unit multiplexes these stereoscopic components into the data stream using existing high-resolution 2D image formats (e.g., 4K UHD 2D streams), leveraging their deep color modes to carry the additional stereoscopic information (e.g., a 10-bit color channel might carry 8-bit image data plus 2-bit depth data, or 5-bit left/5-bit right intensity data). Signaling information, critical for precise synchronization and surgical guidance, is embedded in blanking intervals (similar to HDMI Data Island Packets) to inform the medical display about the stereoscopic format, depth scale, and any critical diagnostic overlays. This allows surgeons to perceive depth accurately within the surgical field, improving precision and reducing procedural risks.

flowchart TD
    A[Stereoscopic Endoscope Camera] --> B(Camera Control Unit - Formatter)
    B -- Multiplexed Stereo Data (e.g., 2D+Depth in Deep Color) --> C{Medical Display Interface (Fiber/Shielded Cable)}
    C --> D(3D Medical Display - Processor)
    D -- Synchronized Output --> E[Surgeon's 3D View]
    B -- Signaling (Depth Scale, Format) --> C
    D -- Decodes Signaling --> D

Derivative 4: Autonomously Guided Vehicle (AGV) Robotic Vision

Derivation Axis: Cross-Domain Application (Industrial Automation/Robotics)

Enabling Description:
This derivative implements the stereoscopic data transport for real-time 3D perception in industrial Autonomous Guided Vehicles (AGVs) or collaborative robots. The "first audio-visual device" is a robot's perception module (e.g., containing stereo cameras or LiDAR-fusion) and the "second audio-visual device" is the robot's onboard processing unit or a remote control station. The "digital display interface" is an industrial Ethernet link (e.g., PROFINET, EtherCAT) or a high-speed wireless industrial communication standard (e.g., 5G NR-U, Wi-Fi 6E).

The perception module's formatter multiplexes stereoscopic data (e.g., a 2D visual stream + real-time point cloud depth data, or semantic segmentation maps) into the industrial network packets. Instead of traditional pixel data, the "data elements" here represent slices of compressed depth maps, feature vectors, or grid occupancy data, multiplexed within standard high-bandwidth Ethernet frames. Signaling information, conveyed via custom EtherType packets or specific IP/UDP headers, specifies the 3D data format, coordinate system (e.g., robot base frame, world frame), sensor fusion parameters, and dynamic region-of-interest indicators. This enables the AGV's navigation system or remote operator to accurately perceive the robot's environment in 3D, crucial for obstacle avoidance, object manipulation, and path planning in dynamic industrial settings.

flowchart LR
    A[Stereo Vision/LiDAR Sensors] --> B(Robot Perception Module - Formatter)
    B -- Multiplexed 3D Data (e.g., 2D+Depth as Industrial Ethernet Packets) --> C{Industrial Ethernet/Wireless Link}
    C --> D(Robot Control Unit / Remote Station - Processor)
    D -- 3D Environmental Model --> E[AGV Navigation / Operator Interface]
    B -- Signaling (Coordinate System, ROI) --> C
    D -- Decodes Signaling --> D

Derivative 5: AI-Driven Dynamic Bandwidth Allocation for Stereoscopic Streaming

Derivation Axis: Integration with Emerging Tech (AI-driven optimization)

Enabling Description:
This derivative enhances the patent's core concept by integrating AI-driven optimization to dynamically allocate bandwidth for stereoscopic image components based on content complexity, network conditions, and user viewing preferences. The formatter (source) and processor (sink) from claims 1 and 12 incorporate embedded AI inference engines.

On the source side, an AI module within the formatter continuously analyzes the incoming stereoscopic content (e.g., scene depth complexity, motion vectors, regions of interest) and monitors interface telemetry (e.g., available bandwidth, error rates). Based on this analysis, the AI dynamically determines the optimal multiplexing strategy: for low-complexity scenes, it might allocate more bits to the 2D image and fewer to depth; for fast-moving, high-depth scenes, it might prioritize depth data or switch to a full left/right stream if capacity allows. The AI also generates adaptive signaling information that informs the sink device not only about the current mode and characteristics but also the rate and quality of each stereoscopic component, which can change frame-by-frame. This signaling is carried in auxiliary data elements (e.g., HDMI Data Island Packets or custom transport stream metadata).

On the sink side, the processor's AI module interprets this dynamic signaling and adjusts its demultiplexing and rendering pipeline in real-time. For instance, if the AI determines that network congestion requires reduced depth data, the sink's AI might use a local depth estimation algorithm to interpolate missing depth information, ensuring a continuous, albeit adaptively scaled, 3D experience. This allows the system to operate efficiently across varying conditions without requiring a fixed stereoscopic format, maximizing visual quality while adhering to the "known data carrying capacity" by intelligently distributing the load.

sequenceDiagram
    participant SC as Stereo Content Source
    participant SF as Source Formatter (with AI)
    participant DDI as Digital Display Interface
    participant SP as Sink Processor (with AI)
    participant D as 3D Display

    SC->>SF: Raw Stereo Components
    SF->>SF: AI analyzes content & telemetry
    SF->>SF: AI determines dynamic multiplexing strategy
    SF->>DDI: Dynamically Multiplexed Stereo Data
    SF->>DDI: Dynamic Signaling (Mode, Characteristics, Rates)
    DDI->>SP: Dynamically Multiplexed Stereo Data & Signaling
    SP->>SP: AI interprets dynamic signaling & adjusts pipeline
    SP->>SP: AI interpolates/enhances if needed
    SP->>D: Adaptive 3D Rendered Output

Derivative 6: IoT-Enabled Context-Aware 3D Display Personalization

Derivation Axis: Integration with Emerging Tech (IoT sensors for real-time monitoring)

Enabling Description:
This derivative extends the patent's concept by integrating IoT sensors to gather real-time context about the viewing environment and user, dynamically adjusting the stereoscopic display parameters. The display interface part on both the source and sink (claims 1 and 12) communicates with a local IoT network.

On the source side, the formatter receives user-specific 3D preferences (e.g., preferred depth level, convergence point) and environmental data (e.g., ambient light, viewing distance, number of viewers) from IoT sensors (e.g., smart cameras, ambient light sensors, proximity sensors). An IoT gateway connected to the source device aggregates this data. The formatter then uses this real-time contextual information to adapt the multiplexing of stereoscopic components. For example, if a single viewer is close to the screen, it might enable a higher depth fidelity profile, or if multiple viewers are present, it might adjust for autostereoscopic comfort zones. This adaptive strategy results in modified stereoscopic image data streams. The signaling information sent via auxiliary data elements (e.g., HDMI Data Island Packets) includes not only the stereoscopic format but also dynamic metadata related to the context-aware adjustments, such as current depth budget, parallax adjustments, or individualized rendering instructions.

On the sink side, the processor receives this contextual metadata via the interface and further refines the 3D rendering based on its own local IoT sensor data (e.g., eye-tracking for precise gaze-contingent rendering, biometric feedback for viewer comfort). The result is a personalized, contextually optimized 3D viewing experience that dynamically adapts to the user and environment, all while leveraging the patent's efficient data transport methods.

graph TD
    subgraph Source Device (AV1)
        AVS[Stereo Content Source] --> F(Formatter)
        F -- Multiplexed Stereo Data --> DDI
    end

    subgraph IoT Network
        IS1[Ambient Light Sensor] --> IOTG(IoT Gateway)
        IS2[Proximity Sensor] --> IOTG
        IS3[User Preferences DB] --> IOTG
    end

    IOTG -- Contextual Data --> F
    F -- Context-aware Signaling --> DDI[Digital Display Interface]

    subgraph Sink Device (AV2)
        DDI --> P(Processor)
        P -- Personalized 3D Output --> Display[3D Display]
        ES[Eye-Tracking Sensor] --> P
    end

Derivative 7: Fail-Safe Stereoscopic Degradation (2D Fallback)

Derivation Axis: The "Inverse" or Failure Mode

Enabling Description:
This derivative focuses on the "inverse" or fail-safe operation mode of the stereoscopic display interface. The system is designed to gracefully degrade stereoscopic content to 2D in the event of interface errors, bandwidth limitations, or sink device capability failures, ensuring continuous, albeit reduced, functionality. The formatter and processor of claims 1 and 12 are augmented with error detection, health monitoring, and fallback logic.

On the source side, the formatter continuously monitors the display interface (e.g., CRC errors, dropped packets, DDC/EDID capability negotiation failures). If critical errors are detected in the "second portion" of the interface carrying stereoscopic data (e.g., depth information loss), or if the sink device signals a degraded state, the formatter initiates a fail-safe sequence. It gracefully transitions from the "second mode" (multiplexed stereoscopic) to the "first mode" (2D image generation) as described in claim 1. This is achieved by ceasing to multiplex the stereoscopic components and instead sending only the 2D base image data within the standard data elements. Signaling information, explicitly indicating the transition to "2D Fallback Mode" and the reason for the fallback, is sent via robust auxiliary data elements (e.g., dedicated HDMI Data Island Packets marked with a high priority).

On the sink side, the processor continuously monitors incoming signaling and data integrity. Upon receiving the "2D Fallback Mode" signal or detecting a severe degradation in the stereoscopic data stream (e.g., corrupted depth maps), it automatically switches its operation from demultiplexing stereoscopic components to simply extracting and displaying the 2D image data. This ensures that the user always receives a viewable image, preventing a black screen or distorted 3D experience in failure scenarios. The system can be configured to attempt re-negotiation for 3D transmission once conditions improve.

stateDiagram
    [*] --> Initializing
    Initializing --> NegotiatingCapabilities: System Boot/Reconnect
    NegotiatingCapabilities --> Full3DMode: Capabilities OK, Bandwidth OK
    NegotiatingCapabilities --> Legacy2DMode: Sink No 3D, or Insufficient Bandwidth
    Full3DMode --> DegradationDetected: Interface Errors, BW Loss, Sink Issue
    DegradationDetected --> Graceful2DFallback: Source Initiates Fallback
    Graceful2DFallback --> Full3DMode: Conditions Recovered, Renegotiate
    Graceful2DFallback --> Legacy2DMode: Persistent Failure or Manual Override
    Legacy2DMode --> Full3DMode: Manual 3D Enable, Capabilities Re-established

---

Combination Prior Art Scenarios

Here are three scenarios combining US 9036010's principles with existing open-source standards to demonstrate broader applicability and potential obviousness of future improvements.

1. HDMI 2.1 with VESA Display Stream Compression (DSC) for Depth Data

Scenario Description:
US Patent 9036010 describes leveraging existing interface capacity, like HDMI deep color modes, to multiplex stereoscopic data and using Data Island Packets for signaling. This scenario combines the patent's core idea with the HDMI 2.1 standard and the VESA Display Stream Compression (DSC) standard. HDMI 2.1 significantly increases bandwidth (up to 48 Gbps) and introduces features like Fixed Rate Link (FRL) and Enhanced Audio Return Channel (eARC). VESA DSC is an open-source, visually lossless compression standard.

Combination: An implementation sends 2D image data over the primary TMDS/FRL channels of an HDMI 2.1 interface. The associated depth information, or the second eye's image data (for L/R formats), is compressed using VESA DSC before being multiplexed into either:
a) The higher-capacity "deep color" pixel packing modes of HDMI 2.1, or
b) Dedicated auxiliary data channels that HDMI 2.1's FRL can carry, beyond what was explicitly defined as Data Island Packets in earlier HDMI versions.
The signaling information, as taught by US 9036010, is embedded within HDMI 2.1 InfoFrames (an evolution of Data Island Packets) to specify the DSC profile used for the stereoscopic components (e.g., DSC bitrate, specific slicing, predictor mode), the 3D format (2D+Depth, L/R), and the decoding parameters. This allows for higher effective stereoscopic resolution or frame rates over the same HDMI 2.1 link by applying a known compression standard to the less critical or redundant 3D components.

2. DisplayPort Alt Mode over USB-C with Side-by-Side Frame Packing and Metadata Packets

Scenario Description:
US Patent 9036010 outlines multiplexing stereoscopic components and using auxiliary data for signaling. DisplayPort (DP) is another digital display interface, and USB-C with DisplayPort Alt Mode allows DP signals to be carried over a USB-C cable. The patent mentions "schemes which send left eye image data and right eye image data" and "signaling information...carried in a horizontal or vertical blanking period and for a High Definition Multimedia Interface (HDMI) the signaling information can be sent in a Data Island Packet."

Combination: A system uses DisplayPort Alt Mode over USB-C to transmit stereoscopic video. Instead of solely relying on deep color modes, the system employs a "side-by-side" or "top-and-bottom" frame packing method, a common open-source approach for 3D content, where the left and right eye images are scaled and placed adjacent within a single standard 2D video frame. The key innovation from US 9036010 is applied to metadata transmission: custom DisplayPort "Secondary Data Packets" (analogous to HDMI Data Island Packets) sent during the Horizontal Blanking Interval (HBI) or Vertical Blanking Interval (VBI) are used to carry rich signaling information. This signaling explicitly defines:
a) The precise geometry of the side-by-side/top-and-bottom packing (e.g., scaling factor, aspect ratio adjustments).
b) Parallax and convergence metadata for the 3D display to optimize depth perception.
c) Any embedded depth maps that complement the 2D side-by-side images, multiplexed into unused pixel data capacity within the blanking interval or allocated specific portions of the active frame (similar to the WOWvx format mentioned in the patent's background, but explicitly using DP's metadata capabilities for signaling).
This combines a common open 3D framing method with the patent's intelligent signaling over auxiliary channels for enhanced capability and flexibility.

3. OpenCAPI/CCIX as a Heterogeneous DDI for Distributed 3D Processing

Scenario Description:
US Patent 9036010 describes a "digital display interface" and refers to "a first audio-visual device" and "a second audio-visual device." While it implicitly assumes a dedicated display interface, the principles can extend to more generalized, high-speed interconnects. OpenCAPI (Open Coherent Accelerator Processor Interface) and CCIX (Cache Coherent Interconnect for Accelerators) are open-source, high-speed, cache-coherent interconnect standards designed for heterogeneous computing, linking CPUs with accelerators (like GPUs, FPGAs).

Combination: Consider a scenario where a high-performance rendering server (first AV device) streams complex volumetric stereoscopic data to a specialized 3D display controller (second AV device) for an advanced autostereoscopic or holographic display. Instead of a traditional display interface, an OpenCAPI or CCIX link is used as the "digital display interface."
The formatter on the rendering server multiplexes the stereoscopic data, which in this case might be raw point clouds, voxel data, or light field parameters (rather than pixel data), into the memory-mapped coherent transactions of OpenCAPI/CCIX. The "deep color modes" analogy extends to utilizing the high-bandwidth, low-latency, and cache-coherent nature of these interconnects to effectively stream large chunks of 3D volumetric data. Signaling information, indicating the 3D data format (e.g., voxel resolution, point cloud density, light field array parameters), rendering instructions, and synchronization metadata, is communicated via specific memory-mapped registers or doorbell mechanisms accessible through the coherent interconnect. This allows for distributed, high-fidelity 3D rendering where the initial stereoscopic components are not necessarily pixels but fundamental 3D scene descriptors, efficiently transported over a highly advanced, open-standard, heterogeneous computing interconnect.