Patent 11129591
Derivative works
Defensive disclosure: derivative variations of each claim designed to render future incremental improvements obvious or non-novel.
Active provider: Google · gemini-2.5-flash
Derivative works
Defensive disclosure: derivative variations of each claim designed to render future incremental improvements obvious or non-novel.
The USPTO search confirms that US Patent 11129591 is active and expires on September 3, 2038. It also confirms the inventors and assignee. The search also brought up general information about USPTO's search capabilities and news, but no specific contradictory information regarding patent 11129591.
Defensive Disclosure Document for US Patent 11129591
Current Date: April 26, 2026
Target Patent: US11129591B2, "Echocardiographic image analysis"
Objective: To establish comprehensive prior art against future incremental improvements related to echocardiographic image analysis and neural network training, thereby rendering such improvements obvious or non-novel. This document details derivative variations of the core claims across multiple technical axes.
Derivative Variations for Claim 1 (Computer-implemented system for facilitating echocardiographic image analysis)
Core Claim 1: A computer-implemented system with at least one processor configured to receive echocardiographic images, associate them with view categories, determine view-category-specific quality assessment values, and produce signals for associating these values with the images, for both a first and a different second image/view category.
1. Material & Component Substitution
Derivative 1.1: Alternative Imaging Modality with Specialized Transducer Array and Processing Unit
- Enabling Description: This variation describes a computer-implemented system for facilitating cardiac image analysis that replaces the traditional piezoelectric ultrasound transducer with a matrix array transducer composed of single-crystal relaxor ferroelectric materials (e.g., Lead Magnesium Niobate-Lead Titanate, PMN-PT) to achieve superior bandwidth and acoustic sensitivity. The raw radiofrequency (RF) data generated by this transducer is acquired and processed by a dedicated field-programmable gate array (FPGA) co-processor, specifically a Xilinx Versal ACAP with integrated digital signal processing (DSP) blocks. This FPGA is programmed for parallel beamforming algorithms, dynamic focusing, and advanced harmonic imaging reconstruction, operating at a data throughput of 40 Gbps. The functionality for "view category association" and "quality assessment" (Claim 1b, 1c) is offloaded to an application-specific integrated circuit (ASIC) featuring a spiking neural network (SNN) architecture. This SNN is implemented using memristor crossbar arrays, enabling ultra-low power neuromorphic computing for real-time inference (sub-millisecond latency) directly at the point of care. The determined quality assessment value is then transmitted wirelessly via a low-power Bluetooth Low Energy (BLE) 5.2 module (e.g., Nordic nRF52 series) to a user interface display utilizing electro-wetting display (EWD) technology (e.g., from Liquavista), offering superior contrast ratio (>15:1) and readability under varying ambient light conditions compared to conventional LCDs.
- Mermaid Diagram:
graph TD A[PMN-PT Matrix Transducer] --> B(Raw RF Data Stream); B --> C{Xilinx Versal ACAP FPGA Co-processor}; C -- Beamforming/Harmonic Imaging --> D[Reconstructed Cardiac Image (RF/B-mode)]; D --> E{ASIC with Memristor SNN}; E -- View Category / Quality Assessment Inference --> F[Quality Assessment Value]; F -- BLE 5.2 Transmission --> G[EWD User Interface Display];
Derivative 1.2: Optoacoustic Imaging with Photon Counting Detectors and Quantum Computing for Analysis
- Enabling Description: A computer-implemented system for facilitating cardiac image analysis using optoacoustic (photoacoustic) imaging. The "signals representing a first at least one echocardiographic image" (Claim 1a) are derived from photoacoustic waves generated by pulsed laser illumination of tissue. A tunable nanosecond Nd:YAG laser (e.g., operating at 532 nm and 1064 nm) delivers pulses to the region of interest. The acoustic response is detected by a high-bandwidth capacitive micromachined ultrasonic transducer (CMUT) array (e.g., 5-10 MHz bandwidth) coupled with a photon-counting detector array to enhance signal-to-noise ratio at low optical fluences. Image reconstruction is performed on a custom GPU cluster (e.g., NVIDIA A100 GPUs) utilizing a hybrid delay-and-sum and inverse acoustic wave propagation algorithm. The "view category specific quality assessment" (Claim 1c) is determined by a quantum computing module, specifically an IBM Quantum System executing a variational quantum classifier (VQC) algorithm on superconducting transmon qubits. The VQC is configured to analyze quantum feature embeddings of image characteristics (e.g., tissue oxygenation levels, microvascular density) against predetermined cardiac view templates. The quantum processor interfaces with classical control electronics at cryogenic temperatures. The probabilistic quality assessment value output is securely transmitted over an encrypted quantum key distribution (QKD) channel to a remote clinical workstation for display and further analysis.
- Mermaid Diagram:
graph TD A[Tunable Pulsed Nd:YAG Laser] --> B(Cardiac Tissue); B -- Photoacoustic Waves --> C[CMUT Array + Photon-Counting Detectors]; C --> D{GPU Cluster - Optoacoustic Reconstruction}; D[Optoacoustic Image Data] --> E{IBM Quantum System (VQC)}; E -- Qubit Measurement / Classification --> F[Probabilistic Quality Assessment Value]; F -- QKD Encrypted Channel --> G[Remote Clinical Workstation];
2. Operational Parameter Expansion
Derivative 1.3: Micro-Echocardiography for Zebrafish Embryo Cardiac Analysis with Extreme High-Frequency Ultrasound
- Enabling Description: This system is configured for micro-echocardiographic image analysis, specifically tailored for cardiovascular phenotyping in developing zebrafish embryos. The "at least one echocardiographic image" (Claim 1a) is acquired using a micro-electromechanical systems (MEMS) based ultrasound transducer operating at extreme high frequencies (e.g., 50 MHz to 150 MHz), achieving lateral resolutions of 30 µm and axial resolutions of 10 µm. The image acquisition frame rate is elevated to 5000 frames per second (fps) to accurately capture the rapid cardiac cycles (200-300 beats per minute) of embryonic zebrafish. The "view category specific quality assessment" neural network (Claim 1c) is a specialized convolutional LSTM (ConvLSTM) architecture, trained on a dataset of micro-ultrasound images of zebrafish hearts across standard embryonic cardiac views (e.g., ventricular long-axis, atrial short-axis, outflow tract). The quality assessment value specifically evaluates quantitative metrics such as end-diastolic and end-systolic volumes, fractional shortening, myocardial wall thickness, and detection of pericardial effusion, all with sub-millimeter precision essential for developmental cardiotoxicity studies. The transducer and embryo holder are actively cooled to maintain physiological temperature during prolonged imaging sessions, and data is streamed via a high-speed data acquisition (DAQ) card with sustained 10 Gbps PCIe throughput.
- Mermaid Diagram:
graph TD A[MEMS 50-150MHz Transducer] --> B(Zebrafish Embryo); B -- 5000 fps Raw Data --> C{High-Speed DAQ (10 Gbps)}; C --> D[Micro-Echocardiographic Image (10-30 µm res)]; D --> E{ConvLSTM Neural Network (Zebrafish Cardiac Views)}; E -- Quantitative Quality Assessment (µm precision) --> F[Developmental Biology Workstation];
Derivative 1.4: Real-time, Ultra-High Pressure Echocardiography for Deep-Sea Marine Mammal Monitoring
- Enabling Description: The system is adapted for deployment in extreme oceanic environments for real-time cardiac monitoring of deep-diving marine mammals. The ultrasound transducer, operating at frequencies optimal for large animal penetration (0.5 MHz to 2 MHz), is encapsulated within a pressure-compensated titanium alloy casing (e.g., Ti-6Al-4V) capable of withstanding hydrostatic pressures up to 30 MPa (approximately 300 atmospheres) and temperatures ranging from -2°C to 4°C. The transducer employs a custom-designed 1-3 piezocomposite array with a robust, pressure-resistant polymer lens (e.g., a specific grade of polyurethane). "Signals representing a first at least one echocardiographic image" (Claim 1a) are transmitted via a hybrid fiber-optic and electrical umbilical cable to a remotely operated vehicle (ROV) or autonomous underwater vehicle (AUV). The "at least one processor" (Claim 1) is housed in the ROV/AUV's pressure vessel, featuring hardened components. The "view category specific quality assessment" neural network is trained on a synthetic dataset augmented with images from simulated or ex vivo marine mammal hearts under varying pressure and hypoxic conditions. The quality assessment value provides real-time indicators of cardiac output, blood flow velocity through major vessels, and valvular function, crucial for understanding diving physiology and health status. Data storage utilizes radiation-hardened, non-volatile solid-state drives (e.g., based on NAND flash).
- Mermaid Diagram:
graph TD A[Titanium Pressure Housing] --> B(Piezocomposite Transducer Array); B -- Low-Frequency Acoustic Waves --> C(Deep-Sea Marine Mammal); C -- Fiber-Optic/Electrical Link --> D{ROV/AUV Hardened Processor}; D --> E[Sub-Aqua Echocardiographic Image Data]; E --> F{Neural Network (Marine Mammal Cardiac Views, Pressure-Adapted)}; F -- Cardiac Function/Health Assessment --> G[Radiation-Hardened Data Storage]; G --> H[Surface Control Station (Telemetry)];
3. Cross-Domain Application
Derivative 1.5: Industrial Weld Quality Assessment using Ultrasonic Phased Array for Automotive Manufacturing
- Enabling Description: The computer-implemented system is repurposed for non-destructive testing (NDT) in automated industrial manufacturing, specifically for real-time quality assessment of robotic resistance spot welds in automotive chassis fabrication. The "signals representing a first at least one echocardiographic image" (Claim 1a) are replaced by ultrasonic phased array data (A-scan, B-scan, and C-scan representations) obtained from critical weld points. A 5-15 MHz ultrasonic phased array transducer (e.g., Olympus 16L64-AW type) is integrated into a robotic arm end-effector, ensuring consistent contact. The "plurality of predetermined echocardiographic image view categories" (Claim 1b) corresponds to distinct industrial weld configurations (e.g., single spot weld on two layers of 1.5 mm galvanized steel, seam weld on 2.0 mm aluminum alloy, lap joint with known material stack-up) and associated reference defect profiles. The "view category specific quality assessment" neural network (Claim 1c) is a hybrid convolutional-recurrent network, trained on a comprehensive dataset of labeled ultrasonic weld images, where labels include various defect types (e.g., porosity, insufficient penetration, expulsion, brittle fracture) and their severity, verified by destructive metallurgical testing. The quality assessment value (e.g., a score from 0 to 1 indicating weld integrity) is fed directly to the manufacturing execution system (MES) to trigger immediate robotic arm parameter adjustments or flag the weld for human visual and radiographic inspection, optimizing production line efficiency and safety.
- Mermaid Diagram:
graph TD A[Robotic Phased Array Transducer (5-15MHz)] --> B(Resistance Spot Weld); B -- Ultrasonic Echo Signals --> C{Ultrasonic Data Acquisition/Reconstruction}; C --> D[Ultrasonic Weld Image (A/B/C-Scan)]; D --> E{Hybrid Conv-RNN (Weld Configuration Specific)}; E -- Weld Integrity Score --> F[Manufacturing Execution System (MES)]; F -- Robotic Adjustment / Inspection Flag --> G[Automotive Production Line];
Derivative 1.6: Subsurface Infrastructure Health Monitoring using Ground Penetrating Radar (GPR)
- Enabling Description: The system is applied to civil engineering for monitoring the structural integrity and identifying anomalies in subsurface infrastructure. The "signals representing a first at least one echocardiographic image" (Claim 1a) are replaced by raw radar traces and subsequently processed radargrams generated from a multi-frequency (e.g., 400 MHz, 900 MHz, 2.5 GHz) Ground Penetrating Radar (GPR) antenna array (e.g., GSSI StructureScan Mini XT). This array is mounted on an autonomous inspection robot or vehicle. The "plurality of predetermined echocardiographic image view categories" (Claim 1b) now represents different subsurface material compositions (e.g., reinforced concrete with varying rebar density, asphalt over gravel base, soil strata with utility conduits) and expected structural features (e.g., intact rebar, typical utility pipe, known void signature). The "view category specific quality assessment" neural network is a 3D convolutional network, trained on extensive GPR datasets correlated with ground-truth data from core samples, excavations, or known construction blueprints. The quality assessment value (e.g., an anomaly index or structural integrity score) indicates the presence and severity of structural defects (e.g., concrete delamination, rebar corrosion, pipe leaks, unknown voids) or the accurate mapping of buried utilities. This information is displayed in a geospatial information system (GIS) for infrastructure management.
- Mermaid Diagram:
graph TD A[Multi-Frequency GPR Antenna Array] --> B(Subsurface Infrastructure); B -- Radar Echo Signals --> C{GPR Processing Unit (Radargram Generation)}; C --> D[GPR Radargram (Subsurface Cross-section)]; D --> E{3D CNN (Subsurface Material/Structure Specific)}; E -- Anomaly Index / Structural Integrity Score --> F[Geospatial Information System (GIS)]; F --> G[Predictive Maintenance & Repair Scheduling];
Derivative 1.7: Agricultural Crop Health Assessment via Hyperspectral Imaging for Precision Farming
- Enabling Description: This computer-implemented system is tailored for precision agriculture, providing automated, view-category-specific assessment of crop health. The "signals representing a first at least one echocardiographic image" (Claim 1a) are replaced by hyperspectral image (HSI) cubes acquired by a drone-mounted or satellite-based hyperspectral sensor (e.g., Headwall Nano-Hyperspec sensor) providing spectral data across 270 narrow bands from 400 nm to 1000 nm. The "plurality of predetermined echocardiographic image view categories" (Claim 1b) corresponds to specific crop types (e.g., corn, wheat, soybean), distinct growth stages (e.g., vegetative, flowering, senescence), and characteristic disease or stress manifestations (e.g., nitrogen deficiency, fungal infection, water stress). The "view category specific quality assessment" neural network is a recurrent convolutional neural network (R-CNN) specifically designed to process spectral-spatial information, trained on a vast library of labeled hyperspectral signatures linked to ground-truthed plant physiological states and disease severity scores. The quality assessment value quantifies specific parameters such as normalized difference vegetation index (NDVI), chlorophyll content, water stress index, or pathogen severity. This output directly informs variable-rate application maps for precision fertilizer, pesticide, or irrigation systems, optimizing resource use and crop yield.
- Mermaid Diagram:
graph TD A[Drone/Satellite HSI Sensor] --> B(Agricultural Field); B -- Hyperspectral Data Cube --> C{HSI Preprocessing & Radiometric Correction}; C --> D[Hyperspectral Image (Spectral-Spatial)]; D --> E{R-CNN (Crop Type/Growth Stage/Disease Specific)}; E -- Crop Health Metrics (NDVI, Chlorophyll, Disease Severity) --> F[Precision Farming Management Platform]; F --> G[Variable-Rate Application System];
4. Integration with Emerging Tech
Derivative 1.8: AI-driven Optimization with IoT-enabled Feedback Loop and Blockchain-verified Training Data
- Enabling Description: This system for echocardiographic image analysis incorporates real-time AI-driven optimization, IoT sensing, and blockchain for data integrity. "Signals representing a first at least one echocardiographic image" (Claim 1a) are acquired by an IoT-enabled ultrasound transducer (e.g., Clarius C3 HD3) equipped with integrated inertial measurement units (IMUs), force sensors for probe pressure, and patient position trackers. The "view category specific quality assessment value" (Claim 1c) is determined by an on-device neural network and is simultaneously fed into a proprietary generative adversarial network (GAN)-based AI optimization engine. This engine, running on a local GPU, generates real-time, context-aware recommendations for optimal transducer adjustments (e.g., angulation, rotation, depth, gain, frequency) which are presented to the sonographer via an augmented reality (AR) overlay on the ultrasound display. The training dataset for the neural networks (as per Claim 20) is immutably stored and managed on a permissioned blockchain ledger (e.g., Hyperledger Fabric). Expert quality assessment values and associated image metadata are cryptographically signed by certified echocardiographers and time-stamped as transactions on the ledger, ensuring data provenance, preventing tampering, and providing an auditable history for regulatory compliance. Furthermore, the AI optimization suggestions, along with the sonographer's acceptance or rejection of these suggestions, are also logged as transactions on the blockchain to continuously refine the GAN's recommendation model and improve its efficacy.
- Mermaid Diagram:
graph TD A[IoT-enabled Transducer (IMU, Force Sensors)] --> B(Echocardiographic Image + Sensor Data); B --> C{On-Device View Category NN}; B --> D{On-Device Quality Assessment NN}; C & D --> E(Quality Assessment Value); E --> F{AI Optimization Engine (GAN) - Real-time Recs}; F -- AR Overlay Display --> G[Sonographer]; G -- Accepted/Rejected Adjustments --> H(Blockchain Ledger); H -- Verified Training Data --> I[Neural Network Trainer (Claim 20)]; I --> C & D;
5. The "Inverse" or Failure Mode
Derivative 1.9: Low-Power, Limited-Functionality "Screening Mode" with Safe-Failure Protocols
- Enabling Description: This variation implements a "low-power screening mode" within the echocardiographic image analysis system, designed for rapid, preliminary cardiac assessment in austere, remote, or resource-limited environments. In this mode, the "at least one processor" (Claim 1) is a highly power-optimized ARM Cortex-M microcontroller (e.g., STM32L series) operating at a significantly reduced clock frequency. Non-essential peripherals and high-resolution imaging capabilities are disabled. The "view category specific quality assessment" neural network (Claim 1c) is replaced by a highly compressed and quantized neural network model (e.g., an 8-bit integer quantized MobileNetV3 architecture) with a drastically reduced parameter count, specifically optimized for binary classification: "adequate for basic screening" vs. "requires expert review/higher fidelity imaging." This quantization reduces computational and memory demands, extending battery life significantly (e.g., 24+ hours on a single charge). If the image quality determined by this simplified model falls below a pre-defined critical threshold for "adequate for basic screening," the system initiates a "safe-failure" protocol: it automatically saves the last 'N' (e.g., 5-10) low-resolution images and their associated metadata to a tamper-proof, non-volatile memory (e.g., secure eMMC). Concurrently, it displays a prominent "RE-SCAN REQUIRED: PROCEED TO ADVANCED IMAGING" message on a low-power monochromatic e-paper display and transmits a low-bandwidth alert (e.g., via LoRaWAN or NB-IoT) to a central telehealth monitoring station, providing an anonymized error code and location without patient-identifying data. The system automatically enters a diagnostic deep-sleep state if battery levels drop below a critical operational threshold, preventing data corruption or incomplete assessments.
- Mermaid Diagram:
graph TD A[Low-Power Transducer] --> B(Reduced Resolution Image Stream); B --> C{ARM Cortex-M Microcontroller}; C --> D{Quantized MobileNetV3 (Binary Quality Assessment)}; D -- "Adequate / Requires Re-scan" --> E[Monochromatic E-paper Display]; E -- Low Quality Trigger --> F{Safe-Failure Protocol}; F -- Save N Low-Res Images --> G(Tamper-Proof eMMC); F -- LoRaWAN/NB-IoT Alert --> H[Central Telehealth Monitoring Station]; C -- Critical Battery Level --> I(Diagnostic Deep-Sleep State);
Derivative Variations for Claim 20 (Computer-implemented system for training neural networks)
Core Claim 20: A computer-implemented system with at least one processor configured to receive echocardiographic training images (with view categories), receive expert quality assessment values (view-category-specific), and train neural networks using this data to determine network parameters, with at least a portion of each network associated with a view category.
1. Material & Component Substitution
Derivative 2.1: Federated Learning Framework with Homomorphic Encryption for Expert Feedback
- Enabling Description: This variation describes a computer-implemented system for training neural networks that utilizes a federated learning paradigm, enabling collaborative model training across multiple healthcare institutions while preserving strict data privacy. Instead of receiving "signals representing expert quality assessment values" (Claim 20b) directly at a central server, local clinical workstations (edge devices) at each institution perform initial, decentralized training steps. Each edge device contains powerful GPUs (e.g., NVIDIA H100) and processes its local "plurality of echocardiographic training images" and "expert quality assessment values." To ensure patient privacy and expert confidentiality, these expert quality assessment values and corresponding local model updates (e.g., gradients or weights) are homomorphically encrypted using a fully homomorphic encryption (FHE) library based on the Brakerski/Fan-Vercauteren (BFV) scheme before transmission. A central "trainer processor" (Claim 20) then performs encrypted aggregation of these homomorphically encrypted model updates from numerous participating institutions without ever decrypting the raw expert assessments or patient images. The "neural networks" are trained iteratively on these encrypted aggregates, generating updated "sets of neural network parameters" that are robust and generalized across a diverse, global clinical dataset while adhering to stringent privacy regulations (e.g., HIPAA, GDPR).
- Mermaid Diagram:
graph TD subgraph Local Clinical Workstation 1 (Edge) A[Training Images 1 + Expert QAV 1] --> B{FHE Module (BFV Scheme)}; B --> C(Local Model Training); C -- Encrypted Model Update --> D(Secure Channel); end subgraph Local Clinical Workstation N (Edge) E[Training Images N + Expert QAV N] --> F{FHE Module (BFV Scheme)}; F --> G(Local Model Training); G -- Encrypted Model Update --> H(Secure Channel); end D & H --> I{Central Trainer Processor (Encrypted Aggregation)}; I -- Iterative Encrypted Training --> J[Globally Optimized FHE-trained NN Parameters]; J --> K[Secure Model Distribution];
Derivative 2.2: Quantum-Annealing-Accelerated Neural Network Training with Superconducting Qubits
- Enabling Description: This computer-implemented system for training neural networks leverages quantum annealing for accelerated optimization of neural network parameters. The "training the neural networks" (Claim 20c) involves framing the optimization of specific "sets of neural network parameters" (e.g., weights and biases of the shared convolutional layers or fully connected layers) as a Quadratic Unconstrained Binary Optimization (QUBO) problem. A D-Wave Advantage quantum annealer, utilizing superconducting flux qubits, is employed to find the ground state (optimal solution) or near-ground states of this QUBO problem. The "expert quality assessment values" (Claim 20b) are integrated into the cost function of the QUBO problem, where lower energy states directly correlate with improved model performance against expert labels. The classical "trainer processor" (Claim 20) manages the preprocessing of "echocardiographic training images" (Claim 20a) and expert labels, converts relevant neural network sub-problems into QUBO instances for the quantum annealer, orchestrates the annealing process, and then interprets the quantum annealing results to iteratively refine the neural network parameters in conjunction with classical backpropagation for other layers. This hybrid approach aims to mitigate issues like local minima and potentially accelerate convergence for complex, high-dimensional parameter spaces.
- Mermaid Diagram:
graph TD A[Training Images + Expert QAV] --> B{Classical Preprocessing Unit}; B -- Formulate QUBO Problem --> C{D-Wave Advantage Quantum Annealer}; C -- Annealing Results (Parameter Candidates) --> D{Classical Post-processing / Backpropagation Unit}; D -- Iteratively Refined NN Parameters --> E[Hybrid NN Model Storage]; E --> F[Neural Network Deployment];
2. Operational Parameter Expansion
Derivative 2.3: Massive-Scale Distributed Training for Global Echocardiography Datasets (Exascale Computing)
- Enabling Description: This system is designed for training neural networks on an unprecedented scale, capable of processing petabytes of "echocardiographic training images" sourced from a global consortium of medical institutions. The "at least one processor" (Claim 20) represents an exascale computing environment, comprising millions of CPU cores and hundreds of thousands of specialized AI accelerators (e.g., GPUs, TPUs) interconnected by a high-bandwidth, low-latency InfiniBand EDR or custom optical network fabric. The "plurality of echocardiographic training images" (Claim 20a) could be in the order of billions, necessitating advanced data sharding, dynamic load balancing, and fault-tolerant distributed training algorithms (e.g., Asynchronous Stochastic Gradient Descent with parameter servers, communication-avoiding gradient compression techniques). The "expert quality assessment values" (Claim 20b) are generated through a meticulously standardized, multi-national, consensus-based labeling protocol involving numerous expert echocardiographers, ensuring consistency across diverse data sources. The training process employs customized PyTorch Distributed or JAX/XLA frameworks to optimize for exascale parallelism, allowing the determination of "sets of neural network parameters" for highly robust and generalizable models that account for significant variability in patient demographics, imaging device manufacturers, and acquisition protocols.
- Mermaid Diagram:
graph TD subgraph Global Data Sources A[Hospital A (Images/QAVs)] --> D; B[Clinic B (Images/QAVs)] --> D; C[Research Lab C (Images/QAVs)] --> D; end D[Petabytes of Standardized Training Data] --> E{Exascale Computing Cluster (Millions Cores/Accelerators)}; E -- Distributed Training (PyTorch/JAX) --> F[Globally Optimized, Generalizable NN Parameters]; F --> G[Central Model Repository (Version Control)];
Derivative 2.4: Ultra-Low Latency, On-Device Retraining for Adaptive Patient-Specific Models
- Enabling Description: This system focuses on enabling ultra-low latency, continuous on-device retraining of neural networks for patient-specific echocardiographic image analysis. The "at least one processor" (Claim 20) is an integrated edge AI chip (e.g., Google Edge TPU, NVIDIA Jetson Orin Nano) directly embedded within a portable ultrasound device. "Echocardiographic training images" (Claim 20a) are local scans from the current patient, and "expert quality assessment values" (Claim 20b) are provided by the clinician in near real-time (e.g., via a touch interface) immediately after image acquisition. The training process, "train the neural networks" (Claim 20c), utilizes incremental learning combined with federated transfer learning or meta-learning techniques (e.g., MAML). This allows the pre-trained global model on the device to rapidly adapt its "view category specific portions" to the unique anatomical characteristics, physiological variations, or specific echogenicity of an individual patient, or to learn the subtle nuances of transducer manipulation by the current operator. The retraining cycle, from expert input to updated model parameters, completes within milliseconds to a few seconds, providing real-time personalized model improvements without requiring cloud connectivity. This ensures that the quality assessment is continuously optimized for the specific context of the current patient and operator.
- Mermaid Diagram:
graph TD subgraph Portable Ultrasound Device A[Live Echocardiographic Image] --> B(On-Device Inference Model); C[Clinician Expert QAV (Real-time Input)] --> D(Edge AI Chip - Adaptive Retraining Module); B & C --> D; D -- Incremental Model Update (ms-s latency) --> B; B --> E[Real-time Patient-Specific Quality Feedback]; end
3. Cross-Domain Application
Derivative 2.5: Training Neural Networks for Satellite Imagery Classification in Environmental Monitoring
- Enabling Description: The computer-implemented system for training neural networks is adapted for environmental monitoring through satellite imagery. The "plurality of echocardiographic training images" (Claim 20a) is replaced by multi-temporal, multi-spectral, and hyper-spectral satellite image data (e.g., from Sentinel-2, Landsat-8/9, MODIS) covering diverse geographic regions globally. The "plurality of predetermined echocardiographic image view categories" (Claim 20a) are analogous to environmental land cover and land use classes, such as "deforested area," "healthy forest canopy," "urban impervious surface," "water body with algal bloom," "wetland ecosystem," or "agricultural land with specific crop type." "Expert quality assessment values" (Claim 20b) are provided by environmental scientists, remote sensing specialists, or validated ground-truthing campaigns, labeling image segments based on ecological health indices, biomass estimations, or identified environmental anomalies. The "at least one processor" (Claim 20) trains specialized deep learning architectures (e.g., U-Net, DeepLabV3+ with spatial-temporal attention mechanisms) to determine "sets of neural network parameters" for accurate pixel-wise classification and semantic segmentation of these environmental categories. Portions of the neural networks are specifically tailored for different sensor modalities (e.g., optical vs. SAR), atmospheric conditions, or specific biomes.
- Mermaid Diagram:
graph TD A[Multi-Temporal Satellite Images (Sentinel, Landsat)] --> B(Environmental Scientist Expert Labels); B -- Land Cover/Use Categories (e.g., Forest, Urban, Water) --> C{Neural Network Trainer (DeepLabV3+/U-Net)}; C -- Train Modality/Biome-Specific NN Portions --> D[Environmental Monitoring NN Parameters]; D --> E[Global Land Cover Atlas & Change Detection System];
Derivative 2.6: Training Neural Networks for Defect Detection in Semiconductor Manufacturing
- Enabling Description: This computer-implemented system for training neural networks is repurposed for automated defect detection in semiconductor manufacturing. The "plurality of echocardiographic training images" (Claim 20a) are replaced by high-resolution images acquired from various in-line inspection tools, including brightfield optical microscopes (e.g., KLA-Tencor), scanning electron microscopes (SEM), and atomic force microscopes (AFM) performing wafer-level metrology. These images capture critical features at different fabrication stages (e.g., after lithography, etch, deposition, chemical-mechanical planarization). The "plurality of predetermined echocardiographic image view categories" (Claim 20a) now corresponds to specific manufacturing layers or inspection steps (e.g., "polysilicon gate layer," "metal interconnect layer 3," "shallow trench isolation"), each having a distinct pattern and expected defect types. "Expert quality assessment values" (Claim 20b) are derived from experienced semiconductor engineers, process technicians, or high-accuracy automated defect classification (ADC) systems, labeling defects based on type (e.g., particle, scratch, bridge, void, pattern collapse), size, and location, with severity scores impacting device yield. The "at least one processor" trains specialized convolutional autoencoders or Vision Transformers (ViT) to determine "sets of neural network parameters" for robust detection and classification of microscopic defects, leading to real-time process control adjustments and significant yield improvements.
- Mermaid Diagram:
graph TD A[Microscope/SEM/AFM Wafer Images] --> B(Semiconductor Engineer Expert Labels); B -- Fabrication Layer Categories (e.g., Lithography, Interconnect) --> C{Neural Network Trainer (Conv Autoencoder/ViT)}; C -- Train Layer-Specific NN Portions --> D[Defect Detection NN Parameters]; D --> E[Semiconductor Fabrication Process Control System];
Derivative 2.7: Training Neural Networks for Material Science Characterization (Microstructure Analysis)
- Enabling Description: The training system is adapted for material science research and industrial quality control, specifically for automated characterization of material microstructures. The "plurality of echocardiographic training images" (Claim 20a) are replaced by high-magnification images obtained from advanced microscopy techniques such as electron backscatter diffraction (EBSD) for crystallographic orientation, scanning transmission electron microscopy (STEM) for atomic-scale features, or X-ray microtomography (XMT) for 3D volumetric analysis of various material samples (e.g., superalloys, advanced ceramics, polymer composites). The "plurality of predetermined echocardiographic image view categories" (Claim 20a) corresponds to distinct microstructural features or phases, such as "ferrite grains," "austenite twins," "martensite laths," "grain boundary networks," "precipitate phases," or "void distributions." "Expert quality assessment values" (Claim 20b) are provided by metallurgists, material scientists, or image analysis specialists, annotating and quantifying critical microstructural parameters (e.g., grain size, phase fraction, defect density, aspect ratio) from these images, often correlated with mechanical properties or performance. The "at least one processor" trains specialized graph convolutional networks (GCN) or deep residual networks (ResNet) to determine "sets of neural network parameters" for automated identification, segmentation, and quantification of these microstructural features, accelerating materials discovery, process optimization, and failure analysis.
- Mermaid Diagram:
graph TD A[EBSD/STEM/XMT Material Images] --> B(Metallurgist/Scientist Expert Labels); B -- Microstructural Feature Categories (e.g., Grain Boundary, Precipitate Phase) --> C{Neural Network Trainer (GCN/ResNet)}; C -- Train Feature-Specific NN Portions --> D[Material Characterization NN Parameters]; D --> E[Automated Materials Design & Quality Control Platform];
4. Integration with Emerging Tech
Derivative 2.8: Decentralized Training with Confidential Computing and AI Explainability for Regulatory Compliance
- Enabling Description: This computer-implemented system for training neural networks is designed for decentralized collaborative training across multiple hospitals or research centers, prioritizing data privacy and regulatory compliance. Each participating institution utilizes a secure "confidential computing enclave" (e.g., Intel SGX or AMD SEV technology) for local processing of its "plurality of echocardiographic training images" (Claim 20a) and "expert quality assessment values" (Claim 20b). Within this enclave, local model training occurs, ensuring that raw, sensitive patient data and expert annotations are never exposed outside the trusted execution environment. Only anonymized and aggregated model updates (e.g., gradient vectors or encrypted parameter deltas) are then shared with a central "trainer processor" (Claim 20). Furthermore, the training pipeline integrates AI Explainability (XAI) techniques (e.g., LIME, SHAP, integrated gradients) during the parameter determination process. This generates human-understandable justifications and feature importance maps for the "sets of neural network parameters," demonstrating why the model makes certain quality assessments. These XAI outputs, along with all data contributions and model updates, are immutably recorded as transactions on a distributed ledger technology (DLT) (e.g., Ethereum blockchain or a private consortium chain). This DLT provides a transparent and auditable record for regulatory bodies (e.g., FDA, EMA) to verify model integrity, data provenance, and ethical AI development in a highly regulated medical domain.
- Mermaid Diagram:
graph TD subgraph Decentralized Training Node A A[Training Images A + Expert QAV A] --> B{Confidential Compute Enclave A}; B -- Anonymized Model Update A + XAI Log A --> D(DLT Ledger); end subgraph Decentralized Training Node B C[Training Images B + Expert QAV B] --> E{Confidential Compute Enclave B}; E -- Anonymized Model Update B + XAI Log B --> D; end D --> F{Central Aggregator / Trainer Processor}; F -- Consolidated Training --> G[Explainable & Auditable NN Parameters]; G --> H[Regulatory Compliance Platform (DLT Verification)];
5. The "Inverse" or Failure Mode
Derivative 2.9: Adversarial Training for Robustness Against Intentional Image Degradation (Cybersecurity Focus)
- Enabling Description: This variation of the computer-implemented system for training neural networks explicitly focuses on developing robustness against intentional image degradation or adversarial attacks. The "training the neural networks" (Claim 20c) incorporates an adversarial training loop involving a generative adversarial network (GAN). The "generator" component of the GAN acts as an "adversary," learning to produce subtle, imperceptible perturbations (adversarial examples) to the "echocardiographic training images" (Claim 20a). These perturbations are designed to mislead the "image quality assessment neural network" (acting as the "discriminator" in this GAN setup), causing it to output incorrect "quality assessment values." The "trainer processor" (Claim 20) then iteratively trains the "discriminator" network using a mix of clean "echocardiographic training images" and these synthetically generated adversarial examples. The objective is to force the discriminator to become highly robust and accurately determine "view category specific quality assessment values" even when presented with inputs that have been subtly manipulated. This enhanced training regimen ensures that the deployed image analysis system can withstand malicious attempts to compromise the integrity of echocardiographic data and maintain reliable diagnostic accuracy in the face of cybersecurity threats.
- Mermaid Diagram:
graph TD subgraph Adversarial Training Loop A[Clean Echocardiographic Images + Expert QAV] --> B{Generator (Adversary)}; B -- Adversarial Perturbations --> C[Adversarial Examples]; C --> D{Image Quality Assessment NN (Discriminator)}; A --> D; D -- Quality Assessment / Adversarial Loss --> E{Trainer Processor}; E -- Update Discriminator & Generator --> D; end D -- Robust & Adversarial-Resistant NN Parameters --> F[Secure Deployment System (Cyberhardened)];
Derivative 2.10: Progressive Degradation Training for Low-Resolution / Compressed Image Inputs
- Enabling Description: This computer-implemented system for training neural networks is specifically designed to create models that maintain high accuracy in "view category specific quality assessment" even when presented with severely degraded or aggressively compressed "echocardiographic training images." The training process (Claim 20c) involves a progressive degradation module that applies various forms of artificial degradation to the original high-fidelity "echocardiographic training images" (Claim 20a). These degradations include, but are not limited to, JPEG/MPEG compression with varying quality factors (e.g., 5% to 80%), Gaussian noise injection with different signal-to-noise ratios (SNRs), resolution downsampling (e.g., from 512x512 to 64x64 pixels), and simulated packet loss or missing pixel data. For each synthetically degraded image, the corresponding "expert quality assessment values" (Claim 20b) are either derived from the original high-fidelity assessment or re-evaluated by experts to reflect the expected quality under that specific degradation. The "at least one processor" then trains the "neural networks" on this diverse dataset of progressively degraded images. This specialized training ensures that the deployed models can provide meaningful and reliable "quality assessment values" even when operating in scenarios with bandwidth constraints (e.g., telemedicine), limited computational resources (e.g., mobile ultrasound), or challenging acquisition conditions.
- Mermaid Diagram:
graph TD A[High-Fidelity Echocardiographic Images] --> B{Progressive Degradation Module}; B -- Degraded Image Versions (Compressed, Noisy, Low-Res) --> C[Expert QAV Re-assessment/Confirmation]; C --> D{Neural Network Trainer}; D -- Train on Degraded & Labeled Data --> E[Robust NN for Degraded Inputs]; E --> F[Telemedicine / Mobile Ultrasound Deployment (Bandwidth-Limited)];
Combination Prior Art Scenarios
Here are at least three scenarios where US Patent 11129591 can be combined with existing open-source standards to establish prior art, demonstrating obviousness for future incremental improvements.
Combination with DICOM (Digital Imaging and Communications in Medicine) Standard for Interoperable Quality Assessment Reporting.
- Description: The computer-implemented system described in US11129591 (specifically Claim 1 and its dependent claims for image analysis) is integrated with the DICOM standard. The "signals representing a first at least one echocardiographic image" (Claim 1a) are received as DICOM Part 10-compliant image files (e.g., US Multi-frame Image Storage SOP Class), ensuring seamless interoperability within existing medical imaging infrastructure (PACS). The "view category" (Claim 1b) is determined either by parsing existing DICOM attributes (e.g.,
(0018,5100) Patient Orientation,(0008,0008) Image Type,(0020,0062) Referenced Image Sequencepointing to view classification definitions) or by automatically generating a new DICOM attribute using a private tag within a standard group. The "first quality assessment value" (Claim 1c) is then generated by the system and encapsulated within a DICOM Structured Report (SR) object (DICOM Part 16, using IOD(0008,0016) ContentCreatorRolewith a standard template such as TID 5200: Echocardiography Report or a custom template if necessary for the quality metric). This SR object is then associated with the original echocardiographic image series via standard DICOM object relationships and stored in a Picture Archiving and Communication System (PACS) or transmitted to an Electronic Health Record (EHR) system, enabling the quality assessment to be readily accessible and machine-readable across healthcare systems. - Open-Source Standard: DICOM (Digital Imaging and Communications in Medicine) Standard (e.g., using DCMTK or pydicom open-source libraries).
- Relevance: DICOM is the fundamental and pervasive standard for medical imaging data exchange and storage. The integration of image analysis results, particularly quality assessments for clinical utility, into DICOM-compliant structures is a logical and obvious extension for any developer working within medical imaging informatics. The patent itself mentions PACS.
- Description: The computer-implemented system described in US11129591 (specifically Claim 1 and its dependent claims for image analysis) is integrated with the DICOM standard. The "signals representing a first at least one echocardiographic image" (Claim 1a) are received as DICOM Part 10-compliant image files (e.g., US Multi-frame Image Storage SOP Class), ensuring seamless interoperability within existing medical imaging infrastructure (PACS). The "view category" (Claim 1b) is determined either by parsing existing DICOM attributes (e.g.,
Combination with OpenCV (Open Source Computer Vision Library) and Keras/TensorFlow for Neural Network Implementation and Image Preprocessing.
- Description: The systems and methods described in US11129591 (specifically Claim 1 for image analysis and Claim 20 for neural network training) extensively rely on neural networks, including convolutional layers, pooling layers, and LSTM layers. The "at least one processor" (Claim 1, 20) utilizes OpenCV (Open Source Computer Vision Library) for essential image preprocessing steps, such as filtering (e.g.,
cv2.medianBlur,cv2.bilateralFilterfor speckle reduction), amplification (e.g.,cv2.normalize), scan-conversion (e.g., geometric transformations usingcv2.warpAffine), and resizing (e.g.,cv2.resize). The "neural networks" (Claim 20c) themselves, including their architecture definition (e.g.,Conv2D,MaxPooling2D,LSTMlayers), the determination of "sets of neural network parameters," and the training process using a "mean absolute error loss function" and "stochastic gradient-based optimization algorithm" (as detailed in the patent), are explicitly implemented using the open-source deep learning framework Keras with a TensorFlow backend. The parameters (weights and biases) determined during training are stored in standard formats like HDF5 (Hierarchical Data Format 5), which is native to Keras for model persistence. - Open-Source Standard: OpenCV (Open Source Computer Vision Library) and Keras/TensorFlow.
- Relevance: The patent explicitly references the use of the "Keras deep learning library with TensorFlowTM backend" for training and testing models. This direct mention, combined with the ubiquitous nature of OpenCV for image processing in any computer vision application, makes the combination of these open-source tools with the described inventive concepts an obvious engineering choice for anyone skilled in the art.
- Description: The systems and methods described in US11129591 (specifically Claim 1 for image analysis and Claim 20 for neural network training) extensively rely on neural networks, including convolutional layers, pooling layers, and LSTM layers. The "at least one processor" (Claim 1, 20) utilizes OpenCV (Open Source Computer Vision Library) for essential image preprocessing steps, such as filtering (e.g.,
Combination with FHIR (Fast Healthcare Interoperability Resources) for Clinical Decision Support System Integration.
- Description: The computer-implemented system for facilitating echocardiographic image analysis (Claim 1) produces "quality assessment values" that are intended to represent "suitability for quantified clinical measurement of anatomical features" and to "assist in diagnosing a medical condition or a characteristic of the heart". To enhance the utility and interoperability of these assessment values within the broader healthcare ecosystem, the system transmits or integrates this information using the FHIR standard. Specifically, the "first quality assessment value" (Claim 1c) and associated contextual data (e.g., patient identifier, study identifier, imaging event timestamp, the determined view category, specific metrics contributing to the quality score) are encapsulated within standard FHIR Resources. For instance, the overall quality assessment could be represented as a
DiagnosticReportResource, while individual component scores (e.g., LV, LA, MV scores, centering, depth, gain assessments as mentioned in the patent) could be represented asObservationResources, linked back to theImagingStudyResource (which references the original DICOM images). This allows the quality assessment data to be consumed by other FHIR-compliant clinical systems, such as Electronic Health Records (EHRs), Clinical Decision Support (CDS) systems, or research databases, enabling automated workflows, improved data integrity checks, and more informed clinical decisions. The communication adheres to FHIR RESTful APIs and uses standard JSON or XML formats. - Open-Source Standard: FHIR (Fast Healthcare Interoperability Resources).
- Relevance: FHIR is rapidly becoming the industry standard for healthcare data exchange, particularly for clinical data intended for real-time use and integration. The generation of a clinically relevant quality assessment value by US11129591 logically leads to its integration into FHIR resources to ensure maximum interoperability and utility, a step that would be considered obvious by a person skilled in the art of health informatics.
- Description: The computer-implemented system for facilitating echocardiographic image analysis (Claim 1) produces "quality assessment values" that are intended to represent "suitability for quantified clinical measurement of anatomical features" and to "assist in diagnosing a medical condition or a characteristic of the heart". To enhance the utility and interoperability of these assessment values within the broader healthcare ecosystem, the system transmits or integrates this information using the FHIR standard. Specifically, the "first quality assessment value" (Claim 1c) and associated contextual data (e.g., patient identifier, study identifier, imaging event timestamp, the determined view category, specific metrics contributing to the quality score) are encapsulated within standard FHIR Resources. For instance, the overall quality assessment could be represented as a
Generated 5/15/2026, 6:47:29 PM