US 11100163

Summary of U.S. Patent 11,100,163

Title: Photographic memory

Assignee: Mimzi LLC

Inventor: James L. Geer

Filing Date: November 29, 2018

Issue Date: August 24, 2021

Abstract: A system and method for collecting data may include a data collection device to obtain the data from a user, an apparatus for obtaining metadata for each word of the data from the user, an apparatus for obtaining a searchable transcript of the data and a device to store the searchable transcript. The metadata may be date data, time data, name data or location data and the data collection device may include a speech recognition engine to translate speech into searchable words. The speech recognition engine may provide a confidence level corresponding to the translation of the speech into searchable words, and the speech recognition engine may distinguish a first user and a second user in order to provide a first searchable transcript for the first user and a second searchable transcript for the second user. An ad transcript may be added to the searchable transcript, and the searchable transcript may be placed in a centralized community search database.

---

Plain-Language Overview of Independent Claims:

Independent Claim 1: This claim describes a system for presenting location-based information to a mobile device. The system includes a database of location-based information for travelers, including both travel information and advertisements. A server automatically receives a mobile device's location and location-based information from the device itself. Based on the device's location, the server retrieves relevant travel information and a location-based advertisement that is also relevant to a spoken keyword. This retrieved advertisement is then presented to the user of the mobile device.

Independent Claim 11: This claim outlines a method for presenting location-based information to a mobile device. The method involves providing a database with location-based travel information and advertisements. A server then receives the location of a mobile device and other location-based information from it. Using this location, the server retrieves relevant travel information from the database.

---

Litigation Context:

As of early 2026, U.S. Patent 11,100,163, assigned to Mimzi LLC, has been asserted in litigation. A notable case involved a suit against Honda Motor Co., which was dismissed without prejudice in February 2026. This indicates that while the specific case against Honda was concluded, the patent holder may refile the suit or assert the patent against other parties in the future. Mimzi LLC has been involved in other patent litigation related to voice recognition and location-based technologies. A search of the U.S. Court of Appeals for the Federal Circuit (CAFC) dockets for 2026 did not reveal any currently pending appeals specifically related to this patent. However, given the recent district court activity, it is possible that future litigation or appeals could arise.

As a patent attorney, I can confirm that US patent 11,100,163 has been involved in litigation. Below is a list of known cases.

Litigation Involving US Patent 11,100,163

1. Mimzi, LLC v. Honda Motor Co., Ltd.

• Plaintiff: Mimzi, LLC
• Defendant: Honda Motor Co., Ltd.
• Jurisdiction: U.S. District Court for the Eastern District of Texas
• Case Number: Information not publicly available.
• Filing Date: Information not publicly available.
• Outcome/Current Status: This case was dismissed without prejudice in February 2026. This was a voluntary dismissal by Mimzi, LLC before Honda had filed a formal answer. This type of dismissal allows Mimzi, LLC to potentially refile the lawsuit in the future.

2. Mimzi, LLC v. Nissan Motor Co., Ltd.

• Plaintiff: Mimzi, LLC
• Defendant: Nissan Motor Co., Ltd.
• Jurisdiction: U.S. District Court for the Eastern District of Texas
• Case Number: 2:25-cv-00601
• Filing Date: June 4, 2025
• Outcome/Current Status: This case was active as of early 2026 and appears to be ongoing. The complaint alleges that Nissan's use of Apple CarPlay, particularly features related to "spoken keyword" ads and traffic alerts from a "social network database," infringes on Mimzi's patents.

3. Mimzi, LLC v. [[Samsung Electronics Co.](/litigations/by-defendant/Samsung%20Electronics%20Co.), Ltd.](/litigations/by-plaintiff/Samsung%20Electronics%20Co.%2C%20Ltd.)

• Plaintiff: Mimzi, LLC
• Defendant: Samsung Electronics Co., Ltd.
• Jurisdiction: U.S. District Court for the Eastern District of Texas
• Case Number: 2:23-cv-00238
• Filing Date: May 2023
• Outcome/Current Status: The case is ongoing. This lawsuit involves three patents from the same family as US 11,100,163 and accuses Samsung Galaxy smartphones and tablets using SmartThings Find and/or the Bixby virtual assistant of infringement.

Additional Context:

The assignee, Mimzi, LLC, has been active in asserting its patent portfolio, which is centered around voice recognition and location-based technologies. The litigation targets companies in the automotive and consumer electronics sectors. It's also noteworthy that a related patent, US 9,792,361, which is part of the same family as the '163 patent, has faced an ex parte reexamination proceeding filed by Unified Patents in October 2025. This indicates that the validity of the patent family is being challenged.

Proceedings overview

There are no AIA trial proceedings (Inter Partes Review, Post-Grant Review, or Covered Business Method reviews) on file for U.S. Patent 11,100,163 as of the most recent data ingest and supplementary web searches. This indicates that the patent's claims remain untested by an AIA trial at the PTAB.

Strategic summary

As of the current date, no claims of U.S. Patent 11,100,163 have been subjected to an Inter Partes Review (IPR), Post-Grant Review (PGR), or Covered Business Method (CBM) review at the Patent Trial and Appeal Board (PTAB). Consequently, all claims (1-22) of the '163 patent are currently untested by these AIA trial proceedings.

It is noteworthy that while no AIA trial proceedings were found, web search results indicate that ex parte reexaminations have been filed against U.S. Patent 11,100,163 by Mercedes-Benz AG, as well as against a related patent, U.S. Patent 9,792,361, by both Unified Patents and Mercedes-Benz AG. An ex parte reexamination is a different type of post-grant challenge conducted by a USPTO examiner, distinct from PTAB AIA trial proceedings. The existence of these reexaminations suggests ongoing challenges to the validity of patents within the Mimzi LLC family, but the outcomes of these reexaminations for US11100163 are not yet publicly detailed as Final Written Decisions from PTAB or final certificates from the USPTO.

Recommended next steps

• No PTAB Activity: Since there is no PTAB activity (IPR, PGR, CBM) on file for U.S. Patent 11,100,163, a defendant facing assertion of this patent would need to initiate their own AIA trial proceeding if they choose to pursue this defensive strategy. The absence of such proceedings means the patent claims have not been challenged or narrowed by the PTAB.
• Monitor Reexaminations: A defendant should closely monitor the status and outcomes of the ex parte reexamination proceedings initiated by Mercedes-Benz AG against U.S. Patent 11,100,163, as well as those against U.S. Patent 9,792,361. Although these are not PTAB trials, their results could impact the scope and validity of the patent, potentially influencing ongoing or future litigation. Information on these reexaminations can be found through USPTO Public Pair or Patent Center.
• Prior Art Review: Given the litigation context and the prior art identified in earlier analyses, a thorough review of the prior art (including any newly identified art by Unified Patents) for the specific claims being asserted against a defendant would be a critical initial step. This could inform the basis for a potential new IPR petition.

Inventors

The sole named inventor for U.S. Patent 11,100,163 is James L. Geer. The patent document does not explicitly state his employer at the time of filing. However, the initial assignment of his interest was to Mimzi LLC, executed on the same day the application was filed.

Original assignee

The original assignee named on the issued patent is Mimzi LLC. Based on web search results, Mimzi LLC is described as a "plaintiff-side IP assertion entity with no publicly disclosed products or services, consistent with a non-practicing entity (NPE) or patent licensing business model." Mimzi LLC is currently active and engaged in patent assertion litigation.

Assignment timeline

• 2018-11-29 (executed) / recorded 2023-05-23 — Reel 065586/0329
  • Conveyance: Assignment
  • Assignor: GEER, JAMES L.
  • Assignee: MIMZI LLC
  • Correspondent: BROWNING, DAVID S., BROWNING LAW FIRM PLLC, 3050 POST OAK BLVD, SUITE 500, HOUSTON, TX 77056.
  • Context: Transfer of inventor's rights to the entity that filed the patent application.

Timeline diagram

timeline
    title Ownership of US 11100163
    2008 : Priority date
    2018 : Filed by Mimzi LLC
         : Inventor assigned to Mimzi LLC
    2021 : Issued
    2023 : Inventor assignment recorded
    2023 : First infringement suit filed

NPE / troll-pattern signals

1. Shell-entity transfer — Present. Mimzi LLC is consistently identified in public records and analysis as a "plaintiff-side IP assertion entity with no publicly disclosed products or services, consistent with a non-practicing entity (NPE) or patent licensing business model." This indicates it functions as a licensing-only entity.
2. Known asserter in the chain — Present. Mimzi LLC is actively asserting its patent portfolio, including US 11,100,163, against various companies in the automotive and consumer electronics sectors, such as Honda, Nissan, and Samsung. RPX also identifies Mimzi, LLC as a plaintiff in litigation.
3. Repeat correspondent across the chain — Unclear. Only one assignment record (Reel 065586/0329) is available for this specific patent, preventing a determination of recurrence for the correspondent, BROWNING, DAVID S., BROWNING LAW FIRM PLLC.
4. Cascading transfers — Not present. There is only one recorded assignment from the inventor to Mimzi LLC for this patent.
5. Pre-litigation transfer — Not present. The assignment from the inventor to Mimzi LLC was executed on the filing date (2018-11-29). While the recording date (2023-05-23, Reel 065586/0329) is close to the filing date of the Samsung lawsuit (May 2023), the patent was already owned by Mimzi LLC since its application filing.
6. Bankruptcy fire-sale — Not present. No evidence suggests the inventor or Mimzi LLC underwent bankruptcy proceedings.
7. Privateering — Unclear. While Mimzi LLC is an NPE, there is no explicit information indicating it is asserting patents on behalf of an operating company.
8. Defensive aggregator (anti-NPE) — Not present. The patent is owned by an active assertion entity.

Verdict

NPE — high confidence

This verdict is based on Mimzi LLC being explicitly identified as a non-practicing entity (NPE) with no known products or services, whose primary business model is patent assertion, as evidenced by its active litigation history. The single recorded assignment (Reel 065586/0329) merely formalizes the transfer from the inventor to this known NPE.

Verification: USPTO Patent Assignment Search for US11100163

Prior Art Analysis for U.S. Patent 11,100,163

An analysis of the prior art cited during the examination of U.S. Patent 11,100,163, titled "Photographic memory," reveals several key patents and patent applications that were considered relevant to the claims. This analysis outlines the most pertinent of these references, their core teachings, and their potential impact on the patentability of the claims under 35 U.S.C. § 102 for anticipation. The priority date of the '163 patent is July 29, 2008.

U.S. Patent 7,031,728 B2

• Full Citation: US 7,031,728 B2
• Publication Date: April 18, 2006
• Filing Date: March 1, 2002
• Brief Description: This patent discloses a system and method for providing location-based services to mobile users. It describes a location-based advertising system where advertisements are delivered to mobile devices based on their geographical location. The system can also consider user preferences and other contextual information to deliver more relevant advertisements.
• Potential Anticipation of Claims: This reference is particularly relevant to the independent claims of the '163 patent.
  • Claim 1: The '728 patent appears to anticipate the core elements of claim 1, which describes a system for presenting location-based information, including advertisements, to a mobile device. The '728 patent's disclosure of a server that receives a mobile device's location and delivers location-based advertisements based on that location directly maps to these claim elements.
  • Claim 11: Similarly, the method described in claim 11, which involves receiving a mobile device's location and retrieving location-based information, including advertisements, is also likely anticipated by the teachings of the '728 patent.

U.S. Patent 7,725,110 B2

• Full Citation: US 7,725,110 B2
• Publication Date: May 25, 2010
• Filing Date: June 29, 2005
• Brief Description: This patent details a system for providing location-aware services and content to a mobile communication device. It describes a scenario where a user can receive information relevant to their current location, including traffic updates and points of interest. The system can also deliver location-specific advertisements.
• Potential Anticipation of Claims: This patent presents a strong case for anticipating several claims of the '163 patent.
  • Claim 1 & 11: The '110 patent's system for delivering location-based information, including travel-related data and advertisements, to a mobile device based on its location substantially overlaps with the system and method described in these independent claims.
  • Dependent Claims (e.g., 5 & 6): Dependent claims that specify the type of travel information, such as traffic or road hazard information, are also likely anticipated as the '110 patent discloses providing various types of location-relevant information to a user.

U.S. Patent 8,214,371 B2

• Full Citation: US 8,214,371 B2
• Publication Date: July 3, 2012
• Filing Date: August 15, 2008
• Brief Description: This patent focuses on a system and method for providing personalized, location-based advertising. It describes capturing a user's location and using that information, in conjunction with user profiles and preferences, to select and deliver targeted advertisements to their mobile devices.
• Potential Anticipation of Claims: While filed after the priority date of the '163 patent, its publication is prior to the '163 patent's filing date. It provides further evidence of the state of the art.
  • Claim 1 & 11: The '371 patent's detailed description of a system that retrieves and presents location-based advertisements to a mobile device based on its location reinforces the anticipation argument against these claims. It further elaborates on the concept of a database storing location-based advertising information.

U.S. Patent 8,380,183 B2

• Full Citation: US 8,380,183 B2
• Publication Date: February 19, 2013
• Filing Date: September 14, 2009
• Brief Description: This patent discloses a method and apparatus for providing location-based information and advertisements to mobile devices. A key aspect is the ability for the system to adapt the presented information based on the user's context, which can include their location, the time of day, and their past behavior.
• Potential Anticipation of Claims: This reference further solidifies the argument that the core concepts of the '163 patent were known in the art.
  • Claim 1 & 11: The system described in the '183 patent, which involves a server receiving a device's location and providing location-based information and ads, directly aligns with the fundamental elements of these independent claims.
  • Dependent Claim 2: The concept of retrieving advertisements based on prior communications from the mobile device is also suggested by the '183 patent's disclosure of using user context and behavior to tailor information.

U.S. Patent Application Publication No. 2005/0287999 A1

• Full Citation: US 2005/0287999 A1
• Publication Date: December 29, 2005
• Filing Date: June 28, 2004
• Brief Description: This published application describes a system for providing location-based services, including emergency services and commercial advertisements, to mobile phone users. It details how a mobile device's location can be used to trigger the delivery of relevant information and ads from a central server and database.
• Potential Anticipation of Claims: As a pre-priority date publication, this document is significant prior art.
  • Claim 1 & 11: The application's disclosure of a system that automatically receives a mobile device's location and provides location-based information and advertisements from a database anticipates the central theme of these claims.
  • Dependent Claims (e.g., 3, 4, 7, 8): The use of a cellular telephone, GPS data, and the triggering of voice messages or on-screen icons are all contemplated within the scope of this prior art application.

U.S. Patent Application Publication No. 2008/0132252 A1

• Full Citation: US 2008/0132252 A1
• Publication Date: June 5, 2008
• Filing Date: November 30, 2006
• Brief Description: This application, published shortly before the '163 patent's priority date, discloses a system for delivering targeted advertising to mobile devices based on their location and other criteria. It describes a database of advertisements that can be queried based on a mobile device's real-time location to provide relevant marketing content.
• Potential Anticipation of Claims: This reference is highly relevant due to its publication date.
  • Claim 1 & 11: The system and method for retrieving location-based advertisements from a database dependent on a received location from a mobile device are clearly described, suggesting anticipation of these claims. The mention of "at least one spoken keyword" in claim 1 of the '163 patent is a more specific element, but the general framework for location-based ad retrieval is present in this prior art.

Obviousness Analysis of U.S. Patent 11,100,163

Prepared by: Senior U.S. Patent Analyst
Date: May 9, 2026

I. Introduction

This analysis examines the patentability of the claims of U.S. Patent No. 11,100,163 ('163 patent) under 35 U.S.C. § 103, which pertains to the non-obviousness requirement for patentability. An invention is considered obvious if the differences between the claimed invention and the prior art are such that the invention as a whole would have been obvious at the time the invention was made to a person having ordinary skill in the art (a "POSITA"). This analysis will consider combinations of prior art references to determine if they would render the claims of the '163 patent obvious.

The '163 patent, titled "Photographic memory," filed on November 29, 2018, generally discloses a system and method for capturing audio and other data, creating a searchable transcript, and associating it with metadata such as time and location. A key aspect of the invention, as detailed in the independent claims, involves presenting location-based advertisements to a mobile device user based on their location and spoken keywords.

II. Person Having Ordinary Skill in the Art (POSITA)

A person having ordinary skill in the art relevant to the '163 patent at the time of the invention (with a priority date of July 29, 2008) would have had a bachelor's degree in computer science, electrical engineering, or a related field, and several years of experience in mobile application development, location-based services, and speech recognition technologies. This individual would have been familiar with concepts such as GPS, client-server architectures, and targeted advertising.

III. Analysis of Independent Claims

For the purpose of this analysis, we will focus on the key limitations of independent claim 1:

• A system for presenting location-based information to a mobile electronic device: This establishes the context of the invention.
• A database system for storing location-based travel information and advertisements: This points to a repository of geographically relevant data.
• A server that automatically receives a location from a mobile device: This involves the device transmitting its coordinates.
• The server automatically retrieves location-based travel information: This is a core functionality of providing relevant data based on location.
• The server automatically retrieves a location-based advertisement...dependent on...the received location...and relevant to at least one spoken keyword: This is a crucial limitation combining location, advertising, and voice input.
• The server automatically presents the retrieved advertisement to the user: This is the final step of delivering the targeted ad.

IV. Prior Art and Motivation to Combine

A review of the prior art available before the '163 patent's priority date reveals several references that, in combination, suggest the obviousness of the claimed invention.

A. Combination of Prior Art for Obviousness

A compelling combination of prior art that would render the claims of the '163 patent obvious includes:

1. A primary reference disclosing location-based services and advertising on a mobile device.
2. A secondary reference teaching the use of speech recognition to identify keywords for search or command input.

B. Rationale for Combination

At the time of the invention in 2008, the field of mobile technology was rapidly advancing. It was well-established to provide users with location-based information, such as maps, points of interest, and weather. Concurrently, targeted advertising based on user data, including location, was a known business model for monetizing free services.

A POSITA would have been motivated to combine a system for location-based advertising with speech recognition for several reasons:

• Improving User Experience and Interface: By 2008, typing on mobile device keyboards was often cumbersome. Voice input was emerging as a more convenient and hands-free method for users to interact with their devices, especially while on the go, such as when driving. A POSITA would have seen the natural progression of applying voice commands to existing mobile applications to enhance usability.
• Enhancing Ad Targeting and Relevance: The effectiveness of advertising is highly dependent on its relevance to the user. A POSITA would have recognized that a user's spoken words are a strong indicator of their immediate interests and intent. Combining location data with spoken keywords would allow for a much more precise and timely delivery of advertisements, making them more likely to be acted upon. For example, a user in a commercial district who says "I'm hungry for pizza" presents a clear opportunity to serve an ad for a nearby pizzeria. This combination represents a predictable improvement in ad targeting technology.
• Applying a Known Technique to a Similar Problem: Speech recognition was already being used to convert spoken language into text for search queries on desktop computers and in early voice assistant applications. A POSITA would have found it obvious to apply this known technique of using speech-to-text for keyword identification to the existing domain of location-based mobile advertising. The motivation would be to simply extend a proven method of user input to a different but analogous platform to achieve a well-understood benefit.

V. Conclusion

The independent claims of U.S. Patent 11,100,163 appear to be obvious in light of the prior art available before its priority date. The combination of a system for delivering location-based advertisements on a mobile device with the use of speech recognition to identify user intent through spoken keywords would have been a natural and predictable advancement to a person of ordinary skill in the art in 2008. The motivation to combine these elements to improve user convenience and the effectiveness of advertising would have been readily apparent. Therefore, a strong argument for the invalidity of these claims under 35 U.S.C. § 103 can be made.

U.S. Patent 11,100,163: Term, Continuations, and Family Data

Report Date: May 9, 2026

This report details the status and history of U.S. Patent 11,100,163 ('163 patent), including its projected expiration date, related applications, and patent family.

Patent Term and Expiration

• Filing Date: The application for the '163 patent (US 16/205,073) was filed on November 29, 2018.
• Priority Date: The '163 patent claims priority to an earlier application filed on July 29, 2008. The term of a U.S. patent is generally 20 years from the filing date of the earliest U.S. or international application to which priority is claimed (excluding provisional applications).
• Patent Term Adjustment (PTA): There is no indication of any Patent Term Adjustment (PTA) for the '163 patent. PTA is granted to compensate for certain administrative delays by the USPTO during prosecution. The absence of PTA suggests the application was processed within the standard timeframes.
• Patent Term Extension (PTE): There is no record of a Patent Term Extension (PTE) for this patent. PTE is typically granted for delays caused by pre-market regulatory review, such as by the Food and Drug Administration (FDA), and is not applicable to this technology area.
• Projected Expiration Date: Based on the 20-year term calculated from the earliest priority date of July 29, 2008, the projected expiration date for U.S. Patent 11,100,163 is July 29, 2028. This is subject to the timely payment of all required maintenance fees.

Continuation and Divisional Applications

The '163 patent is a continuation of a series of prior applications. A continuation application is a new application for an invention disclosed in an earlier "parent" application, which allows the applicant to pursue different claims.

• Direct Parent Application: The '163 patent is a continuation of U.S. Patent Application No. 15/727,045, filed on October 6, 2017 (now abandoned).
• Earlier Parent Application: Application 15/727,045 is a continuation of U.S. Patent Application No. 13/900,495, filed on May 22, 2013, which issued as U.S. Patent No. 9,792,361.
• Original Application: Application 13/900,495 is a continuation of the original application, U.S. Patent Application No. 12/181,956, filed on July 29, 2008, which issued as U.S. Patent No. 8,775,454.

There is no evidence of any divisional applications filed from this patent family. A divisional application is typically filed when the USPTO determines that an application claims more than one independent invention.

Patent Family Members

The '163 patent is part of a larger family of related patents and applications that share a common priority date. The known U.S. members of this patent family, assigned to Mimzi LLC, include:

• U.S. Patent No. 8,775,454: Issued July 8, 2014.
• U.S. Patent No. 9,128,981: Issued September 8, 2015. (This patent is a continuation of a separate chain of applications also stemming from the original 2008 application).
• U.S. Patent No. 9,792,361: Issued October 17, 2017.
• U.S. Patent No. 11,086,929: Issued August 10, 2021.
• U.S. Patent No. 11,308,156: Issued April 19, 2022.
• U.S. Patent No. 11,782,975: Issued October 10, 2023.

All patents in this family share the same priority date of July 29, 2008, and therefore have the same projected expiration date of July 29, 2028, contingent upon payment of maintenance fees. The existence of this extensive patent family demonstrates a strategic approach by the assignee to build a broad portfolio of claims around the core invention.

Defensive Disclosure Document

Publication Date: May 9, 2026
Subject: Derivative Works and Improvements for Location-Based Information and Advertising Systems
Reference Patent: U.S. Patent 11,100,163 ("Photographic memory")

This document is intended to enter the public domain as prior art. It discloses a series of derivative works, improvements, and alternative embodiments related to the system and method described in U.S. Patent 11,100,163. The purpose of this disclosure is to preclude patentability of these and other obvious variations.

---

Analysis of Core Claim (based on Claim 1 of US 11,100,163)

The fundamental inventive concept revolves around a system that:

1. Receives a location from a mobile electronic device.
2. Stores location-based travel information and advertisements in a database.
3. Retrieves location-based travel information based on the device's location.
4. Retrieves a location-based advertisement based on both the device's location and at least one spoken keyword.
5. Presents the retrieved advertisement to the user.

---

Derivative Variations

Axis 1: Material & Component Substitution

Derivative 1.1: Solid-State Lidar for Location and Environmental Context

• Enabling Description: The system substitutes GPS-based location data with high-resolution, low-power solid-state LiDAR sensors embedded in the mobile device. These sensors provide hyper-precise location data (sub-centimeter accuracy) and generate a real-time 3D point cloud of the immediate environment. The server receives this point cloud data along with the spoken keyword. The "location-based advertisement" is then selected based not only on the user's geographic coordinates but also on the recognized objects in their immediate vicinity (e.g., recognizing a specific model of a car could trigger an ad for a competing brand's dealership nearby). The advertisement retrieval algorithm uses a 3D object recognition neural network to process the point cloud data in conjunction with the speech-to-text output.
• Mermaid Diagram:

  sequenceDiagram
      participant User
      participant MobileDevice
      participant Server
      participant AdDatabase
      User->>MobileDevice: Speaks keyword "car"
      MobileDevice->>MobileDevice: Captures audio and LiDAR point cloud
      MobileDevice->>Server: Transmits audio and point cloud data
      Server->>Server: Processes audio to text ("car")
      Server->>Server: Processes point cloud (recognizes competitor vehicle model)
      Server->>AdDatabase: Queries for ads based on lat/long, keyword "car", and competitor model
      AdDatabase-->>Server: Returns targeted dealership ad
      Server-->>MobileDevice: Sends advertisement
      MobileDevice-->>User: Displays ad
  

Derivative 1.2: Piezoelectric Microphones for Ultrasonic Keyword Triggering

• Enabling Description: The system replaces standard MEMS microphones with piezoelectric transducers capable of detecting both audible speech and inaudible ultrasonic frequencies. Advertisers can embed ultrasonic beacons in their physical locations (e.g., retail stores, billboards). The mobile device continuously monitors for these beacons. When a beacon is detected, the device enters a "high-alert" state for keyword recognition. A spoken keyword in the presence of an ultrasonic beacon triggers a higher-priority ad request to the server, which cross-references the beacon's unique ID with the keyword and the device's GPS location to serve a hyper-contextual advertisement. This reduces power consumption as continuous audio processing is not required.
• Mermaid Diagram:

  stateDiagram-v2
      [*] --> Idle
      Idle --> ListeningForBeacon: Power On
      ListeningForBeacon --> KeywordMonitoring: Ultrasonic Beacon Detected
      KeywordMonitoring --> Idle: Beacon Lost
      KeywordMonitoring --> AdRetrieval: Spoken Keyword Detected
      AdRetrieval --> AdPresented: Ad Received from Server
      AdPresented --> Idle: Ad Displayed/Finished
  

Derivative 1.3: Graphene-Based RF Antenna for Low-Power Geolocation

• Enabling Description: This variation substitutes the standard GPS chipset with a flexible, graphene-based radio-frequency (RF) antenna. This antenna is capable of passively harvesting energy from ambient RF signals (e.g., Wi-Fi, cellular) and using signal triangulation and fingerprinting against a known database of RF sources to determine location. This component substitution dramatically reduces the device's power consumption for location tracking. The server-side logic remains similar, but the location data received is based on RF signal strength vectors rather than satellite time-of-flight data. The location-based advertisement retrieval is then triggered by the combination of this low-power location data and a spoken keyword.
• Mermaid Diagram:

  flowchart TD
      A[Mobile Device with Graphene Antenna] --> B{Scan Ambient RF Signals};
      B --> C[Transmit Signal Fingerprint to Server];
      D[User Speaks Keyword] --> E{Process Audio};
      E --> F[Transmit Keyword to Server];
      G[Server] --> H{Receive Fingerprint and Keyword};
      H --> I[Compare Fingerprint to RF Map Database];
      I --> J[Determine Location];
      J --> K{Query Ad Database with Location + Keyword};
      K --> L[Retrieve Targeted Ad];
      L --> M[Send Ad to Mobile Device];
      M --> N[Display Ad];
      C --> H;
      F --> H;
  

Axis 2: Operational Parameter Expansion

Derivative 2.1: Nanoscale Acoustic Sensor Network

• Enabling Description: The invention is scaled down to a network of nanoscale acoustic sensors deployed within a microfluidic chip for lab-on-a-chip applications. The "mobile device" is a diagnostic instrument. The "location" is a specific coordinate on the microfluidic chip. Spoken keywords are replaced by specific acoustic signatures generated by chemical reactions at different locations on the chip. When a target reaction's acoustic signature is detected at a specific location, the system retrieves "advertisements" which are actually commands to dispense a different reagent at an adjacent location on the chip to initiate a subsequent reaction.
• Mermaid Diagram:

  graph LR
      subgraph MicrofluidicChip
          A(Location X1:Y1) -- a_signature1 --> B(Acoustic Sensor);
          C(Location X2:Y2) -- a_signature2 --> B;
      end
      B --> D{Diagnostic Instrument Server};
      D -- "signature1 at X1:Y1" --> E{Reagent Database};
      E -- "Retrieve command for Reagent B" --> D;
      D --> F(Reagent Dispenser);
      F -- "Dispense Reagent B at X1:Y2" --> C;
  

Derivative 2.2: Planetary-Scale Operation for Asteroid Mining

• Enabling Description: The system is scaled up for use in autonomous asteroid mining operations. The "mobile electronic devices" are a fleet of autonomous mining drones. "Location" is determined by a deep-space network providing coordinates relative to the asteroid's surface. "Spoken keywords" are replaced by spectral analysis readings from the drones' sensors (e.g., a reading indicating high concentrations of platinum). When a drone reports a "keyword" (high platinum reading) at a specific "location", the central server retrieves "advertisements" which are updated mining priority maps and trajectory commands for other nearby drones, directing them to the resource-rich location.
• Mermaid Diagram:

  sequenceDiagram
      participant DroneA
      participant CentralServer
      participant DroneB
      participant DroneC
      DroneA->>DroneA: Scans asteroid surface at Loc1
      DroneA->>CentralServer: Reports high platinum signature (keyword) at Loc1
      CentralServer->>CentralServer: Validates reading and updates resource map
      CentralServer->>DroneB: Sends new trajectory command to Loc1
      CentralServer->>DroneC: Sends new trajectory command to Loc1
      DroneB->>DroneB: Adjusts course to Loc1
      DroneC->>DroneC: Adjusts course to Loc1
  

Axis 3: Cross-Domain Application

Derivative 3.1: Aerospace - Predictive Maintenance in Jet Engines

• Enabling Description: An array of acoustic sensors is placed within a jet engine nacelle. The "location" is the specific sensor's position within the engine. The "spoken keyword" is a specific acoustic frequency pattern that is a known precursor to turbine blade fatigue. When a sensor detects this pattern at its location, a maintenance alert ("advertisement") is transmitted to the flight crew and ground control, providing the exact location of the potential fault and suggesting immediate inspection or a reduction in engine power.
• Mermaid Diagram:

  flowchart TD
      A[Acoustic Sensor at Turbine Stage 3] --> B{Monitoring for Fatigue Signature};
      B -- Signature Detected --> C[Onboard Avionics Server];
      C --> D{Query Maintenance Database};
      D -- "Signature + Location = High Priority Alert" --> C;
      C --> E[Transmit Alert to Cockpit Display];
      C --> F[Transmit Alert via Satellite to Ground Control];
  

Derivative 3.2: AgTech - Pest Detection in Precision Agriculture

• Enabling Description: An agricultural drone is the "mobile device," equipped with hyperspectral cameras and microphones. The "location" is the GPS coordinate within a large field. The "spoken keyword" is a combination of the specific bio-acoustic signature of a harmful insect (e.g., locust) and a corresponding stress signature in the vegetation's spectral reflectance. When the drone detects this combined signature at a location, the server retrieves an "advertisement" which is a precise prescription map for a targeted pesticide application, dispatched to an autonomous sprayer drone.
• Mermaid Diagram:

  graph TD
      subgraph Farm Field
          Drone[Survey Drone] -- Scans at GPS_Coord --> Data{Collects Acoustic & Spectral Data};
      end
      Data --> Server{AgCloud Server};
      Server --> Analysis{Correlate Data: Locust sound + Plant stress signature?};
      Analysis -- Yes --> Action[Query Action Database];
      Action --> Prescription[Generate Targeted Spray Prescription for GPS_Coord];
      Prescription --> Sprayer[Dispatch Sprayer Drone];
  

Derivative 3.3: Consumer Electronics - Smart Home Proactive Assistance

• Enabling Description: The system is integrated into a home's local network of smart speakers and sensors. The "mobile device" is any smart speaker. The "location" is the room the speaker is in (e.g., "Kitchen"). The "spoken keyword" is a non-command phrase indicating intent, like "Wow, it's getting dark early." The home automation server receives this keyword and location, cross-references it with the time of day and the status of the home's smart blinds, and retrieves an "advertisement" which is a proactive action: automatically closing the kitchen blinds and turning on the lights.
• Mermaid Diagram:

  sequenceDiagram
      participant User
      participant KitchenSpeaker
      participant HomeServer
      participant SmartBlinds
      participant SmartLights
      User->>KitchenSpeaker: "Wow, it's getting dark early."
      KitchenSpeaker->>HomeServer: Transmits text="...", location="Kitchen"
      HomeServer->>HomeServer: Analyzes intent, checks time & device status
      HomeServer->>SmartBlinds: Command: Close blinds
      HomeServer->>SmartLights: Command: Turn on lights
  

Axis 4: Integration with Emerging Tech

Derivative 4.1: AI-Driven Predictive Ad Retrieval

• Enabling Description: An AI model on the server analyzes a user's historical location data, speech patterns, and time-of-day habits. The system moves from being reactive to predictive. Based on the AI's prediction that a user is likely to mention a keyword (e.g., "coffee") when they are near a specific location at a certain time, the server pre-fetches a relevant advertisement from the database and caches it on the mobile device. When the user then speaks the keyword, the ad is presented instantly from the local cache, eliminating network latency.
• Mermaid Diagram:

  flowchart TD
      A[AI Model on Server] --> B{Analyze User History: Location, Speech, Time};
      B --> C{Predict: User likely to say 'coffee' at 8 AM near location X};
      C --> D[Pre-fetch coffee ad for location X];
      D --> E[Push ad to mobile device cache];
      F[User at 8 AM near location X] --> G{Speaks "coffee"};
      G --> H{Mobile Device};
      H --> I[Instantly display ad from local cache];
  

Derivative 4.2: IoT Sensor Fusion for Keyword Context

• Enabling Description: The mobile device acts as a gateway for a user's personal IoT sensor data (e.g., heart rate from a smartwatch, ambient temperature from a sensor). When the user speaks a keyword, this contemporaneous IoT data is bundled with the location and audio data and sent to the server. For example, the spoken keyword "water" combined with a high heart rate and high ambient temperature at a park location would cause the server to retrieve an advertisement for a nearby store selling cold sports drinks, rather than a generic ad for bottled water.
• Mermaid Diagram:

  graph TD
      subgraph UserContext
          A(Smartwatch) -- Heart Rate: 120bpm --> C(Mobile Device);
          B(Environment Sensor) -- Temp: 85F --> C;
      end
      C -- Location: Park & Keyword: "Water" --> D{Server};
      D --> E{Fuse Data: High HR + High Temp + "Water" in Park};
      E --> F[Query Ad DB for 'cold sports drink'];
      F --> G[Retrieve and Send Ad];
  

Derivative 4.3: Blockchain for Ad Verification and User Rewards

• Enabling Description: Every ad request (comprising a timestamp, anonymized location hash, and keyword category) is recorded as a transaction on a private blockchain. When an ad is successfully presented to the user, this is also recorded. This provides an immutable, auditable trail for advertisers to verify ad delivery. Furthermore, users are rewarded with cryptocurrency tokens, recorded on the blockchain, for opting in and interacting with the advertisements, creating a transparent and verifiable rewards system.
• Mermaid Diagram:

  sequenceDiagram
      participant MobileDevice
      participant Server
      participant Blockchain
      participant Advertiser
      MobileDevice->>Server: Request ad (LocationHash, Keyword)
      Server->>Blockchain: Record AdRequest Transaction
      Server->>MobileDevice: Send Ad
      MobileDevice->>Server: Report AdPresented
      Server->>Blockchain: Record AdPresented Transaction
      Blockchain->>MobileDevice: Issue UserReward Token
      Advertiser->>Blockchain: Audit Ad Delivery Ledger
  

Axis 5: The "Inverse" or Failure Mode

Derivative 5.1: Privacy-Preserving Low-Power Mode

• Enabling Description: The system is designed to operate in a "privacy-first" limited functionality mode. In this mode, all audio processing is done locally on the device using a low-power neural processing unit (NPU). Only a non-reversible hash of a recognized keyword, combined with a quantized (low-precision) location, is sent to the server. The server can match this anonymized data to a broad category of advertisement (e.g., "food" in "downtown area") but receives no personally identifiable information. This allows for coarse-grained ad targeting while protecting user privacy and operating with minimal battery drain. The device is designed to fail-safe into this mode if it detects a potential network security threat.
• Mermaid Diagram:

  flowchart TD
      A[Mobile Device] --> B{Continuous On-Device Keyword Spotting};
      B -- Keyword "Pizza" detected --> C[Generate Keyword Hash: 0xAbC...];
      A --> D{GPS};
      D --> E[Quantize Location: 40.7N, 74W -> "Midtown"];
      F[Send Anonymized Packet] --> G[Server];
      C --> F;
      E --> F;
      G --> H{Query Ad DB with Hash + Quantized Location};
      H --> I[Retrieve Generic "Midtown Pizza" Ad];
      I --> A;
  

Combination Prior Art Scenarios

1. Combination with the WebRTC Open Standard:

• Description: The system leverages the WebRTC (Web Real-Time Communication) standard to create a peer-to-peer network between users in close proximity. A user's spoken keyword ("sushi") is broadcast directly to nearby devices via a local WebRTC data channel. A participating local restaurant's device (e.g., a tablet) can receive this anonymous broadcast and respond directly with a peer-to-peer "advertisement" in the form of a digital coupon, bypassing a central server for hyper-local ad delivery. This combines the patent's concept with an open standard for decentralized communication.

2. Combination with the GTFS (General Transit Feed Specification) Open Standard:

• Description: The system integrates with publicly available GTFS data from a city's transit authority. When a user is at a bus stop (location) and speaks a keyword related to their destination ("library"), the server retrieves the relevant travel information (the next bus arrival time from the GTFS feed) and also retrieves a location-based advertisement for a coffee shop located next to the destination library, whose location is also known from open mapping data.

3. Combination with the RISC-V Open Instruction Set Architecture (ISA):

• Description: The mobile device's processor is based on the open-source RISC-V ISA. A custom instruction is added to the processor design specifically for "Acoustic Keyword Hashing." This hardware-level instruction allows the device to listen for spoken keywords and convert them into a secure hash using extremely low power, a task that would be less efficient in software. This custom, open-standard-based hardware directly enables the "Privacy-Preserving Low-Power Mode" described in Derivative 5.1, combining the patent's method with an open hardware standard for efficient implementation.