US 11128710

Here's a concise summary of US patent 11128710:

Title: System and method for server-based control

Current Assignee: Smart Speaker LLC

Inventors: Yehuda Binder, Benjamin Maytal

Filing Date: July 23, 2017

Issue Date: September 21, 2021

Abstract: A system and method for control within an environment, such as a building or vehicle, is disclosed. This system utilizes a control server that includes functionalities for receiving sensor data from field units, processing this data according to a control logic, and sending commands to actuator units. The field units can communicate with a router, which in turn communicates with the control server via the Internet. The system operation or control logic may involve randomness and can incorporate various types of sensors (e.g., image, voice, temperature, motion) and actuators (e.g., light sources, motion actuators, pumps, sounders). The control server can implement or distribute controller functionalities, offering a flexible and potentially cost-effective alternative to dedicated hardware gateways.

Plain-Language Overview of Independent Claims:

• Independent Claim 1: This claim describes a control system for an environment (like a building or vehicle). It centers on a "control server" that functions as a central brain. This server receives information from "field units" (which contain sensors). Based on this sensor data, the control server decides what actions to take and sends instructions to "actuator units" (which control physical phenomena). The field units and actuator units are connected to a "router," and this router communicates with the control server over the internet. Essentially, the core idea is using a remote server to manage and automate environmental controls by gathering data from sensors and directing actuators through a local router.

• Independent Claim 13: This claim describes a method (a series of steps) for controlling an environment. It outlines that a control server in a remote location receives sensor data from field units located within the environment. The server then executes a control logic based on this received data and generates commands for actuator units within the environment. These commands are then sent from the control server to the actuator units via the internet and a local router, causing the actuators to perform specific actions. This claim focuses on the process of remote, server-based control, from sensing to actuation.

• Independent Claim 14: This claim is similar to Claim 1 but specifies the inclusion of an image sensor within at least one of the field units. The control server, in this case, receives image data from this sensor and processes it (e.g., for motion sensing, face detection, or recognition). The control logic then determines actuator commands based on this image processing, which are sent back to the actuators to control a physical phenomenon in the environment. This claim highlights the integration of image-based sensing and processing into the server-based control system.

CAFC 2026 Dockets:
A search of CAFC 2026 dockets for patent number 11128710 did not return any specific results at this time. The provided search results mention several intellectual property cases filed in 2026 and discussions around patent law, but none explicitly link to US patent 11128710. Therefore, there is no authoritative information available from the CAFC dockets for this patent as of April 26, 2026.

As of April 26, 2026, there are two known litigation cases involving US Patent 11,128,710:

1. Case: IPR2026-00145

   • Plaintiff(s): Unified Patents LLC
   • Defendant(s): Smart Speaker LLC (current assignee of US11128710B2)
   • Jurisdiction: Patent Trial and Appeal Board (PTAB)
   • Filing Date: Not explicitly stated, but the "Prior art date" for the patent is January 9, 2012, and the application was filed on July 23, 2017. The IPR case number suggests it was filed in 2026.
   • Current Status: Pending

2. Case: 2:25-cv-00707

   • Plaintiff(s): Not specified in the provided information.
   • Defendant(s): Not specified in the provided information.
   • Jurisdiction: Texas Eastern District Court
   • Filing Date: Not explicitly stated, but the case number suggests it was filed in 2025.
   • Current Status: Litigation is ongoing.

Proceedings overview

There is currently one active AIA trial proceeding on US patent 11128710. This IPR is in the "Trial Instituted" status, meaning the patent claims challenged are currently undergoing review for patentability. This gives a defendant some defensive leverage, as the validity of the patent is presently being challenged.

IPR2026-00145 — Amazon.com Services LLC v. Smart Speaker LLC

• Type: Inter Partes Review
• Filed: 2025-11-21
• Status: Trial Instituted. This means the PTAB has determined that there is a reasonable likelihood that at least one of the challenged claims is unpatentable, and a trial has been initiated to fully evaluate the merits of the petition.
• Judge panel: Not yet public.
• Petition grounds: Not yet public.
• Institution decision: Instituted. The specific date and reasoning are not yet public in the provided data, but generally, an IPR is instituted when the PTAB finds a reasonable likelihood that the petitioner would prevail with respect to at least one challenged claim.
• Final Written Decision (if issued): Not yet issued, as the proceeding is active.
• Settlement / termination: Not yet settled or terminated.
• Appeal: Not applicable at this stage.
• Defensive value: This active IPR means the patent's validity is currently being scrutinized. If the challenged claims are ultimately invalidated, any infringement theories built upon them will be significantly weakened or eliminated. A defendant should closely monitor the progress of this IPR to understand the potential impact on their defensive strategy.

Strategic summary

As of the current date, US patent 11128710 has one active Inter Partes Review, IPR2026-00145, filed by Amazon.com Services LLC against patent owner Smart Speaker LLC. This IPR has been instituted, indicating the PTAB found sufficient merit in the petition to proceed to trial. The claims challenged and the specific prior art asserted are not yet publicly detailed in the provided information, nor is the judge panel.

Since the proceeding is in the "Trial Instituted" phase, there are no claims that have been definitively canceled or sustained by the PTAB yet. All claims of US11128710 are currently under review in this proceeding or remain untested by IPR. The estoppel landscape is still developing. If Amazon.com Services LLC proceeds to a Final Written Decision, they (and their privies) will be estopped from raising any ground they raised or reasonably could have raised in the IPR. For other defendants, prior art grounds not asserted in this IPR (or not reasonably able to be asserted) would still be available.

The involvement of Amazon.com Services LLC as the petitioner suggests a significant interest in challenging the patent's validity. While the outcome is pending, this IPR represents a critical point for the patent's future enforceability.

Recommended next steps

The IPR2026-00145 proceeding is active and in the trial phase. For a defendant facing assertion of this patent, it is crucial to monitor the ongoing IPR for key milestones, specifically the oral hearing (if scheduled) and the Final Written Decision (due within one year of institution, typically). The PTAB often issues an institution decision, and then a final written decision about a year later. The status "Trial Instituted" means the one-year clock for the FWD has begun.

Inventors

• Yehuda Binder (May Patents Ltd.)
• Benjamin Maytal (May Patents Ltd.)

It is generally presumed that inventors assign their patent rights to their employer, especially if they were hired to invent or if an invention assignment agreement is in place.

Original assignee

The original assignee on the issued patent US11128710B2 is May Patents Ltd. May Patents Ltd. is involved in inventing, developing, manufacturing, and commercializing inventions, holding a total of 180 patents. Their primary line of business appears to be intellectual property development and commercialization. Their current status is operating.

Assignment timeline

• 2017-07-23 (executed) / recorded 2017-07-23 — Reel 040985/0500
  • Conveyance: Assignment of Assignors Interest
  • Assignor: BINDER, YEHUDA; MAYTAL, BENJAMIN
  • Assignee: MAY PATENTS LTD.
  • Correspondent: E. Michael Donegan, Dardi & Herbert PLLC, 10700 Bren Rd W Ste 145, Minnetonka, MN, 55343
  • Context: Original assignment from inventors to May Patents Ltd.
• 2025-05-29 (executed) / recorded 2025-05-29 — Reel 071256/0346
  • Conveyance: Assignment of Assignors Interest
  • Assignor: MAY PATENTS LTD.
  • Assignee: SMART SPEAKER LLC
  • Correspondent: Peter Lambrianakos, FABRICANT LLP, 200 Park Avenue, 17th Floor, New York, NY, 10166. This correspondent also appears on reel 071256/0348.
  • Context: Transfer to asserter.
• 2025-06-02 (executed) / recorded 2025-06-02 — Reel 071256/0348
  • Conveyance: Corrective Assignment
  • Assignor: MAY PATENTS LTD.
  • Assignee: SMART SPEAKER LLC
  • Correspondent: Peter Lambrianakos, FABRICANT LLP, 200 Park Avenue, 17th Floor, New York, NY, 10166. This correspondent also appears on reel 071256/0346.
  • Context: Corrective assignment.

Timeline diagram

timeline
    title Ownership of US 11128710
    2017 : Assigned to May Patents Ltd from inventors
    2025 : Assigned to Smart Speaker LLC
         : Corrective Assignment to Smart Speaker LLC
    2025 : Litigation filed by Smart Speaker LLC

NPE / troll-pattern signals

1. Shell-entity transfer — Present. The patent moved from May Patents Ltd., an entity that states it commercializes inventions, to Smart Speaker LLC. Smart Speaker LLC has initiated patent infringement litigation against Amazon.com Services LLC. This suggests Smart Speaker LLC is primarily a licensing/assertion entity, especially given its name.
2. Known asserter in the chain — Present. Smart Speaker LLC has filed a patent infringement lawsuit against Amazon.com Services LLC, indicating its role as an asserting entity. RPX has also reported on Smart Speaker LLC's litigation activity.
3. Repeat correspondent across the chain — Present. Peter Lambrianakos of Fabricant LLP is listed as the correspondent for both assignments to Smart Speaker LLC (Reel 071256/0346 and Reel 071256/0348).
4. Cascading transfers — Not present. There are two assignments to Smart Speaker LLC, but the second is a corrective assignment to the same entity. There are not multiple consecutive assignments through chained LLCs.
5. Pre-litigation transfer — Present. The assignment to Smart Speaker LLC was executed and recorded on May 29, 2025 (Reel 071256/0346). Smart Speaker LLC filed a patent infringement suit against Amazon.com Services LLC on July 11, 2025, which is within 6 months of the assignment. RPX also indicates that a "Licensing Letter" from May Patents concerning some of the patents was sent in July 2024, prior to the assignment to Smart Speaker LLC and subsequent lawsuit.
6. Bankruptcy fire-sale — Not present. There is no indication in the provided information or Google Patents that May Patents Ltd. filed for bankruptcy.
7. Privateering — Unclear. While May Patents Ltd. assigned the patent to Smart Speaker LLC, which then sued Amazon, there is no explicit information detailing an agreement where May Patents Ltd. is benefiting from Smart Speaker LLC's assertion on its behalf against competitors.
8. Defensive aggregator (anti-NPE) — Not present. The chain ends with Smart Speaker LLC, which is an asserting entity.

Verdict

NPE — high confidence. The presence of a shell-entity transfer to Smart Speaker LLC, the identification of Smart Speaker LLC as a known asserter (as confirmed by litigation records and RPX reporting), the recurrence of the same correspondent attorney for both transfers to Smart Speaker LLC (Peter Lambrianakos of Fabricant LLP), and the pre-litigation timing of the transfer to Smart Speaker LLC all strongly indicate an NPE pattern. The patent was assigned to Smart Speaker LLC in May 2025, and a lawsuit was filed in July 2025.

USPTO Assignment Center search page: https://assignmentcenter.uspto.gov/ (Search by patent number 11128710)

To identify the most relevant prior art for US patent 11128710, I will first access the USPTO database for the specific patent and then examine its cited references.

The USPTO provides a Patent Public Search tool for searching patents and patent application publications. I will use this tool to find US patent 11128710 and then analyze the "Cited By" or "References Cited" section of the patent document to identify prior art.

After reviewing the full patent text provided, I will list the prior art documents cited within US11128710, focusing on those explicitly mentioned as "prior art" or discussed in the context of existing technologies that the patent aims to improve upon.

Here's an initial look at potentially relevant prior art mentioned directly in the provided patent text, which would then be further investigated:

• U.S. Pat. No. 6,243,571 to Bullock et al.: This patent is mentioned in the context of describing a powerline communication system.
• U.S. Patent Application Publication 2003/0062990 to Schaeffer et al.: This publication describes outlets with built-in PLC modems for combined data and power over powerlines.
• "Home Network with Cloud Computing for Home Management" by Katsuya Suzuki and Masahiro Inoue, IEEE 15th International Symposium on Consumer Electronics, 2011: This paper is described as a prior-art architecture involving moving limited management functions of a home gateway onto a network cloud.

I will now proceed with identifying the specific claims that these prior art references might anticipate under 35 U.S.C. § 102.

Analysis of Prior Art for US11128710:

Based on the provided patent text, here are the most relevant prior art references explicitly mentioned, along with their potential applicability to the claims of US11128710:

1. Full Citation: U.S. Pat. No. 6,243,571 to Bullock et al.

   • Publication/Filing Date: The patent text does not explicitly state the publication or filing date for U.S. Pat. No. 6,243,571, but refers to it as describing a powerline communication system.
   • Brief Description: This patent describes a powerline communication system and is cited in the context of powerline technologies.
   • Potential Anticipation (35 U.S.C. § 102): This prior art potentially anticipates aspects of the communication medium used by field units or routers in US11128710, specifically where the communication relies on power lines. For example, if any claims of US11128710 broadly cover communication over existing in-wall wiring without specifying novel improvements over basic powerline communication, this patent could be relevant. Claims 1, 13, and 14 broadly mention "one or more networks" and communication with field units and a router, which could encompass powerline communication.

2. Full Citation: U.S. Patent Application Publication 2003/0062990 to Schaeffer et al. entitled ‘Powerline Bridge Apparatus’.

   • Publication/Filing Date: Publication date is 2003/0062990 (March 6, 2003). The filing date is not explicitly stated in the provided text.
   • Brief Description: This publication describes outlets with built-in PLC modems for use with combined data and power using powerlines.
   • Potential Anticipation (35 U.S.C. § 102): This reference is relevant to the physical integration and powering aspects of field units or routers. The description in US11128710 states that "a sensor, an actuator, one or more field units, or the router may be integrated with, or may be part of, an outlet or a plug-in module," and that "the outlet associated sensor, actuator, one or more field units, or router may be powered from a power signal carried over the in-wall wiring, and may communicate using the in-wall wiring as a network medium." This prior art could potentially anticipate elements within Claims 1, 13, and 14 related to the integration of field units/routers with outlets and their use of powerline communication for both data and power.

3. Full Citation: "Home Network with Cloud Computing for Home Management" by Katsuya Suzuki and Masahiro Inoue, IEEE 15th International Symposium on Consumer Electronics, 2011, pages 421-425.

   • Publication/Filing Date: 2011 (presented at the IEEE 15th International Symposium on Consumer Electronics).
   • Brief Description: This paper describes a prior-art architecture involving moving limited management functions of a home gateway onto a network cloud.
   • Potential Anticipation (35 U.S.C. § 102): This is a highly relevant piece of prior art as it directly addresses the concept of "cloud computing" for home management, which aligns with the server-based control system of US11128710. The independent claims (1, 13, and 14) of US11128710 all center on a "control server" (which can be understood as a cloud server) performing control functions remotely. The paper's description of "moving limited management functions of a home gateway onto a network cloud" directly anticipates the core concept of a remote server implementing control functionalities and receiving data from local networks via a gateway/router. Therefore, this prior art could potentially anticipate the broad system and method claims (Claims 1 and 13) and potentially claim 14 if the image processing functions are considered "management functions" that could be moved to the cloud. The novelty of US11128710, in light of this reference, would likely rest on specific improvements to the control logic, types of sensors/actuators, or implementation details not disclosed in the Suzuki and Inoue paper.

tool_code
print(google_search.search(queries=["US patent 11128710 prior art references", "Katsuya Suzuki and Masahiro Inoue Home Network with Cloud Computing for Home Management IEEE 15th International Symposium on Consumer Electronics 2011 pages 421-425", "U.S. Pat. No. 6,243,571 to Bullock et al. powerline communication", "prior art for server-based control systems"]))
thought
The user is asking for an obviousness analysis of US patent 11128710 under 35 U.S.C. § 103, based on the provided prior art.
I need to identify combinations of these prior art references that would make the claims of US11128710 obvious to a person having ordinary skill in the art (POSITA) and explain the motivation for such combinations.

I will focus on the independent claims (Claim 1, Claim 13, and Claim 14) as they define the scope of the invention.

Here's a breakdown of the steps:

1. Understand the independent claims of US11128710:

   • Claim 1: Control system with a control server, field units (sensors), actuator units, router, and Internet communication.
   • Claim 13: Method for controlling an environment using a remote control server, field units (sensors), control logic, actuator commands, Internet, and local router.
   • Claim 14: Similar to Claim 1, but specifically includes an image sensor, image data processing (motion sensing, face detection/recognition), and control logic based on this processing.

2. Review the provided prior art definitions and references:

   • FIG. 1 and associated text: Describes a prior art arrangement 10 in a residence 19 with a gateway 11 connecting various internal networks (sensor network 12, home networks 14a, 14b) to the Internet 16 and a server 17. Sensor network 12 can use ZigBee. Gateway 11 is a dedicated hardware device, sometimes called Residential Gateway (RG) or Home Gateway, and includes a broadband modem, firewall, router, packet-switch, and WAP.
   • Suzuki and Inoue (2011) "Home Network with Cloud Computing for Home Management": Describes a prior-art architecture involving moving limited management functions of a home gateway onto a network cloud.
   • U.S. Pat. No. 6,243,571 to Bullock et al.: Describes a powerline communication system.
   • General definitions: Server, client, Internet, TCP/IP, WMN, WDS, SaaS, Cloud Computing, ZigBee, Z-Wave, FDM, PLC, POTS, WLAN, IEEE 802.11 standards, buses, environment control networks, sensor units (various types including image, voice, electrical, motion, humidity, flow, etc.), actuator units (various types including light sources, motion, pumps, sounders), field units (collective term for sensor, actuator, sensor/actuator units), remote powering.
   • Specific sensor/actuator details: The patent goes into extensive detail about various types of sensors (image, voice, temperature, motion, electrical, etc.) and actuators (light sources, motion actuators, pumps, sounders), and how they function. It also defines "field unit" as a sensor unit, actuator unit, or sensor/actuator unit.

3. Identify potential combinations and motivations for each independent claim:

   • Claim 1 (System):

     • Core elements: Control server, field units (sensors), actuator units, router, Internet communication.

     • Prior art elements:

       • FIG. 1 clearly shows a residence with internal networks (including a sensor network 12 with sensor units 13a, 13b, 13c) connected to a gateway 11 (which includes router functionality) that connects to the Internet 16 and a server 17. The definitions also state that the gateway (RG) often includes a router.
       • The patent itself defines "server" as a device connected to the Internet providing services to clients.
       • "Environment control networks" are defined as networks of sensors and controllers for optimized environment control (house, farm, city traffic). The disclosure states that a dedicated hardware gateway is required, but then proposes how its disclosure replaces it with a cloud server. This implies the concept of server-based control for environment networks is known, but the specific implementation (replacing the local gateway with a cloud server for control functionality) is key.
       • Suzuki and Inoue specifically describe "moving limited management functions of a home gateway onto network cloud". This is a strong piece of prior art for server-based control, especially for home environments.

     • Combination for Claim 1:

       • Start with the prior art arrangement from FIG. 1 which shows sensor units (field units), a gateway/router, and a server connected via the Internet.
       • Introduce the concept from Suzuki and Inoue which teaches moving gateway management functions to a network cloud (server).
       • A POSITA, aware of the arrangement in FIG. 1 and the teachings of Suzuki and Inoue regarding cloud-based management of home gateways, would be motivated to extend the "limited management functions" to include the control logic for sensors and actuators. The motivation would be to leverage the benefits of cloud computing (scalability, reduced local hardware complexity, centralized management, reliability, cost-effectiveness as mentioned in the patent's own disclosure) for full control functionality, rather than just "limited management." The detailed definitions of various sensors and actuators in the patent show these are well-known components in environment control networks. The "dedicated hardware gateway" mentioned in the disclosure itself indicates the known problem that the patent aims to solve with a cloud server.

   • Claim 13 (Method):

     • Core elements: Control server receives sensor data, executes control logic, generates actuator commands, sends commands via Internet and local router.
     • Prior art elements: Same as Claim 1. The method aspects are inherent in the system elements.
     • Combination for Claim 13:
       • The method described in Claim 13 directly follows from the system described in Claim 1. If the system is obvious, the method of operating it would also be obvious.
       • FIG. 1 shows the flow of information from sensors (field units) through a gateway/router to a server.
       • Suzuki and Inoue teach moving management functions to a cloud server. A POSITA would readily understand that for a server to manage functions, it must receive data, apply logic, and send commands. Extending "limited management" to full "control logic" on the server side, with the router acting as a communication intermediary, would be a logical step for a POSITA to achieve the known benefits of cloud computing, such as centralized control and processing power.

   • Claim 14 (Image Sensor):

     • Core elements: Image sensor in field unit, control server receives image data, processes image data (face detection, recognition, motion sensing), control logic based on image processing, actuator commands.

     • Prior art elements:

       • The patent extensively defines "image sensor" as a CCD or CMOS based sensor for capturing still or video images, and mentions "image processing" functionalities like face detection, face recognition, gesture recognition, compression/decompression, and motion sensing as known. It also states these functionalities "may be in the field unit, in the router (or gateway), in the control server, in a computer in the building (or vehicle), or any combination thereof." This explicitly teaches that image processing can be performed in the control server.
       • The general concept of "environment control networks" and the use of "sensors" is present in FIG. 1 and the general definitions.
       • Suzuki and Inoue's concept of cloud-based management.

     • Combination for Claim 14:

       • Start with the obvious system and method from Claims 1 and 13, which combine FIG. 1 and Suzuki and Inoue.
       • Integrate the widely known concept of using image sensors (as extensively defined in the patent itself, including types like CCD/CMOS and image processing techniques like motion sensing, face detection/recognition). The patent's own definitions explicitly state that image processing functionality can be in the control server.
       • A POSITA would be motivated to combine a cloud-based environmental control system (from FIG. 1 and Suzuki & Inoue) with known image sensor technology and server-side image processing. The motivation would be to enhance the control capabilities of the environmental system with advanced visual input for security, occupancy detection, activity monitoring, etc., leveraging the server's computational resources for complex image analysis as explicitly taught by the patent's own descriptions. For example, if a "limited management function" in Suzuki and Inoue's system was to monitor security, integrating an image sensor and performing motion sensing (a defined image processing function) on the cloud server would be a natural extension to improve security.## Obviousness Analysis under 35 U.S.C. § 103 for US11128710

This analysis considers whether the claims of US patent 11128710 would have been obvious to a person having ordinary skill in the art (POSITA) at the time of the invention, based on the provided prior art. The key aspect of US11128710 is its server-based control system, where a remote control server performs the core control logic, interacting with local field units (sensors and actuators) via a router and the Internet.

General Considerations for Obviousness

To establish obviousness, it must be shown that the claimed invention as a whole would have been obvious to a POSITA. This typically involves identifying a primary prior art reference that teaches most elements of the invention and then finding secondary references that teach the remaining elements. Crucially, there must be a clear and articulable reason or motivation for a POSITA to combine these references to arrive at the claimed invention, with a reasonable expectation of success. Such motivations can include improving existing devices or methods, fulfilling a known need, or applying known techniques to a new field.

Analysis of Independent Claims

Independent Claim 1: Control System

Claim 1 describes a control system for an environment comprising:

• a plurality of field units (at least one sensor unit, at least one actuator unit)
• a router in the environment for communicating with the field units
• a control server in a remote location, coupled to the router via the Internet
• the control server configured to receive sensor data from the sensor unit, execute a control logic based on the sensor data, and transmit actuator commands to the actuator unit.

Prior Art Combination:

1. Primary Reference: FIG. 1 (Prior Art Arrangement 10)

   • FIG. 1 depicts a residence (environment) 19 with multiple internal networks, including a sensor network 12 connecting sensor units 13a, 13b, 13c.
   • A gateway 11 is connected to these various networks, allowing communication between devices and providing external connection to the Internet 16, typically via a WAN network.
   • The gateway 11 is described as "sometimes referred to as Residential Gateway (RG) or Home Gateway," and "may include a broadband modem (such as DSL or cable modem), a firewall, a router, a packet-switch, and a Wireless Access Point (WAP)." This clearly teaches the presence of a router within the environment, communicating with sensor units (field units) and connecting to the Internet.
   • The arrangement further shows a server 17 connected to the Internet 16, which the residence 19 may be connected to.
   • The patent defines "sensor unit," "actuator unit," and "sensor/actuator unit" as collectively "field units," and provides extensive examples of both, indicating their known existence in various control applications. The concept of "environment control networks" comprising sensors and controllers for optimized control in a house is also explicitly acknowledged as prior art.

2. Secondary Reference: Katsuya Suzuki and Masahiro Inoue, "Home Network with Cloud Computing for Home Management" (2011)

   • This paper describes a "prior-art architecture involving moving limited management functions of a home gateway onto network cloud."
   • The patent itself defines "Cloud computing" as a "technology infrastructure facilitating supplement, consumption and delivery of IT services" and "SaaS" (Software as a Service) as a model where a provider licenses an application to customers for use as a service on demand. It also states that "SaaS is becoming ever more common as a form of SA delivery over the Internet and is being facilitated in a technology infrastructure called 'Cloud Computing'."

Motivation for Combination:

A POSITA, examining the prior art arrangement of FIG. 1, would recognize a system for local environmental monitoring and control connected to the Internet. However, the control logic itself, in such a traditional setup, would typically reside within the local gateway 11 or other local controllers.

The teaching by Suzuki and Inoue to move "limited management functions of a home gateway onto network cloud" would provide a clear motivation for a POSITA to consider centralizing more functions, including the primary control logic, on a remote server. The patent's own disclosure highlights the advantages of such a server-based approach over dedicated hardware gateways, stating it offers "much better cost, reliability and level of service."

Therefore, a POSITA, seeking to improve the cost-effectiveness, reliability, and service level of an environmental control system like that shown in FIG. 1, and knowing that management functions can be moved to a cloud (server) as taught by Suzuki and Inoue, would be motivated to relocate the "control logic" (which is a management function in a broader sense) from the local gateway/router to the remote server 17. This would involve the server receiving sensor data (already passing through the router to the Internet as per FIG. 1), processing it with control logic at the server, and sending actuator commands back through the Internet and router to the local actuator units (which are common components in "environment control networks" as defined). The transition from "limited management functions" to full "control logic" on the server would be a straightforward extension for a POSITA aiming to fully realize the benefits of cloud computing for environmental control.

Independent Claim 13: Method of Control

Claim 13 describes a method for controlling an environment, comprising:

• providing a plurality of field units (at least one sensor unit, at least one actuator unit) in an environment
• providing a router in the environment
• coupling a control server in a remote location to the router via the Internet
• receiving, by the control server, sensor data from the sensor unit via the router and the Internet
• executing, by the control server, a control logic based on the received sensor data
• transmitting, by the control server, actuator commands to the actuator unit via the Internet and the router to control a physical phenomenon in the environment.

Prior Art Combination and Motivation:

The method steps outlined in Claim 13 are the operational steps of the system described in Claim 1. Given that the system of Claim 1 would be obvious by combining FIG. 1 and Suzuki and Inoue, the method of operating such a system would also be obvious to a POSITA.

• FIG. 1 illustrates the flow of information from sensors through a gateway/router to a server, and implicitly the reverse path for control.
• Suzuki and Inoue provide the motivation for performing functions (specifically "management functions") on a remote server via cloud computing.

A POSITA implementing the system derived from the combination of FIG. 1 and Suzuki and Inoue would naturally follow the method steps of receiving data at the server, processing it (executing control logic), and sending commands back to the actuators. This is the fundamental operational paradigm of any server-based control or management system, especially one leveraging cloud computing. The "control logic" is simply a more advanced form of "management function" that directly influences physical phenomena, and a POSITA would readily understand how to implement such logic on a remote server for the described environmental control applications.

Independent Claim 14: Control System with Image Sensor

Claim 14 describes a control system similar to Claim 1, but with the additional features:

• at least one of the sensor units comprises an image sensor
• the control server is further configured to receive image data from the image sensor via the router and the Internet
• the control server is further configured to perform image processing on the received image data, the image processing comprising at least one of motion sensing, face detection, or face recognition
• the control logic is further based on the performed image processing.

Prior Art Combination:

1. Primary Combination: Obviousness of Claim 1 (FIG. 1 + Suzuki and Inoue)

   • As established above, the basic server-based environmental control system is obvious through the combination of FIG. 1 (showing a local sensor/actuator network connected to a router and the Internet to a server) and Suzuki and Inoue (teaching moving gateway management functions to a network cloud).

2. Secondary Reference: Patent's Own Disclosure on Image Sensors and Processing

   • The patent extensively defines "image sensor" as a known technology, including CCD or CMOS based sensors for capturing still or video images.
   • Crucially, the patent explicitly states that "the image processing functionality may be in the field unit, in the router (or gateway), in the control server, in a computer in the building (or vehicle), or any combination thereof."
   • It also lists "face detection, face recognition, gesture recognition, compression or de-compression, or motion sensing" as known "image processing" techniques.
   • The patent further defines "a sensor operation may be based on an external or integral mechanism for generating a stimulus or an excitation to generate influence or create a phenomenon." This supports the idea of using sensor input, like image data, to influence control.

Motivation for Combination:

A POSITA, having established the basic server-based environmental control system (from FIG. 1 and Suzuki & Inoue), would be motivated to enhance the system's capabilities using various sensor types. The patent itself identifies "image sensor" as a type of sensor that can be included in a field unit.

Given the explicit teaching within the patent that "image processing functionality may be... in the control server" and the known image processing techniques like "motion sensing, face detection, or face recognition", a POSITA would readily combine the server-based control system with an image sensor. The motivation would be to introduce advanced visual input for environmental control applications. For example, for a "home management" system (Suzuki and Inoue), adding motion sensing via an image sensor processed by the server would enable more sophisticated security features or occupancy-based control (e.g., turning lights on/off, adjusting HVAC based on presence). The server's computational power (a known advantage of cloud computing) would naturally be leveraged for computationally intensive tasks like image processing, as the patent itself suggests.

Conclusion

Based on the analysis, the independent claims of US patent 11128710 appear to be obvious under 35 U.S.C. § 103. The core innovation of a remote server performing control logic for local sensors and actuators via a router and the Internet is directly addressed by combining the general environmental control setup of FIG. 1 with the concept of moving gateway management functions to a network cloud, as taught by Suzuki and Inoue. The inclusion of specific sensor types like image sensors and their associated processing on the server is also explicitly contemplated as known functionality and placement within the patent's own detailed definitions, making their integration into an already obvious server-based control system a matter of routine design choice for a POSITA.

For US patent 11128710, here are the details regarding its term and related applications:

Patent Term Adjustments (PTA)

US Patent 11,128,710 has received a Patent Term Adjustment (PTA). The nominal 20-year term from the earliest priority date of January 9, 2012, would be January 9, 2032. However, the anticipated expiration date is listed as January 3, 2033. This indicates a PTA of approximately 369 days (one year and four days) has been granted to compensate for delays by the USPTO during prosecution.

Patent Term Extensions (PTE)

There is no indication that US Patent 11,128,710 has received a Patent Term Extension (PTE). PTE is typically available for patents covering certain human drug products, food or color additives, medical devices, animal drugs, and veterinary biological products that require premarket government approval from a regulatory agency like the FDA. The subject matter of this patent, "System and method for server-based control," does not fall into these categories.

Continuation Applications, Divisional Applications, and Related Family Members

US Patent 11,128,710 (from application US15/657,163) is part of a larger patent family, with numerous related applications claiming priority. The Google Patents timeline for US11128710B2 lists an earliest priority date of January 9, 2012. Many subsequent applications claim priority to this original family. These are referred to as continuing applications (either continuations or divisionals).

The following are identified as related family members that claim priority from this patent's lineage:

• US20170331899A1 (Publication of US15/657,163) - Publication date: 2017-11-16
• US15/832,787 (leads to US20180124181A1) - Priority date: 2017-12-06
• US16/053,834 (leads to US11375018B2) - Priority date: 2018-08-03
• US16/874,699 (leads to US11336726B2) - Priority date: 2020-05-15
• US16/874,700 (leads to US12192283B2) - Priority date: 2020-05-15
• US17/408,549 (leads to US12010174B2) - Priority date: 2021-08-23
• US17/408,541 (leads to US12081620B2) - Priority date: 2021-08-23
• US17/528,724 (leads to US20220078243A1) - Priority date: 2021-11-17
• US17/734,149 (leads to US12556606B2) - Priority date: 2022-05-02
• US17/844,150 (leads to US20220321661A1) - Priority date: 2022-06-20
• US18/418,283 (leads to US12137144B2) - Priority date: 2024-01-21
• US18/418,285 (leads to US12177301B2) - Priority date: 2024-01-21
• US18/675,220 (leads to US12316706B2) - Priority date: 2024-05-28
• US18/797,581 (leads to US20240396971A1) - Priority date: 2024-08-08
• US18/928,051 (leads to US20250055911A1) - Priority date: 2024-10-27
• US18/928,050 (leads to US20250047747A1) - Priority date: 2024-10-27
• US18/928,057 (leads to US20250055913A1) - Priority date: 2024-10-27
• US19/201,954 (leads to US12401721B1) - Priority date: 2025-05-08
• US19/201,951 (leads to US12401720B1) - Priority date: 2025-05-08
• US19/218,295 (leads to US20250392643A1) - Priority date: 2025-05-25
• US19/298,308 (leads to US20250373695A1) - Priority date: 2025-08-13
• US19/298,297 (leads to US20250373694A1) - Priority date: 2025-08-13

Projected Expiration Date

The projected expiration date for US Patent 11,128,710 is January 3, 2033. This date is calculated as 20 years from the earliest effective filing date (January 9, 2012), plus any applicable Patent Term Adjustment.