Obviousness

US patent 8830293, "Video superposition for continuous presence," faces potential obviousness challenges under 35 U.S.C. § 103, particularly when considering the combination of prior art references that were available around its May 26, 2009, priority date. A person having ordinary skill in the art (PHOSITA) in the field of video teleconferencing would have been motivated to combine existing technologies to address the limitations of conventional continuous presence solutions, such as the "Hollywood Squares" layout, which reduces participant image size and lacks a natural sense of depth.

The core invention of US8830293 involves combining real-time video streams by separating subject images from their backgrounds, scaling, and superimposing them to create a combined frame where subjects appear in anterior (foreground) and posterior (background) positions, without substantially reducing their size, thus simulating a shared physical space (e.g., "stadium seating").

Obviousness Analysis of Independent Claim 1

Independent Claim 1 describes a method comprising:

1. Receiving at least first and second real-time video streams, each with a subject image and a background image.
2. Combining subject images into a combined frame where the first video stream's subject is anterior and the second's is posterior.
3. This combining specifically includes:
   • Scaling video frames of the first video stream and repositioning pictures in a first direction.
   • Removing the background image from these scaled frames to produce first background separated video frames for the anterior portion.
   • Superimposing these first background separated frames onto corresponding video frames of the second video stream.
4. Supplying the combined video stream to a video display.

Combination of Prior Art References:
A compelling combination for rendering Claim 1 obvious would include:

• US20090033737A1 (Goose): "Method and System for Video Conferencing in a Virtual Environment."
• US20080095470A1 (Chao): "Digital Image Auto-Resizing."
• General knowledge of video segmentation techniques (e.g., chroma keying, pixel comparison).

Rationale for Obviousness:

1. Receiving real-time video streams with subject and background images: Goose teaches a "Method and System for Video Conferencing in a Virtual Environment." In a video conferencing system, it is inherent that real-time video streams from participants would be received, and these streams would contain images of participants (subject images) and their surroundings (background images). Goose's focus on a "virtual environment" for conferencing would immediately suggest processing these streams to place participants within a shared digital space.

2. Combining subject images for anterior/posterior positioning: Goose's objective to place participants in a "virtual environment" would motivate a PHOSITA to combine subject images to create a unified view. To enhance realism and overcome the flat, grid-like appearance of traditional "Hollywood Squares" continuous presence, a PHOSITA would readily consider arranging participants with a sense of depth, such as placing one participant's image in front of another (anterior/posterior). This is a common design choice in visual composition to create a more natural and "life-like" scene, a goal explicitly stated by US8830293B2.

3. Scaling video frames of the first video stream and repositioning: Chao teaches "Digital Image Auto-Resizing." A PHOSITA would find it obvious to apply image resizing techniques, such as those taught by Chao, to scale the video frames of the first stream. Repositioning the scaled pictures in a "first direction" is a fundamental image manipulation technique, especially when aiming for a specific layout within a combined frame, such as anterior placement. This adjustment would be a predictable design choice to achieve the desired visual arrangement.

4. Removing the background image to produce background separated video frames for the anterior portion: Goose's "virtual environment" necessarily requires separating participants from their original backgrounds before they can be placed into a new, shared virtual space. By 2009, techniques for video segmentation and background removal, such as blue screen (chroma keying) or pixel comparison, were well-known in the art and commonly used in video production and effects. US8830293B2 itself describes these techniques as conventional means for background separation. A PHOSITA would readily apply these known methods to the scaled video frames of the first stream to isolate the subject image for foreground display.

5. Superimposing the first background separated video frames onto corresponding ones of the video frames of the second video stream: Once the subject image from the first video stream is separated from its background, superimposing it onto the second video stream is a standard compositing technique. This directly achieves the anterior/posterior arrangement where the first subject is layered "over" the second stream. This is a natural consequence of implementing a virtual environment (Goose) and separating foreground subjects.

6. Supplying the combined video stream to a video display: Any video conferencing system, including those envisioning a "virtual environment" (Goose), would necessarily output the resulting combined video stream to a display for viewing by participants.

Motivation to Combine:
A PHOSITA would have been motivated to combine Goose, Chao, and general knowledge of video segmentation to create more advanced and natural-looking continuous presence video conferences. The desire to move beyond the limitations of "Hollywood Squares" (acknowledged by US8830293B2) and provide a more immersive "face-to-face, non-animated teleconference environment" (as implied by US5572248A and directly addressed by Goose) would drive this combination. Implementing a "virtual environment" (Goose) logically requires separating subjects from backgrounds (known techniques) and manipulating their size and position (Chao) to create a desired visual depth and composition. The specific anterior/posterior arrangement, scaling, and superimposition are predictable design choices for achieving a more realistic and engaging combined view within such a virtual conferencing context.

Obviousness of Dependent Claims

Claim 3 (Method variation for combining):
Claim 3, dependent on Claim 1, further specifies: scaling the second video stream and repositioning it in a second (opposite) direction, extending its background, and then superimposing the first background separated frames onto these background-extended second frames.

• Scaling and Repositioning the second video stream: Similar to the first stream, applying scaling (Chao) and repositioning to the second stream is a straightforward image manipulation. If the first stream is positioned anteriorly, repositioning the second stream in an "opposite" direction for posterior placement is a natural design choice for creating depth.
• Extending the background image in the second sequence of scaled video frames: The patent describes "inpainting" as a technique for extending backgrounds, noting it can be achieved by creating static filler images or by copying and flipping portions of the existing background. These are known video enhancing techniques. If the second video stream is scaled down for posterior placement, its original background might not fill the entire required area. A PHOSITA would find it obvious to use known background extension methods to seamlessly fill any gaps and maintain a complete background image, especially to avoid unsightly borders or blank spaces and contribute to the "life-like" illusion.

Motivation for Claim 3: A PHOSITA, aiming for a highly polished "virtual environment" (Goose) or natural "stadium seating" effect (US8830293B2), would be motivated to apply scaling and repositioning consistently to both foreground and background elements. Extending the background of the posterior stream with known techniques (like inpainting) would be an obvious step to ensure a visually coherent and complete scene, preventing visual artifacts that could break the illusion of continuous presence.

Claim 5 (Method variation using supplemental background):
Claim 5, dependent on Claim 1, further specifies: removing backgrounds from both first and second video streams, generating supplemental background image video frames, and superimposing both background-separated subjects onto the supplemental background.

• Removing background images in both first and second video streams: This is a direct and obvious application of known background separation techniques (e.g., chroma keying, pixel comparison) to all participant streams when the goal is to place them into an entirely new, shared "virtual environment" as taught by Goose.
• Generating supplemental background image video frames: Goose explicitly teaches video conferencing in a "virtual environment." A key aspect of a virtual environment is the use of a generated or predetermined virtual background. Therefore, generating a "supplemental background image" is directly anticipated by Goose.
• Superimposing background-separated subjects onto the supplemental background: Once the subjects are separated from their original backgrounds, superimposing them onto a generated virtual background is the fundamental operation for creating a composite scene in a "virtual environment" (Goose).

Motivation for Claim 5: A PHOSITA, seeking to create a truly integrated "virtual environment" for video conferencing as envisioned by Goose, would be strongly motivated to employ this approach. Removing all original backgrounds and placing the separated subjects onto a new, unified supplemental background allows for greater control over the visual context and enhances the illusion that all participants are present in the same virtual space, thus improving the "natural and pleasing to view" aspect of continuous presence.