Obviousness

Obviousness Analysis of US Patent 8031223 Under 35 U.S.C. § 103

This analysis evaluates the obviousness of US Patent 8031223, which claims a "Virtual reality camera," under 35 U.S.C. § 103, based on the prior art landscape as described within the patent's "BACKGROUND OF THE INVENTION" section and the priority date of August 20, 1999. A person having ordinary skill in the art (PHOSITA) at that time would possess knowledge of digital camera technology, image processing techniques for panoramic stitching, and interactive viewing software.

The primary inventive concepts of US 8031223, as articulated in its summary claims, center on integrating known panoramic image creation and viewing functionalities directly into a digital camera. The patent itself identifies key problems in the prior art that the invention aims to solve:

1. Photographers typically needed to download digital photos to a separate computer to run a "stitching" application (e.g., PhotoVista® software) to combine them into a panoramic image. This meant "the photographer needs to take a computer with him in the field".
2. The inability to create and view the panoramic image in the field meant "the photographer cannot see the quality of his panoramic image while in the field," making it difficult to correct problems.
3. Accurately aligning adjacent fields of view was challenging, often requiring mechanical aids like "a tripod bracket that has equi-spaced notches".

A PHOSITA in 1999, aware of these problems and the existing technological landscape, would have been motivated to combine known elements in an obvious manner to address these shortcomings.

Combination of Prior Art for Obviousness

The following combinations of prior art elements, as described in the patent's background, would render the claims of US 8031223 obvious:

1. In-Camera Alignment Assistance via Viewfinder Compositing (Relevant to Claim 1)

• Prior Art Elements:

  • Cameras with viewfinders: Standard digital camera technology included viewfinders for displaying the live scene.
  • The problem of accurate alignment: The background explicitly states that "When rotating the camera freely in his hand, it is difficult for a photographer to accurately align adjacent fields of view" and even with tripod brackets, precision was important.
  • Image compositing techniques: The general concept of compositing or "stitching" images was known, as evidenced by "stitching application[s]" like "assignee's PhotoVista® software" that combined digital photos.

• Motivation to Combine: A PHOSITA would recognize the critical need for improved alignment assistance in panoramic photography, especially in the field. Knowing that image compositing was a technique used post-capture to combine images, it would be an obvious step to apply a form of this technique pre-capture in the viewfinder. Integrating known compositing methods to overlay a portion of a previously captured frame onto the live current field of view in the viewfinder would provide real-time visual feedback to the photographer, directly addressing the stated problem of accurate alignment. This would guide the photographer to achieve the desired overlap and reduce errors, thereby improving the efficiency and quality of in-field panoramic image acquisition.

2. In-Camera Panoramic Stitching and Playback (Relevant to Claims 3 and 4)

• Prior Art Elements:

  • Digital cameras with internal processing, memory, and displays: By 1999, digital cameras were equipped with internal processors, memory for storing images, and displays (viewfinders).
  • Computer-based panoramic stitching software: The background details that "digital photos are then downloaded to a computer, and a 'stitching' application is run to combine the digital photos into a single panoramic image". "PhotoVista® software" is given as an example.
  • Computer-based interactive panoramic viewing software: The patent describes "Client viewer software" that "enables users to interactively view panoramic images by navigating through the panorama" on a "client computer video display." This software "converts a selected portion of the panoramic image... from cylindrical or other surface geometry to rectilinear geometry" and allows for "shifting the selected portion up, down, left, right, or other directions, and for reducing or enlarging the current magnification factor, by zooming in and out".
  • The problem of in-field processing and viewing: The patent explicitly states the "disadvantage is that the photographer needs to take a computer with him in the field. Otherwise, he cannot create and view the panoramic image while in the field".

• Motivation to Combine: A PHOSITA would be strongly motivated to combine the known functionalities of computer-based panoramic stitching and interactive viewing into a single, portable digital camera. As digital camera hardware became more powerful, it would be an obvious engineering goal to integrate these existing software capabilities directly into the camera to overcome the "burdensome" need for a separate computer in the field. This integration would allow photographers to "create and view the panoramic image while in the field" and immediately "see the quality of his panoramic image," directly solving the identified problems.

3. Memory-Efficient In-Camera Coordinate Transformation (Relevant to Claim 2)

• Prior Art Elements:

  • Texture mapping for panoramic images: It was known that "Panoramic images are typically texture mapped into a suitable surface geometry, such as a cylindrical or a spherical geometry" from rectilinear input. The mathematical basis for such transformations (e.g., from rectilinear (x, y) to cylindrical (a, h) coordinates as shown in Equations 5 and 6 of the patent) would be known or derivable by a PHOSITA.
  • Memory constraints in embedded systems: A PHOSITA would be aware that embedded systems like digital cameras have more limited memory resources compared to personal computers.

• Motivation to Combine: When implementing resource-intensive image processing tasks, such as coordinate transformations for panoramic texture mapping, within the memory-constrained environment of a digital camera, a PHOSITA would be motivated to employ memory-efficient techniques. The concept of "in-place" processing, where data is transformed and overwritten in the same memory buffer, is a standard optimization strategy to conserve memory. Applying this known optimization to the necessary rectilinear-to-cylindrical coordinate transformation, perhaps through a multi-pass approach (e.g., "left-to-right pass and the right-to-left pass" described in the patent), would be an obvious engineering choice to enable complex image processing within the camera's hardware limitations.

4. Standardized Image Processing Algorithms for In-Camera Stitching (Relevant to Claim 5)

• Prior Art Elements:

  • Panoramic stitching process: The general process of stitching images involved "spatially aligning, chromatically aligning and stitching them together".
  • Spatial alignment techniques: Techniques for determining horizontal and vertical offsets between images for alignment, such as Sum of Absolute Differences (SAD), were commonly known and used in image processing fields like motion estimation (e.g., in video compression) by 1999.
  • Chromatic alignment (color correction/blending) techniques: Methods for adjusting brightness and contrast to chromatically align images, often involving histogram matching or similar color correction models, were known. The patent even references "Assignee's co-pending application U.S. Ser. No. 08/922,732, filed on Sep. 3, 1997 and entitled 'A Method and System for Compositing Images'" for blending techniques, acknowledging prior work in this area.
  • Image compositing: The act of generating a panoramic image by compositing portions of frames was the fundamental step of any "stitching application".

• Motivation to Combine: Given the motivation to perform panoramic stitching within a camera (as per point 2 above), a PHOSITA would naturally select and combine well-known and efficient image processing algorithms to achieve the required spatial alignment, chromatic alignment, and compositing steps. SAD is a computationally straightforward method for estimating image offsets. Adjusting brightness and contrast is a fundamental aspect of color correction. Combining these standard algorithmic building blocks would be an obvious implementation choice for a PHOSITA tasked with developing in-camera stitching functionality to produce a high-quality panoramic image.

In conclusion, the patent US 8031223 describes an invention that integrates several individually known functionalities and techniques into a single, self-contained digital camera. The problems addressed by the patent—in-field alignment, in-field processing, and in-field viewing—were well-recognized disadvantages of the prior art. Given the increasing capabilities of digital camera hardware and the existence of computer-based solutions for each individual problem, a PHOSITA at the priority date would have a clear and explicit motivation to combine these known elements in the manner claimed to create a more convenient and effective panoramic camera. The claimed methods and systems represent an obvious application of existing technologies to address identified market needs and technical limitations.