Image analysis – Image compression or coding – Interframe coding
Reexamination Certificate
2000-09-12
2004-07-20
Wu, Jingge (Department: 2623)
Image analysis
Image compression or coding
Interframe coding
C382S238000, C375S240140
Reexamination Certificate
active
06766059
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to image processing apparatuses.
2. Description of the Related Art
As a compression-encoding method of images, object encoding has been conventionally known. In object encoding, the foreground and background of a plurality of continuous frames of images (one scene or one cut of image) (for example, frames from a scene change to the next scene change) are extracted. When a plurality of images are formed of N frames, the background (if a scene is taken when a video camera is panned or tilted, for example, the background is a landscape image or a portrait image) of the entire one scene displayed by the N frames and the foreground obtained in the N frames in common are extracted. Data obtained by object encoding is decoded by arranging the foreground in the background. This type of object encoding is described in U.S. Pat. No. 5,706,367, assigned to the assignee of the present application, and hereby incorporated by reference.
In encoding in which the foreground and the background are extracted, such as object encoding, the way the extracted foreground is encoded highly affects the efficiency of encoding.
In encoding in which the foreground and the background are extracted, such as object encoding, the precision of extracting of the background highly affects the quality of the decoded image.
As a method for detecting camera motion in object encoding, a method for regarding the entire frame as one block and achieving block matching can be considered, like a method for detecting the motion vector of a macroblock.
To apply block matching to the entire frame, however, it is necessary to obtain the sum of the absolute-value differences between the pixels of an image on one frame and those of an image on a frame one frame before while the spatial position of the frame for which camera motion is to be detected is being shifted. The amount of calculation is huge and the calculation is troublesome.
SUMMARY OF THE INVENTION
The present invention has been made in consideration of the above situation. Accordingly, it is an object of the present invention to efficiently encode the foreground of an image.
Another object of the present invention is to extract the background from an image highly precisely.
Still another object of the present invention is to easily detect camera motion.
One of the foregoing object is achieved in one aspect of the present invention through the provision of an image processing apparatus for processing the image signal of a plurality of continuous frames, including foreground extracting means for extracting the foreground of each frame from the image signal of the plurality of continuous frames; prediction-information generating means for generating prediction information used for predicting the foreground of each frame according to a front accumulated image obtained by viewing the plurality of continuous frames from the future side in the time-progress direction of the plurality of continuous frames in a condition in which positioning has been applied to the backgrounds of the image signal of the plurality of continuous frames and the foregrounds are overlapped, and a rear accumulated image obtained by viewing the plurality of continuous frames from the past side in the time-progress direction of the plurality of continuous frames in the condition in which positioning has been applied to the backgrounds of the image signal of the plurality of continuous frames and the foregrounds are overlapped; and output means for outputting information including the front accumulated image, the rear accumulated image, and the prediction information as the result of encoding of the foregrounds of the plurality of continuous frames.
One of the foregoing object is achieved in another aspect of the present invention through the provision of an image processing method for processing the image signal of a plurality of continuous frames, including the steps of extracting the foreground of each frame from the image signal of the plurality of continuous frames; generating prediction information used for predicting the foreground of each frame according to a front accumulated image obtained by viewing the plurality of continuous frames from the future side in the time-progress direction of the plurality of continuous frames in a condition in which positioning has been applied to the backgrounds of the image signal of the plurality of continuous frames and the foregrounds are overlapped, and a rear accumulated image obtained by viewing the plurality of continuous frames from the past side in the time-progress direction of the plurality of continuous frames in the condition in which positioning has been applied to the backgrounds of the image signal of the plurality of continuous frames and the foregrounds are overlapped; and outputting information including the front accumulated image, the rear accumulated image, and the prediction information as the result of encoding of the foregrounds of the plurality of continuous frames.
One of the foregoing object is achieved in still another aspect of the present invention through the provision of a recording medium for storing a computer-controllable program for processing the image signal of a plurality of continuous frames, the program comprising the steps of extracting the foreground of each frame from the image signal of the plurality of continuous frames; generating prediction information used for predicting the foreground of each frame according to a front accumulated image obtained by viewing the plurality of continuous frames from the future side in the time-progress direction of the plurality of continuous frames in a condition in which positioning has been applied to the backgrounds of the image signal of the plurality of continuous frames and the foregrounds are overlapped, and a rear accumulated image obtained by viewing the plurality of continuous frames from the past side in the time-progress direction of the plurality of continuous frames in the condition in which positioning has been applied to the backgrounds of the image signal of the plurality of continuous frames and the foregrounds are overlapped; and outputting information including the front accumulated image, the rear accumulated image, and the prediction information as the result of encoding of the foregrounds of the plurality of continuous frames.
One of the foregoing object is achieved in yet another aspect of the present invention through the provision of an image processing apparatus for processing the image signal of a plurality of continuous frames, including extracting means for extracting from the result of encoding including prediction information used for predicting the foreground of each frame, according to a front accumulated image obtained by viewing the plurality of continuous frames from the future side in the time-progress direction of the plurality of continuous frames in a condition in which positioning has been applied to the backgrounds of the image signal of the plurality of continuous frames and the foregrounds are overlapped, and a rear accumulated image obtained by viewing the plurality of continuous frames from the past side in the time-progress direction of the plurality of continuous frames in the condition in which positioning has been applied to the backgrounds of the image signal of the plurality of continuous frames and the foregrounds are overlapped, the front accumulated image, the rear accumulated image, and the prediction information; and decoding means for decoding the image signal of each frame according to the front accumulated image, the rear accumulated image, and the prediction information.
One of the foregoing object is achieved in still yet another aspect of the present invention through the provision of an image processing method for processing the image signal of a plurality of continuous frames, including the steps of extracting from the result of encoding including prediction information used for predicting the foreground of each frame, accordin
Frommer William S.
Frommer & Lawrence & Haug LLP
Wu Jingge
LandOfFree
Image processing apparatus does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Image processing apparatus, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Image processing apparatus will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3227475