Television – Image signal processing circuitry specific to television – Special effects
Reexamination Certificate
1998-06-04
2002-06-25
Garber, Wendy R. (Department: 2612)
Television
Image signal processing circuitry specific to television
Special effects
C348S036000, C348S157000, C348S159000, C348S218100, C348S586000, C348S700000, C382S103000, C382S195000, C382S284000
Reexamination Certificate
active
06411339
ABSTRACT:
TECHNICAL FIELD
The present invention relates to a technology for generating new videos by integrating a plurality of videos and, more particularly, a method of spatio-temporally integrating/managing a plurality of videos and a system for embodying the same and a recording medium for recording a program for carrying out the method.
BACKGROUND ART
With the progress of high performance of the computer, large capacity of the hard disk, reduction in size and digitization of the camcorder, and lower costs of them, spread of these devices into general families has been accelerated. According to such spread of the high performance computer and the mass storage hard disk and in addition establishment of the information compression technology, digitization of videos has become close to us. According to such digitization the videos, the videos have be able to be handled with the general-purpose personal computer and also be output to the high resolution display for the personal computer. In general, the videos have been limited to be output to the TV monitor (640×480 pixels) only, but this has enabled the videos to be output by the resolution in excess of the resolution of the TV monitor. For example, a plurality of videos has been able to be displayed simultaneously on the display for the personal computer, etc.
With such development of video devices, several methods of enhancing the videos have been reported. In a literature, Michael Irani and Samuel Peleg; “Motion Analysis for Image Enhancement: Resolution, Occlusion and Transparency”, Journal of Visual Communication and Image Representation, Vol.4, No.4, December, pp.324-335, 1993, the method of achieving the high resolution of the videos by using motion information in the videos and the method of interpolating the background hiding area caused by the subject, etc. have been proposed. In addition, Laura A. Teidcio has reported the method of generating the high resolution still pictures from the videos (Patent Application Publication (KOKAI) Hei 5-304675). In recent, ORAD Corporation has published the system “Digital Replay” which can implement reproduction of the videos to which new values added are attached. As system functions, for example, the system has have the functions of enhancement representation, tracing, and magnification of the subject, and the function for displaying information of figures and segments thereof, distances and velocities, etc. together with the videos.
Moreover, there has been reported a new user interface of the videos. In a literature, “A Magnifier Tool for Video Data”, Proceedings of CHI '92, pp.93-98 (1992), M. Mill et al. have reported that the video frames are arranged in the space according to the resolution level of time, so that the new video looking and accessing style to the time can be attained from coarse time resolution to fine time resolution. Still more, in a literature, “Motion Image Processing”, Striking Possibilities, ADVANCED IMAGING, AUGUST (1992), E. Elliot and A. W. Davis have reported that the new representing method of time information of the videos and the intuitive access to the time information can be achieved by representing three-dimensional object, i.e., video picture (two-dimensional)+time (one-dimensional).
In the meanwhile, under circumstances in which it becomes easy to input the videos by the camcorder and display style can be made free, the request for handling of a plurality of videos has occurred. For example, “a plurality of videos” used herein signifies either the plurality of videos which are picked up by a plurality of camcorders set up in the sport stadium such as the Olympics or the videos which are picked up by a single camcorder but show behaviors of different players. Further, “handling” used herein signifies that the plurality of videos are appreciated, compared, searched, edited, etc. simultaneously.
However, according to the above reports in the prior art, there have been unsolved problems in the plurality of videos. According to the reports in the prior art, the enhancement of one shot has been achieved, but the enhancement of the plurality of videos by applying relations between plural videos to the plurality of videos has not been implemented. In addition, the plurality of videos have not integrated spatio-temporally and managed integratedly. “Enhancement of the plurality of videos” used herein signifies to execute the correlation between the plurality of videos, to extract automatically the video contents information (object information reflected actually on the videos, i.e., subject information), and to represent them visually. Also, it signifies to generate one or plural videos in which correlation of the plurality of videos and the video contents information are represented visually. For instance, one example is to generate one video, in which respective players are overlapped in the common space, from the plurality of videos which pick up behaviors of different players. “To manage spatio-temporally” is that information extracted based on the spatio-temporal video structure is managed integratedly. For example, the subject and the background are separated and managed respectively and also their spatio-temporal relation information are managed. To manage the plurality of videos integratedly by using the spatio-temporal structure has not been included in the object of the prior art. It has been impossible to manage the plurality of videos spatio-temporally integratedly only by combining merely the prior arts.
In the prior art, the implemented video user interface has represented the videos again simply, so that it has not extracted positively information of the videos and relations between the plurality of videos to enhance the videos. Since the contents of the videos and the relations between the plurality of videos have not been taken into account, it has been impossible to grasp intuitively the videos and the contents of the videos and enhance newly the video information, especially, information concerning the time. Also, since the plurality of videos have not been managed spatio-temporally, it has been impossible to interact the contents of the videos more precisely.
Like the above, according to the reports as with the enhancement of the videos, the user interface, etc. reported in the prior art, there has been no enhancement to assign high value added to the plurality of videos and no representation which can manage, represent, and operate the videos spatio-temporally integratedly. In other words, there have been problems in the prior art.
It is an object of the present invention to provide a method of spatio-temporally integrating/managing a plurality of videos and a system for embodying the same and a recording medium for recording a program for carrying out the method, which are capable of integrating spatio-temporally a plurality of videos to enhance the videos and managing, representing, and operating spatio-temporally integratedly a plurality of videos, in order to acquire information of plural videos from a plurality of videos picking up the same space effectively in response to user's interest and object in their own style.
DISCLOSURE OF INVENTION
In order to achieve the above object, the present invention provides a system for spatio-temporally integrating/managing a plurality of videos, comprising: an image data string memory portion for reading video data to save them as data string; a camcorder operation condition detecting portion for reading the data string from the image data string memory portion and detecting camcorder operation condition information including camcorder on/off information and camcorder operating information; a video splitting portion for splitting videos of the data string into respective shots based on the camcorder on/off information; a subject/background separating portion for separating a subject and a background every frame of the videos by using the camcorder operating information and physical feature properties; a subject motion information extracting portion for correlating subject
Akutsu Akihito
Hamada Hiroshi
Tonomura Yoshinobu
Garber Wendy R.
Nippon Telegraph and Telephone Corporation
Olson & Hierl Ltd.
Villecco John M
LandOfFree
Method of spatio-temporally integrating/managing a plurality... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method of spatio-temporally integrating/managing a plurality..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method of spatio-temporally integrating/managing a plurality... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2969620