Data processing: presentation processing of document – operator i – Presentation processing of document – Layout
Reexamination Certificate
1999-03-18
2003-11-11
Hong, Stephen S. (Department: 2178)
Data processing: presentation processing of document, operator i
Presentation processing of document
Layout
C715S252000, C715S252000, C348S460000, C348S468000, C348S700000
Reexamination Certificate
active
06647535
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of Invention
This invention relates to real-time storyboarding using a graphical user interface to automatically parse a video data signal and browse within the parsed video data signal. Specifically, this invention is directed toward systems and methods that generate a real-time storyboard on a distributed network, such as the World Wide Web (WWW), and a graphical user interface tool for fast video analysis of both compressed and uncompressed video images for automatic parsing and browsing.
2. Description of Related Art
A “document” is no longer merely a conventional paper product. Rather, a “document” now encompasses electronic multimedia files which can include audio, video and animations, in addition to text and images. Nevertheless, people still prefer to print or have a hard copy of the multimedia document for various reasons, including portability and ease of reading. For space-dependent information, such as text and images, printing is easy.
Video is becoming an important element in many applications, such as multimedia, news broadcasting, video conferencing and education. A plethora of scholars, including political scientists, physicians and historians, study video or multimedia documents as a primary source of educational or research material. By using traditional techniques, such as video recorders, one is able to view the material of interest, or fast forward and/or rewind to sections deemed important. However, since video content is generally extremely vague, multimedia and video cannot be handled as efficiently as text. For example, most multimedia and video application systems rely on interactive user input to compile the necessary representative static data.
SUMMARY OF THE INVENTION
However, to easily scan the content of a document containing audio/video or animations, or print portions of the document containing audio/video or animations, the dynamic information must first be converted into a static counterpart. By performing a real-time dynamic-to-static conversion on the video or multimedia document, the methods and systems of this invention enable printing and/or viewing through a distributed network, such as the World Wide Web (WWW), whether or not the original source contains command information pertaining to the significant or representative frames of the document. The command information which is embedded during production specifically indicates that one or more frames is representative of a particular segment of the document.
In one example, a corporation desires to show a video to its employees that contains the chief executive officer's report of the previous quarter, questions and answers and some of the company's new products. Traditionally, this is achieved by collocating the employees in a conference room and showing them the video, or performing a multicast throughout the company. Another way to show the report would be to convert the video into a format which can be displayed as a video on an intranet or the Internet, such as in a web page, thereby allowing employees to view it at their discretion. However, this would require tremendous bandwidth and storage capabilities.
Alternatively, by processing the video or multimedia document, the systems and methods of this invention summarize the original video, i.e., the dynamic information, by placing representative static images, and if appropriate, associated text, into a web document for viewing. This overcomes the storage and bandwidth problems previously mentioned, as well as solves the problem of scanning or printing a dynamic document. Since the dynamic media is converted into static media before being presented, the static media can then be printed during a presentation using commonly used and known techniques.
Once a video or multimedia document has been disassembled into key frames and placed on a distributed network or into a web document, a user is able to further browse the details of each segment represented by the key frame.
This invention provides systems and methods for real-time storyboarding on a distributed network.
This invention separately provides a graphical user interface that allows both automatic parsing and browsing of video sequences from the key frames.
This invention separately provides methods and systems for automatic video parsing of a video and/or for browsing through the, video using a graphical user interface.
This invention separately provides for real-time dynamic-to-static conversion of video documents.
This invention also provides systems and methods that allow for printing and/or viewing static documents through a distributed network, such as the World Wide Web, when the original source is a video or multimedia document.
This invention separately provides systems and methods that reduce the dependency on humans to create visual aids representing meaningful segments of a video or multimedia document.
This invention separately provides systems and methods that eliminate required interactive components for translating a parsed incoming video data signal into meaningful segments.
By using statistical methods based on frame and histogram differencing, key frames can be extracted. The extracted key frames associated with each segment can then be used for fast browsing or for retrieving the actual video or multimedia clip represented by that key frame. For example, a first image, e.g., captured frame, of a segment could be shown. Through a graphical user interface, the user could elect to play the remainder of the segment, or skip forward to the next significant, or key, frame.
REFERENCES:
patent: 5481296 (1996-01-01), Cragun et al.
patent: 5485554 (1996-01-01), Lowitz et al.
patent: 5703655 (1997-12-01), Corey et al.
patent: 5852435 (1998-12-01), Vigneaux et al.
patent: 5959622 (1999-09-01), Greer et al.
patent: 5959687 (1999-09-01), Dinwiddie et al.
patent: 6006241 (1999-12-01), Purnaveja et al.
patent: 6031526 (2000-02-01), Shipp
patent: 6097442 (2000-08-01), Rumreich et al.
patent: 6098082 (2000-08-01), Gibbon et al.
patent: 6154771 (2000-11-01), Rangan et al.
patent: 6219837 (2001-04-01), Yeo et al.
patent: 6271892 (2001-08-01), Gibbon et al.
patent: 6297797 (2001-10-01), Takeuchi et al.
patent: 6363380 (2002-03-01), Dimitrova
patent: 6366699 (2002-04-01), Kuwano et al.
patent: 6462754 (2002-10-01), Chakraborty et al.
patent: 6463444 (2002-10-01), Jain et al.
H. Yu et al., “Feature-Based Hierarchical Video Segmentation,” Princeton University, Electrical Engineering. Department, 1996.
H. Zhang et al., “Content-Based Video Browsing Tools,”SPIE, vol. 2417, Feb. 1995, pp. 389-398.
Y. Tonomura et al., “VideoMAP and VideoSpaceIcon: Tools for Anatomizing Video Content,”INTERCHI '93. The Netherlands, Apr. 24-29, 1993, pp. 131-136.
M. Yeung et al., “Video Browsing Using Clustering and Scene Transitions on Compressed Sequences,”SPIE, vol. 2417, Feb. 1995, pp. 399-413.
“An Exploration of Dynamic Documents,” http://home.netscape.com/assist
et_sites/pushpull.html, Sep. 25, 1998.
VISICOM, Vigra products, http://www.vigra.com, Sep. 25, 1998.
Cheetah Systems, Inc., http://www.caption.com/products/index.shtml, Sep. 25, 1998.
Bozdagi Gozde
Bryll Robert
Campanelli Michael R.
Harrington Steven J.
Yu Hong Heather
Hong Stephen S.
Huynh Thu V.
Oliff & Berridg,e PLC
Xerox Corporation
LandOfFree
Methods and systems for real-time storyboarding with a web... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Methods and systems for real-time storyboarding with a web..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Methods and systems for real-time storyboarding with a web... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3173497