Computer graphics processing and selective visual display system – Display driving control circuitry – Controlling the condition of display elements
Reexamination Certificate
1997-09-23
2001-12-18
Dela Torre, Crescelle N. (Department: 2173)
Computer graphics processing and selective visual display system
Display driving control circuitry
Controlling the condition of display elements
C345S215000
Reexamination Certificate
active
06331864
ABSTRACT:
FIELD OF THE INVENTION
This invention relates generally to programming environments and, more specifically, to an improved visual programming interface and interface support process.
BACKGROUND OF THE INVENTION
In the fields of computational control and research, events are abstractions which are typically based upon physical phenomena. Researchers or real-time managers may gain access to these events through mathematical, numerical, textual, audio or graphical techniques. Although each of these techniques augments the perspectives brought to bear on an event, each has its advantages and disadvantages when conveying information.
Comprehension of information results from the interplay and juxtaposition of these various techniques. That is, the juxtaposition of graphical, textual, and numerical techniques gives graduated access to data streams. Visual representation, i.e., the use of visual and auditory displays to represent information, has emerged as a desirable environment with which to effectively convey information, because visual representation allows simultaneous presentation of multiple data streams.
Some general-purpose visualization systems include visual programming interfaces for researchers/users to create their own visualization environments from a library of program modules. The researcher/user must have a reasonably good understanding of software coding, because a visual program module within a standard visual programming interface is a software-coded process consisting of a sequence of operations that are organized to produce a specified result. The visual programming interfaces contain graphical tools for users to interactively assemble the modules into dataflow configurations of communication processes so that the users may visualize their data and created dataflow configurations. That is, an output port of one module may be connected to the input port of another module so that when data flows between the modules, the latter module's operations are performed. This requires that the user understand object oriented programming structure and data representation techniques to connect and interpret connected modules. A typical dataflow configuration may thus include a series of interconnected modules that are configured to read data, process that data into new representations, and then display the data on a computer screen.
Despite their flexibility towards customizing dataflow configurations, the general-purpose visual programming systems are not well suited for exploring real-time data streams' interactions or computational research data, or creating multimedia experiences, because they lack essential interactive capabilities and require a user to have expert programming knowledge. For example, user interaction is typically limited to selecting the means for displaying the data without any means for interactively manipulating the data at various stages of the dataflow configuration. As a result, data can only be arranged in specific preconfigured visual arrangements.
In other words, known visual programming systems allow users to merely visualize their data in pre-established ways. This is particularly true in applications involving analysis of empirical data and multimedia programs that allow increased user expression. However, in order to fully analyze or experience their data, users must have real-time tools to probe the value of individual data elements as they impact a variety of parameters. Then they must be able to apply special procedures to a small region-of-interest, e.g., compute the mean data value of a subset of data elements. Further, users must be able to visualize relationships between the data elements in several images or volumes which may span several windows of a computer display.
In summary, there do not exist any visual programming tools that allow a person with little or no programming skill to create in real-time elaborate multimedia audio-visual episodes, computational research studies or human-machine interface with which anyone can interact using a multitude of input and output devices.
The present invention is directed to overcoming the foregoing and other disadvantages. More specifically, the present invention is directed to providing a visual programming interface that allows a user with no programming skill to create in real-time programs for exploring management control options, computational research data relationships or multimedia experiences.
SUMMARY OF THE INVENTION
In accordance with the present invention, a visual programming system with a visual programming interface is provided that allows a user to visually create multimedia programs in real-time. In this system, input and output functions are represented as graphical transmit and receive interface leads, respectively. A user with no programming skill easily links desired transmit interface leads to desired receive interface leads. In real-time, the output devices perform the functions associated with receive interface leads and any changes to the receive interface leads that occur as a result of any links to transmit interface leads. The user may create complex programs by encapsulating transmit and receive interface leads in a boundless number of encapsulation layers, limited only by memory and processor speed.
As will be readily appreciated from the foregoing summary, the invention provides a new and improved method, apparatus and computer-readable medium for visually programming a multimedia program in real-time. The created multimedia program can be saved. The saved multimedia program can then be executed. The program can be manipulated in real-time during execution. Given the nature of the input and/or output device, the computer program created using the GUI
66
may also be referred to as an “arrangement” or a “composition” of inputs and outputs.
REFERENCES:
patent: 4885717 (1989-12-01), Beck et al.
patent: 4914568 (1990-04-01), Kodosky et al.
patent: 5285376 (1994-02-01), Struger et al.
patent: 5291587 (1994-03-01), Kodosky et al.
patent: 5301259 (1994-04-01), Gibson et al.
patent: 5301301 (1994-04-01), Kodosky et al.
patent: 5327529 (1994-07-01), Fults et al.
patent: 5377318 (1994-12-01), Wolber
patent: 5386568 (1995-01-01), Wold et al.
patent: 5388264 (1995-02-01), Tobias, II et al.
patent: 5392207 (1995-02-01), Wilson et al.
patent: 5398313 (1995-03-01), Kojima et al.
patent: 5432903 (1995-07-01), Frid-Nielsen
patent: 5437007 (1995-07-01), Bailey et al.
patent: 5475851 (1995-12-01), Kodosky et al.
patent: 5481741 (1996-01-01), McKaskle et al.
patent: 5537630 (1996-07-01), Berry et al.
patent: 5557730 (1996-09-01), Frid-Nielsen
patent: 5566294 (1996-10-01), Kojima et al.
patent: 5590271 (1996-12-01), Klinker
patent: 5619636 (1997-04-01), Sweat et al.
patent: 5623592 (1997-04-01), Carlson et al.
patent: 5642511 (1997-06-01), Chow et al.
patent: 5651108 (1997-07-01), Cain et al.
patent: 5706453 (1998-01-01), Cheng et al.
patent: 5850548 (1998-12-01), Williams
Konstantinos Konstantinides and John R. Rasure, “The Khoros Software Development Environment for Image and Signal Processing,” 8395 IEEE Transactions on Image Processing, 3(1994)May, No.3, New York, US, pp. 243-252.
Coco Geoffrey P.
Reay C. Phillip
Christensen O'Connor Johnson & Kindness PLLC
dela Torre Crescelle N.
Onadime, Inc.
LandOfFree
Real-time multimedia visual programming system does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Real-time multimedia visual programming system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Real-time multimedia visual programming system will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2583078