Data processing: artificial intelligence – Adaptive system
Reexamination Certificate
1998-08-27
2002-12-03
Starks, Jr., Wilbert L. (Department: 2122)
Data processing: artificial intelligence
Adaptive system
C706S013000, C706S015000
Reexamination Certificate
active
06490570
ABSTRACT:
The present invention relates to an architecture, embodied either in hardware or a software agent or in a combination of hardware and software, adapted to develop reflexes and, more particularly, conditioned reflexes.
The interest of such an architecture is two-fold. Firstly, by being able to develop conditioned responses which are linked to unfulfilled operational requirements (needs), an architecture of this type can maximise the probability of satisfaction of its requirements and thus maximise its operational efficiency, for example, by increasing the duration of its useful working life. Secondly, an architecture having reflexes which are conditioned, at least in part, by externally-given user inputs, appears to the user to be exhibiting behaviour in a quasi-social manner. Such an observation leads to the experiencing by the user of a feeling of sympathy towards the machine or programme embodying the architecture. This type of sympathetic response to the architecture is something which has long been viewed as a desirable goal in the field of artificial intelligence (A.I.). One of the reasons why this goal is highly valued, is that it is generally considered that the user who feels sympathy towards a machine or software agent will better cooperate with that machine or software agent in the achievement of a common task. Moreover, the user will find working with this machine or software agent to be more congenial.
In the field of artificial intelligence, it has already been proposed to create architectures which, based on sensory inputs, can exhibit behavioural patterns which, to a human observer, appear to denote intelligence. See, for example, “A Robust Layered Control System For A Mobile Robot” by R. A. Brooks, IEEE Journal of Robotics and Automation, RA-2(1):14-23, 1986. Brooks' creatures are based on a so-called subsumption architecture and, based on a small set of primitive behaviours, without symbolic expression, they exhibit apparently very complex behaviour. Brooks' work represents an example of behaviour-based artificial intelligence.
However, in order for human user to feel sympathy towards a machine or software agent, it is not sufficient for that machine or software agent to exhibit behaviour which appears to be intelligent, it is also important that there should be an inference of emotion. This has been seen, for example, from the work of Bates (“The Role of Emotion in Believable Characters” by J. Bates, Communication of the ACM 37(7):122-125, 1994). Bates was interested in creating animated characters which would be considered to be believable by human users. His “believable” characters attracted people because they appeared to imitate human-like expressions of emotion and, thus, to show an “illusion of life”. The importance of this inference of emotion in attracting or creating the sympathy of human users has also been shown by other studies such as the “Neurobaby” project (“Neurobaby” by N. Tosa in Visual Proceedings of SIGGRAPH-93 Tomorrow's Realities. ACM SIGGRAPH, 1993) and the ALIVE project (“Situation Action: A Symbolic Interpretation” by Percy Maes in Communications of the ACM 38(11):108-114). Moreover, the degree of attachment which humans can develop for animated characters which exhibit an “illusion of life” is seen from the fact that many owners of Tamagochi™ cry when the animated character embodied therein “dies”.
The present invention is based on a model which postulates that emotional expressions in humans are rooted in the experiencing of bodily needs. Although, it is clear that the needs of computers and software agents are different from those of humans, the architecture of the present invention implements an approach which metaphorically resembles that of humans when experiencing bodily needs, according to the postulated model.
More particularly, the present invention provides a system adapted to develop reflexes conditioned by experience, comprising: at least one application module having an operational requirement and adapted, when said operational requirement is not satisfied, to output a signal indicative of a need condition; a regulatory unit adapted to receive said need signal and to produce a control signal leading to a manifestation, perceptible to an external agent or user, of the existence of an unsatisfied operational requirement; input means for detecting an input or event of external origin, said input or event being adapted to cause the operational requirement of said application module to be satisfied; a conditioning unit adapted to receive signals indicative of the existence of unsatisfied operational requirements in application modules of said system, signals indicative of the manifestation perceptibly to external agents or users of the existence of the unfulfilled operational requirement, signals indicative of the detection of satisfaction inputs or events of external origin, and to generate a signal indicating the probability of satisfaction of a present unsatisfied operational requirement based on values of said received signals for previous unsatisfied operational requirements; wherein at least one unit in the system adapts its operation as a function of the value of said expectation signal.
By developing reflexes, especially reflexes conditioned by the reaction of human users or other non-human agents with which the architecture interacts, directed at the satisfaction of unsatisfied operational requirements (needs), the architecture according to the present invention optimises the chances of obtaining satisfaction of its operational requirements and exhibits a behaviour which, to a human observer, implies the existence of emotional states. This latter feature leads to a feeling of sympathy in the human user towards the machine or software agent embodying the architecture.
Other advantageous features of embodiments of the invention are recited in the dependent claims appended hereto.
REFERENCES:
patent: 5390282 (1995-02-01), Koza et al.
patent: 5880731 (1999-03-01), Liles et al.
patent: WO 93/21586 (1993-10-01), None
patent: WO 96/37815 (1996-11-01), None
patent: WO 97/12318 (1997-04-01), None
Jacak W. et al.: “Lifelong Learning approach to intelligent agents modeling” Computer Aided Systems Theory—Eurocast '97. Selection of Papers From the 6th Int'l Workshop on Computer Aided Systems Theory. Proceedings, Computer Aided Systems Theory—Las Palmas de Gran Canaria, Spain, Feb. 24-28, 1997, ISBN; 3-540-63811-3, 1997, Berlin, Germany, Springer-Verlag, Germany, pp. 367-379.
Maes P.: “Social interface agents: acquiring competence by learning from users and other agents” Software Agents, Papers From The 1994 AAAI Spring Symposium, Proceedings of AAAI Spring Symposium Series 1994, Stanford, CA, USA, Mar. 21-23, 1994, ISBN 0-929280-59-8, 1994, Menlo Park, CA, USA, AAAI Press, USA, pp. 71-78.
Heidy Maldonado, Antoine Picard, Patrick Doyle and Barbara Hayes-Roth; Tigrito: a multi-mode interactive improvisational agent; Proceedings of the 1998 international conference on Intelligent user interfaces, San Francisco, CA USA, Jan. 6-9, 1998, Pa.*
Heidy Maldonado, Antoine Picard and Barbara Hayes-Roth; Tigrito: a high-affect virtual toy; Proceedings of the conference on CHI 98 summary: human factors in computing systems, Apr. 18-23, 1998, p. 367.*
John L. Moreland and David R. Nadeau; The virtual reality behavior system (VRBS): using Perl as a behavior language for VRML; Proceedings of the 1995 symposium on Virtual reality modeling language, 1995, pp. 63-68, Jan. 1998.
Kessler Gordon
Starks, Jr. Wilbert L.
LandOfFree
Hardware or software architecture adapted to develop... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Hardware or software architecture adapted to develop..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Hardware or software architecture adapted to develop... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2997225