Method and system for name-face/voice-role association

Details Method and system for name-face/voice-role association Method and system for name-face/voice-role association

2005-08-02

2005-08-02

Ahmed, Samir (Department: 2623)

Image analysis

Applications

Personnel identification

C707S793000, C707S793000, C707S793000, C704S231000, C704S246000, C348S061000

Reexamination Certificate

active

06925197

ABSTRACT:
A method for providing name-face/voice-role association includes determining whether a closed captioned text accompanies a video sequence, providing one of text recognition and speech to text conversion to the video sequence to generate a role-name versus actor-name list from the video sequence, extracting face boxes from the video sequence and generating face models, searching a predetermined portion of text for an entry on the role-name versus actor-name list, searching video frames for face models/voice models that correspond to the text searched by using a time code so that the video frames correspond to portions of the text where role-names are detected, assigning an equal level of certainty for each of the face models found, using lip reading to eliminate face models found that pronounce a role-name corresponding to said entry on the role-name versus actor-name list, scanning a remaining portion of text provided and updating a level of certainty for said each of the face models previously found. Once a particular face model/voice model and role-name association has reached a threshold the role-name, actor name, and particular face model/voice model is stored in a database and can be displayed by a user when the threshold for the particular face model has been reached. Thus the user can query information by entry of role-name, actor name, face model, or even words spoken by the role-name as a basis for the association. A system provides hardware and software to perform these functions.

REFERENCES:
patent: 6629107 (2003-09-01), Ouchi et al.
patent: 2001/0003214 (2001-06-01), Shastri et al.
patent: 2002/0022959 (2002-02-01), Nakamura et al.
patent: 0648054 (1995-04-01), None
www.imdb.com; a website which contains a database of actors/actresses/movies/characters/roles/etc. which a user places a query about any one of these variables to obtain information of other related variables in the database.
S. Satoh et al., “Name-It: Association of Face and Name in Video”, School of Computer Science, Dec. 1996, CMU-CS-96-205, pp.1-17.
S. Satoh et al., “Name-It: Naming and Detecting Faces in News Videos”, National Center for Science Information Systems, IEEE Multimedia Jun. 1999, No. 1, pp. 22-35.
R. Hamada et al., “Associating Video with Related Documents”, Graduate School of Electrical Engineering, University of Tokyo, ACM Multimedia Conference, Oct. 1999, vol. 2, pp. 12-20.

Affiliated with

Also associated with

Rating

Method and system for name-face/voice-role association does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Method and system for name-face/voice-role association, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and system for name-face/voice-role association will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3450755