Television – Image signal processing circuitry specific to television – Special effects
Reexamination Certificate
2001-06-25
2004-08-17
Lee, Michael H. (Department: 2614)
Television
Image signal processing circuitry specific to television
Special effects
C348S584000, C348S589000, C348S598000, C345S215000
Reexamination Certificate
active
06778224
ABSTRACT:
FIELD OF THE INVENTION
This invention relates to television systems. Specifically, this invention relates to methods and devices for adaptively placing overlay elements in videos.
BACKGROUND OF THE INVENTION
During the production and display of television broadcasts, the images of the video can have various elements overlaid across areas thereof. A typical example of such an overlay element is a closed captioning window, which is usually positioned on the bottom or top of the image. Other overlay elements may include captions for the displayed persons, scoreboards, news tickers, logos etc.
The exact location of the overlay element in the image is usually random and often blocks areas of the image that may be highly desired by viewers to see, such as text or human faces. This is due to the fact that in the analog domain, there are no practical techniques for detecting semantic features and adaptively adjusting the placement of the overlay element in the images.
Consequently, in the case of a closed captioning window, the placement thereof at the bottom or the top of the image is currently made in a manual selection process. As a result, especially in live broadcasts, the closed captioning window or other overlay material or objects is often overlaid across desirable areas of the image thereby occluding (blocking) the same.
Methods and devices are, therefore, needed for adaptively placing overlay elements in images of videos so that the desirable areas of the images are not occluded thereby.
SUMMARY OF THE INVENTION
In accordance with one aspect of the invention, a method for placing overlay elements in images of a digital video so that desirable viewing areas of the images are not occluded thereby, comprises extracting frames from the video, each of the frames defining an image which may have one or more desirable viewing areas which may be identified by detecting face or text, or measuring motion activity in different areas of the frames. For each frame, an area is selected in the image for placing the overlay element and the percentage the overlay element overlaps the desirable viewing areas is determined for the selected area. The selected area may be a randomly selected position in one of a plurality of predetermined positions. The overlay element is placed in the selected area if the percentage is below a maximum allowed predetermined percentage of overlapping. If it is not, one or more other areas in the image are selected and evaluated as described above until an area is found which minimizes occlusion of the desirable viewing areas in the image. These other areas may be one of the other predetermined positions or positions selected using some other selection scheme. Alternatively, the occlusion can be minimized by changing the size, shape, aspect ratio, and/or the like of the overlay element instead of changing its position in the frame. Additionally, occlusion can be minimized by changing the position of the overlay element while simultaneously changing the size, shape, aspect ratio, and/or the like of the overlay element.
In accordance with another aspect of the invention, a device, such as a video transmitter or video receiver, for placing an overlay element in images of a digital video so that desirable viewing areas of the images are not occluded by the overlay element, comprises a frame extractor for extracting frames from the video, each of the frames defining an image which may have at least one desirable viewing area that may be identified by detecting face or text, or measuring motion activity in different areas of the frames. An image processor analyzes the images of the frames to identify desirable viewing areas in the images of the frames. An overlay element locator places the overlaid element in the images of the frames in a manner which minimizes the occlusion of the desirable viewing areas.
REFERENCES:
patent: 4998171 (1991-03-01), Kim et al.
patent: 5561471 (1996-10-01), Kim et al.
patent: 5953076 (1999-09-01), Astle et al.
patent: 6373530 (2002-04-01), Birks et al.
patent: 6381362 (2002-04-01), Deshpande et al.
patent: 6573945 (2003-06-01), Wu et al.
patent: 6597818 (2003-07-01), Kumar et al.
patent: 2001/0048481 (2001-12-01), Hatano et al.
patent: 0700211 (1996-03-01), None
patent: 1022898 (2000-07-01), None
patent: 07274140 (1995-10-01), None
patent: 08289253 (1996-01-01), None
patent: 11168702 (1999-06-01), None
Abdel-Mottaleb et al.; Face Detection in Complex Environments From Color Images; Fifth International Conference on Image Processing; ICIP-99, Kobe, Japan; Oct., 1999; pp. 1-5.
PHA 23,569, U.S. Ser. No. 09/210,415, filed: Dec. 11, 1998.
“Automatic Measurement of Intensity of Motion Activity of Video Segments”, by K.A. Peker et al, Proc. SPIE Vo. 4315, pp. 341-351.
Abdel-Mottaleb Mohamed
Dagtas Serhan
Gathman Laurie
Koninklijke Philips Electronics , N.V.
Lee Michael H.
Tran Trang U.
LandOfFree
Adaptive overlay element placement in video does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Adaptive overlay element placement in video, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Adaptive overlay element placement in video will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3280297