Television – Camera – system and detail – Solid-state image sensor
Reexamination Certificate
2000-03-06
2004-07-27
Moe, Aung (Department: 2612)
Television
Camera, system and detail
Solid-state image sensor
C348S294000, C706S015000
Reexamination Certificate
active
06768515
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates to an integrated sensing and processing device. More specifically, the present invention relates to an architecture for the integrated realization of sensing and processing within a single device.
BACKGROUND
Currently, Cellular Neural Networks (CNN) build a paradigm based on a set of canonical differential equations (Equations 1-3 below) that define a set of nonlinear dynamic interactions between cells in a (usually two dimensional) grid. There are several degrees of freedom in setting up these interactions in the form of feedback and feedforward weights (namely the values A and B in Equation 1) and the initial conditions of the states (x(t=0) in Equation 1) and the bias currents (I in Equation 3). CNN is in fact programmed by way of manipulating these values. The nonlinearity comes from the nonlinear nature of the function (‘f’ in Equation 2). The function “f” can take on different shapes and characteristics. Programming a particular function is then delegated to finding the right combination of A, B, x(t=0), and I that yields the desired outcome or outputs (y) given a pattern of inputs (u). This type of programmability is quite flexible.
CNN is a hybrid of Cellular Automata and Neural Networks (hence the name Cellular Neural Networks) and it incorporates the best features of both concepts. Like Neural Networks, its continuous time feature allows real-time signal processing, and like Cellular Automata its local interconnection feature makes physical realization in VLSI possible. Its grid-like structure is suitable for the solution of a high-order system of first order nonlinear differential equations on-line and in real-time. In summary, CNN can be viewed as an analog nonlinear dynamic processor array. The basic unit of CNN is called a cell. Each cell receives input from its immediate neighbors (and itself via feedback), and also from external sources (e.g., the sensor array points and/or previous layers).
The canonical CNN equation summarizes these relationships:
τ
ij
x
.
ij
(
t
)
=
-
x
ij
(
t
)
+
∑
kl
∈
N
r
(
ij
)
A
ij
,
kl
(
y
kl
(
t
)
,
y
ij
(
t
)
)
+
∑
kl
∈
N
r
(
ij
)
B
ij
,
kl
(
u
kl
(
t
)
,
u
ij
(
t
)
)
+
I
ij
Equation 1
y
ij
=
f
(
x
ij
)
Equation 2
and
I
ij
=
I
Equation 3
where u represents the input, x represents the state, and y represents a nonlinear function of the state associated with a cell (or neuron), and A and B represent the cloning templates.
In a typical CNN, local connections between the neighbors (feedback weights, or the entries of the matrix A in Equation 1), along with connections form the sensory array (input weights, or entries of the matrix B in Equation 1) form the programmable cloning templates. Cloning templates to perform numerous types of visual processing tasks have been developed. Each template is specific to a particular application, e.g., a cloning template for edge detection or binocular stereo. Cellular neural networks are attractive in image processing because of their programmability: One needs to change only the template to perform a different iconic task.
Despite such flexibility, critical problems arise when one tries to implement CNN in electronic circuits. The CNN model described in Equations (1-3), however, is not suitable for direct VLSI implementation. In an integrated circuit implementation of the CNN model, the summation equation is a current based computation, as the circuit model in
FIG. 1
suggests. By Kirchoff's law, all currents coming into the node that defines the state of the cell (x) must add to zero. As the intrinsic resistance values (R) are very large and capacitance values are very small, little charge is required to maintain a particular voltage. This also means that the current required to alter the voltage value of the state is relatively very small. The values of the noise currents are of sufficient magnitude to make significant difference. When one adds to that the fact that the transistor characteristics can generally vary as much as 20% within the same chip substrate, it becomes clear that the (x) node is highly likely to charge up or down to a power rail. One remedy is adding significant capacitance to each node. This is not desirable at all since it requires precious VLSI real estate and furthermore increases the response time of the cell. The VLSI implementations of the current CNN models have not addressed this issue, and as such, the current CNN model described in Equations (1-3) is not suitable for direct VLSI implementation.
SUMMARY
An integrated sensing device comprising an array of sensor processor cells capable of being arranged into a detection array. Each sensor processor cell comprises a sensing medium; at least one transconductance amplifier configured for feedforward template multiplication; at least one transconductance amplifier configured for feedback template weights; a plurality of local dynamic memory cells; a data bus for data transfer; and a local logic unit. The array of sensor processor cells, by responding to data control signals, is capable of transforming, reshaping, and modulating the original sensed image into varied represenations which include (and extend) traditional spatial and temporal processing transformations.
REFERENCES:
patent: 5140670 (1992-08-01), Chua et al.
patent: 5200914 (1993-04-01), McCanny et al.
patent: 5208786 (1993-05-01), Weinstein et al.
patent: 5329611 (1994-07-01), Pechanek et al.
patent: 5355528 (1994-10-01), Roska et al.
patent: 5383164 (1995-01-01), Sejnowski et al.
patent: 5483620 (1996-01-01), Pechanek et al.
patent: 5539832 (1996-07-01), Weinstein et al.
patent: 5706402 (1998-01-01), Bell
patent: 5923779 (1999-07-01), Ohmi et al.
patent: 6185309 (2001-02-01), Attias
patent: 6389445 (2002-05-01), Tsividis
patent: WO98/58450 (1998-12-01), None
patent: WO99/66638 (1999-12-01), None
E. Weinstein, et al.; Multi-Channel Signal Separation by Decorrelation; IEEE Transactions on Speech and Audio Processing, vol. 1, No. 4, Oct. 1993 pp. 405-413.
C. Jutten and J. Herault; Blind Separation of Sources, Part 1: An adaptive algorithm based on neuromimetic architecture; Signal Processing, vol. 24, No. 1, Jul. 1991, pp. 1-10.
C. Jutten and J. Herault; Blind Separation of Sources, Part II: Problems Statement; Signal Processing, vol. 24, No. 1, Jul. 1991, pp. 11-20.
F.M. Salam; An Adaptive Network for Blind Separation of Independent Signals; Proceedings of the 1993 IEEE International Symposium on Circuits and Systems (ISCAS) vol. 1, pp. 431-434.
A. Chihocki, et al.; Adapative Approach to Blind Source Separation with Cancellation of Additive and Convolutional Noise; 3rd. International Conference on Signal Processing; 1996, vol. 1; pp 412-415.
T. Nomura et al., “An Extension of The Herault-Jutten Network to Signals Including Delays for Blind Separation,” 1996, p. 443-452.
C. Marven and G. Ewers, “A Simple Approach to Digital Signal Processing,” p. 90-103, 1996, John Wiley & Sons, Inc.
P. Gilbert, “State Space and ARMA Models: An Overview of the Equivalence,” Mar. 1993.
International Search Report, PCT/US00/05785—filed Mar. 6, 2000.
A.J. Bell, et al.; Blind Separation and Blind Deconvolution; An Information-Theoretic Approach: 1995 International Conference on Acoustics, Speech, and Signal Processing; ICASSP-95; vol. 5; pp. 3415-3418.
G. Erten and F. Salam; Real Time Separation of Audio Signals Using Digital Signal Processors; MWSCAS 1997 Sacramento, California; IEEE 1997; pp 1237-1240.
FM Salam and G. Erten; Blind Signal Separation and Recovery in Dynamic Environments; NSIP 97 Workshop; Mackinac Island, Michigan, USA, in Sep. 1997.
Hoang-Lan Nguyen Thi and Christian Jutten; “Blind Source Separation for Convolutive Mixtures”; Signal Processing European Journal Devoted to the Methods and Applications of Signal Processing; vol. 45, No. 2; Aug. 1, 1995; pp. 209-229.
Erten, G. et al., “Two Cellular Architectures for Integrated Image Sensing and Processin
Erten Gamze
Salam Fathi M.
Brooks & Kushman P.C.
Clarity Technologies Inc.
Moe Aung
LandOfFree
Two architectures for integrated realization of sensing and... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Two architectures for integrated realization of sensing and..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Two architectures for integrated realization of sensing and... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3230731