Multiplex communications – Diagnostic testing – Determination of communication parameters
Reexamination Certificate
2007-10-23
2007-10-23
Lee, Andrew C. (Department: 2616)
Multiplex communications
Diagnostic testing
Determination of communication parameters
C370S335000, C706S014000
Reexamination Certificate
active
10339600
ABSTRACT:
The present invention provides a method using Q-learning rule to accurately estimate the transmission cost for the multi-rate transmission control (MRTC) for RRC (radio resource control) in the WCDMA network. This method comprises the following iterative steps: first obtaining a system state and an action using an incoming request, a mean of interference and a variance of interference, then obtaining Q values based on the system state and the action. Afterwards, allocating an optimal action with the Q values, and when a new request with a new state arrives, going back to the first step and updating the Q values using the new state and a cost function based on the system state and the action.
REFERENCES:
patent: 6192354 (2001-02-01), Bigus et al.
patent: 6633858 (2003-10-01), Yamakawa et al.
patent: 6665651 (2003-12-01), Young et al.
patent: 6917925 (2005-07-01), Berenji et al.
patent: 2003/0224813 (2003-12-01), Lehtinen et al.
patent: 2005/0058154 (2005-03-01), Lee et al.
S. Choi et al, “An uplink CDMA system architecture with diverse QoS guarantees for heterogeneous traffic,” IEEE/ACM Trans. Netorking, vol. 7, No. 5, pp. 616-628, Oct. 1999.
K.S. Gilhousen, et al., “On the capacity of a cellular CDMA system,” IEEE Trans. Veh. Technol., vol. 40, No. 2, pp. 303-312, May 1991.
W. Huang et al., “Performance evaluation of a DS-CDMA cellular system with voice and data services,” IEEE PIMRC'96, pp. 588-592.
J. B. Kim et al, “Resource allocation for multiple classes of DS-CDMA traffic,” IEEE Trans. Veh. Technol., vol. 49, No. 2, pp. 506-519, Mar. 2000.
S. M. Shin et al, “Interference-based channel assignment for DS-CDMA cellular systems,” IEEE Trans. Veh. Technol., vol. 48, No. 1, pp. 233-239, Jan. 1999.
N. Dimitriou et al, “Quality of service for multimedia CDMA,” IEEE Comm. Mag., vol. 38, No. 7, pp. 88-94, Jul. 2000.
D. Mitra, et al, “Robust dynamic admission control for unified cell and call QoS in statistical multiplexers,” IEEE J. Select. Areas. Commun., vol. 16, No. 5, pp. 692-707, 1998.
K. W. Ross, “Multiservice Loss Models for Broadband Communication Networks. Berlin”, Germany: Springer-Verlag, 1995.
J. Nie et al., “A Q-learning-based dynamci channel assignment technique for mobile Communication systems,” IEEE Trans. Veh. Technol., vol. 48, No. 5, pp. 1676-1687, Sep. 1999.
H. Tong et al, “Admission call admission control under quality if service constraints: a reinforcement learning solution,” IEEE Trans. Veh. Technol., vol. 18, No. 2, pp. 209-221, Feb. 2000.
B. Makarevitch, “Application of reinforcement learning to admission control in CDMA network,” IEEE PIMRC 2000, pp. 1353-1357.
P. Marbach et al, “Call admission control and routing in integrated services networks using neuro-dynamic programming,” IEEE Trans. Veh. Technol., vol. 18, No. 2, pp. 197-208, Feb. 2000.
C. J. C. H. Watkins et al, “Q-learning,” Machine Learning, vol. 8, pp. 279-292, 1992.
S. Haykin, Neural Networks 2nd. Prentice Hall, 1999.
D. P. Bertsekas et al , “Neuro-Dynamic Programming”. Athena Scientific, 1996.
3GPP TS25.211: “Physical Channels and Mapping of Transport Channels onto Physical Channels (FDD),” V3.1.1, Dec. 1999.
3GPP TS25.321: “MAC Protocol Specification,” V3.2.0, Dec. 1999.
3GPP TS25.214: “Physical layer procedures (FDD),” v.4.0.0, Mar. 2001.
R. Bellman, Dynamic Programming, Princeton, NJ: Princeton Univ. Press, 1957.
Chang Chung-Ju
Chen Jian-An
Chen Yih-Shen
Ren Fang-Chin
Chunghwa Telecom Co. Ltd.
Lee Andrew C.
Rabin & Berdo P.C.
LandOfFree
Q-learning-based multi-rate transmission control (MRTC)... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Q-learning-based multi-rate transmission control (MRTC)..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Q-learning-based multi-rate transmission control (MRTC)... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3879661