Electrical computers and digital processing systems: multicomput – Distributed data processing – Client/server
Reexamination Certificate
1998-11-10
2002-06-25
Burgess, Glenton B. (Department: 2153)
Electrical computers and digital processing systems: multicomput
Distributed data processing
Client/server
C709S201000, C709S202000, C709S207000, C370S431000, C345S215000, C345S215000, C711S124000, C340S870030, C340S870030
Reexamination Certificate
active
06411986
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates generally to Internet client-server applications, and more specifically to multiplexing connections between clients and servers over the Internet.
2. Related Art
The importance to the modern economy of rapid information and data exchange cannot be understated. This explains the exponentially increasing popularity of the Internet. The Internet is a world-wide set of interconnected computer networks that can be used to access a growing amount and variety of information electronically.
One method of accessing information on the Internet is known as the World Wide Web (www, or the “web”). The web is a distributed, hypermedia system, and functions as a client-server based information presentation system. Information that is intended to be accessible over the web is stored in the form of “pages” on general-purpose computers known as “servers.” Computer users can access a web page using general-purpose computers, referred to as “clients,” by specifying the uniform resource locator (URL) of the page.
FIG. 1
is a network block diagram showing a plurality of clients and servers connected to the Internet.
When a client specifies a URL, a part of the URL known as the Domain Name is passed to a domain server (DNS) to be translated to a network address. The network address specifies the Internet protocol (IP) address of the intended server. The client request is passed to the server having the network address. The server uses the path name in the URL to locate the web page requested by the client. A copy of the web page is then sent to the client for viewing by the user.
The client-server paradigm described above has served the Internet well. However, there are some problems. One problem is server connection loading.
Servers are designed to do certain things well. Servers are typically general-purpose machines that are optimized for general tasks such as file management, application processing, database processing, and the like. Servers are not optimized to handle switching tasks such as opening and closing network connections. Under certain load conditions, these tasks can represent a considerable overhead, consuming a large percentage of the server's processing resources, often on the order of twenty percent and sometimes up to fifty percent. This problem is referred to herein as “connection loading.”
To further explain loading, the client and server must typically exchange three packets of information to setup a connection. Once the connection is established a client sends a URL (page) request to the server, this consists of one packet. The server will then send one or more packet responses back to the client. Once a request and response is exchanged from the client and server, both client and server will close their respective connections. The closing of the connection takes an additional four packets of information exchange. As demonstrated above, there is a significant amount of overhead (i.e., seven packets) involved to download one URL. A page typically consists of multiple URL's.
Additional problems associated with connection loading include:
Each packet that reaches the server interrupts the server's CPU to move that packet from the Network Interface Card (NIC) into the server's main memory. This results in loss of productivity on the server's CPU. Thus what is needed is a way to avoid wasting valuable CPU time at the server side. As a consequence, the same resource can be applied to process more URL (page) requests. This will thus improve the servers URL processing capacity.
As discussed above, it takes three packets for connection establishment. Furthermore, connection establishment uses up significant server resources related to the CPU/memory. To establish a connection at the server side, the packet needs to be processed by the driver layer, where Ethernet specific information is handled. The driver layer sends the packet to the IP layer for more processing, where all the IP (Internet Protocol) related processing is handled. After this, the packet is passed to TCP (Transmission Control Protocol) layer, where the TCP related information is processed. The TCP layer consumes significant server resources to create a connection table, etc. Thus, what is needed is a way of avoiding connection processing to thereby save significant CPU/memory resources.
The Web server needs to create a thread for each incoming connection to be processed. After the connection and URL request are processed, the thread will be closed. A thread is a Light Weight Process (LWP) that is a type of process. Even though threads are efficient it takes significant CPU and memory resources to create and destroy the threads. Thus, by avoiding thread creation, a significant amount of server resources can be preserved, which in turn can be used to process more web requests.
Servers with more than one CPU are called SMP (Symmetric Multi Processing) systems, these systems have a common memory architecture. The SMP systems also have a single Operating System (OS) managing the multiple CPUs. Single OS implies single Networking/Protocol stack. When multiple CPUs access data structures in the kernel protocol stack, it is important to protect against the data corruption, since more than one CPU can read/write on that data structure. The protection code imposes additional per-packet overhead on SMP systems.
Finally, the throughput of an individual server is limited. Therefore, data providers wishing to serve a high volume of Internet requests frequently resort to an approach of replicating the content on multiple servers and then distributing the requests between these servers. This approach requires content to be replicated in its entirety to each one of the replica servers, even the content which is infrequently accessed. This represents a waste of server resources.
SUMMARY OF THE INVENTION
The present invention is a system, method and computer program product for network client-server multiplexing. In a preferred embodiment, the present invention is implemented within an interface unit connecting a plurality of servers to the Internet, which is in turn connected to a plurality of clients.
According to one aspect of the invention, the method includes the steps of opening a connection between a client and the interface unit; opening a connection between the interface unit and a server if no free connection is open between the interface unit and the server; allowing the client to access information on the server via the connections; and closing the connection between the client and the interface unit while keeping open the connection between the interface unit and the server.
According to another aspect of the invention, the method includes the steps of receiving from a client a request to retrieve data using a network address and a path name; selecting a server storing the data as a function of predefined policies including at least one of the path name, the load of the server, and the state of the server; retrieving the data from the server using a previously-opened connection; and sending the data to the client.
One advantage of the present invention is that it resolves the connection loading problem through a technique referred to herein as “connection pooling.”
Another advantage of the present invention is that it resolves the content replication problem through use of a technique referred to herein as “connection distribution.”
Yet another advantage of the present invention is that it transparently splices connections from servers and clients using a technique referred to herein as “connection multiplexing.”
REFERENCES:
patent: 5774670 (1998-06-01), Montulli
patent: 5787470 (1998-07-01), Desimone et al.
patent: 5852717 (1998-12-01), Bhide et al.
patent: 5918013 (1999-06-01), Mighdoll et al.
patent: 5941988 (1999-08-01), Bhagwat et al.
patent: 6173322 (2001-01-01), Hu
Egevangik et al. “The IP Network Address Translator NAT,” Request for Comments N#1631, May 1994.*
Zheng Wang et al., “Prefetching in Worl
Setia Deepinder S.
Sinha Rajiv
Soni Ajay V.
Susai Michel K.
Burgess Glenton B.
Le Hien C.
Netscaler, Inc.
Sterne Kessler Goldstein & Fox PLLC
LandOfFree
Internet client-server multiplexer does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Internet client-server multiplexer, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Internet client-server multiplexer will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2924604