Data processing: generic control systems or specific application – Generic control system – apparatus or process – Optimization or adaptive control
Reexamination Certificate
2000-08-28
2002-01-01
Sheikh, Ayaz (Department: 2155)
Data processing: generic control systems or specific application
Generic control system, apparatus or process
Optimization or adaptive control
C700S050000, C700S213000, C700S207000, C700S245000
Reexamination Certificate
active
06336051
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates to agricultural machines and more particularly to harvesting machines which, as part of the harvesting process, cut the crop or the plants on which the crop was grown. The invention provides an automatic steering control capable of locating the crop line between cut and uncut crop, steering the harvesting machine along the crop line as it traverses a field, sensing the end of a crop row and, upon reaching the end of the crop row, controlling the turning of the harvester to begin a new traverse of the field.
BACKGROUND OF THE INVENTION
In recent years many of the functions of harvesting machines normally controlled manually by an operator have been automated. Audible and visual sensing by the operator have been replaced with optical, sonic, magnetic, radio frequency and other types of sensors. Microprocessors operating in response to conditions sensed by the sensors have replaced manual operator control of the mechanical functions. However, it is still necessary to have an operator for steering the harvester to (1) move along a crop line, (2) turn the harvester when the end of a crop row has been reached, and (3) avoid obstacles which may be present in the field.
If the need for an operator can be eliminated, it would not be necessary to provide a cab for the harvester or the many operator comfort features such as air conditioning, stereo, etc. now provided on many harvesters.
Even if the need for an operator is not completely eliminated, it is still desirable to provide some form of automated steering or “cruise control” to lessen the burden on the operator and increase the efficiency of utilization of the harvester. While an operator may easily steer a harvester along a crop line at speeds of about 4 to 5 miles an hour, the constant attention required to accomplish this is extremely tiring and an operator can not maintain this speed for long periods of time. The efficiency of utilization of the harvester could be increased by providing a form of cruise control which steers the harvester along a crop line at the maximum harvester speed and either stops the harvester or signals the operator to take over manual control of the steering as the harvester approaches the end of a crop field.
SUMMARY OF THE INVENTION
The invention provides a robotic control system for an agricultural harvester, the robotic control system comprising an execution monitor module which is sequenced through a plurality of finite states by trigger messages from a field coverage planner module, a global trajectory tracker module, a controller module, an end of row detector module and a field coverage monitor module, the execution monitor module activating at least one of the field coverage planner module, the global trajectory tracker module, the end of row detector module, a crop line tracker module or a local trajectory tracker module in each finite state so as to generate steering signals for steering the harvester along a path specified by a field coverage plan to cut all crop in a field.
The global trajectory tracker module generates votes indicating the preferred direction the harvester should be steered so as to follow the path and the crop line tracker module generates steering votes on the direction the harvester should be steered to follow a crop line between cut and uncut crop, the system further comprising a continuously running steering arbiter module for developing steering commands from all the steering votes, and a continuously running controller responsive to the steering commands for developing signals to differentially drive front wheels of the harvester to steer it.
According to one aspect of the invention, the robotic control system includes at least one and preferably two alternately active video cameras mounted on the harvester for viewing the changing scene in front of the harvester and producing images thereof as the harvester moves along the planned path, a frame grabber for grabbing one image at a time from the active camera, and a video processing computer for analyzing each image pixel by pixel according to a color discriminant function to locate a crop line between cut and uncut crop, the color discriminant function being adaptively updated by computing, as the discriminant used in analyzing one image, the Fisher linear discriminant in RGB space between the cut and uncut pixel classes for the preceding image. Prior to analyzing each image to locate the crop line, the image may be compensated for shadows.
According to another aspect of the invention, the robotic control system includes at least one and. preferably two alternately active video cameras mounted on a harvester for viewing the changing scene in front of the harvester and producing images thereof as the harvester moves along the planned path, a frame grabber for grabbing one image at a time from the active camera, and a video processing computer for analyzing each image pixel by pixel and scan line by scan line to locate, for each scan line, a crop line point between cut and uncut crop if there is a crop line imaged in the scan line, and determining which scan line is most likely imaging the end of a crop row.
According to a further aspect of the invention, the robotic control system includes at least one and preferably two alternately active video cameras mounted on a harvester for viewing the changing scene in front of the harvester and producing images thereof as the harvester moves along the planned path, a frame grabber for grabbing one image at a time from the active camera, and a video processing computer for analyzing each image pixel by pixel to determine the probability that a region of the image surrounding each pixel is imaging an obstacle in the path of the harvester.
REFERENCES:
patent: 3946825 (1976-03-01), Gail
patent: 4126984 (1978-11-01), Gail
patent: 4482960 (1984-11-01), Pryor
patent: 4532757 (1985-08-01), Tutle
patent: 4700301 (1987-10-01), Dyke
patent: 4726175 (1988-02-01), Day et al.
patent: 4868752 (1989-09-01), Fujii et al.
patent: 5279068 (1994-01-01), Rees et al.
patent: 5442552 (1995-08-01), Slaughter et al.
patent: 5444965 (1995-08-01), Colens
patent: 5528888 (1996-06-01), Miyamoto et al.
patent: 5544474 (1996-08-01), Finkelstein
patent: 5809440 (1998-09-01), Beck et al.
patent: 5828971 (1998-10-01), Dickhans et al.
patent: 5899950 (1999-05-01), Milender et al.
patent: 5906647 (1999-05-01), Zyburt et al.
patent: 6070673 (2000-06-01), Wendte
patent: 6101795 (2000-08-01), Diekhans
Willie Vogt, “Robo-Crop”, Jan. 1996—Farm Futures.
Henry J. Holcomb, “Robo-Crop”, Jul. 11, 1996,The Philadelphia Inquirer.
“Demeter: An Autonomous Alfalfa Harvesting System”, 1996 ASAE Annual International Meeting, Jul. 14-18, Paper No. 963005.
Fitzpatrick Kerien
Happold Michael
Ollis Mark
Pangels Henning
Pilarski Thomas
Backer Firmin
Carnegie Mellon University
Griffin & Szipl, P.C.
Sheikh Ayaz
LandOfFree
Agricultural harvester with robotic control does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Agricultural harvester with robotic control, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Agricultural harvester with robotic control will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2837953