An autonomous adaptive agent which can learn verbal as well as nonverbal behavior. The primary object of the system is to optimize a primary value function over time through continuously learning how to behave in an environment (which may be physical or electronic). Inputs may include verbal advice or information from sources of varying reliability as well as direct or preprocessed environmental inputs. Desired agent behavior may include motor actions and verbal behavior which may constitute a system output (and which may also function "internally" to guide external actions. A further aspect involves an efficient "training" process by which the agent can be taught to utilize verbal advice and information along with environmental inputs.
RELATED INVENTIONS
This application is a divisional of U.S. patent application Ser. No. 09/520,030 filed on Mar. 6, 2000, now U.S. Pat. No. 6,754,644, which is a divisional of Ser. No. 09/143,909 filed on Aug. 31, 1998, now U.S. Pat. No. 6,038,556, which is a divisional of U.S. Ser. No. 08/451,543, now U.S. Pat. No. 5,802,506 filed on May 26, 1995 which are hereby incorporated by reference in their entirety.
