The invention concerns a method of generating morphemes for speech recognition and understanding. The method may include receiving training speech, selecting candidate sub-morphemes from the training speech, selecting salient sub-morphemes from the candidate sub-morphemes based on salience measurements, and clustering the salient sub-morphemes based on semantic and syntactic similarities into morphemes. The morphemes may be acoustic and/or non-acoustic. The sub-morphemes may represent any sub-unit of communication including phones, phone-phrases, grammars, diphones, words, gestures, tablet strokes, body movements, mouse clicks, etc. The training speech may be verbal, non-verbal, a combination of verbal and non-verbal, or multimodal.
This continuation patent application claims the benefit of U.S. patent application Ser. No. 09/690,903 filed on Oct. 18, 2000, now U.S. Pat. No. 6,681,206, which claims the benefit of U.S. Provisional Patent Application No. 60/163,838, filed Nov. 5, 1999. The contents of both of these patent applications are incorporated herein by reference in their entirety.
