Communication device having capability to convert between voice and text message

Description Submit all comments and votes

FIELD OF THE INVENTION

This invention relates to communication devices and, in particular, to apparatus contained in the communication device that automatically converts between text and voice mode communications, and can for example generate and transmit a text message based upon the user input voice commands and voice message.

PROBLEM

It is a problem in communications technology to efficiently transfer information among users. It is also a significant problem to bridge the disjunct architectures of the various communication systems presently in use for voice and text communications.

Voice communication systems rely on a direct connection on a real time basis from the calling party to the called party or their agent. If the called party is unavailable, the incoming call can be completed to an agent that can comprise either a human operator: message center operator, receptionist, secretary or an automated system for message storage: answering machine, voice mail system and the like. All of these systems operate on a real time direct connection basis, wherein the calling party provides a voice communication that is immediately delivered as it is being generated to the called party or delivered to and recorded by the called party's agent for later retrieval by the called party. A problem with these systems is that the transmission and storage of voice represents a high bandwidth communications mode, especially the storage of a voice message, which in many cases relies on the use of a mechanical system, such as a tape drive, that is more prone to maintenance problems than an electronic system. However, the cost of storing real time voice messages in an electronic memory based system represents a significant expense.

The alternative text based communication systems operate by the calling party generating a text message and transmitting same to the called party over a communication medium. The text message mode represents a non-real time message system, wherein the calling party generates the text message in real time, on a personal computer for example, but the message is not transmitted as it is generated. It is only when the calling party is satisfied with the content of the text message and activates the transmission of the message that the message is forwarded to the called party in its entirety. Examples of such transmissions are E-Mail over the Internet or an intranet, and facsimile transmissions. The transmitted text message is delivered to the called party by storage of the text message in a memory appropriate for the type of message transmitted. The storage and ultimate retrieval by the called party is also non-real time in nature. For example, the facsimile transmission must be received by the called party's facsimile machine, decoded and then printed out by a printer. In many cases the called party is equipped with a fax/modem device on a personal computer that stores the received fax in a computer memory for later retrieval and printing by the called party. Furthermore, the E-Mail transmission is passed from mailbox to mailbox via the Internet servers, again not in real time, but more likely in a batch mode mail transfer from transfer point to transfer point in the Internet until the message is stored in the called party's mailbox. The mail is retrieved by the user only when the user queries the mailbox to determine whether a message is stored therein.

There is even a crossover system of converting the received voice message to a text message and this comprises the use of message center operators or secretaries, who transcribe the received message into a text format. However, this system is expensive to operate and subject to traffic limitations.

Therefore, the problems with existing message communication systems are that they are limited to use of a single format of communication: either voice or text and they are either real time person to person or non-real time "mailbox" types of communications. Thus, the calling and called parties must operate in the same message mode to be able to communicate. These limitations of existing message communications systems also result in additional expense when the information conveyed must be converted from the native format of the original message to an alternative form. This typically requires the recreation of the message in the alternate format by the called party with the inherent expense of such an operation. There are no existing systems that enable the calling party or even the called party to selectively generate and receive messages in any desired format, regardless of the message mode of the other party to the communications session.

SOLUTION

The above described problems are solved and a technical advance achieved in the field by the present communication device that provides the capability to automatically convert between voice and text messages. The communication device 100 supports both one-way and two-way communications. In the one-way communication environment, a user can implement one-way text messaging: text transmission from the user to a called party, text transmission from a user to a computer system, text transmission from the user to a text storage medium, text transmission from a computer system to the user. In the two-way communication environment, a user can implement two-way text messaging: voice-to-text conversion at each party's telephone station which text is transmitted to the other party (computer system or human recipient) where it is converted into voice, voice-to-text conversion at each user's telephone station which text is transmitted to the other party (computer system or human recipient).

As an example, this communication device enables the calling party to input a message in voice mode, then activate the communication device to automatically convert the message into a text message format for transmission to the called party. The communication device can display the content of the text message prior to transmission or can retrieve the message from its memory and play the message back to the calling party in an audio mode. The communication device automatically initiates the outgoing call and, since the message is transmitted in a text mode to the called party, the destination can be a computer system or output to a printer. This feature therefore enables hands free operation for E-Mail. The communication device also provides a data retrieval feature where the user can retrieve E-Mail or voice mail messages using the communication device and have the retrieved messages output in either text or audio format. The retrieved messages, since they are stored in memory in the communication device, can be forwarded to another destination once the user has reviewed their content.

Thus, the present communication device bridges the gap between existing voice communication systems and text based communication systems. The communication device enables users to communicate by exchanging messages even though their communication formats differ. In addition, the communication device can be used as a secure data input device since it can be equipped to authenticate the identity of the user via voiceprint identification.

BRIEF DESCRIPTION OF THE DRAWING

FIG. 1 illustrates in block diagram form the architecture of the present communication device having the capability to convert between voice and text messages;

FIGS. 2A-2B illustrate in flow diagram form the operation of the present communication device having the capability to convert between voice and text messages in a typical call scenario.

DETAILED DESCRIPTION

System Architecture

FIG. 1 illustrates in block diagram form the architecture of the present communication device having the capability to convert between voice and text messages 100. This communication device 100 comprises either a wireless telephone station set or a non-wireless telephone station. In either case, the technology used to implement the basic elements of the communication device 100 are well known and are not described in detail herein. The additional elements comprise the memory 110, processor 107 with its set of control instructions 111-114, the voice-to-text 102, 103 and text-to-voice 104, 105 converter circuits which function to enhance the communication capabilities of the basic station set. For the purpose of illustration, the present description is couched in terms of a wireless communication device, although he wired alternative is equally applicable.

The communication device 100 comprises a microphone 101 that receives audio input from the user and converts the received audio signals to analog electrical signals. The output of the microphone 101 is applied to an analog to digital converter circuit 102 that produces digital signal indicative of the audio input. These digital signals are processed by a digital signal processor 103 that functions to convert the digital signals to text data. In the reverse communication path, a digital signal processor 104 is responsive to received text input for generating digital signals indicative of the received text message. The digital signals are converted by digital to analog converter 105 into analog signals that produce audio output when applied to speaker 106. The standard telephone communication circuitry 108 is included to enable to the communication device 100 to operate in a conventional manner to transmit the user input audio signals to the communication port 109 in electrical signal form and in the return path transmit received electrical signals from the communication port 109 to the user in audio signal form at the loudspeaker 106. The communication port 109 in this example is the wireless transceiver apparatus that establishes the wireless communication connection between the communication device and a wireless server comprising a transceiver system (not shown), as is well known in wireless communications.

The communication device 100 also comprises a processor 107 that is equipped with a memory 110 and sets of program instructions 111-114 that function when executed in processor 107 to implement the communication services described herein. Included in the sets of program instructions 111-114 are a user authentication process 111, data mode conversion process 112, communication connection management process 113, message management process 114, and the like. The operation of this apparatus is described below in conjunction with the description of the flowcharts of FIGS. 2A-2B. The various elements noted herein can be implemented in various alternate configurations, such as the combination of the analog-to-digital converter and the digital-to-analog converter elements into a single device. The selection of the particular functional architecture of FIG. 1 is for the purpose of illustrating the functionality embodied in the communication device.

Communication Modes

There are a plurality of communication modes that are possible using the communication device 100. In particular, the voice-to-text and text-to-voice conversion capability of the communication device 100 supports both one-way and two-way communications. In the one-way communication environment, a user can implement one-way text messaging: text transmission from the user to a called party, text transmission from a user to a computer system, text transmission from the user to a text storage medium, text transmission from a computer system to the user. In the two-way communication environment, a user can implement two-way text messaging: voice-to-text conversion at each party's telephone station which text is transmitted to the other party (computer system or human recipient) where it is converted into voice, voice-to-text conversion at each user's telephone station which text is transmitted to the other party (computer system or human recipient).

Call Origination

An example of the operation of the present communication device is provided in FIGS. 2A-2B wherein the examples of a call origination by a user with the conversion of the user's voice input to a text message which is automatically transmitted to a destination and the retrieval of messages by the user are both used.

The present communication device 100 is operational as a data entry tool and personal communication device for the user and can be activated at step 201 by means of an on/off switch (not shown) on the communication device 100 or even voice activated wherein the communication device 100 remains in a monitor mode until activated by the speaking of a predetermined command by the user, such as "initiate call." The communication device 100, when activated, recognizes user input voice commands and also preferably the voice of the user. This is accomplished by applying the output of microphone 101 to an analog to digital converter circuit 102 that produces digital signal indicative of the audio input. These digital signals are processed by a digital signal processor 103 that functions to convert the digital signals to text data. The communication device 100 can optionally include a user authentication function 111 wherein at step 202 the communication device 100 enters a user authentication mode. The user at step 203 inputs voice data, such as a predetermined phrase or series of words, to serve as user authentication input. The communication device 100 at step 204 executes the user voiceprint verification process which may be operational in digital signal processor 103 and processor 107 determines at step 205 whether the user is a valid user of the communication device 100. Since the communication device 100 may be used by a number of users, the capability can be provided to enable the communication device 100 to respond to a plurality of users. For simplicity of description, the case of a single user is provided herein. If at step 205 the user is not authenticated, processing advances to step 232 where the communication device 100 enters the inactive mode and the communication initiation attempt by the unauthorized user is thereby rejected. If the user is authenticated at step 205, processing advances to step 206 where the communication device 100 is enabled to receive user message data input. At step 207, the user inputs commands to initiate a selected communication function that is programmed into memory 110. Since the present communication device 100 is capable of performing many communication functions in various communication modes, the following description illustrates both a typical data entry operation and a typical data retrieval operation to thereby illustrate some of the functionality provided by the present communication device 100.

Data Entry Mode

At step 208, the communication device 100 receives the commands that have been issued by the user and makes a determination of the proper mode of operation that has been requested. The two modes illustrated are data entry and data retrieval. Assume that the user has issued a command for data entry at step 207, processing then advances to step 208. A typical data entry mode is for a user to input a voice message that is to be transmitted in text form to a designated destination. In this case, the user must input not only the voice message but also an indication of the destination for this message and the format of the message. The order of data entry in not critical and the following sequence of events can be modified as desired in implementing the communication device 100. For example, the user can issue the command "send call" which activates the message management process 114 of communication device 100, wherein the voice input message is to be transmitted to a defined destination. The user identifies the destination by issuing, for example, the command "to my personal computer" immediately after "send call." This sequence of commands identifies the function and message destination. An additional data entry can be used in this sequence to define the format of the communication. Thus, the user can note "text message" as part of the initial command input stream to enable the data mode conversion process 112 of communication device 100 to convert the format of the user's message into the user designated format of the output message. In response to the above-noted command strings issued by the user, at step 209 the communication device 100 enables the data communication functions that have been requested by the user. The address of the destination is stored by processor 107 in memory 110 for later retrieval and in this example, the digital signal processor circuit 103 is activated to receive the users voice input, convert it into a text message and store the text message in memory 110 for later transmission (possibly with a prior review by the user).

The user then inputs the voice message into the communication device 100 at step 210. In the present example, the user inputs a message that is destined for the user's personal computer, such as a reminder of the need to make travel plans for an out-of-state meeting on a predetermined date. The communication device 100 at step 211 converts the voice input into a text message and stores the text in memory 110, using the apparatus described above. Upon the conclusion of the data entry, the user can optionally activate the message management process 114 of communication device 100 at step 212 to display the text message on display 116 to ensure the accuracy of the message. The communication device scrolls the text message on the display 116 and thereby enable the user to confirm the content of the text message prior to transmission. If the message is to be discarded and rerecorded, the user can input verbal commands to activate these functions at this juncture. For the purpose of this example, it is assumed that the user confirms the message content and at step 213 the user wishes to transmit the te