WikiPatents - Community Patent Review
Create Free Account  |  License or Sell Your Patent  |  WikiPatents Marketplace  |  WikiPatents Blog
Username:  Password:  
    
Advanced Search
Computer data entry and manipulation apparatus and method    
United States Patent4988981   
Link to this pagehttp://www.wikipatents.com/4988981.html
Inventor(s)Zimmerman; Thomas G. (San Francisco, CA); Lanier; Jaron Z. (Palo Alto, CA)
AbstractApparatus is disclosed for generating control signals for the manipulation of virtual objects in a computer system according to the gestures and positions of an operator's hand or other body part. The apparatus includes a glove worn on the hand which includes sensors for detecting the gestures of the hand, as well as hand position sensing means coupled to the glove and to the computer system for detecting the position of the hand with respect to the system. The computer system includes circuitry connected to receive the gesture signals and the hand position signals for generating control signals in response thereto. Typically, the control signals are used to manipulate a graphical representation of the operator's hand which is displayed on a monitor coupled to the computer system, and the graphical representations of the operator's hand manipulates virtual objects or tools also displayed by the computer.
   














 Title Information Submit all comments and votes
 
Patent Text Patent PDF Print Page Summary File History
Plain text PDF images Print Summary File History
Drawing from US Patent 4988981
Computer data entry and manipulation apparatus and method - US Patent 4988981 Drawing
Computer data entry and manipulation apparatus and method
Inventor     Zimmerman; Thomas G. (San Francisco, CA); Lanier; Jaron Z. (Palo Alto, CA)
Owner/Assignee     VPL Research, Inc. (Redwood City, CA)
Patent assignment
All assignments
Publication Date     January 29, 1991
Application Number     07/317,107
PAIR File History     Application Data   Transaction History
Image File Wrapper   Patent Term   Fees
Litigation
Filing Date     February 28, 1989
US Classification     345/158 345/156 434/45
Int'l Classification     G09G 003/02
Examiner     Oberley; Alvin E.
Assistant Examiner    
Attorney/Law Firm     Townsend and Townsend
Address
Parent Case     This is a Continuation of application Ser. No. 07/026,930, filed Mar. 17, 1987, now abandoned.
Priority Data    
USPTO Field of Search     340/709 340/706 340/712 340/705 340/725 340/6 352/50
Patent Tags     computer data entry manipulation
   
Enter a comma (,) or semicolon (;) between multiple tag words/phrases.
Describe this patent:
 Amusing   
 Clever   
 Complex   
 Efficient   
 Historic   
 Important   
 Innovative   
 Interesting   
 Practical   
 Simple   
[no votes]
Patent WIKI

Share information and news about this patent, including information and news about the technology, inventors, company, ligation and licensing.

 References Submit all comments and votes
 
*references marked with an asterisk below are user-added references
 U.S. References
 
Add a new US reference:  
ReferenceRelevancyCommentsReferenceRelevancyComments
2356267



[0 after 0 votes]
3510210



[0 after 0 votes]
1335272



[0 after 0 votes]
4715235
Fukui
73/862.68
Dec,1987

[0 after 0 votes]
4711543
Blair
352/87
Dec,1987

[0 after 0 votes]
4682159
Davison
345/158
Jul,1987

[0 after 0 votes]
4665388
Ivie
340/573.1
May,1987

[0 after 0 votes]
4660033
Brandt
340/825.72
Apr,1987

[0 after 0 votes]
4654520
Griffiths
250/227.14
Mar,1987

[0 after 0 votes]
4654648
Herrington
345/179
Mar,1987

[0 after 0 votes]
4634856
Kirkham
250/227.25
Jan,1987

[0 after 0 votes]
4613139
Robinson, II
463/37
Sep,1986

[0 after 0 votes]
4586387
Morgan
73/862.05
May,1986

[0 after 0 votes]
4586335
Hosoda
60/528
May,1986

[0 after 0 votes]
4581491
Boothroyd
607/118
Apr,1986

[0 after 0 votes]
4579006
Hosoda
73/862.381
Apr,1986

[0 after 0 votes]
4569599
Bolkow
368/120
Feb,1986

[0 after 0 votes]
4565999
King
345/158
Jan,1986

[0 after 0 votes]
4558704
Petrofsky
607/48
Dec,1985

[0 after 0 votes]
4553393
Ruoff
60/528
Nov,1985

[0 after 0 votes]
4544988
Hochstein
361/211
Oct,1985

[0 after 0 votes]
4542291
Zimmerman
250/231.1
Sep,1985

[0 after 0 votes]
4540176
Baer
463/37
Sep,1985

[0 after 0 votes]
4524348
Lefkowitz
341/5
Jun,1985

[0 after 0 votes]
4414984
Zarudiansky
600/587
Nov,1983

[0 after 0 votes]
4414537
Grimes
341/20
Nov,1983

[0 after 0 votes]
4408495
Couch
73/655
Oct,1983

[0 after 0 votes]
4355805
Baer
463/31
Oct,1982

[0 after 0 votes]
4302138
Zarudiansky
414/5
Nov,1981

[0 after 0 votes]
4209255
Heynau
356/141.3
Jun,1980

[0 after 0 votes]
4074444
Laenger, Sr.
434/112
Feb,1978

[0 after 0 votes]
4059830
Threadgill
340/575
Nov,1977

[0 after 0 votes]
3777086
Riedo
200/52R
Dec,1973

[0 after 0 votes]
 Foreign References
 Other References
 Market Review Submit all comments and votes
   
Market Size
Estimate the gross annual revenues of the relevant market sector:
> $10B
$5B - $10B
$2B - $5B
$500M - $2B
$100M - $500M
$10M - $100M
$1M - $10M
$500K - $1M
$100K - $500K
< $100K
[No votes]
$0
 
$0   $2.5B   $5B   $7.5B   $10B
Market Share
Estimate the percentage of the relevant market sector this invention will capture:
75% - 100%
50% - 74.99%
25% - 49.99%
10 - 24.99%
5 - 9.99%
2 - 4.99%
1 - 1.99%
< 1%
[No votes]
0.0%
 
0%   25%   50%   75%   100%
Reasonable Royalty
What percentage of gross sales should the inventor or assignee be paid?
75% - 100%
50% - 74.99%
25% - 49.99%
10 - 24.99%
5 - 9.99%
2 - 4.99%
1 - 1.99%
< 1%
[No votes]
0.0%
 
0%   25%   50%   75%   100%
Public's "Guesstimation" of Royalty Value
Market SizeN/A[No votes]
xMarket ShareN/A[No votes]
xReasonable RoyaltyN/A[No votes]

N/A

License Availablity
If you are NOT the owner or assignee, answer here:
Yes, license is available for purchase

No, license is not currently available



[No votes]
License Availablity
If you ARE the owner or assignee, answer here:
Yes, license is available for purchase

No, license is not currently available



[No votes]
Competitive Advantage
Does this invention have a significant competitive advantage over similar technologies?
Yes

No



[No votes]
Most helpful competitive advantage comment
[No comments]

Commercial Alternatives
Are there viable commercial alternatives for this invention?
Yes

No



[No votes]
Most helpful commercial alternative comment
[No comments]

 Technical Review Submit all comments and votes
 Claims Submit all comments and votes
 


I claim:

1. Apparatus for interacting with a computer program comprising:

display means connected to the computer for displaying objects on a screen;

glove means adapted to be worn on a hand of a user, the glove means including gesture sensing means coupled to the glove means for detecting flexure of fingers of the user's hand, and position sensing means coupled to the glove means for detecting a position of the hand with respect to the display means;

interface means for coupling the glove means to the computer; and

control means for controlling a cursor indicated on the display means in response to and emulating the flexure of fingers and the position of the hand, the cursor being capable of interactivity acting upon a virtual object represented within the computer to allow communication and interaction between the user and the program.

2. Apparatus as in claim 1 wherein the position sensing means comprises transmitting means affixed to the glove for transmitting signals to receiving means disposed about the display means in close proximity thereto.

3. Apparatus as in claim 2 wherein the gesture sensing means further comprises flexure sensors affixed to the glove means to detect the extent of bending of the fingers of the user.

4. Apparatus as in claim 2 wherein the transmitting means transmits ultrasonic signals.

5. Apparatus as in claim 4 wherein the receiving means comprises a plurality of receivers of ultrasonic signals disposed about the screen.

6. Apparatus as in claim 5 wherein the plurality of receivers is three and the three receivers are not linearly arranged.

7. Apparatus as in claim 5 wherein the interface means includes circuitry coupled to the flexure sensors and to the plurality of receivers.

8. Apparatus as in claim 1 wherein the display means includes means for displaying the cursor as a representation of a hand which mirrors the position and flexure of fingers in the user's hand.

9. Apparatus as in claim 4 wherein the transmitting means comprises a plurality of transmitters.

10. Apparatus as in claim 1 wherein the interface means includes a cable connecting the glove means to the computer.

11. Apparatus as in claim 1 wherein the interface means includes an electromagnetic transmitter connecting the glove means to the computer.

12. Apparatus as in claim 1 wherein the interface means includes an optical transmitter/receiver connecting the glove means to the computer.

13. An apparatus for controlling a computer display of the type having a virtual object depicted thereon that is used for communicating and interacting with a computer program comprising:

flex sensing means disposed in close proximity to a part of the body of the user, for sensing flexure of the associated part of the body of the user; and

cursor display means, coupled to the flex sensing means and to the computer display, for displaying a cursor emulating the flexure of the part of the body, the cursor being capable of interactivity acting upon the virtual object to allow communication and interaction between the user and the computer program.

14. The apparatus according to claim 13 wherein the flex sensing means senses the degree of flexure of the part of the body.

15. The apparatus according to claim 14 wherein the cursor display means displays a cursor depicting the degree of flexure of the part of the body.

16. The apparatus according to claim 13 wherein the flex sensing means senses flexure of a user's hand.

17. The apparatus according to claim 16 wherein the flex sensing means senses flexure of a finger of the user's hand.

18. The apparatus according to claim 17 wherein the flex sensing means senses the degree of flexure of the user's hand.

19. The apparatus according to claim 18 wherein the cursor display means displays the degree of flexure of the user's hand.

20. The apparatus according to claim 19 wherein the flex sensing means is disposed in a glove that is worn on the user's hand.

21. The apparatus according to claim 20 wherein the cursor display means displays a representation of a hand which mirrors the flexure of fingers of the user's hand.

22. The apparatus according to claim 21 further comprising position sensing means for sensing the position of the user's hand with respect to the display.

23. The apparatus according to claim 22 wherein the cursor display means is coupled to the position sensing means and displays the position of the user's hand with respect to the display.

24. The apparatus according to claim 13 wherein the flex sensing means senses the degree of flexure of the part of the user's body and provides an analog signal to the cursor display means that indicates the degree of flexure of the part of the body;

and wherein the cursor display means depicts the flexure of the part of the body based on the intensity of the analog signal.

25. The apparatus according to claim 24 wherein the analog signal is a function of voltage.

26. An apparatus of interacting with a virtual object represented within a computer, the virtual object being used for communicating and interacting with a computer program, comprising:

position sensing means, disposed in close proximity to a part of a body of a user for movement therewith, for sensing the position of the associated part of the body of the user with respect to the computer;

flex sensing means, disposed in close proximity to a part of the user's body for movement therewith, for sensing flexure of the associated part of the user's body;

interface means for coupling the position sensing means and the flex sensing means to the computer and for controlling movement of a cursor represented within the computer in response to the position sensing means and the flex sensing means, the cursor emulating the position and flexure of the part of the user's body for interactivity acting upon the virtual object to allow communication and interaction between the user and the program; and

wherein the computer includes contact detecting means for detecting contact between the cursor and the virtual object.

27. The apparatus according to claim 26 wherein the virtual object may be manipulated by the cursor and wherein the interface means includes object manipulating means for manipulating the virtual object with the cursor in response to the contact detecting means and in response to the position of the part of the user's body with respect to the computer.

28. The apparatus according to claim 27:

wherein the part of the user's body is a hand.

29. The apparatus according to claim 28 wherein the flex sensing means detects flexure of a finger of the user's hand.

30. The apparatus according to claim 29 wherein the interface means represents within the computer a virtual hand which mirrors the position and flexure of the fingers of the user's hand.

31. The apparatus according to claim 30 wherein the contact detecting means detects when the virtual object is grasped by the virtual hand.

32. The apparatus according to claim 31 wherein the flex sensing means detects the degree of flexure of the fingers of the user's hand, and wherein the interface means represents within the computer the degree of flexure of the fingers of the user's hand.

33. The apparatus according to claim 32 further comprising display means for visually displaying the cursor as the position and flexure of the fingers of the user's hand.

34. The apparatus according to claim 33 wherein the display means visually displays the virtual object together with the cursor.

35. The apparatus according to claim 34, wherein the interface means causes the virtual object to be manipulated according to commands represented by the position and flexure of the fingers of the user's hand.

36. The apparatus according to claim 35 wherein the interface means causes an effect of the manipulation of the virtual object to be substantially the same as if a real object depicted by the virtual object were being manipulated in the same way of the user's hand.

37. The apparatus according to claim 36 wherein the user's hand does not act upon a real object depicted by the virtual object.

38. The apparatus according to claim 36 wherein the interface means causes the virtual object to be coupled to the virtual hand and to move together with the virtual hand when the virtual object is grasped by the virtual hand.

39. The apparatus according to claim 38 wherein the interface means further comprises linkage means for linking action of the virtual object to a second virtual object.

40. The apparatus according to claim 39 wherein the position sensing means and the flex sensing means operate without using a camera.

41. The apparatus according to claim 39 wherein the virtual object is a tool which acts upon the second virtual object.

42. The apparatus according to claim 26 wherein the flex sensing means senses the degree of flexure of the part of the user's body and provides and analog signal to the interface means that indicates the degree of flexure of the part of the body;

and wherein the interface means depicts the flexure of the part of the body based on the intensity of the analog signal.

43. The apparatus according to claim 42 wherein the analog signal is a function of voltage.

44. The apparatus according to claim 28 further comprising display means for visually displaying the cursor as the position and flexure of the part of the user's body with respect to the display.

45. The apparatus according to claim 44 wherein the display means visually displays the virtual object together with the cursor.

46. An apparatus for controlling a computer display of the type having a virtual object depicted thereon that is used for communicating and interacting with a computer program comprising:

orientation sensing means, disposed in close proximity to a part of a body of a user, for sensing the orientation of the associated part of the body of the user with respect to the display; and

cursor display means, coupled to the orientation sensing means and to the computer display, for displaying a cursor emulating the orientation of the part of the user's body, the cursor being capable of interactivity acting upon the virtual object to allow communication and interaction between the user and the computer program.

47. The apparatus according to claim 46 further comprising flex sensing means, disposed in close proximity to a part of the user's body, for sensing flexure of the part of the user's body.

48. The apparatus according to claim 47 wherein the cursor display means is coupled to the flex sensing means and displays a cursor depicting the flexure of the part of the user's body.

49. The apparatus according to claim 48 wherein the flex sensing means causes the degree of flexure of the part of the user's body.

50. The apparatus according to claim 49 wherein the cursor display means displays a cursor depicting the degree of flexure of the part of the user's body.

51. The apparatus according to claim 50 wherein the part of the user's body is the user's hand.

52. The apparatus according to claim 51 wherein the flex sensing means senses flexure of a finger of the user's hand.

53. The apparatus according to claim 52 wherein the flex sensing means senses the degree of flexure of the user's hand.

54. The apparatus according to claim 53 wherein the cursor display means displays the degree of flexure of the user's hand.

55. The apparatus according to claim 54 wherein the flex sensing means and the orientation sensing means are disposed in a glove that is worn on the user's hand.

56. The apparatus according to claim 55 wherein the cursor display means displays a virtual hand which mirrors the orientation and flexure of fingers of the user's hand.

57. The apparatus according to claim 56 further comprising position sensing means for sensing the position of the user's hand with respect to the display.

58. The apparatus according to claim 57 wherein the cursor display means is coupled to the position sensing means and depicts the position of the user's hand with respect to the display.

59. The apparatus according to claim 58 wherein the cursor display means further comprises contact detecting means for detecting when the virtual object is grasped by the virtual hand.

60. The apparatus according to claim 59 wherein the cursor display means includes object manipulating means for manipulating the virtual object in response to the contact detecting means and in response to the position, flexure, and orientation of the user's hand.

61. The apparatus according to claim 46 wherein the cursor display means further comprises means for displaying a cursor depicting the roll orientation of the part of the user's body.

62. The apparatus according to claim 46 wherein the cursor display means further comprises means for displaying a cursor depicting the pitch orientation of the part of the user's body.

63. The apparatus according to claim 46 wherein the cursor display means further comprises means for displaying a cursor depicting the yaw orientation of the part of the user's body.

64. The apparatus according to claim 46 wherein the cursor display means further comprises means for displaying a cursor depicting the pitch, roll and yaw orientation of the part of the body.

65. The apparatus according to claim 47 wherein the flex sensing means sense the degree of flexure of the part of the user's body and provides an analog signal to the interface means that indicates the degree of flexure of the part of the body;

and wherein the interface means depicts the flexure of the part of the body based on the intensity of the analog signal.

66. The apparatus according to claim 65 wherein the analog signal is a function of voltage.
 Description Submit all comments and votes
 


BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates generally to the field of devices for data entry and manipulation in computers, and relates more particularly to an apparatus and method for entering data into a computer and manipulating virtual objects defined by the computer based on the gestures and positions of the hand, or other parts of the body, of an operator.

2. Description of the Prior Art

Input devices for computers include such devices as keyboards, digitizers, joysticks, mice, trackballs, and light pens. One function of these input devices is to position, in two dimensions, a cursor on the display screen of a computer. Once the cursor is positioned at a desired location, the computer typically will be instructed to perform an operation. The processes of positioning the cursor and selecting the operation are discrete operations, since separate motions are required to perform each operation. With a mouse, for example, cursor positioning is accomplished by moving the mouse along a surface, while selection of the operation is accomplished by pushing keys located either on the mouse or on a separate keyboard. Mastering the operation of such input devices is often difficult because the hand movements required to operate the devices do not correspond to the visual feedback presented by the display screen of the computer. Furthermore, the operator's hand(s) must be removed from the keyboard, positioned on the mouse, then returned to the keyboard.

Glove input devices also have been used to supply data to computers. U.S. Pat. No. 4,414,537, filed Sept. 15, 1981, by G. Grimes and entitled "Digital Data Entry Glove Interface," describes one such glove input device. The Grimes patent discloses a glove with sensors for detecting the flexing of finger joints, sensors for detecting contact between various portions of the hand, and sensors for detecting the orientation of the hand. The Grimes device is used to identify static hand positions representing the characters of the alphabet. Furthermore, the glove is designed to differentiate from one another a fixed number of static shapes representing the letters of the alphabet.

SUMMARY OF THE INVENTION

The present invention provides an apparatus and method for manipulating virtual objects defined by a computer according to the gestures, position, and movement of the hand of an operator. Such manipulation includes positioning a cursor or other representation of the hand of the operator with respect to virtual objects defined by the computer. Operations on those virtual objects may then be carried out according to certain gesture specifying movements of the operator's hand. The virtual objects themselves may be representations of computer input devices such as a joystick, mouse, pen, keyboard, paintbrush or other devices. More generally, the objects may be tools which themselves act on other virtual objects. For example, a virtual steering wheel may be used to drive a simulation of an automobile, or to provide input to a remote system.

The in