WikiPatents - Community Patent Review
Create Free Account  |  License or Sell Your Patent  |  WikiPatents Marketplace  |  WikiPatents Blog
Username:  Password:  
    
Advanced Search
Interactive television system and method for viewer control of multiple camera viewpoints in broadcast programming    
United States Patent5600368   
Link to this pagehttp://www.wikipatents.com/5600368.html
Inventor(s)Matthews, III; Joseph H. (Redmond, WA)
AbstractAn interactive television system has a set-top box adapted for use with a television and a remote control handset. The set-top box is connected to receive a television broadcast that is filmed using multiple cameras situated at various camera viewpoints. The television broadcast has a primary channel, with which the viewer is familiar as carrying the desired television program, and multiple virtual channels associated with the primary channel. The virtual channels carry video signals from the multiple different cameras covering the event. The remote control handset has dedicated camera control buttons for selecting corresponding virtual channels to allow the viewer to choose a desired camera viewpoint. The dedicated camera control buttons are arranged in an intuitive pattern that correlates to the camera viewpoints.
   














 Title Information Submit all comments and votes
 
Patent Text Patent PDF Print Page Summary File History
Plain text PDF images Print Summary File History
Drawing from US Patent 5600368
Interactive television system and method for viewer control of multiple

     camera viewpoints in broadcast programming - US Patent 5600368 Drawing
Interactive television system and method for viewer control of multiple camera viewpoints in broadcast programming
Inventor     Matthews, III; Joseph H. (Redmond, WA)
Owner/Assignee     Microsoft Corporation (Redmond, WA)
Patent assignment
All assignments
Publication Date     February 4, 1997
Application Number     08/336,804
PAIR File History     Application Data   Transaction History
Image File Wrapper   Patent Term   Fees
Litigation
Filing Date     November 9, 1994
US Classification     348/143 348/159 348/211.2
Int'l Classification     H04N 007/18 H04N 005/232
Examiner     Au; Amelia
Assistant Examiner    
Attorney/Law Firm     Lee & Hayes, PLLC
Address
Parent Case    
Priority Data    
USPTO Field of Search     348/143 348/144 348/157 348/159 348/7 348/13 348/211 348/148 348/149 348/150 348/151 348/156
Patent Tags     interactive television viewer control multiple camera viewpoints broadcast programming
   
Enter a comma (,) or semicolon (;) between multiple tag words/phrases.
Describe this patent:
 Amusing   
 Clever   
 Complex   
 Efficient   
 Historic   
 Important   
 Innovative   
 Interesting   
 Practical   
 Simple   
[no votes]
Patent WIKI

Share information and news about this patent, including information and news about the technology, inventors, company, ligation and licensing.

 References Submit all comments and votes
 
*references marked with an asterisk below are user-added references
 U.S. References
 
Add a new US reference:  
ReferenceRelevancyCommentsReferenceRelevancyComments
5488427
Kayashima
348/569
Jan,1996

[0 after 0 votes]
5479268
Young
386/83
Dec,1995

[0 after 0 votes]
5479266
Young
386/83
Dec,1995

[0 after 0 votes]
5448291
Wickline
348/159
Sep,1995

[0 after 0 votes]
5353121
Young
725/52
Oct,1994

[0 after 0 votes]
5335277
Harvey

Aug,1994

[0 after 0 votes]
5335079
Yuen
386/83
Aug,1994

[0 after 0 votes]
5307173
Yuen
386/83
Apr,1994

[0 after 0 votes]
5233654
Harvey

Aug,1993

[0 after 0 votes]
5206732
Hudson
348/211.11
Apr,1993

[0 after 0 votes]
5182641
Diner
348/86
Jan,1993

[0 after 0 votes]
5151789
Young
725/133
Sep,1992

[0 after 0 votes]
5068733
Bennett

Nov,1991

[0 after 0 votes]
5068734
Beery

Nov,1991

[0 after 0 votes]
5038211
Hallenbeck
348/460
Aug,1991

[0 after 0 votes]
4992866
Morgan
348/159
Feb,1991

[0 after 0 votes]
4977455
Young
348/460
Dec,1990

[0 after 0 votes]
4908713
Levine
386/83
Mar,1990

[0 after 0 votes]
4751578
Reiter
348/564
Jun,1988

[0 after 0 votes]
4706121
Young
348/27
Nov,1987

[0 after 0 votes]
4706121
Young
348/27
Nov,1987

[0 after 0 votes]
4704725
Harvey
380/242
Nov,1987

[0 after 0 votes]
4694490
Harvey
380/234
Sep,1987

[0 after 0 votes]
4228543
Jackson
455/181.1
Oct,1980

[0 after 0 votes]
4203130
Doumit
348/96
May,1980

[0 after 0 votes]
4081754
Jackson
455/181.1
Mar,1978

[0 after 0 votes]
 Foreign References
 Other References
 Market Review Submit all comments and votes
   
Market Size
Estimate the gross annual revenues of the relevant market sector:
> $10B
$5B - $10B
$2B - $5B
$500M - $2B
$100M - $500M
$10M - $100M
$1M - $10M
$500K - $1M
$100K - $500K
< $100K
[No votes]
$0
 
$0   $2.5B   $5B   $7.5B   $10B
Market Share
Estimate the percentage of the relevant market sector this invention will capture:
75% - 100%
50% - 74.99%
25% - 49.99%
10 - 24.99%
5 - 9.99%
2 - 4.99%
1 - 1.99%
< 1%
[No votes]
0.0%
 
0%   25%   50%   75%   100%
Reasonable Royalty
What percentage of gross sales should the inventor or assignee be paid?
75% - 100%
50% - 74.99%
25% - 49.99%
10 - 24.99%
5 - 9.99%
2 - 4.99%
1 - 1.99%
< 1%
[No votes]
0.0%
 
0%   25%   50%   75%   100%
Public's "Guesstimation" of Royalty Value
Market SizeN/A[No votes]
xMarket ShareN/A[No votes]
xReasonable RoyaltyN/A[No votes]

N/A

License Availablity
If you are NOT the owner or assignee, answer here:
Yes, license is available for purchase

No, license is not currently available



[No votes]
License Availablity
If you ARE the owner or assignee, answer here:
Yes, license is available for purchase

No, license is not currently available



[No votes]
Competitive Advantage
Does this invention have a significant competitive advantage over similar technologies?
Yes

No



[No votes]
Most helpful competitive advantage comment
[No comments]

Commercial Alternatives
Are there viable commercial alternatives for this invention?
Yes

No



[No votes]
Most helpful commercial alternative comment
[No comments]

 Technical Review Submit all comments and votes
 Claims Submit all comments and votes
 


I claim:

1. A system comprising:

a display unit to receive a broadcast program which is filmed using multiple cameras situated at various camera viewpoints, the broadcast program having a primary channel and multiple virtual channels associated with the primary channel, the virtual channels carrying video signals from corresponding cameras;

a remote control handset remotely coupled to the display unit, the remote control handset having dedicated camera control buttons for selecting corresponding virtual channels to thereby choose a desired camera viewpoint; and

the dedicated camera control buttons being arranged in a correlating pattern to the camera viewpoints to directly map the camera control buttons on the remote control handset to the camera viewpoints so that a viewer can choose a desired camera viewpoint using intuitive control of the camera control buttons without diverting the viewer's eyes from the display unit.

2. A system according to claim 1 wherein the dedicated camera control buttons are arranged according to directional components of a compass.

3. A system according to claim 1 wherein the display unit includes:

a channel number display that shows a number of the primary channel; and

a virtual channel selector to switch among the virtual channels selected by the dedicated camera control buttons on the remote control handset without changing the primary channel number shown on the channel number display.

4. A system according to claim 1 further comprising a head end server connected to the display unit, the remote control handset generating unique camera control signals indicative of and corresponding to the multiple camera viewpoints and transmitting them to the display unit, the display unit sending the camera control signal to the head end server, the head end server switching among the virtual channels selected by the dedicated camera control buttons on the remote control handset.

5. A system according to claim 4 wherein the head end server stores the video signals from corresponding cameras.

6. An interactive television system comprising:

a television;

a set-top box operatively connected to the television, the set-top box being connected to receive a television broadcast which is filmed using multiple cameras situated at various camera viewpoints, the television broadcast having a primary channel and multiple virtual channels associated with the primary channel, the virtual channels carrying video signals from corresponding cameras;

a remote control handset remotely coupled to the set-top box, the remote control handset having dedicated camera control buttons for selecting corresponding virtual channels to thereby choose a desired camera viewpoint, the dedicated camera control buttons being arranged in a correlating pattern to the camera viewpoints to directly map the camera control buttons on the remote control handset to the camera viewpoints so that a viewer can choose a desired camera viewpoint using intuitive control of the camera control buttons without diverting the viewer's eyes from the display unit;

the television displaying the virtual channel selected by the remote control handset, the television further displaying at least one selectable option icon, a modal selection icon, and a highlighting indicator which highlights one of the option icon or modal selection icon for visual identification;

the remote control handset further having a mode select button which allows toggle between first and second modes of operation when the modal selection icon on the television is highlighted;

in the first mode of operation, the camera control buttons are used to cycle between the option icon and the modal selection icon; and

in the second mode of operation, the camera control buttons are used to switch among the virtual channels.

7. An interactive television system according to claim 6 wherein the dedicated camera control buttons are arranged according to directional components of a compass.

8. A remote control handset for use in controlling a display unit, the display unit being connected to receive a broadcast program which is filmed using multiple cameras situated at various camera viewpoints, the broadcast program having a primary channel and multiple virtual channels associated with the primary channel, the virtual channels carrying video signals from corresponding cameras; the remote control handset comprising:

multiple dedicated camera control buttons for selecting corresponding virtual channels to thereby choose a desired camera viewpoint, the dedicated camera control buttons being arranged in a correlating pattern to the camera viewpoints to directly map the camera control buttons on the remote control handset to the camera viewpoints so that a viewer can choose a desired camera viewpoint using intuitive control of the camera control buttons without diverting the viewer's eyes from the display unit.

9. A remote control handset according to claim 8 wherein the dedicated camera control buttons are arranged according to directional components of a compass.

10. A method for controlling multiple camera viewpoints during a broadcast program, the television program having a primary channel and multiple virtual channels associated with the primary channel, the virtual channels carrying video signals from corresponding cameras, comprising the following steps:

correlating the camera viewpoints to corresponding camera control buttons on a remote control handset in art intuitive relationship, the camera control buttons being arranged in a correlating pattern to the camera viewpoints to directly map the camera control buttons on the remote control handset to the camera viewpoints so that a viewer can chose a desired camera viewpoint using intuitive control of the camera control buttons without diverting the viewer's eyes from the broadcast program;

displaying a first camera viewpoint corresponding to a first virtual channel;

switching, in response to actuation of a particular camera control button on the remote control handset, from the first virtual channel to a second virtual channel which corresponds to a second camera viewpoint; and

displaying the second camera viewpoint corresponding to the second virtual channel.

11. A method according to claim 10 further comprising the following additional steps:

generating channel changing signals within the remote control handset in response to activation of a channel button on the remote control handset;

generating camera control signals within the remote control handset in response to activation of the camera control buttons;

selecting the primary channel using a channel changing signal; and

maintaining the primary channel while using the camera control signals to switch among the virtual channels so that use of multiple channels is transparent to an end user.

12. A method according to claim 10 further comprising the following additional steps:

displaying at least one selectable option icon and a modal selection icon;

cycling between the option icon and the modal selection icon in a first mode of operation in response to actuation of the camera control buttons on the remote control handset;

choosing the modal selection icon to switch from the first mode of operation to a second mode of operation; and

switching among the virtual channels in the second mode of operation in response to actuation of the camera control buttons on the remote control handset.

13. In a video broadcast system, a method for controlling multiple camera viewpoints during a broadcast program, the video broadcast system having a display unit and a remote control handset at a viewer residence and a video content provider remote to the viewer residence to serve the broadcast program to the display unit, the broadcast program being filmed using multiple cameras situated at various camera viewpoints, the method comprising the following steps:

correlating the camera viewpoints to corresponding camera control buttons on the remote control handset in an intuitive relationship, the camera control buttons being arranged in a correlating pattern to the camera viewpoints to directly map the camera control buttons on the remote control handset to the camera viewpoints so that a viewer can choose a desired camera viewpoint using intuitive control of the camera control buttons without diverting the viewer's eyes from the display unit;

transmitting the camera viewpoints from the video content provider to the display unit on a primary channel and multiple virtual channels associated with the primary channel;

displaying on the display unit a first camera viewpoint corresponding to a first virtual channel;

generating, in response to actuation of a particular camera control button on the remote control handset, a camera control signal within the remote control handset, the camera control signal being indicative of and corresponding to a second camera viewpoint;

sending the camera control signal from the remote control handset to the display unit;

switching, in response to the camera control signal, from the first virtual channel to the second virtual channel; and

displaying on the display unit the second camera viewpoint corresponding to the second virtual channel.

14. A system according to claim 1 wherein the display unit comprises a set-top box and a television.
 Description Submit all comments and votes
 


TECHNICAL FIELD

This invention relates to interactive television, and more particularly, to a system and method for viewer control of multiple camera viewpoints in broadcast programming. This invention further relates to a remote control handset used in the interactive television system.

BACKGROUND OF THE INVENTION

Conventional broadcast programming has traditionally been limited to a single video stream broadcast from the television or cable company to a viewer's television. Although multiple cameras may have been used to cover the event, the program's producer selects which camera to use at which point in the program so that only one video stream is broadcast to the viewer. For example, when broadcasting sporting events, such as baseball games or tennis matches, the sports network typically employs multiple cameras to adequately cover the action. The multiple cameras enable ready replay of key plays, such as a runner sliding into home plate or a diving backhand volley, from many different angles. The producer relies on his or her creativity and experience to timely select the appropriate camera viewpoint which best conveys the sporting event.

The viewer, on the other hand, has no control over what he/she is viewing. Conventional broadcast systems are not interactive and thus, the viewer is forced to watch the single video stream compiled by the program's producer. As a result, the viewer cannot independently choose to watch the action from the home plate camera in anticipation of a close call at home plate.

With the advances made in fiber optics, digital communications, and other broadcast-related technologies, the number of available channels to end viewers is ever increasing. Today, there are approximately 40-70 channels. By the year 2000, the number of channels is expected to reach 500.

As the number of available channels increases, it has become possible to make available multiple camera signals for control by the viewer. In such systems, a channel is reserved for each camera video signal. For example, suppose a musical concert event required three camera viewpoints: one camera facing center stage, a second camera facing at an angle toward the stage, and a third camera portably roving near the stage for close-ups on the musicians. The three cameras would be assigned to channels, say, 150-152. If the viewer wanted to watch a close-up of the lead singer, the viewer changes to channel 152 using the television control panel or a conventional remote control handset having a number keypad and a channel up/channel down key. If the viewer wanted a full view of the stage, the viewer would change to channel 150, and so forth.

This method for viewer interaction is not, however, very convenient for the viewer. The viewer must consciously remember which channels show which camera viewpoints. Three viewpoints for a concert might be manageable. But, six or more viewpoints in a fast paced basketball game or tennis match might leave the viewer frustrated and seemingly behind the action of every play.

The present invention provides an interactive system and method which is intuitive to operate so that the viewer can expertly manipulate the camera viewpoints as desired.

SUMMARY OF THE INVENTION

According to one aspect of this invention, an interactive television system is provided which permits viewer control of multiple camera viewpoints during a television broadcast. The television broadcast is filmed using multiple cameras situated at various camera viewpoints, such as at a sporting event where many different cameras are employed to capture the action from several angles. The television broadcast has a primary channel which the viewer is familiar, and multiple virtual channels associated with the primary channel. These virtual channels carry video signals from the different cameras. The viewer need not be aware of the virtual channels, but simply assumes that he/she has tuned to the primary channel where various camera angles can be manipulated.

The interactive television system includes a set-top box, which is adapted for use with a television, and a remote control handset that is remotely coupled to the set-top box. The set-top box is connected to receive the primary and virtual channels. The remote control handset has dedicated camera control buttons for selecting corresponding virtual channels to thereby permit the viewer to choose a desired camera viewpoint. The dedicated camera control buttons are arranged in a correlating pattern to the camera viewpoints so that selection of a desired viewpoint is intuitive to the viewer. Preferably, the dedicated camera control buttons are arranged according to directional components of a compass. In this arrangement, the viewer simply depresses the "north" button when he/she wishes to view the sporting event from the north side, and so on.

The interactive television system of this invention therefore provides intuitive operation whereby the viewer tunes to a single station, and then expertly manipulates the camera viewpoints as desired using the designated camera control buttons. This arrangement is further advantageous as it permits rapid camera change to keep up with the action. The viewer need not remember which channel carries which viewpoint. Additionally, the viewer is relieved of having to punch various numbers on the keypad or up/down buttons to switch camera angles, which is often times too slow.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an interactive television system according to one aspect this invention.

FIG. 2 shows an example camera configuration at a baseball game.

FIG. 3 shows a preferred arrangement of dedicated camera control buttons on a remote control handset according to this invention.

FIG. 4 is a functional block diagram of the remote control handset and set-top box of this invention.

FIG. 5 is a flow diagram of preferred steps for controlling multiple camera viewpoints during a television broadcast according to one aspect of this invention.

FIG. 6 shows an interactive television system according to another aspect of this invention.

FIG. 7 is a functional block diagram of the remote control handset, set-top box, and head end server according to another aspect of this invention.

FIG. 8 is a flow diagram of preferred steps for controlling multiple camera viewpoints during a television broadcast according to still another aspect of this invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1 shows an interactive television system 20 according to this invention. The interactive television system 20 includes a television 22, a set-top box 24, and a remote control handset 26. The set-top box 24 is coupled to receive television broadcasts from a cable or television company, and feeds the broadcast signals to the television 22 for display. As is customary, the set-top box controls which broadcast is displayed on the television.

The remote control handset 26 has conventional channel changing buttons in the form of numeric keypad 28 and an up channel/down channel button 30. A volume control button 32 is also shown. Other buttons, such as power and VCR control keys, are not shown, but may also be provided on remote control handset 26. According to one aspect of this invention, remote control handset 26 also has designated camera control buttons 34 and a mode select button 36, which are be described below in more detail.

This invention is particularly concerned with television broadcasts which are filmed using multiple cameras situated at various camera viewpoints. The television broadcast has a primary channel which the viewer is familiar with, and multiple virtual channels associated with the primary channel. A "virtual channel" is an otherwise normal channel that carries a video stream like the primary channel, but the identity of the channel itself is hidden from the viewer. The virtual channels are used to carry video signals from the different cameras. The viewer does not need to be aware of the virtual channels, but instead simply assumes that he/she has tuned to the primary channel where various camera angles can be manipulated.

It would be helpful for purposes of continuing discussion to provide a example entailing a familiar sporting event. Suppose a sports network broadcasts live coverage of a baseball game. The sports network has a primary channel, say channel 20, which the viewer tunes into to watch the baseball game. The viewer tunes to the primary channel using the channel changing buttons 28 or 30. Set-top box 24 includes a channel number display 38 which shows the primary channel number "20".

To adequately cover the baseball game, the sports network positions multiple cameras around a baseball field to provide varied viewpoints. The multiple viewpoints help capture all of the action, as well as provide different replay angles of critical plays, such as a grand slam.

FIG. 2 shows an example camera arrangement around baseball field 40. The action on the baseball field is monitored by seven cameras 42-48. Center field camera 42 captures the action from the center field perspective. Camera 43 provides overhead visuals from a blimp or dome. First base camera 44 monitors action from behind first base as well as a view of the home dugout. Third baseline camera 45 provides a view of the entire field and particularly, down the third baseline. Home plate camera 46 provides a catcher's perspective and shows the types of pitches being hurled at a batter. First baseline camera 47 covers the entire field and down the first baseline. Third base camera 48 observes action from behind third base as well as a view of the visitors' dugout.

The video streams generated by the cameras are carried on separate channels which are simultaneously broadcast to the viewer's home. The program's producer assigns the cameras to corresponding channels in a manner compatible with directional control afforded by the camera control buttons 34 on remote control handset 26. For instance, suppose the program producer assigns a composite signal (i.e., the signal produced and edited by the program staff that is traditionally available on television) to channel 120. The video signals produced by cameras 42-48 are assigned to respective channels 121-127. Channels 120-127 can be referred to as "virtual channels" because the actual identity of channel remains hidden from the viewer who believes that he/she is watching the sports channel "20".

When the viewer first tunes to the primary sports network channel "20", the composite video stream is initially displayed on the television. The composite video stream is created by the program's producer and staff from the multiple camera viewpoints. It presents the baseball game in the same manner available in conventional television systems, including: data overlays for scores or statistics, audio from the commentators, and cuts to various camera angles to timely capture the action.

If the viewer wishes to choose another camera viewpoint independently from what the program producer is displaying, the viewer simply pushes one of the dedicated camera control buttons 34 on the remote control handset 26. The camera control buttons are arranged in a correlating pattern to the camera viewpoints. One preferred arrangement is a directional layout along compass coordinates as shown in FIG. 3. Here, camera control buttons 34 include a "northwest" oriented button 50, a "north" oriented button 51, a "northeast" oriented button 52, an "east" oriented button 53, a "southeast" oriented button 54, a "south" oriented button 55, a "southwest" oriented button 56, and a "west" oriented button 57.

The camera control buttons 34 correlate to the camera viewpoints at the baseball field 40 in an intuitive fashion. For example, the "north" button 51 can be assigned to select the viewpoint from center field camera 42 situated at the north end of the ballpark. The "south" button 55 can be assigned to select the viewpoint from home plate camera 46 situated at the south end of the baseball field. The following table 1 summarizes the correlation between the camera control buttons and the camera positions about the baseball field 40, as well as the corresponding channel carrying the video stream.

TABLE 1 ______________________________________ Direction Button Camera (Number and Viewpoint) Channel ______________________________________ NW 50 Composite -- edited by producer 120 from all cameras N 51 42 -- Center Field 121 NE 52 43 -- Blimp 122 E 53 44 -- 1st Base 123 SE 54 45 -- 3rd Baseline 124 S 55 46 -- Home Plate 125 SW 56 47 -- 1st Baseline 126 W 57 48 -- 3rd Base 127 ______________________________________

As evident from table 1, the dedicated camera control buttons offer the viewer intuitive, intelligent control of the various camer