WikiPatents - Community Patent Review
Create Free Account  |  License or Sell Your Patent  |  WikiPatents Marketplace  |  WikiPatents Blog
Username:  Password:  
    
Advanced Search
System and method for linking and presenting movies with their underlying source information    
United States Patent5596705   
Link to this pagehttp://www.wikipatents.com/5596705.html
Inventor(s)Reimer; James A. (Morgan Hill, CA); Reinsch; Roger A. (Cupertino, CA)
AbstractA system and method for providing on demand access to information related to a movie while the movie is being presented to a user, where the movie was generated from the movie related information, are described. The system operates by presenting the movie to the user, and then receiving from the user a query pertaining to the movie. The system determines a frame of the movie that was being presented to the user when the user issued the query (the system may extract this information from the query, or may extract this information from the movie itself). The system identifies, as specified by the query, portions of the movie related information relating to the frame, and retrieves those portions of the movie related information. These retrieved portions of said movie related information are presented to the user. Also discussed is a manager to enable users to create personalized versions of movies, and personalized collections of items. Also discussed is a system and method for providing to users on demand access to merchandise information related to a movie, and for providing on demand connectivity to merchants, while the movie is being presented to the users.
   














 Title Information Submit all comments and votes
 
Patent Text Patent PDF Print Page Summary File History
Plain text PDF images Print Summary File History
Drawing from US Patent 5596705
System and method for linking and presenting movies with their

     underlying source information - US Patent 5596705 Drawing
System and method for linking and presenting movies with their underlying source information
Inventor     Reimer; James A. (Morgan Hill, CA); Reinsch; Roger A. (Cupertino, CA)
Owner/Assignee     International Business Machines Corporation (Armonk, NY)
Patent assignment
All assignments
Publication Date     January 21, 1997
Application Number     08/407,306
PAIR File History     Application Data   Transaction History
Image File Wrapper   Patent Term   Fees
Litigation
Filing Date     March 20, 1995
US Classification     715/720 715/500.1 715/501.1 715/512 715/810
Int'l Classification     G06F 015/00
Examiner     Powell; Mark R.
Assistant Examiner     Huynh; Ba
Attorney/Law Firm     Kappos, Esq.; David J. Sterne, Kessler, Goldstein & Fox, P.L.L.C.,
Address
Parent Case    
Priority Data    
USPTO Field of Search     395/155 395/156 395/157 395/160 395/152 395/154 395/161
Patent Tags     linking presenting movies their underlying source information
   
Enter a comma (,) or semicolon (;) between multiple tag words/phrases.
Describe this patent:
 Amusing   
 Clever   
 Complex   
 Efficient   
 Historic   
 Important   
 Innovative   
 Interesting   
 Practical   
 Simple   
[no votes]
Patent WIKI

Share information and news about this patent, including information and news about the technology, inventors, company, ligation and licensing.

 References Submit all comments and votes
 
*references marked with an asterisk below are user-added references
 U.S. References
 
Add a new US reference:  
ReferenceRelevancyCommentsReferenceRelevancyComments
5404316
Klingler
715/723
Apr,1995

[0 after 0 votes]
5353391
Cohen
345/619
Oct,1994

[0 after 0 votes]
5111409
Gasper
715/500.1
Dec,1969

[0 after 0 votes]
5307456
MacKay
715/782
Dec,1969

[0 after 0 votes]
 Foreign References
 Other References
 Market Review Submit all comments and votes
   
Market Size
Estimate the gross annual revenues of the relevant market sector:
> $10B
$5B - $10B
$2B - $5B
$500M - $2B
$100M - $500M
$10M - $100M
$1M - $10M
$500K - $1M
$100K - $500K
< $100K
[No votes]
$0
 
$0   $2.5B   $5B   $7.5B   $10B
Market Share
Estimate the percentage of the relevant market sector this invention will capture:
75% - 100%
50% - 74.99%
25% - 49.99%
10 - 24.99%
5 - 9.99%
2 - 4.99%
1 - 1.99%
< 1%
[No votes]
0.0%
 
0%   25%   50%   75%   100%
Reasonable Royalty
What percentage of gross sales should the inventor or assignee be paid?
75% - 100%
50% - 74.99%
25% - 49.99%
10 - 24.99%
5 - 9.99%
2 - 4.99%
1 - 1.99%
< 1%
[No votes]
0.0%
 
0%   25%   50%   75%   100%
Public's "Guesstimation" of Royalty Value
Market SizeN/A[No votes]
xMarket ShareN/A[No votes]
xReasonable RoyaltyN/A[No votes]

N/A

License Availablity
If you are NOT the owner or assignee, answer here:
Yes, license is available for purchase

No, license is not currently available



[No votes]
License Availablity
If you ARE the owner or assignee, answer here:
Yes, license is available for purchase

No, license is not currently available



[No votes]
Competitive Advantage
Does this invention have a significant competitive advantage over similar technologies?
Yes

No



[No votes]
Most helpful competitive advantage comment
[No comments]

Commercial Alternatives
Are there viable commercial alternatives for this invention?
Yes

No



[No votes]
Most helpful commercial alternative comment
[No comments]

 Technical Review Submit all comments and votes
 Claims Submit all comments and votes
 


Having thus described our invention, what we claim as new and desire to secure by Letters Patent is:

1. A method for providing on demand access to movie related information while said movie is being continuously presented to a user, wherein said movie related information includes any of actor, director, character, prop, contract, set, location or other movie related information, the method comprising the steps of:

(1) presenting said movie to said user in a continuous manner;

(2) pausing the presentation of said movie at user determined intervals, and presenting a menu of user query selections;

(3) receiving from said user during a pause a query signal representing a query pertaining to said movie;

(4) determining a frame of said movie that was being presented to said user when said query signal was received;

(5) identifying, as specified by said query signal portions of said movie related information relating to said frame by extracting from said movie a time code of said frame that was being presented to said user when said query signal was received;

(6) retrieving said identified portions of said movie related information;

(7) presenting to said user said retrieved portions of said movie related information; and

(8) resuming presentation of said movie related information to said user in a continuous manner.

2. The method of claim 1, further comprising the following step that is performed before step (1):

(a) generating index information identifying relationships between said movie and said movie related information, comprising the step of generating a source table having an entry for each scene, clip, and take in said movie, each entry storing first information identifying one of a scene, clip, and take, second information identifying time codes of frames in said movie corresponding to said one of a scene, clip, and take, third information sufficient to locate movie related information used to create said one of a scene, clip, and take and being otherwise related to said one of a scene, clip, and take, and fourth information identifying a scene.

3. The method of claim 2, wherein step (5) comprises the steps of:

comparing said time code of said frame with said second information stored in entries of said source table to identify at least one entry of said source table relating to said frame; and

utilizing said third information stored in said at least one entry to locate movie related information related to said frame.

4. The method of claim 2, wherein step (a) comprises the step of:

generating as part of said index information:

(i) an actor in take table having an entry for each actor appearing in each take of said movie, each entry in said actor in take table storing information identifying an actor, information identifying a take, and information identifying time codes of frames in said movie corresponding to said identified take;

(ii) a character in scene table having an entry for each character appearing in each scene of said movie, each entry in said character in scene table storing information identifying a scene, and information identifying a character who appears in said identified scene; and

(iii) an actor plays character table having an entry for each actor who portrays each character in said movie, each entry in said actor plays character table storing information identifying a character in said movie, information identifying an actor who plays said character in said movie, and information identifying a manner in which said identified actor played said identified character in said movie.

5. The method of claim 4, wherein steps (5) and (6) comprise the steps of:

comparing said time code of said frame with said second information stored in entries of said source table to identify a take entry of said source table relating to a take encompassing said frame; and

utilizing said second information stored in said take entry to identify and retrieve at least one entry in said actor in take table identifying at least one actor appearing in said take.

6. The method of claim 5, wherein steps (5) and (6) further comprise the step of:

identifying and retrieving from said actor plays character table entries corresponding to actors identified in said at least one entry retrieved from said actor in take table.

7. The method of claim 4, wherein steps (5) and (6) comprise the steps of:

comparing said time code of said frame with said second information stored in entries of said source table to identify a take entry from said source table relating to a scene encompassing said frame; and

utilizing said fourth information stored in said take entry to identify and retrieve at least one entry in said character in scene table associated with said scene.

8. A system for providing on demand access to movie related information while said movie is being continuously presented to a user, wherein said movie related information includes any of actor, director, character, prop, contract, set, location, or other movie related information said movie having been generated from said movie related information, the system comprising:

movie presenting means for presenting said movie to said user in a continuous manner;

pause means for pausing the presentation of said movie in response to a user generated pause signal deriving a pause generated at user determined intervals;

query signal receiving means for receiving during a pause of said movie a user generated query signal representing a query pertaining to said movie;

frame identifying means for identifying a frame of said movie that was being continuously presented to said user when said query signal was received, wherein said frame identifying means comprises means for extracting from said movie a time code of said frame that was being presented to said user when said query signal was received;

means for identifying, as specified by said query signal, portions of said movie related information relating to said frame;

means for retrieving said portions of said movie related information;

means for presenting to said user the retrieved portions of said movie related information, while said movie is being continuously presented, and

means for resuming presentation of said movie to said user in a continuous manner.

9. The system of claim 8, further comprising:

index information generating means for generating index information identifying relationships between said movie and said movie related information, comprising the step of generating a source table having an entry for each scene, clip, and take in said movie, each entry storing first information identifying one of a scene, clip, and take, second information identifying time codes of frames in said movie corresponding to said one of a scene, clip, and take, third information sufficient to locate movie related information used to create said one of a scene, clip, and take and being otherwise related to said one of a scene, clip, and take, and fourth information identifying a scene.

10. The system of claim 9, wherein said movie related information identifying means comprises:

means for comparing said time code of said frame with said second information stored in entries of said source table to identify at least one entry of said source table relating to said frame; and

means for utilizing said third information stored in said at least one entry to locate movie related information related to said frame.

11. The system of claim 9, wherein said index information generating means comprises:

means for generating as part of said index information:

(i) an actor in take table having an entry for each actor appearing in each take of said movie, each entry in said actor in take table storing information identifying an actor, information identifying a take, and information identifying time codes of frames in said movie corresponding to said identified take;

(ii) a character in scene table having an entry for each character appearing in each scene of said movie, each entry in said character in scene table storing information identifying a scene, and information identifying a character who appears in said identified scene; and

(iii) an actor plays character table having an entry for each actor who portrays each character in said movie, each entry in said actor plays character table storing information identifying a character in said movie, information identifying an actor who plays said character in said movie, and information identifying a manner in which said identified actor played said identified character in said movie.

12. The system of claim 11, wherein said movie related information identifying means and said movie related information retrieving means collective comprise:

means for comparing said time code of said frame with said second information stored in entries of said source table to identify a take entry of said source table relating to a take encompassing said frame; and

means for utilizing said second information stored in said take entry to identify and retrieve at least one entry in said actor in take table identifying at least one actor appearing in said take.

13. The system of claim 12, wherein said movie related information identifying means and said movie related information retrieving means collective comprise:

means for identifying and retrieving from said actor plays character table entries corresponding to actors identified in said at least one entry retrieved from said actor in take table.

14. The system of claim 11, wherein said movie related information identifying means and said movie related information retrieving means collective comprise:

means for comparing said time code of said frame with said second information stored in entries of said source table to identify a take entry from said source table relating to a scene encompassing said frame; and

means for utilizing said fourth information stored in said take entry to identify and retrieve at least one entry in said character in scene table associated with said scene.

15. The system of claim 8, further comprising:

means for receiving a query signal from said user during a pause to show a script of said movie while said movie is being continuously presented;

means for retrieving said script from a database storing said movie related information; and

means for presenting to said user said retrieved script while said movie is being continuously presented.

16. A method for providing on demand access to secondary information while primary information is being continuously presented to a user, wherein said secondary information includes any of actor, director, character, prop, contract, set, location, or other information related of said primary information, the method comprising the steps of:

(1) presenting said primary information to said user in a continuous manner;

(2) pausing the presentation of said primary information at user determined intervals, and presenting a menu of user query selections;

(3) receiving from said user during a pause a query signal representing a query pertaining to said primary information;

(4) determining which segment of said primary information was being presented to said user when said query signal was received;

(5) identifying portions of said secondary information relating to said segment of said primary information as specified by said query signal;

(6) retrieving said portions of said secondary information;

(7) presenting to said user said retrieved portions of said secondary information, while said primary information is being continuously presented; and

(8) resuming presentation of said secondary information to said user in a continuous manner.

17. A system for providing on demand access to information related to a movie, wherein said movie related information includes any of actor, director, character, prop, contract, set, location, or other movie related information, the system comprising:

a processor;

pause means for pausing the presentation of said movie in response to pause signals generated at user determined intervals;

a controller for controlling said processor, comprising:

movie presenting means for enabling said processor to present said movie continuously to said user;

query signal receiving means for enabling said processor to receive from said user during a pause a query signal representing a query pertaining to said movie, said query signal including an identification of a frame of said movie that was being presented to said user when said query signal was received;

identifying means for enabling said processor to identify, as specified by said query signal, portions of said movie related information relating to said frame;

retrieving means for enabling said processor to retrieve said portions of said movie related information;

presenting means for enabling said processor to present to said user said retrieved portions of said movie related information, while said movie is being continuously presented; and

(8) means for resuming presentation of said movie related information to said user in a continuous manner.

18. A controller to enable a processor to provide on demand access to information related to a movie, wherein said movie related information includes any of actor, director, character, prop, contract, set, location, or other movie related information, the controller comprising:

movie presenting means for enabling said processor to present said movie continuously to said user;

pause means for pausing the presentation of said movie in response to pause signals generated at user determined intervals;

query receiving means for enabling said processor to receive from said user during a pause a query signal representing a query pertaining to said movie, said query signal including an identification of a frame of said movie that was being presented to said user when said query signal was received;

identifying means for enabling said processor to identify, as specified by said query signal, portions of said movie related information relating to said frame;

retrieving means for enabling said processor to retrieve said portions of said movie related information;

presenting means for enabling said processor to present to said user said retrieved portions of said movie related information, while said movie is being continuously presented; and

means for resuming presentation of said movie related information to said user in a continuous manner.
 Description Submit all comments and votes
 


CROSS-REFERENCE TO OTHER APPLICATIONS

The following applications of common assignee contain some common disclosure, and are believed to have an effective filing date identical with that of the present application.

"System and Method for Enabling the Creation of Personalized Movie Presentations and Personalized Movie Collections," Attorney Docket No. ST9-94-045 (1252.1910000), incorporated herein by reference.

"System and Method for Providing Merchant Information and Establishing Links to Merchants While Presenting a Movie," Attorney Docket No. ST9-94-046 (1252.1920000), incorporated herein by reference.

DESCRIPTION

Technical Field

The present invention relates generally to data linking and presentation, and more particularly to linking and presenting movies with their underlying source information.

Related Art

The Information Age that currently exists has produced incredible amounts of data that are currently unavailable to the public. In many cases, the producers of such information would be more than willing to provide the information to the public for some reasonable fee, and the public would be willing to pay this fee. Typically, however, these information producers (also called information providers) are not able to take advantage of this significant business opportunity due to the problems inherent in providing the information to the public.

One problem relates to the medium in which the information is stored. Today, information is stored on paper, on film, on video, on compact disks, on magnetic tapes, on computer floppy disks, etc. Information related to a particular topic may be stored on any combination of these storage mediums. In order to provide information on that topic to an user, it would be necessary for an information provider to identify and locate all items containing information related to the topic, and then transport these items to the user. The value of these items to the user is questionable, since the user probably does not possess the equipment needed to access the information stored in all of the items. Accordingly, it is difficult to provide information to users because such information is stored in many different storage mediums.

A more significant problem results from the sheer volume of information relating to any particular topic. Such information is of little value to an user unless the user is able to efficiently and expeditiously make use of the information. For example, suppose that the user is reviewing a document written by an author and decides that it would be interesting to study other works the author has had a part in creating. The information provided to the user from the information provider will be of little value unless the user is able to efficiently, effectively, and expeditiously traverse the information and locate the data on the author of interest.

These above-described commercial opportunities associated with the dissemination of information, and the problems that prevent such commercial opportunities from being realized, shall now be described more concretely by considering a real-life example: the motion picture industry.

Viewing a movie via a theatrical presentation today involves travelling to the theater, waiting in line to buy a ticket, choosing a seat, and waiting for the movie to begin. The viewer's schedule must match that of the theater. Once the movie has started, the viewer must watch promotional previews of other films before watching the feature film. During the presentation, the viewer has no control over the sound volume or presentation flow. When the movie is over, the viewer travels back home. The picture quality and sound are excellent, and the viewer enjoys the best viewing experience possible today. However, these benefits are obtained only at the expense of convenience and viewing control. Thus, commercial opportunities exist in electronically transferring movies to viewer's homes.

The technology to electronically transfer movies to viewer's homes exists today. Viewing a movie over a conventional network or premium channel broadcast is simpler and more convenient, but the viewer has fewer movie choices and enjoys a more limited quality experience. Like a theatrical viewing, the viewer's schedule must match that of the broadcast and the viewer does not control the presentation flow. There is no travelling involved, and the cost is generally less than that of a theater experience. The video and audio quality are dependent on the viewer's television and sound system. Note that, with this viewing option (and also with the theatrical presentation option discussed above), the viewer is typically not provided with any supplemental information about the movie, such as information about the making of the movie, interviews with the director and cast members, information on the actors, information about special effects, etc.

Alternatively, a person can watch a movie by renting a video tape or laser disk. Watching a movie in this manner involves two trips to the rental shop, a search of their available titles, a wait in line, and a rental fee. The viewing experience is improved over that of a broadcast presentation, as the viewer has some presentation controls (pause, fast forward, rewind, etc.). A laser disk may also offer supplemental information about the film. Parallel audio tracks may be included containing, for example, director commentary. Separate chapters of video may also be provided. However, there is no ability to play video content from different chapters simultaneously. The cost is generally higher than that of a network broadcast. Cost comparisons to that of a premium channel are dependent on usage patterns (flat fee versus fee per rental).

A mid-90s `near video on demand` viewing experience represents something between that of broadcast movies and a VCR/laser disk. A viewer selects a movie from an expanded broadcast rotation (generally a much smaller collection than that available at a VCR rental outlet). The viewer must wait a few minutes until the next rotation of the movie broadcast. A purchase request via remote control or an 800 number is required to enable viewing. Once the presentation has begun, the viewer has a limited range of controls over the presentation flow. If the movie is paused, the viewer must wait until the next instance of the movie at that point is available in the rotation. This latency is dependent on the number of channels available and the collection size configured by the viewer's cable carrier, and is typically about five minutes. No travel is required, and the per use fee is typically added to the viewer's monthly cable bill. Supplemental information about the movie is typically not available.

A mid-90s `true video on demand` viewing experience is effectively like that of a VCR rental, without two trips to the rental outlet. A digital movie server and ITV infrastructure are used to enable the viewer to select a movie from a large collection of all digitized films available on the server. The available selection list is not restricted by a broadcast rotation, and each viewer has full and immediate control over their movie presentation. Like `near video on demand,` a purchase request via remote control or an 800 number is required to enable viewing. The per use fee is typically added to the viewer's monthly bill, and supplemental information is typically not available.

Thus, the current options for viewing a movie are limited because they are inconvenient (the viewer must travel to the theater or to the video store), and/or provide the viewer with little or no presentation flow. Also, these current viewing options are limited because they provide the viewer with little or no supplemental movie information. Thus, the motion picture industry is not taking advantage of the potential commercial opportunities associated with providing supplemental movie information to viewers. Even in those cases where supplemental information is provided, the viewer has little control over how such supplemental information is presented. Accordingly, the supplemental information is available only in a limited way to videophiles who are willing to pay extra for "special" or "director's cut" editions of the titles.

DISCLOSURE OF INVENTION

The present invention is directed to a system and method for providing on demand access to information related to a movie while the movie is being presented to a user, where the movie was generated from the movie related information. The invention operates by presenting the movie to the user, and then receiving from the user a query pertaining to the movie. The invention determines a frame of the movie that was being presented to the user when the user issued the query (the invention may extract this information from the query, or may extract this information from the movie itself). The invention identifies, as specified by the query, portions of the movie related information relating to the frame, and retrieves those portions of the movie related information. These retrieved portions of the movie related information are presented to the user.

The present invention is also directed to a system and method for enabling a user to create, modify, and utilize a personalized version of a movie. The system includes a foundation information database which stores movie related information used to generate the movie. This embodiment of the invention operates by enabling the user to modify a copy of an edit decision list associated with the movie. The edit decision list includes an entry for each scene, clip, and take in the movie. The modified edit decision list defines the personalized version of the movie. The personalized version of the movie is presented to the user in response to a request to do so from the user. Such presentation operates by retrieving an entry from the modified edit decision list, retrieving from the foundation information database one or more digitized frames specified by the retrieved entry, and presenting the digitized frames to the user.

In a similar manner, the present invention is directed to a system and method for enabling a user to create, modify, and utilize a personalized collection of items. This embodiment of the invention operates by enabling the user to modify a personalized collection table, where the personalized collection table defines the personalized collection and has an entry for each item in the personalized collection. The personalized collection of items is presented to the user in response to a request to do so from the user. Such presentation operates by retrieving an entry from the personalized collection table, retrieving from the foundation information database foundation information specified by the retrieved entry, and presenting the retrieved foundation information to the user. The items contained in the personalized collection include any combination of shots, takes, scenes, clips, audio segments, etc.

Further, the present invention is directed to a system and method for providing on demand access to merchandise information related to a movie, and for providing on demand connectivity to merchants, while the movie is being presented to a user. This embodiment of the invention operates by presenting the movie to the user, receiving from the user a merchandise related query pertaining to the movie, and determining a scene of the movie that was being presented to the user when the user issued the query. Portions of movie related information relating to merchandise appearing in the scene are identified and retrieved. These portions of movie related information are then presented to the user. The invention enables the user to interact with any merchant who provided any merchandise appearing in the scene in response to a request from the user to do so.

Further features and advantages of the present invention, as well as the structure and operation of various embodiments of the present invention, are described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers indicate identical or functionally similar elements.

The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular description of (a) preferred embodiment(s) of the invention, as illustrated in the accompanying drawing(s).

BRIEF DESCRIPTION OF FIGURES

The present invention will be described with reference to the accompanying drawings, wherein:

FIG. 1 is a block diagram of a preferred embodiment of the present invention;

FIG. 2 is a block diagram of a computer system representing a preferred implementation of many components of the present invention;

FIGS. 3 and 4 are data flow diagrams depicting the manner in which foundation and index information is generated according to a preferred embodiment of the present invention;

FIGS. 5 and 6 illustrate example index information contents;

FIG. 7 illustrates the pedigree of a frame;

FIG. 8 illustrates an example source table;

FIGS. 9A, 9B, 11, 15, 17A, 18, 19, and 21 are flowcharts depicting the operation of the present invention;

FIGS. 10A-10C, 12A, 12B, 13A, 13B, 14A, 14B, 17B, 20, 22A, and 22B are example index tables; and

FIG. 16 is a block diagram of a manager according to a preferred embodiment of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

The present invention is directed to a system and method for organizing information, and for providing services to enable users to efficiently, effectively, and expeditiously access such information. In other words, the present invention provides services to enable users to access information in an intelligent, user-driven manner.

For illustrative purposes, the present invention is sometimes described herein in the context of information produced by the motion picture industry. That is, the present invention is described as a system and method for organizing movie and supplemental movie information, and for presenting such movie and supplemental movie information to users. It should be understood, however, that the present invention is not limited to this embodiment (call the "movie environment" for reference purposes). Instead, the present invention is applicable to any environment where information is produced, and where a commercial opportunity exists with the organization and presentation of such information. For example, the present invention is applicable to computer programming environment where information about the person who wrote a program, the company that sold the program, the place the program was written and tested, etc., could be linked to a running program.

The movie embodiment of the present invention is preferably realized through a combination of a `true video on demand` infrastructure, database technology, and other specialized digital servers. By tightly coupling databases to specialized digital servers for video, audio, still image, text, etc., a novel level of control of movie presentation is achieved. Additional information about a movie is stored and managed, to permit a viewer to more effectively explore and understand movies. The combination of greater control and additional information permits the viewer to experience a new level of richness and entertainment from movies.

Accordingly to the movie embodiment, text, still image, and audio information is directly related to specific movie scenes or frames. This level of association, coupled with a database, permits a greater level of direct access to movie information than previously possible. Searching and correlation of supplemental information (also called side information) permits the examination of different side information relationships, and permits the following sample actions not existing in conventional viewing technologies:

1. List the names of the actors, other credited roles, or scene technical detail for the current scene (e.g., director, producer, musical score, shot location, blue screen, matte, etc.).

2. List other movies, TV shows, or other scenes in the current movie with one or more properties equal to those found above.

3. List all scenes including a specific product tie-in (i.e., product brand name used in movie).

4. Save any of these lists for viewing selection.

5. View scene while listening to voice overs of director or actor with their comments about the scene.

6. View stills with pan and zoom controls, to examine fine detail.

7. View movie at desired censor level.

8. View script or staging information via picture in picture.

9. View outtakes for the current scene.

10. View signing (i.e., sign language) via picture in picture.

11. Search other stills for like colors, shapes, or textures.

12. Search the script for a word or phase.

13. Search other scripts for like words or phrases.

14. Layout a movie presentation box, with areas for displaying related information of interest.

15. View a movie through a presentation box, to concurrently view the movie and related information of interest.

In addition to these queries predominantly based on script and editing linkages, queries can be made on non-text factors. Metrics extracted from the video, audio, or stills are also managed by the database, and are used to form non-text searches against these data. This scheme can be used to search for non-text aspects such as cut boundaries and movies having similar soundtracks.

The movie embodiment of the present invention also permits the examination of movie detail beyond that viewable through a TV or HDTV. Feature films are today captured principally on high grade film, affording fidelity far beyond that viewable on TV or HDTV. The present invention permits a viewer to pan and zoom, to examine finer detail in a movie or image still.

By using the movie embodiment of the present invention, film makers are afforded a new level of flexibility in optional viewing and associations from within their films. Alternate plot lines, cuts, or censor levels are much more easily constructed, because the film components are manipulated independently. Composition is directed through the database, easing the construction of alternate presentations and linkages.

Structure of the Present Invention

The present invention shall now be discussed more generally with reference to FIG. 1, which illustrates a block diagram of a data processing environment 102 of the present invention. This environment 102 includes a plurality of user devices 106 representing, for example, set top boxes (STB) in combination with television monitors, or computers (such as personal computers). The user devices 106 each include a mechanism (such as a keyboard either integrated into the user devices 106 or contained in a remote control unit) for receiving control and information-messages from human operators.

Each user device 106 also includes a well known transmit and receive component to transmit and receive control and information signals from other devices via a communication medium 124. Preferably, the communication medium 124 represents a data communication network, such as a local area network or a wide area network, in which case the environment 102 represents a distributed computing environment. However, the present invention is not limited to this connection scheme. For example, some of the devices shown in FIG. 1 may be positioned locally to each other, and/or some of the devices in FIG. 1 may be implemented using a single computer. In sum, any mechanism or scheme for connecting the devices shown in FIG. 1 is within the scope and spirit of the present invention.

The environment 102 also includes a foundation information interface component 108 that controls access to foundation information in a foundation information database 112. (As shown by line 110, the foundation information interface component 108 is preferably directly connected to the foundation information database 112.) The term "foundation information" is used herein to refer to information that has been produced by one or more parties (each party being a person or organization). According to the present invention, the foundation information represents digital information only. The present invention provides foundation information on demand to users via the user devices 106. With respect to the movie embodiment, the foundation information represents, for example, a movie and supplemental information pertaining to the movie (i.e., additional information generated during the pre-production, production, and post-production stages of the movie). The foundation information is described in greater detail below.

Preferably, the foundation interface component 108 represents a relational database management system (RDBMS). The foundation information database 112 preferably represents a file server. The foundation information database 112 may be distributed for performance reasons (i.e., to position foundation information closer to the user devices 106 so that communication performance is enhanced), in which case there would be multiple foundation information interface components 108 and multiple foundation information databases 112 (for simplicity purposes, only one foundation information interface component 108 and one foundation information database 112 are described).

An index interface component 118 controls access to index information in an index information database 122. (As shown by line 120, the index interface component 118 is preferably directly connected to the index information database 122.) This index information represents indices of the foundation information in the foundation information database 112. Accordingly, the organization of the foundation information is established by the index information. The present invention uses the index information to locate and reference particular foundation information. The index information is discussed further below.

Preferably, the index interface component 118 represents a relational database management system (RDBMS). The index information database 122 preferably represents a file server which has special searching capabilities or another relational database management system (RDBMS). The index information 122 may be distributed for performance reasons, in which case there would be multiple index interface components 118 and multiple index information databases 122 (for simplicity purposes, only one index interface component 118 and one index information database 122 are described).

The environment 102 further includes a presentation and control component 104. The functionality of the presentation and control component 104 may be distributed, in which case there would be multiple presentation and control components 104. For simplicity purposes, only one presentation and control component 104 is discussed. The presentation and control component 104 coordinates the actions of the user devices 106, the foundation information interface component 108, and the index interface component 118.

In particular, the presentation and control component 104 receives information requests from the user devices 106. The presentation and control component 104 processes these information requests by accessing the index information in the index information database 122 (via the index interface component 118) to identify and locate the particular foundation information indicated by the user requests. The presentation and control component 104 then retrieves this foundation information from the foundation information database 112 (via the foundation information interface component 108), and presents this foundation information to the users via the user devices 106. In an alternative embodiment, any or all of the functionality of the presentation and control component 104 is embedded in the index interface component 118 and/or the foundation information interface component 108, such that the user devices 106 (in some circumstances) communicate directly with the index interface component 118 and/or the foundation information interface component 108.

In an embodiment of the present invention, the user devices 106 are each used as the application driver in a client/server model, and makes server requests of the databases 112, 122 and digital servers through the index interface component 118 and the foundation information interface component 108 through an integrated interface. The functionality of this integrated interface is represented by the presentation and control component 104, although such functionality can alternatively be located or distributed among other modules. Through these interfaces, the digital video, audio, and still image objects stored on the digital server(s) appear to the application to be managed as data in the relational databases 108, 118.

The index information database 122 and the foundation information database 112 are preferably implemented as digital servers for at least two reasons:

1. To permit the use of specialized hardware and software to cost-effectively deliver the digital video, audio, and image stills.

2. To permit the distribution of these servers, thereby reducing the distance to the viewer and the associated latency and transmission costs.

As noted above, each user device 106 can be a full function PC, or a more limited function settop box. Depending on the hardware and software capacity of any particular user device 106, the client application executing thereon may be distributed over the user device 106 and an intermediate station emulating a full function end station. Independent of this distribution of function, the user device/intermediate station interacts with both the relational databases 112, 122 and the digital movie servers 108, 118 through the integrated interface (i.e., the presentation and control component 104).

The environment 102 also includes a cross merchant gateway 116 and a merchant transaction processor 114, which are described in U.S. Patent Application entitled "System and Method for Providing Merchant Information and Establishing Links to Merchants While Presenting a Movie", Attorney Docket No. ST9-94-046 (1252.1920000), referenced above.

The user devices 106, foundation information interface component 108, index interface component 118, presentation and control component 104, foundation information database 112, index information database 122, cross merchant gateway 116, and merchant transaction processor 114 are each preferably implemented using a computer system 202 as shown in FIG. 2. (Alternatively, each computer system 202 is used to implement a subset of these devices/components.)

The computer system 202 includes a processor 204 (or multiple processors 204) communicating with other components via a communication bus 206.

Connected to the bus 206 is a primary memory 208 (such as random access memory, RAM) which stores control logic 210 (i.e., software) and data 212 (such as a portion of the foundation information and index information, for example). During run-time, the control logic 210 enables the processor 204 to perform the functions described herein. Thus, the control logic 210 represents a controller of the processor 204. In an alternate embodiment, the functionality of the present invention described herein is achieved using a hardware implemented state machine.

The computer system 202 also includes secondary memory 214,