Offline editing system with user interface for controlling edit list generation

Description Submit all comments and votes

FIELD OF THE INVENTION

The invention is a post production editing system which includes means for storing unedited video takes in a random access memory, displaying selected takes (or individual frames from selected takes), and generating an edit list which defines an edited video program. In a preferred embodiment, the unedited video takes are stored in one or more laser video disks, and the invention includes a computer programmed to display menus prompting a user to perform desired editing operations.

BACKGROUND OF THE INVENTION

Post production editing of film and video works may be efficiently accomplished using offline and online editing systems. Offline editing systems generate an edit list by manipulating unedited takes that have been stored in video tape or laser video disk format (i.e., motion picture film takes that have been transferred to video tape or video disk), and stored addresses (time codes) identifying the first and last frame of each take. The edit list specifies a sequence of selected takes (with transitions between the takes), which may subsequently be used by an online editing system to generate an edited master film (or tape) from the originally produced medium (i.e., motion picture film).

Post production offline editing systems have been proposed which include means for storing unedited video takes and addresses (on video tape or laser video disks), and computer means for controlling the display of selected unedited video takes (or frames of such takes) and generating the edit list in response to user-entered commands.

Throughout this specification, the noun "edit" shall be used (with reference to video signals) to denote one or more consecutive video frames which correspond to all or part of a scene or take. With reference to audio signals, the noun "edit" shall be used to denote a left or right channel of an audio soundtrack which corresponds to a video edit. The noun "splice" shall be used to denote the transition between two edits, and the noun "show" (or "video program" or "audio program") shall be used to denote a sequence of edits and splices.

A "splice" may be a simple cut, in which the end (i.e., the last frame) of a first edit is concatenated with the beginning (i.e., first frame) of a second edit. Alternatively, a splice (whether video or audio) may be a more complicated transition, such as a wipe, fade, or dissolve. For example, a show may consist of a first edit, followed by a simple cut to a second edit, followed by a dissolve splice to a third edit. Typically, a show will include a video portion, as well as left and right channels of an audio soundtrack.

Sometimes in the specification, the terms "left" and "right" edits will be used respectively to denote earlier and later edits. Used in this sense, for example, when a viewer views a show in its normal time sequence (i.e., not in a reversed sequence), the viewer will see the left edit before the right edit.

Several systems have been proposed for post production offline editing. For example, U.S. Pat. No. 4,746,994 (issued May 24, 1988, to Ettlinger) discloses a computer-based video editing system in which unedited takes are stored on video tape recorders (although the reference also includes a very general suggestion that video disk players may be substituted for the video tape recorders). A computer system enables the user to control the video tape recorders and generate an edit list. The computer system displays a sequence of menus which prompt the user to perform various editing operations (such as displaying desired frames of the unedited takes, shuttling frame-by-frame through a stored unedited take, adding edits to an edit list, and playing back the sequence of takes defined by the edit list). The user may select various ones of the editing operations by actuating a light pen.

For another example, U.S. Pat. No. 4,754,342 issued Jun. 28, 1988, to Duffy) discloses a computer-based video editing system in which unedited takes are stored on video disk players. After generating an edit list, the user may command the system to electronically splice takes in accordance with the edit list and play back the edited show. By using a control console 50 with a control buttons 100 through 112 and a dial 114, the user may command the system to display individual frames of the stored takes, or "roll" one or more takes (or an edited sequence of takes) in forward or reverse motion, at any of a variety of speeds.

However, use of light pens (as in U.S. Pat. No. 4,746,994) is cumbersome and distracts the user's attention from the editing operation, and use of dials and buttons as disclosed in U.S. Pat. No. 4,754,342 is also cumbersome as the dials and buttons perform only a limited number of functions, necessitating use of a computer keyboard to perform other essential post production editing functions. Furthermore, until the present invention, it had not been known how to provide global access to a variety of video post production environments (i.e., computer menus for scene logging, edit list modification, replay of an edited show, and the like) at any point during an post production offline editing operation, and it had not been known how to design user interface software to accomplish this function using convenient icons which may be selected by the use using a mouse-type input device.

SUMMARY OF THE INVENTION

The invention is a post production offline editing system which includes means for storing unedited video takes in a random access memory (preferably a set of laser video disk players), displaying selected takes (or individual frames from selected takes), and generating an edit list which defines an edited video program. The system of the invention includes a computer programmed with software providing an integrated software environment which enables a user conveniently to log unedited takes into the system, and to generate an edit list suitable for use in a subsequent online editing operation. The system software provides global access to a variety of video post production environments (i.e., computer menus prompting the user to perform a variety of operations, such as logging of unedited takes onto the system, edit list modification, and playback of an edited show) at any point during an offline editing operation. The system software presents menus to the user including icons (and mnemonic text) within windows which may conveniently be selected by the user using a mouse.

The system components are preferably arranged to that a user may conveniently view a set of video monitors, thus focusing his or her attention on the video frames being displayed on the monitors, while manipulating the mouse to enter edit decisions into the system.

In a preferred embodiment, the invention includes a video special effects unit capable of processing the stored takes to simulate various video transitions between scenes (such as dissolves, fades, and wipes), to enable the user to view a show defined by an edit list which specifies such transitions.

The user interface includes a convenient means for jogging (and shuttling) the laser disk players using a mouse. After selecting a special jog/shuttle window (identified by an icon or mnemonic text), the user actuates certain buttons on the mouse to enter a mode in which rightward motion of the mouse commands the appropriate video disk player to shuttle a disk player in a forward direction, and leftward motion of the mouse commands the video disk player to shuttle in the reverse direction.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram representing the steps performed during post production offline editing.

FIG. 2 is a schematic diagram of a preferred embodiment of the invention.

FIG. 3 is a block diagram of a portion of the FIG. 1 system, showing hardware connections for control signals.

FIG. 4 is a block diagram of a portion of the FIG. 1 system, showing hardware connections for video signals.

FIG. 5 is a block diagram of a portion of the FIG. 1 system, showing hardware connections for audio signals.

FIG. 6 is a front view of a console portion of the FIG. 1 system.

FIG. 7 is a front view of an equipment rack portion of the FIG. 1 system.

FIG. 8 is a diagram representing the functionality of the software of the invention.

FIG. 9 is a typical display produced by the user interface of the invention on the computer monitor of the invention.

FIG. 10 is a display on the computer monitor of the invention, which includes an enlarged view of an icon shown in FIG. 9, and a non-enlarged view of the icon.

FIG. 11 is an icon of the type shown in simplified form in FIG. 9.

FIG. 12 is a display on the computer monitor of the invention, of the type produced by the project selection module of the invention.

FIG. 13 is a display on the computer monitor of the invention, of the type produced by the scene tracker module of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

FIG. 1 is a schematic diagram representing the steps performed during post production offline editing. FIG. 1 contemplates that during production, the production crew has prepared five video tapes (or strips of motion picture film), each representing a take. Each take corresponds to a portion of a script. The takes are sometimes collectively referred to as "dailies," and are the raw material for the post-production editing process.

Each tape (or segment of motion picture film) is transferred to a laser video disk (or disks), so that the disks may be inserted into the video disk playback units of the invention. During offline editing, the editor may generate an edit list which characterizes the typical "first-cut" shown in the upper right corner of FIG. 1. This first cut consists of concatenated portions of each of the five takes, which define an edited show.

More specifically, during offline editing the editor identifies group "A" of frames from the first disk as the first "edit" on the list. The editor then identifies group "B" of frames from the first disk as the second edit, group "C" of frames from the second disk as the third edit, group "D" of frames from the third disk as the fourth edit, group "E" of frames from the fourth disk as the fifth edit, group "F" of frames from the fourth disk as the sixth edit, group "G" of frames from the fifth disk as the seventh edit, and group "H" of frames from the fifth disk as the eighth edit.

Of course, the editor may choose to revise the initial edit list. For example, the editor may decide that the first splice (the transition between the last frame of edit "A" and the first frame of edit "B") should be a wipe (or a dissolve), rather than a simple cut. The editor would accordingly supplement the edit list to include this "splice" information.

In the preferred embodiment of FIGS. 2-7, the invention includes a programmed computer 30 (including offline editing control hardware and software) for generating the edit list in the form of a computer file (so that the edit list may be written by computer 30, for example, on a 3.5 floppy diskette, as indicated in FIG. 2).

The user interfaces with computer 30 using computer monitor 35, mouse 33, and computer keyboard 31. Computer 30 controls up to six laser video disk units 50, with each of units 50 preferably including a means 50b (shown in FIGS. 4 and 5) for playing a laser video disk (on which unedited takes may be stored) and a means 50a for writing once on a laser disk (for example, to record selected takes being played by other ones of units 50). Sony LVR-5000 and LVS-5000 video disk units are suitable for use as means 50b and 50a, respectively.

The video signals output from units 50 are routed to one or more video monitors 52a, and through video switcher 46, operating under the control of programmed computer 30, to one or more video monitors 52b. Only one monitor 52a and one monitor 52b is shown in FIG. 2 for simplicity, but a total of eight video monitors (52a, 52b, 52c, and 52d) are shown in FIG. 4. A Sony BVS-V1212 video routing switcher is suitable for use as switcher 46.

The audio signals output from units 50 (typically a left and right audio channel for each unit 50) are routed through audio switcher 48, operating under the control of programmed computer 30, to stereo amplifier 56 and speakers 54. An additional audio signal (for special effects) is output from audio CD player 58, through buffer 60 to audio mixer 44, in which it may be mixed with desired signals from unit 48 before amplification in amplifier 56. A Sony BVS-A1201 audio routing switcher is suitable for use as switcher 48.

With reference to FIG. 3, programmed computer 30 communicated with video special effects unit 42 (which includes video signal generator 40), audio mixer 44, switchers 46 and 48, and video disk units 50, through "quad port" boards 32, 34, and 36, and breakout circuit 38. Unit 42 is not shown in FIG. 2 for simplicity.

Preferably, computer 30 is an IBM AT personal computer (or a compatible "AT" computer), and each of boards 32, 34, and 36 is connected within a standard IBM AT slot of the computer. The function of circuits 32, 34, 36, and 38 is to enable computer 30 to control up to twelve peripheral devices through three un-modified slots of the computer. Circuit 38 includes twelve 9-pin RS-422 ports, for connection to the twelve peripheral devices shown in FIG. 3. Four such RS-422 ports are connected to each of the three 37-pin ports of box 38, and each such 37-pin port is connected to a different 37-pin port of board 32, 34, or 36.

A frame reference signal from video signal generator 40 (which may be a Sony Model BVS-3200 signal generator) will cause an interrupt to computer 30 through quad port board 32, to synchronize the communication for device control to video frame time.

Video special effects unit 42 (which may be a Sony DME-450 digital multi effects device) should be capable of processing the stored takes to simulate various video signal transitions between edits (such as dissolves, fades, and wipes), to enable the user to view shows defined by edit lists which specify such video signal transitions.

Similarly, audio mixing unit 44 (which may be a Sony VSP-A600 audio mixing device) should be capable of generating audio signal transitions such as audio cross-fades, to enable the user to listen to the audio track of shows defined by edit lists which specify such audio transitions.

With reference to FIG. 4, the video playback output of each of the upper three video disk units 50 is connected to a different video monitor within group 52a of video monitors, and the playback output of each of the lower three video disk units 50 is connected to a different video monitor within group 52c of video monitors. The playback output of each video disk unit 50 is also connected to an input of video switcher 46. An output of switcher 46 is also connected to video disk recording unit 50a within the top unit 50, so that the video output of switcher 46 may be recorded on a disk within unit 50a. One or more of the other units 50 may also include a recording unit, connected to switcher 46 in the same way as is the top unit 50.

Two outputs of switcher 46 are connected to the inputs of video special effects unit 42, whose output is connected to video monitor 52d and to an input of switcher 46. Another output of switcher 46 is connected to video monitor 52b.

With reference to FIG. 5, the audio playback output (including a left and a right audio channel) of each of the upper three video disk units 50 is connected to an input of audio switcher 48. The line output of audio mixing unit 44 is also connected to the left and right inputs of recording unit 50a within the top unit 50, so that the audio output of mixing unit 44 may be recorded on a disk within unit 50a.

The output of audio CD player 58 is supplied through buffer 60 to left and right inputs of mixing unit 44, so that such audio signals may be mixed with audio signals from switcher 48. The left and right outputs of mixing unit 44 are connected to audio amplifier 56, and the amplified left and right audio channels are sent to pair of speakers 54. PG,12

Preferably, video monitors 52a, 52b, 52c, and 52d, computer monitor 35, audio speakers 54, audio amplifier 56, CD player 58, computer keyboard 31, and mouse 33 are mounted on a console rack as shown in FIG. 6. With the arrangement of FIG. 6, a user may conveniently view the video monitors (and thus focus his or her attention on the frames being displayed), while manipulating the mouse in order to enter edit decisions into the system. At other times during the editing process, a user may conveniently view the computer monitor while typing computer commands using the keyboard or entering computer commands using the mouse.

Preferably also, six video disk units 50 (each including a laser video disk recorder 50a and a player 50b), programmed computer 30, breakout box 38, video special effects unit 42, video switcher 46, and audio switcher 48, are mounted on an equipment rack portion as shown in FIG. 7.

With reference to FIG. 8, programmed computer 30 includes: hardware driver software for controlling the video and audio peripheral devices of the system (including device control routines for each type of peripheral device employed in the system); scene tracker software (enabling the user conveniently to log unedited takes into the system, and generate lists of logged takes); edit decision software; and user interface software, which is capable of accessing the other system software in response to commands entered by the user using mouse 33 or keyboard 31 and is capable of generating displays of the type shown in FIG. 9 on computer monitor 35's screen.

The scene tracker software enables the user conveniently to log unedited takes into the system in either of two ways (depending on whether the unedited takes are stored on videotape or on video disks). First, if the user starts with video tape versions of the unedited takes, the scene tracker module allows the user to cue individual videotaped takes (when video tape players have been connected to the system to play back the takes), mark "in" and "out" frames of the takes being played back, and copy the marked takes onto a video disk (storing not only the first and last frame time codes of the original videotaped version of each copied take but also the first and last frame time codes of the new video disk version each copied take). Alternatively, when the user starts with video disk versions of the unedited takes, the scene tracker module prompts the user to mark "in" and "out" frames of desired ones of the takes, and stores the "in" and "out" (first and last) frame time codes of each marked take (i.e., the scene tracker module logs the marked takes).

The scene tracker module also prompts the user to enter descriptions of logged takes (using computer keyboard 31), and stores the user-entered descriptions. Additionally, the scene tracker module allows the user to revise the descriptions of the logged takes, and to add or delete selected takes to the scene tracker data base (which data base includes the addresses and descriptions of the logged takes).

The edit decision software includes the "first cut" module, "sync-roll" module, "review modify" module, and "edit list manager" module shown in FIG. 8.

The first cut module enables the user conveniently to generate an edit list from logged, unedited takes. The edit list includes time codes identifying the splices between edits on the list, codes identifying the type of each splice (i.e., wipe, dissolve, fade, or simple cut), and user-entered descriptions of the edits on the list.

The "review modify" module enables the user to revise an already-generated edit list (while viewing selected video takes), and to view a show defined by an already-generated edit list (i.e., to cause the video tape players to simulate the show by sequentially playing back the edits on the edit list).

The sync-roll module enables the user to view simultaneously a set of synchronized takes (i.e., takes produced by a number of synchronized cameras) on a number of video monitors, while marking "in" and "out" frames of desired ones of the takes to generate and edit list.

The edit list manager module displays text prompts for prompting the user to manipulate already-generated edit lists (for example by changing the description of an edit or block of edits on the list, or by copying a sequence of edits to another location on the edit list).

Within the first cut module, and each of the other modules described with reference to FIG. 8, are user-selectable subroutines (also denoted herein as "modules") to be described below with reference to FIG. 9.

The user interface software provides an integrated software environment in which the user has global access to a variety of video post production environments, including the scene tracker, first cut, sync-roll, review modify, and edit list manager modules described above. Specifically, the user interface displays user-selectable icons and mnemonic text (representing software modules) enabling the user to access a desired software module (in which a full-screen or pull down menu may be displayed) at any stage during an offline editing operation. The icons (or windows including text) may be selected by the user using a mouse.

FIG. 9 is a typical display generated by the system's user interface software during operation of the system of the invention. Global icons appear in the upper right area of the screen. The user may command the system to execute a software application module of the inventive software by actuating a mouse to select the icon corresponding to the module. For example, the user may select icon 120 (a graphic representation of a question mark) to execute a "help" module; icon 121 to command the system to display the current data and time; icon 122 (a perspective view of a file cabinet, with drawers for containing project files) to execute a "project selection" module in which the system displays a menu including a list of previously created editing project files; icon 123 (a perspective view of a stack of papers with the initials "OE" on the first paper in the stack) to execute a module enabling the user to select one of the modules described above with reference to FIG. 8 (and thus to reconfigure the display screen); icon 124 (a perspective view of a video special effects device resembling the Sony DME-450 digital multi effects device) to execute a "special effects" module (in which the system displays a menu enabling the user to control a digital special effects device to simulate desired transitions between user-specified frames); and icon 125 to access the computer's operating system.

Upon moving a displayed cursor onto an icon using mouse 33, the icon will become highlighted (as is icon 123 in FIG. 9). The user may select a highlighted icon by "clicking" one of the buttons on the mouse (three such buttons are shown in FIG. 2).

Mnemonic text appears in windows along the top and bottom edges of the screen, such as windows 108 and 110. The user may command the system to execute an application module by actuating a mouse to select the text window corresponding to the module. For example, the user may select text 108 ("Advance") to command the system to add the left edit (the edit whose time codes are currently displayed in window 150, and have been marked) to the edit list, move the right edit (the edit whose time codes are currently displayed in window 151, and have been marked) to left monitor 52b (and the move the displayed information from window 151 to window 150), and move the next edit (if any) on the edit list to right monitor 52d (and display the "in" time codes for such next edit in window 151).

For another example, upon selection of text 110 ("Preview") the system will play (display on video monitor 52b) the last five seconds of the current left edit through the end of the current right edit. For another example, upon selection of "reformat" text window 133 along the top edge (immediately to the right of "edit list manager" window 132), the system might prompt the user to modify the position of the displayed windows and icons.

The user may cue a take in a variety of ways. For example, the user may select a video disk player and enter a desired time code (typically after accessing the scene tracker module to display a list of logged takes), and specify whether the take is to be th