Image processing device and method - Patent Review 5634850

Claims

We claim:

1. An image processing device having a first memory, first data processing means for storing image data of a first type in said first memory, a second memory for storing image data of a second type, and second data processing means for combining the image data respectively read from said first memory and said second memory and for outputting resultant image information,

said image processing device being characterized by further comprising a third memory, and third data processing means for reading data of a moving picture from an outside of said image processing device and writing the data of the moving picture into said third memory, wherein said first data processing means reads the image data stored in said third memory, processes read image data as image data of the first type, and stores processed image data in said first memory.

2. An image processing device having a first memory, first data processing means for storing image data of a first type in said first memory, a second memory for storing image data of a second type, and second data processing means for combining the image data respectively read from said first memory and said second memory and for outputting resultant image information;

said image processing device being characterized by further comprising a third memory, and third data processing means for reading data of a moving picture from an outside of said image processing device and writing the data of the moving picture into said third memory, wherein said first data processing means reads the image data stored in said third memory, processes read image data as image data of the first type, and stores processed image data in said first memory;

wherein the image data of the first type is foreground image data forming a foreground of the superimposed image;

the image data of the second type is background image data forming a background of the superimposed image;

said image processing device further comprises a fourth memory for storing foreground image data, and fourth data processing means for transferring the image data stored in said third memory to said fourth memory as the foreground image data; and

said first data processing means performs a predetermined image process for processing the image data read from said fourth memory to obtain a desired display image and stores the image-processed foreground image data in said first memory.

3. The image processing device as claimed in claim 2, characterized in that said fourth data processing means comprises means for cutting out part of the image data stored in said third memory and transfers the cut-out image data to said fourth memory.

4. The image processing device as claimed in claim 2, characterized in that said fourth data processing means comprises means for transferring one frame of the image data stored in said third memory to said fourth memory.

5. The image processing device as claimed in claim 2, characterized in that said second data processing means further comprises priority circuit means for selecting, on a dot basis of the image data, the image data of the first type or the image data of the second type.

6. The image processing device as claimed in claim 2, characterized in that said third data processing means comprises decoder means for reading and expanding compressed moving picture data in an external storage device and for writing expanded moving picture data into said third memory.

7. The image processing device as claimed in claim 2, characterized in that said fourth data processing means further comprises means for transferring the image data to said second data processing means from said third memory; and

priority circuit means for selecting, on a dot basis of the image data, one of the image data of the first type, the image data of the second type and the image data read from said third memory.

8. An image processing device comprising:

first data processing means;

a first memory and a second memory;

second data processing means for storing image data in said first memory under control of said first data processing means, producing image data of a first type by performing a predetermined image process for processing the image data read from said first memory to obtain a desired display image, and storing produced image data in said second memory;

third data processing means, having a third memory, for producing image data of a second type and storing the image data of the second type in said third memory;

fourth data processing means for combining the image data from said second and third memories and outputting resultant display image information; and

fifth data processing means, having a fourth memory, for reading data of a moving picture from an outside of the image processing device and storing the data of the moving picture in said fourth memory,

said first data processing means comprising means for reading the data of the moving picture stored in said fourth memory and storing read data of the moving picture in said first memory, and said second data processing means comprising means for performing a predetermined image process for the data of the moving picture read from said second memory to obtain a desired image and storing image-processed data of the moving picture in said second memory.

9. The image processing device as claimed in claim 8, characterized in that said first data processing means further comprises means for transferring the data of the moving picture from said fourth memory to said fourth data processing means, and priority selecting means for selecting, on a dot basis of the image data, one of the image data read from said second memory, the image data read from said third memory and the image data read from said fourth memory.

10. An image processing device characterized by comprising:

a first memory;

first data processing means for reading a series of moving picture data from an external device and storing the series of moving picture data in said first memory;

a second memory;

a second data processing means including means for writing still-picture data in said second memory and means for writing the moving picture data stored in said first memory in said second memory;

a third memory;

third data processing means for producing first display image data by sequentially reading either the still-picture data or the moving picture data from said second memory and performing a predetermined image process for processing read data so that a series of motion can be represented and for storing the first display image data in said third memory;

a fourth memory;

fourth data processing means for producing second image data and storing the second image data in said fourth memory; and

fifth data processing means for combining the image data read from said third and fourth memories and for outputting resultant display image information.

11. An image processing device characterized by comprising:

a moving picture frame buffer memory;

first data processing means for reading a series of moving picture data from an external storage device and sequentially storing the series of moving picture data in said moving picture frame buffer memory;

a first video memory;

a second data processing means including means for writing still-picture data in said first video memory and means for writing the moving picture data stored in said moving picture frame buffer memory into said first video memory;

a second frame buffer memory;

third data processing means for sequentially reading the still-picture data and the moving picture data from said first video memory and performing a predetermined image process for processing read data so that foreground image data for representing a series of motion is produced and for storing the foreground image data in said second frame buffer memory;

a second video memory;

fourth data processing means for producing background image data and storing the background image data in said second video memory; and

fifth data processing means for combining the image data read from said second frame buffer memory and said second video memory and for outputting resultant display image information.

12. A game machine, comprising:

an image processing device, comprising:

a moving picture frame buffer memory,

first data processing means for reading a series of moving picture data from an external storage device and sequentially storing the series of moving picture data in said moving picture frame buffer memory,

a first video memory,

a second data processing means including means for writing still-picture data in said first video memory and means for writing the moving picture data stored in said moving picture frame buffer memory into said first video memory,

a second frame buffer memory,

third data processing means for sequentially reading the still-picture data and the moving picture data from said first video memory and performing a predetermined image process for processing read data so that foreground image data for representing a series of motion is produced and for storing the foreground image data in said second frame buffer memory,

a second video memory,

fourth data processing means for producing background image data and storing the background image data in said second video memory, and

fifth data processing means for combining the image data read from said second frame buffer memory and said second video memory and for outputting resultant display image information;

said image processing device further comprises an I/O controller for accommodating a game control device, means for connecting said image processing device to the external storage device, and means for executing a game program,

said first data processing means comprises a decoder for expanding compressed moving picture data,

wherein the game program and the compressed moving picture data are stored in the external storage device, the game program is input to said image processing device, said first data processing means reads and expands the compressed moving picture data, and stores the expanded moving picture data in said moving picture frame buffer memory.

13. A method including step (a) of storing image data in a first memory, step (b) of sequentially reading desired image data from said first memory, producing display image data of a first type representing motion, and storing the produced display image data in a second memory, step (c) of producing display image data of a second type in a third memory, and step (d) of sequentially reading image information from said second and third memories, combining the display image data of the first and second types to thereby produce superimposed display image data, characterized in that said method comprises:

step (e) of sequentially reading a series of moving picture data stored in an external storage device and storing the series of moving picture data in a fourth memory; and

step (f) of sequentially reading the moving picture data stored in said fourth memory and storing the moving picture data in said first memory,

in the step (b), the moving picture data being subjected to a predetermined image process and being stored, as the first display image data, in said second memory.

14. The method as claimed in claim 13, characterized in that the step (d) sequentially reads the moving picture data stored in said third memory and combines the moving picture data with a display image to thereby produce said superimposed display image data.

15. An image processing method comprising the steps of:

(a) sequentially reading a series of moving picture data from an external device and storing the read data in a first memory;

(b) producing still-picture data and storing the produced data in a second memory;

(c) storing the moving picture image read from said first memory in said second memory;

(d) performing a predetermined image process for the still-picture data read from said second memory to produce foreground image data representing a series of motion, and storing the thus produced foreground image data in a third memory when the still-picture data is stored in said second memory;

(e) performing a predetermined image process for the moving picture data read from said second memory to produce foreground image data including a moving picture, and storing the thus produced foreground image data in said third memory;

(f) producing background image data and storing the background image data in a fourth memory; and

(g) reading the image data from said third and fourth memories and producing display image data by combining the foreground image data and the background image data.

TECHNICAL FIELD

The present invention relates to an image processing device and method, and more particularly to an image processing device having a function of superimposing a foreground image and a background image.

BACKGROUND ART

Conventionally, a video game device is known such a kind of image processing device. The video game device is connected to a monitor device such as a CRT or a liquid crystal display. An image of a foreground such as a character coming on a game is superimposed with an image of a background and is displayed on the monitor device. The game is played by changing the foreground image and the background image in response to a control signal input by the player.

The foreground contains an object (character) having motion, such as a human being or an animal. The motion of the character is represented by changing its position and shape on the display. For example, the motion of a player character, which is a character directly controlled by the player, is represented so that the position and shape of the player character is changed in accordance with the control signal given by the player.

Conventionally, in order to represent the motion of the character and the like by a change of its shape, still pictures having different shapes are produced beforehand and are stored in a non-volatile memory such as a ROM. A series of motion is represented by sequentially reading the still pictures from the memory. The still pictures may be artificially produced or pictures extracted from a natural picture taken by a video camera in a time-lapse way.

The technique of representing the motion of the character by means of the still pictures can reduce the capacity of the memory to be built in the video game device, while it provides an unnatural motion of the character and the player feels insufficient reality during play of the game.

DISCLOSURE OF THE INVENTION

The present invention was made taking into consideration the above, and has an object of providing an image processing device and method capable of representing natural motion of a foreground image to be superimposed with a background image and representing a resultant image having good reality.

In order to overcome the above disadvantages, the image processing device of the present invention, in which a superimposed image is produced by combining first image data stored in a first memory (23) and second image data stored in a second memory (24), includes a third memory (13) storing data of a moving picture, and means (17, 20) for reading the data of the moving picture from the third memory and storing, as the first image data, the data of the moving picture in the first memory.

The disadvantages described above can also be overcome by a method of obtaining a superimposed image by combining first image data stored in a first memory (23) and second image data stored in a second memory (24), the method including a first step ([6], [7]) of storing data of a moving picture in a third memory (13), and a second step ([9]-[11]) of reading the data of the moving picture from the third memory and storing, as the first image data, the data of the moving picture in the first memory.

BRIEF DESCRIPTION OF THE DRAWINGS

Other objects, features and advantages of the present invention will become apparent from the following description read in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram of an image processing system which uses an image processing device according to an embodiment of the present invention;

FIG. 2 is a diagram of a transfer of moving picture data from a moving picture frame buffer to a sprite VRAM shown in FIG. 1;

FIG. 3 is a diagram of an example of data stored in the sprite VRAM shown in FIG. 1;

FIG. 4 is a diagram of explaining a scroll process;

FIG. 5 is a diagram of the operation of a priority circuit shown in FIG. 1;

FIG. 6 is a diagram of explaining priority bits necessary for the operation of the priority circuit;

FIG. 7 is a diagram of the operation of the image processing device shown in FIG. 1;

FIG. 8 is a diagram of the operation of the image processing device shown in FIG. 1;

FIG. 9 is a diagram of the operation of the image processing device shown in FIG. 1;

FIG. 10 is a diagram of the operation of the image processing device shown in FIG. 1;

FIG. 11 is a diagram of the operation of the image processing device shown in FIG. 1; and

FIG. 12 is a diagram of a variation of the image processing device shown in FIG. 1.

BEST MODE FOR CARRYING OUT THE INVENTION

A description will now be given of embodiments of the present invention with reference to the accompanying drawings.

FIG. 1 is a block diagram of an embodiment of the present invention. An image processing device 100 shown in FIG. 1 is used together with a disk drive 10, a monitor 32 and speakers 44, so that a video game system can be formed. For example, a video game device for home use is configured so that the image processing device 100 functions as a device main body, to which a television set 101 having the monitor 32 and the speakers 44 are connected. Further, a disk (such as a CD-ROM) which stores a program of a game which the player wants to play is set in the disk drive 10.

The disk stores, in addition to the above program, sound data and image data of a moving picture formed by a natural picture or the like. It will be noted that the moving picture is defined as a picture having a series of motion represented by, for example, 10-60 sheets (frames) of image data (patterns) per second. For example, an image itself taken by the video camera is a moving picture. Hence, the sheets of image data are ordinarily different from each other. On the other hand, as has been described previously, a motion realized by using the still pictures is represented by repeatedly combining a few sheets of image data (patterns) together.

In order to save the available storage capacity on the disk, the moving picture data is compressed and is then stored on the disk. The compression is achieved by, for example, the MPEG (Moving Picture Experts Group) method, which is an international standard of the audio/visual signal encoding method. According to the MPEG method, it is possible to store, on one disk for 74 minutes, 30 sheets of moving picture per second and a sound obtained by 44.1 kHz sampling.

In the disk drive 10, compressed moving picture data reproduced from the disk is stored in an internal buffer 11. The above compressed moving picture data is data obtained by compressing moving picture data of the YUV system (luminance Y, color differences U and V) according to the MPEG method. The compressed moving picture data stored in the buffer 11 is then supplied to a decoder 12 of the image processing device, in which the compressed moving picture data is expanded to moving picture data of the YUV system. Then, the expanded moving picture data is written into a moving picture frame buffer 13. The decoder 12 has the function of reading the expanded moving picture data of the YUV system from the moving picture frame buffer 13, converting it into moving picture data of the RGB system and outputting the moving picture data of the RGB system. As will be described later, the moving picture data of the RGB system produced by the decoder 12 may be output to a sprite VRAM 22 via a bus 14 and may be output to a priority circuit 30.

To the bus 14, there are connected a CPU 15, a RAM 16, a bus controller 17, a sprite engine 20 performing an image process for a foreground (sprite), and a scroll engine 21 performing an image process for a background. To the sprite engine 20, there are connected to the sprite VRAM 22 storing foreground patterns, and a sprite frame buffer 23 forming a foreground pattern equal to at least one frame. A scroll VRAM 24, which stores a background pattern and has a storage area greater than one frame, is connected to the scroll engine 21.

The CPU 15 issues a command against the sprint engine 20 and the scroll engine 21 to cause these engines to produce a superimposed image. The bus controller 17 reads data of the foreground image from the moving picture frame buffer 13 at a timing in which the CPU 15 does not occupy the bus 14, and writes the read image data into the sprite VRAM 22 from the bus 14 via the sprite engine 20. All the content of the moving picture frame buffer 13 may be transferred to the sprite VRAM 22, or part (only the foreground part) of the content of the moving picture frame buffer 13 may be transferred thereto.

FIG. 2 is a diagram of a transfer of the moving picture data from the moving picture frame buffer 13 to the sprite VRAM 22. Under the control of the CPU 15, part or all of the moving picture data in the moving picture frame buffer 13 is transferred to the sprite VRAM 22. Cutting out of part of the moving picture data is carried out so that the CPU 15 outputs coordinates data for cutting-out to the frame buffer 13 via the bus controller 17. The above transfer is performed every frame of the moving picture (every pattern). In the embodiment of the present invention being considered, foreground images having natural motion can be produced by transferring the moving picture data from the moving picture frame buffer 13 to the sprite VRAM 22.

The sprite engine 20 selectively reads image data of a foreground pattern such as a character, and carries out image processes for the read image data, such as rotation, enlargement, reduction and color computation processes. Thereafter, the sprite engine 20 causes the image-processed foreground pattern to be stored in an area of the sprite frame buffer 23 specified by a given address. In the example shown in FIG. 2, picture data equal to the whole of one frame and transferred to the sprite VRAM 22 is subjected to the rotation process by the sprite engine 20 so that the transferred picture data is converted into image data forming a rotating cube, which is then stored in the sprite frame buffer 22.

FIG. 3 is a diagram of the inner part of the sprite VRAM 22. In the sprite VRAM 22, a parameter table 22A is stored in addition to a plurality of items of foreground image data (pattern data) 22B. The parameter table 22A is produced, for example, for each character contained in the foreground by the CPU 15. The parameter table 22A includes position coordinates data indicating the position of the corresponding character on the sprite frame buffer 22, the size (dimensions) of the character on the sprite frame buffer 23, data relating to the tilt of the character including rotation, and position coordinates data indicating the position in the sprite VRAM 22 storing pattern data of the character. The sprite engine 20 refers to the parameter table 22A, and writes the pattern data located in the specified position in the sprite VRAM 22 into a specified position in the sprite frame buffer 23. A transfer of the moving picture data to the sprite VRAM 22 is performed each time the moving picture data in the moving picture frame buffer 13 is updated or at an appropriate timing other than updating.

The parameters relating to representation of the foreground image are not limited to the above-described ones, but desirable parameters can be defined in the parameter table 22A. The pattern data 22B forming the foreground image is not limited to the moving picture frame buffer 13, but may include still-picture data conventionally used.

The foreground image data equal to one frame thus formed in the sprite frame buffer 23 is read by the sprite engine 20, and is directly supplied, without the bus 14, to the priority circuit 30 in synchronism with scanning of the monitor 32 (vertical, horizontal and dot synchronizations for the monitor 32).

Principally, it is sufficient for the sprite frame buffer 23 to have a storage area equal to one frame. However, it is preferable that a storage area equal to two frames be provided and the writing and reading operations on the two frames are alternately carried out in order to speed up the process.

The scroll engine 21 produces the background image, on which the characters can be moved, and other images. The scroll VRAM 24 has at least one storage area which is greater than one frame and corresponds to the scroll picture plane. The scroll picture plane corresponds to a plane obtained by extending and connecting right, left, upper and lower ends of the screen (one frame) of the monitor 32. The scroll engine 21 scrolls the backg