Pattern recognition apparatus - Patent Review 4556985

Description Submit all comments and votes

BACKGROUND OF THE INVENTION

The present invention relates to a pattern recognition apparatus for recognizing impressed characters, printed characters or the like.

It is generally desirable that the pattern recognition apparatus of the type described have a high rate of proper character recognition and be operable at a high character reading speed. One prior pattern recognition process, known as a matrix matching method, will be explained with reference to FIG. 1 of the accompanying drawings. According to this method, features called a weight pattern are predetermined for each character, there being shown a weight pattern for the letter "B". More specifically, a region containing the letter is divided into a plurality of subregions which are weighted (as shown by numerals). Different characters are weighted differently. Therefore, any desired character can be recognized by comparing the weight pattern (input pattern) of the character as read with the weight pattern of a reference character.

This known method however is disadvantageous in that the degree of registration between characters is rendered variable and unstable because of relative positional displacement of the weight pattern of a reference character and that of a character as read, and variations in the widths of character strokes. To eliminate the foregoing disadvantage, the applicant has proposed a character recognition method using a shape matrix (see applicant's Japanese Patent Application No. 56-17570). According to this recognition process, each character is broken up into 72 subregions of 9.times.8, a shape matrix is set up for each character by determining whether there is a pattern in the subregions or not, and a character is recognized by comparing the shape matrix with a standard matrix. However, where an impressed character is to be read, the shape matrix of the character tends to vary due to a depression on the surface on which the character is impressed, and due to the presence of dirt such as soot on the surface, and therefore it is difficult to obtain correct character recognition. Another drawback is that only a limited number of characters, i.e. not more than 10, can be recognized using a 9.times.8 sized matrix.

SUMMARY OF THE INVENTION

The present invention has been made to eliminate the foregoing shortcomings. It is an object of the present invention to provide a pattern recognition apparatus which has a high recognition ability and is capable of reading characters that are printed or impressed in poor conditions.

According to the present invention, a pattern recognition apparatus is provided comprising means for obtaining a bit pattern matrix representing the presence and configuration of an unknown scanned pattern in subregions of a frame which substantially encloses the scanned pattern, means for comparing the bit pattern matrix with a plurality of previously obtained bit pattern matrices for a respective plurality of known reference patterns and for outputting comparison quantity values respectively representing the degree of correspondence between the bit pattern matrix for the unknown pattern and the bit pattern matrices for each reference pattern, and means for selecting the comparison quantity values which indicate the best and next best pattern correspondence and for outputting a pattern identification signal which identifies the unknown pattern as the reference pattern corresponding to the best comparison quantity value if this best comparison quantity value compares favorably with a first preset value, and if the difference between the best and next best comparison quantity value is greater than a second preset value.

More specifically, according to the present invention, a video signal generated by a television camera from reading an impressed character, for example, is segmented through binary conversion to obtain pixel or binary data, features are extracted from the segmented data and stored in a memory, and the impressed character is recognized by performing the following process based on the stored information. The process comprises classifying an unknown pattern into a cluster of segments by analyzing association between the stored segment information pieces, defining a frame, e.g. circumsquare of a given size on the unknown pattern, dividing the square into vertical and horizontal regions with a plurality of line segments, expressing the pattern in a matrix (bit matrix B) by assigning a logic level "1", for example, to regions having a pattern and a logic level "0" to regions having no pattern, predefining a standard bit matrix B.sub.S.sup.K, a mask bit matrix B.sub.M.sup.K, and a deformation operation D.sup.K composed of either pattern bits ("1" at all times), or blank bits ("0" at all times), deformation bits (a vertical or horizontal string of bits which can be considered entirely as "1" if any one of the bits in the string is "1"), and mask bits (which vary between "1" and "0"). A program computes a quantity or distance D.sup.K between a given pattern K and the unknown pattern expressed by the bit matrix B according to the following equation ##EQU1## (where D.sup.K (B(i,j)) for bit (i,j) means that an arithmetic operation should be effected with "1" if any one of the combined deformation bits of the bit matrix B is "1", with "0" if not "1" and with bits invariable if other than deformation bits), where the equation is used for defining as K.sub.1 a pattern having a smallest value D.sub.1 for the distance D.sup.K, and determining the unknown pattern as the pattern K.sub.1 when the conditions D.sub.1 <D.sub.U (preset value) and D.sub.2 -D.sub.1 >D.sub.L (preset value) are met, where D.sub.2 is a next smallest value.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrative of a conventional character recognition method using a weight pattern;

FIG. 2 is a block diagram of an embodiment of the present invention;

FIG. 3 is a diagram showing a quantized or binary conversion image of the letter "W";

FIG. 4 is a diagram showing a segmented image of the image of FIG. 3;

FIG. 5 is a diagram illustrative of various pieces of information on features extracted from the segment information of FIG. 4;

FIG. 6 is a block diagram of a feature extracting circuit;

FIG. 7 is a diagram explanatory of unit stroke number of segments;

FIG. 8 is a diagram showing a unit stroke number register;

FIG. 9 is a diagram showing the relationship between the unit stroke numbers and their unit stroke areas of a pattern;

FIG. 10 is a diagram of sets of unit stroke numbers, and unit stroke and plural stroke files for the pattern of FIG. 9;

FIG. 11 is a flowchart showing a program for obtaining a unit stroke file;

FIG. 12 is a flowchart showing a program for obtaining a plural stroke file;

FIG. 13 is a diagram illustrative of the manner in which a character pattern is defined;

FIG. 14 is a diagram showing a quantized image of a character pattern and a circumscribed frame therearound; and

FIG. 15 is a diagram showing a bit matrix of the quantized standard bit matrix corresponding to the pattern of FIG. 14.

FIG. 16 illustrates an example of an identification bit matrix obtained in advance for the character "5".

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

In pattern and character recognition, it is necessary at some point to be able to locate "frames" or the like which circumscribe or enclose the individual patterns and characters to be identified. FIGS. 2-14 and the accompanying text are directed to the frame location process. After the frames for the particular patterns and characters are located, then the scanned data within the frame is identified. FIGS. 15 and 16 and the accompanying text, particularly the discussion concerning the matrix operations, are directed to this identification process.

FIG. 2 shows a solid-state image pickup device 1 (hereinafter referred to as a "camera") in the form of a MOS transistor or charge-coupled device, a binary conversion circuit 2, a feature extracting circuit 3, an image data storage circuit (RAM.sub.1) 4, and arithmetic unit such as a microprocessor 5, a PROM type memory 6 provided primarily for storing a program, a memory (RAM.sub.2) 7 provided primarily for storing data, and a decision output unit 8.

A character or figure to be recognized is scanned by the camera 1 in a horizontal direction X while being vertically successively scanned in a direction Y. Video signals generated on horizontal scanning are converted into binary values with a certain threshold level by the binary conversion circuit 2. The binary image is schematically shown in FIG. 3. Regions where there are character patterns are assigned a logic level "1", and a series of logic levels "1" where the character patterns and the horizontal scanning lines intersect is called a line segment or simply a segment. The character pattern can be divided into segments (SE.sub.81, SE.sub.82, SE.sub.ij, SE.sub.kl, . . . ) on horizontal scanning lines (SC.sub.8, SC.sub.9, SC.sub.i, SC.sub.k, . . . ) as shown in FIG. 4. The character pattern can therefore be expressed by a cluster of such segments.

In order to recognize that these segments belong to the same character pattern, it is necessary to effect coordinate comparison for each segment. For example, when the current scanning line is SC.sub.9, the segments SE.sub.91, on the scanning line SC.sub.9 can be determined to belong to the same pattern as that to which the segment SE.sub.81 on the previous scanning line SC.sub.8 belongs, if the Y coordinate of the segment on the current scanning line SC.sub.9 differs by one coordinate unit from the Y coordinate of the segment on the previous scanning line SC.sub.8, and if the X coordinates of the segments SE.sub.81, SE.sub.91 overlap each other at least partially.

For a clearer understanding of the foregoing, each segment will be considered by way of "start" information, "joint" information, and "connection" information. The "start" information is attached to a segment which is not directly overlapped by any segment on the previous scanning line. The segments with such start information are SE.sub.81, SE.sub.82, and SE.sub.ij in FIG. 4. The "connection" information indicates the sequence in which the segments are generated respectively on the scanning lines. The "joint" information expresses the degree of segment overlap and indicates whether two or more separate segments on a previous scanning line are "joined together" i.e. at least partially overlap one segment on the current scanning line. Those segments which are either joined or connected to, i.e. are directly overlapped by, the segments with the start information are considered as belonging to the same "unit strokes". The segments SE.sub.81, SE.sub.82 and SE.sub.ij are allotted unit stroke numbers 1, 2 and 3, respectively. The segment, SE.sub.k+1 for instance, with joint information is given the same unit stroke number as that assigned to the righthand segment SE.sub.k2 on the previous scanning line, since the segment SE.sub.k+1 is directly overlapped by the segment SE.sub.k2.

Features as illustrated in FIG. 5 can be extracted from the segmented image data. FIG. 5 shows unit stroke numbers of the segments at (a), coordinates of righthand ends of the segments at (b), Y coordinates of the horizontal scanning lines at (c), segment lengths at (d), sets of joined unit stroke numbers at (e), (f), the total number of segments at (g), the total number of segment joints at (h), and the total number of unit strokes at (i). These features are stored in the arrangement shown in the memory 4 (FIG. 1). The segment length A is expressed by (X.sub.R -X.sub.L +1) which is the sum of the difference between the X coordinate (X.sub.R) of the righthand end and the X coordinate (X.sub.L) of the lefthand end, and a constant +1. A value of +1 is added because otherwise the segment length will be zero (and inconvenient) when the X coordinates of the righthand and lefthand ends are the same.

FIG. 6 shows in block form a feature extracting circuit for extracting the foregoing features.

The feature extracting circuit includes a 3.times.3 local memory 9 for storing binary signals for three scanning line, and the scanning line which preceded the last scanning line. The feature extracting circuit also includes a start segment detecting circuit 10, a unit stroke number counter circuit 11, a unit stroke number register 12, a righthand point detecting circuit 13, an X-coordinate generator circuit 14, a Y-coordinate generator circuit 15, a segment length counter circuit 16, a joint detecting circuit 17, a joint-number counter circuit 18, and a segment-number counter circuit 19.

The binary video signals processed by the binary conversion circuit are supplied to the 3.times.3 local memory 9. The start segment detecting circuit 10 detects start segments from an output of the 3.times.3 local memory 9, and the detected start segments are counted by the counter circuit 11 which stores an updated unit stroke number in the unit stroke number register 12. The righthand point detecting circuit 13 detects the positions of the righthand points of the segments, and outputs X, Y from the X-coordinate and Y-coordinate generators 14, 15 are written into the image memory 4 (FIG. 1) in timed relation to detection by the righthand point detecting circuit 13. The counter circuit 16 counts the length of the segment by counting the number of consecutive points in which the binary signal has a logic level of "1", and the count from the counter circuit 16 is issued as the segment length A. The joint detecting circuit 17 detects the presence of a segment joint from the output from the local memory 9, and supplies data indicating the presence of the detected segment joint to the joint-number (N.sub.TJ) counter circuit 18, and also to the unit stroke number register 12. When the unit stroke number register 12 detects joint information, it issues unit stroke information pieces E.sub.1, E.sub.2 that are joined, and also issues a unit stroke number N.sub.S for each unit stroke information piece. The segment-number counter circuit 19 counts the number of righthand point detection signals and issues a total segment number N.sub.TS.

FIG. 7 is a diagram which illustrates the unit stroke numbers of the segments, and FIG. 8 is a diagram showing the content of the register (see 12 in FIG. 6) which temporarily stores the unit stroke numbers.

As described with reference to FIGS. 4 and 5, the letter "W" is segmented, and the segments are numbered with unit stroke numbers based on the sequence in which the segments appear on the horizontal scanning lines and on the start information. Thus, the letter "W" can be considered as a combination of segments assigned unit stroke numbers "1", "2" and "3" as shown in FIG. 7. Subsequently, the sequence or unit stroke numbers of the segments on the horizontal scanning lines SC.sub.19 (Y=19) and SC.sub.20 (Y=20) are considered. The unit stroke numbers on the scanning line SC.sub.19 are 1, 3, 3 and 3, and the unit stroke numbers on the scanning line SC.sub.20 are 3 and 2. These pieces of information are stored in the unit-number register in a pattern as shown in FIG. 8. By checking the stored content of the unit-number register, the number of unit strokes N.sub.SS and the sets of unit stroke numbers E.sub.1, E.sub.2 joined with each other can be obtained. Since one character pattern can be regarded as a cluster of segments to which unit stroke numbers are assigned, features can be extracted from the character pattern by the feature extracting circuit. The features of character patterns are stored in the memory (RAM.sub.1), and the arithmetic unit 5, which is preferably microprocessor CPU, performs prescribed arithmetic operations on the stored feature information in accordance with the program stored in the PROM 6 to recognize the character pattern.

While in the foregoing embodiment the present invention has been described with reference to a simple character pattern, complex character and figure patterns can also be processed in the same manner as described above. Such a processing method will now be described.

Where the pattern to be recognized has a complex shape such as shown in FIG. 9, segments are given unit stroke numbers 1 through 18 as illustrated on the basis of start information in the manner as described above. The regions of the unit strokes are clearly defined by dotted lines shown in FIG. 9. Sets of unit stroke numbers E.sub.1, E.sub.2 joined together as shown at (a) in FIG. 10 can be determined from the joint information of each unit stroke. The file of E.sub.1, E.sub.2 is used to derive a file of unit strokes R.sub.S as shown at (b) in FIG. 10 and a file of plural strokes R.sub.C as shown at (c) in FIG. 10. The unit stroke file R.sub.S is prepared by removing mutually overlapping and redundant unit stroke numbers form the sets E.sub.1, E.sub.2 of unit stroke numbers joined together. FIG. 11 shows a program for preparing such a unit stroke file. The plural stroke file R.sub.C is prepared by arranging the unit stroke file R.sub.S so that the numbers of plural strokes (corresponding to the patterns of the characters or figures to be recognized) which are actually a combination of unit strokes joined together are reassigned the lowest unit stroke number in the combination. This process is carried out in accordance with a program illustrated in FIG. 12. The number N.sub.CS of plural strokes shown in FIG. 9, that is, patterns is found to be "3". The program shown in FIGS. 11 and 12 may be written in FORTRAN. E.sub.1, E.sub.2 are sets of unit strokes joined together, N.sub.TJ is the number of joints, N.sub.SS is the total number of unit strokes, N.sub.CS is the total number of plural strokes, F.sub.T is a temporary file used for checking whether the unit strokes are overlapped, R.sub.S is a file having a size determined by the total number N.sub.SS of unit strokes, R.sub.C is a file of a size determined by the total number N.sub.CS of plural strokes, i, j, k, l, m are citation numbers for the files. The files R.sub.S, R.sub.C are initialized to zero when the program is to be executed. The area A.sub.C, width W.sub.C, height H.sub.C, maximum X and minimum Y of lefthand and righthand points, coordinates X.sub.R, X.sub.L, Y.sub.T, Y.sub.B of the maximum X and minimum Y, and central coordinates X.sub.C, Y.sub.C thereof can all be determined for each of double strokes or patterns.

The process for actually recognizing or identifying a character pattern based on the features as described above will now be described.

FIG. 13 is a diagram illustrative of the manner in which a character pattern is defined; FIG. 14 is a diagram showing a quantized character image and its circumscribing frame (circumsquare); FIG. 15 is a diagram illustrating a bit matrix for the quantized image shown in FIG. 14; and FIG. 16 is a diagram illustrative of an example of a standard bit matrix corresponding to the pattern of FIG. 14.

There are considered two methods of defining a character pattern. In the first method where a character pattern is locally narrow or cut off as with an impressed character, or where small noise patterns tend to be generated due to cuts, oil, soot or other dirt, the dirt or scar pattern is removed according to area, width or height, and a pattern corresponding to the size of a character is found from the remaining patterns. A center P.sub.C of a pattern corresponding to a character size as shown in FIG. 13 serves as a reference. The character center P.sub.C is extrapolated on the basis of a distance D.sub.P between the character center and the center of another character. A pattern which is contained in a search frame (having a width W.sub.A and a height H.sub.A) of a predetermined size is considered to be a character pattern. The character "A" in FIG. 13 is free from the influence of any noise patterns, while the character "B" is affected by a noise pattern N.sub.P. When there is noise N.sub.P, the character frame should be limited within the range of an upper limit HB for a character height, and any portion beyond the upper limit should be neglected. However, the character frame for a single character pattern to be recognized cannot be extrapolated.

In the second method of defining a character pattern where a character pattern is clear and no noise pattern appears to be present, a pattern which enters a character frame defined by a height H.sub.U (upper limit), a height H.sub.L (lower limit), a width W.sub.U (upper limit), and a width W.sub.L (lower limit) is determined as a character pattern. Stated otherwise, a pattern is determined as a character pattern when it meets the following conditions:

W.sub.L .ltoreq.W.sub.C .ltoreq.W.sub.U,

H.sub.L .ltoreq.H.sub.C .ltoreq.H.sub.U,

where W.sub.C and H.sub.C are the width and height of a standard size character pattern.

A character pattern is thus defined to extract a character frame. FIG. 14 shows a character "5" and a character frame L, in which coordinates of maximums X and Y and those of minimums X, Y are X.sub.FR, Y.sub.FB and X.sub.FL, Y.sub.FT, respectively. While the character pattern is shown oriented horizontally, it is not essential that character patterns be oriented horizontally or vertically.

Next, the character frame as defined in the foregoing manner is divided into 24 subregions in the X-axis direction and 12 subregions in the Y-axis direction. If part of a character pattern is present in a subregion, such subregion is expressed by a logic level "1", and if no part of the character pattern is present in a subregion, such subregion is expressed by a logic level "0". The subregions as expressed by the logic levels are shown as a matrix in FIG. 15 which will hereinafter be referred to as a bit matrix B. The blank subregions in FIG. 15 indicate "0".

Each character to be recognized is measured in advance to obtain its identification bit matrix, and the elements of the bit matrix are classified into four kinds of bits or elements as set forth below:

(a) pattern bit; an element or bit which has a value of "1" at all times;

(b) blank bit; an element or bit which has a value of "0" at all times;

(c) mask bit; an element or bit which has a value of either "1" or "0", but does not contribute to the identification process, i.e. the identification process "doesn't care" what this value is; and

(d) deformation bit; a bit in a horizontal or vertical string of bits which is determined as "1" if any one of the bits in the particular string which includes the bit under consideration is "1".

FIG. 16 illustrates an example of an identification bit matrix obtained in advance for the character "5". The bits are indicated by symbols. The blank areas indicate blank bits, the symbol (.DELTA.) indicates mask bits, and the symbol ( ) indicates a string of deformation bits. The illustrated bit matrix of FIG. 16 contains no pattern bits.

The bit matrix B is obtained for each character and figure pattern K to be recognized, and the elements of the bit matrix are classified into the four bit groups. so that a standard bit matrix B.sub.S.sup.K and a mask it matrix B.sub.M.sup.K are defined, and a deformation bit matrix D.sup.K acting on the measured by matrix B is also defined for each character K. The mit matrices and the deformation operator are determined as follows:

B.sub.S.sup.K (i,j)=1 for a pattern bit or deformation bit and 0 for a bit other than above bits, for a bit at location (i,j);

B.sub.M.sup.K (i,j)=1 for a bit other than mask bit and 0 for a mask bit, for a bit at location (i,j); and

D.sup.K (B(i,j)=1 where any bit in the relevant deformation bit string is "1" and 0 where all of the bits in the relevant string are "0".

A quantity or distance D.sup.K representing the amount or degree of difference or correspondence unknown character pattern expressed by a bit matrix B is defined by: ##EQU2##

In the example shown in FIG. 16, M=12 and N=24. The sign (.sym.) stands for the exclusive-OR operation, and AND stands for the logic AND operation.

The value D.sup.K is inversely proportional to the degree of correspondence between the character K and the character to be recognized, i.e. D.sup.K is relatively low for close pattern correspondence, and higher for lack of correspondence. The quantity or distance D.sup.K is determined for all character patterns, and the smallest distance D.sub.1 and the next smallest distance D.sub.2 are determined. The unknown pattern is determined or identified as the pattern K.sub.1 having the minimum D.sub.1 when D.sub.1 <D.sub.U and when D.sub.2 -D.sub.1 >D.sub.L, where D.sub.U and D.sub.L are preset values which are determined differently for character readout and character checking.

With the present invention, as described above, unit stroke and plural stroke processing arrangements are employed so that a character can be defined without being largely influenced by noise patterns and by positional displacement of an input pattern and interpattern distance. By using deformation operator and a mask bit matrix, protection can be gained against fluctuations of character definition due to variations in the width of character strokes and small noise patterns. The character recognition process can be effected at a high speed with the use of a unit stroke and plural stroke processing algorithm.

Although the present invention has been described as being embodied for recognition of impressed or printed characters, the invention is also applicable to recognition of special symbols such as those found on a typewriter keyboard.

From the foregoing, it will be observed that numerous variations and modifications may be effected without departing from the true spirit and scope of the novel spirit of the invention. It is to be understood that no limitation with respect to the specific apparatus illustrated here is intended or should be inferred. It is, of course, intended to cover by the appended claims all such modifications as fall within the scope of the claims.

* * * * *