 |
Description  |
|
|
BACKGROUND OF THE INVENTION
The invention relates generally to computerized systems for storing and
retrieving document text, worksheets and associated graphics. The
invention relates more particularly to such systems which automatically
index a variety of graphics relating to a document or text, allows an
operator to conveniently and rapidly select the graphics for display,
rapidly displays the selected graphics, and allows the operator to rapidly
and conveniently select portions of the displayed graphics to be enlarged
and centered. The invention also relates to such systems which estimate
the cost of repairs and display repair procedures.
Various types of systems for storing and retrieving document text,
worksheets and associated data and graphics were previously known. For
example, text, menus and graphics have been stored in computer memory and
displayed in separate windows on a screen. Controls have also been
provided to scroll the windows up, down, left and right and thereby,
display different portions of the text, menu and graphics.
Book information has also been stored in computer memory to facilitate
layout of the book. Text of the book and reference numbers indicating the
location of associated graphics are stored together in memory. When
combined, the graphics are displayed integral with the text, that is,
portions of pages of the text are devoid of text and filled instead with
graphics.
Previously known systems are also capable of enlarging graphics. In one
such system, a non-enlarged graphic image is displayed, and a relatively
small selection box is superimposed thereon. By means of left, right, up
and down control keys, an operator can move the box over any portion of
the image. Then, by pressing another control key, the portion of the image
under the box is centered on the screen and the image is enlarged.
In another previously known system, a mouse or cursor is superimposed on a
graphic image and moved to a desired location by an omnidirectional
control. Then, by pressing a control key, the portion of the image under
the mouse or cursor is centered on the screen and the image is enlarged.
Despite the advantages of centering and enlarging the graphics provided by
these two previously known systems, it is cumbersome to make the selection
by either the control keys or omnidirectional control.
The foregoing graphics have been stored electronically in computer memory
either in compressed or non-compressed form. In non-compressed form, data
individually defining each pixel of the graphic image is stored. While
this technique allows rapid display of the graphics, it requires a
relatively large memory to store the data because each image has thousands
of pixels and typically, there are many graphic images required for each
system. A variety of techniques such as run-length encoding were
previously known to compress video data so that a relatively small amount
of data need be stored to represent each graphic image. However, when an
operator selects a particular graphic image for viewing, the computer
requires a perceivable time to decompress the data for display, and this
is undesirable in some applications.
In the automotive repair industry, service manuals have been used to
instruct a mechanic how to perform a repair. However, the manuals are
cumbersome to use especially in a shop environment because the mechanic
may need to search throughout the manual for information and graphics
helpful to perform the necessary repair. Also, because of size
constraints, manuals do not include satisfactory enlargements of every
image.
Heretofore, manuals have also been relied upon to estimate the cost of
repairs. An estimator views the damaged vehicle, and determines either
through observation or a parts manual, the parts which are damaged. Then,
the operator estimates the cost of repair by looking-up in a manual the
cost for each of the damaged parts and the specified time for repair. This
procedure has also proven cumbersome because more than one manual may be
required to make the estimation, and after the initial write-up, the
information may have to be transcribed into another form. Also, the
operator may not notice every damaged part.
Automatic Data Processing, Inc. ("ADP") has previously sold a hard copy
insurance estimation system. To utilize the system, a user identifies the
model of a damaged vehicle and then, locates in a file cabinet a hard copy
multi-worksheet form corresponding to the model. The worksheet includes
several different views of the model, part numbers, and lines leading from
the part numbers to the corresponding parts. The multi-worksheet also
includes work space for entry of administrative information. The user
circles the numbers of the damaged parts and then, a computer operator
electronically transmits the part numbers to a central computer which
estimates the cost of repair. The identification of the damaged parts, the
storage of all the forms, and the requirement for entry of the part
numbers into electronic form for transmission to the central computer has
proven cumbersome and prone to error.
The ADP system also includes on the multi-worksheet, a portion similar in
appearance to FIG. 14 by which the user circles a code number indicating
the point of impact. The computer operator also transmits the code number
to the central computer for statistical purposes only.
A general object of the present invention is to provide a convenient,
effective, electronic service manual, insurance estimating system or other
such system.
Another general object of the present invention is to provide a system for
storing and retrieving document text, worksheets and associated data and
graphics, which system automatically indexes a variety of graphics
relating to a document and permits convenient and rapid selection and
display of the associated graphics.
A more specific object of the present invention is to provide a system of
the foregoing type which does not require a large memory for storage of
the graphic images in relation to the number of images which are stored.
Another general object of the present invention is to provide systems of
the foregoing type in which graphic images displayed on a screen can be
more conveniently enlarged and centered about a desired point than in the
prior art systems.
SUMMARY OF THE INVENTION
The present invention resides in apparatus and processes for storing and
displaying documents and associated graphic images in insurance
estimation, service manual and other systems.
According to one feature of the invention, the system stores a multiplicity
of documents in digital form and a multiplicity of graphic images in
compressed, digital form. A first group of the graphic images are
associated with a first one of the documents. By selecting the first
document, the system automatically decompresses the first plurality of
graphic images. The system then displays at least a portion of the
selected first document on a display screen along with a first one of the
decompressed graphic images. Subsequently, upon user command, the system
displays a second one of the decompressed documents. Because the second
graphic image was decompressed when the document was selected, there was
virtually no delay in displaying the second graphic image.
The document includes reference numerals imbedded therein which identify
the associated graphic images so that when the document is selected, the
system can determine which graphic images should be decompressed.
According to one feature of the present invention, the second graphic image
is selected by means of a touch screen overlaying the video display so
that the second selection and display are made easily and rapidly.
In the service manual system, the document comprises text describing steps
for repairing a vehicle and the graphic images illustrate portions of the
vehicle under repair corresponding to the text.
According to another feature of the invention, the graphic image can be
enlarged and centered about or near a point on the screen which is
touched.
In the insurance estimation system, the system displays a graphic image of
a vehicle or other object. By means of a touch screen, damaged parts are
identified. A local or remote processor determines the cost of correcting
the damage of the identified parts.
According to one feature of the insurance estimation system, a first one of
the graphic images is a view of the vehicle as a while, and the control
means is responsive to a touch on the touch screen for displaying a
second, more detailed graphic image corresponding to a damaged region
indicated by the touch. Alternately or in conjunction with the first
graphic image, the system may display a menu for identifying a variety of
graphic images corresponding to the damage area.
BRIEF DESCRIPTION OF THE FIGURES
FIG. 1 is a block diagram illustrating in broken line a system for storing
and retrieving document text and associated graphics according to the
present invention. FIG. 1 also illustrates outside of the broken line
steps for programming the system to implement a particular process.
FIG. 2 is a schematic diagram of the layout in electronic memory of
document text, reference numerals imbedded therein, and associated
graphics, data table and software routine addressed by the reference
numbers. The text, graphics, data table and software routine may be stored
on CD-ROM within the system of FIG. 1.
FIG. 3 is a schematic diagram of a three-tiered, hierarchical indexing or
menu system to access the document of FIG. 2 and other documents within
the system of FIG. 1.
FIG. 4 is a schematic block diagram of components of the system of FIG. 1
and their basic interconnections.
FIG. 5 is a plan view of a keypad of the system of FIG. 1.
FIG. 6 is a schematic block diagram of some of the components of FIG. 4 and
shows the interconnections between the components in more detail as well
as additional related components.
FIG. 7 is a flow chart illustrating the operation of a main microprocessor
within the system of FIG. 1, which microprocessor has been programmed to
implement a service manual application.
FIG. 8 is a schematic block diagram of other components of FIG. 4, and
shows the interconnections between the components in more detail as well
as related components.
FIG. 9 is a plan view of a screen of the system of FIG. 1 displaying a
portion of document text and associated graphics for a service manual
application.
FIG. 10 is a plan view of the screen of FIG. 9 with the document text
scrolled downardly and the graphic image enlarged and centered about a new
point.
FIG. 11 is a flow chart illustrating in more detail a touch, centering and
enlarging step illustrated generally in FIG. 7.
FIGS. 12(a) and (b) form a flow chart illustrating the operation of the
system of FIG. 1 when programmed to implement an insurance estimation
function.
FIG. 13 is a menu displayed by the system programmed according to the flow
chart of FIG. 12 which aids in identifying a subsequent graphic image for
display.
FIG. 14 is a plan view of a graphic image displayed by the system of FIG. 1
in accordance with the insurance estimation program of FIG. 12.
FIG. 15 is a graphic image identified with the aid of the menu of FIG. 13
and/or the graphic image of FIG. 14 and used to specify damaged parts.
FIG. 16 is a worksheet displayed by the system programmed according to FIG.
12 and illustrates the entry of alphabetic information.
FIG. 17 is a block diagram of electronic components within a bus interface,
memory controller and memory of FIG. 8.
FIG. 18 is a partial, schematic diagram of logic circuitry within the
interface of FIG. 17.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Turning now to the figures in detail wherein like reference numerals
indicate like elements throughout the several views, FIG. 1 schematically
illustrates a multidocument storage and retrieval system generally
designated 20 in accordance with the present invention. The system 20
includes a computer terminal 22 which includes a screen 23 for displaying
text, graphics, data and worksheets associated with each document and
stored on a CD-ROM 24. By way of example, screen 23 is a 640.times.400
liquid crystal display Model BF642F93 manufactured by Seiko Instruments
U.S.A., Inc. This model provides a minimum brightness of 50 cd/M.sup.2
with a contrast of 1:10. The nominal refresh rate is 60 HZ.
FIG. 1 also illustrates the steps in programming the system 20. In step 25,
the user furnishes information defining text and associated graphics and
data of a particular application. For example, in a service manual
application, the text includes a description of many different repair
procedures. The graphics include different views of a vehicle or other
object under repair. The data includes tables such as parts' lists. In an
insurance estimation function, the data includes the names of models of
vehicles or other objects under repair, parts lists and costs, and the
graphics include different views of the vehicle or other object being
repaired.
Then, in step 27, specifications for the application are developed. The
specifications include composition requirements such as pagination, layout
and new or existing relationships that the user wishes to establish
between sections of the document, menu selections, graphic to text or data
links, and other links as described in more detail below. The information
according to the specifications is then input to another computer terminal
19 where it may be stored on computer tape (step 26). If the information
is originally in hard copy form, then it may be entered into computer 19
by an associated keyboard or sheet reader (not shown), and if the
information is originally stored electronically, then it may be
transferred electrically into computer 19. In either case, the information
is stored in ASCII or such code. Then the pages or sections of the
document and worksheets are composed, and index files and other
relationships established as illustrated in FIG. 2 (step 43).
Text 27 for one logical section of a document such as a description of a
procedure for repairing one defective part is grouped together in a
single, long "hyperpage" 28, but separated from associated graphics 31-33
and data table 34. At locations in the text which correspond to the
associated graphics and data table 31-34, respectively, reference numbers
37-40, respectively, are entered in the text stream.
A reference number 41 may also be imbedded at the beginning of hyperpage 28
to call-up a special software subroutine 42. However, as described in more
detail below, one software routine may be provided to utilize many
hyperpages 28 of text and associated data and graphics and referenced
otherwise so that this reference and subroutine may not be necessary.
A block of information defining each graphic image 31-33 is compressed and
stored in computer 19. Similarly, a block of information defining data
table 34 and an optional block of information defining software subroutine
42 may also be stored in the computer 19 memory. Multiple software
subroutines such as 42 may also be provided and accessed for one procedure
and, if desired, different hyperpages can share the same software
subroutine. The reference numbers 37-41 indicate the present locations in
computer 19 memory and the subsequent locations in CD-ROM 24 of the
corresponding blocks of information defining the graphic images 31-33,
data table 34 and optional software routine 42, respectively. Thus, text
and the associated graphics, data and optional software routine are linked
to one another by the reference numbers. For example, if one hyperpage of
text relates to a particular automobile repair procedure, the text may be
linked to graphic diagrams of the portion of the automobile having the
part to be replaced and the surrounding parts which provide access to the
defective part. The data table may provide the manufacture and part number
of the defective part, and the software subroutine may inform the user
that if he or she repairs or replaces a part such as a lower ball joint,
then he or she must also perform a related service such as a front wheel
alignment.
In step 43 of FIG. 1, index files are also generated to provide menus which
locate and access desired hyperpages. There may be thousands of text
hyperpages and associated graphics and data tables stored on CD-ROM 24,
and system 20 provides a hierarchical indexing system 198 illustrated by
FIG. 3. A top level menu 200 presents a few, for example three, broad
categories of repair within boxes 201-203. The user can select any of the
three possibilities by either a keyboard entry or touch within the box as
described in more detail below. Each of the selections 201-203 is linked
to a lower level menu 204-206, respectively, which provides more detailed
information about the linked hyperpages. Menu 200 may include, for
example, in selection box 202, "front end", and corresponding menu 205 may
list "upper ball joint", "lower ball joint", "front upper suspension arm"
and "front lower suspension arm." Each of the selections from the lower
level menu 205 is linked to a corresponding hyperpage. Hyperpages 207-210
were listed on menu 205. For simplicity, the other hyperpages linked to
menus 204 and 206 are not illustrated in FIG. 3.
Referring again to FIG. 1, in step 44, specifications are provided to
define the functional requirements of the software for system 20. In step
46, an operator develops a main application specific software based on the
specifications. The software is used to retrieve and present the text,
worksheets, graphics and data and perform computations according to the
desired application and commands entered into the terminal 22 by a user,
and is described in more detail below with reference to FIGS. 7 and 12.
The software is stored in either of three ways, on a floppy disk 48, in
PROM 50 within terminal 22, or on the CD-ROM 24 by prior entry into
computer 19 with the document during step 43. If desired, the optional
software routine 42 may also be stored on floppy disc 48. By way of
example, floppy disc 48 is a Sony Model MP-F83WOOD with a 3.5" diameter
and 1.44 megabyte capacity.
In step 54, the text 27, graphics 31-33, data table 34, optional software
subroutine 42 and main software program (if destined for the CD-ROM) are
written from the computer tape onto the CD-ROM 24. Although not
illustrated in FIG. 2, data defining optional worksheets generated in step
27 are also written onto the CD-ROM.
The basic components of computer terminal 20 are schematically illustrated
in FIG. 4. Terminal 20 includes a master microprocessor 60 which
implements the main software routine stored on either CD-ROM 24, PROM 50
or floppy disk 48. By way of example, microprocessor 60 is Model 80C88
manufactured by Harris Corporation. Microprocessor 60 communicates with
the remainder of the system via a bus 65 which, by way of example, is
Model FE2010 manufactured by Faraday Electronics and/or Western Digital
Company. Microprocessor 60 reads the software if stored on disk 48 with
the aid of disk drive and control 62, and if stored on CD-ROM 24 with the
aid of CD-ROM reader 63 via CD-ROM interface 67. In either case, the
software may be downloaded into dynamic random access memory (DRAM) 72
which by way of example has a 640K byte capacity.
A membrane keypad 74 illustrated in FIG. 5 allows a user to initiate a
program by suitable entry. The entry is read by microprocessor 60 with the
aid of keyboard and touch screen interface 76 via bus 65 which interface
encodes the keyboard entry. A transparent touch screen 70, illustrated in
FIG. 1, overlays the display screen 23. By way of example, the touch
screen is a resistive touch screen manufactured by Microtouch Systems,
Inc. of Massachusetts, U.S.A., and is capable of resolving the
640.times.400 display pixels. Referring again to FIG. 4, the location of
the area touched is decoded as follows. A voltage is applied to one side
edge of the touch screen and the opposite side edge is grounded. Wand or
stylus 130 is connected to the input of an A/D converter (not shown). The
touch screen is resistive so that the voltage at the point of touch
corresponds to the location between the aforesaid side edges. Next, the
voltage is applied to one of the other perpendicular side edges and the
opposite side edge is grounded to determine the location between these two
side edges. Software previously loaded into PROM 50 from either CD-ROM 24
or floppy disk 48 controls this decoding operation. The decoded
information is transmitted to microprocessor 60 via bus 65. Thus, the user
can make selections and commands relating to text, worksheets, graphics
and data displayed on screen 23 by either keypad 74 or touch screen 70.
A static random access memory (SRAM) 78 stores calibration constants
representing the alignment of the touch screen relative to the display
screen and other information described below.
An electronic clock and calendar module 80 is also provided to assist
system 20 in generating reports. A parallel data port 81 provides
communication with a printer and serial data ports 82 provide
communication with a central computer 437 via a modem 89.
Communication channels between the foregoing elements of system 20 are
illustrated in more detail in FIG. 6, along with additional related
components. To transmit data, microprocessor 60 transmits via lines 300 an
address of the destination component to bus controller 65 and latch 302.
Microprocessor 60 also transmits the data via lines 304 to buffer 306, and
a write command via line 310 to bus 65. An address decoder 312 transmits
corresponding enable signals to the destination component via lines 314.
Then the destination component reads the address at which the data should
be stored from latch 302 via bus or lines 318 and then reads the data from
buffer 306 via bus or lines 320.
To read data, microprocessor 60 transmits the address of the source
component to bus controller 65 and latch 302, and a read command on line
310 to bus controller 65. In response, address decoder 312 transmits
corresponding enable signals to the source component via lines 314. Next,
the source component reads the address at which the data should be read
from latch 302 via lines 318, and then transmits the data into buffer 306
via lines 320. Microprocessor 60 reads the data from buffer 306.
FIG. 4 also illustrates an image decompression board 95 comprising a
dedicated processor 96 and an associated DRAM 97 providing work space for
the decompression process. By way of example, board 95 is a Model
TMS-34010 manufactured by Texas Instruments of U.S.A. As described in more
detail below, with reference to FIG. 7, decompression board 95
decompresses the graphic image data stored on CD-ROM 24 or floppy disk 48,
and transmits the decompressed data to a DRAM 99 for storage within a
graphics controller board 100. In the decompressed form, data defining
each pixel for the screen provides a one-to-one mapping and capability for
instantaneous display. A graphics controller processor 102 on board 100
controls the transfer of the decompressed graphics data to screen 23.
FIG. 7 is a flow chart illustrating the utilization of system 20 is an
electronic service manual application. However, it should be understood
that system 20 can be programmed to implement a wide variety of processes.
Initially, a user may request via keypad 74 the menu 200 of repair
procedures contained within CD-ROM 24. After selecting from this menu by
touch-screen 70, either menu 204, 205 or 206 is displayed. After selecting
from one of the latter menus, a document such as the one including
hyperpage 28, graphics 31-33 and data table 34 defining the selected
repair procedure is identified (step 108).
In addition to utilizing the menus 200 and 204-206 illustrated in FIG. 3,
microprocessor 60 is optionally programmed to read in step 108 key words
to locate one or more hyperpages which contain some or all of the key
words. The key words may be input through a keyboard 500 which is
displayed on screen 23 as illustrated in FIG. 16. To display keyboard 500,
data defining keyboard 500 and worksheet 501 was downloaded from CD-ROM 24
into DRAM 22 at the time that the document was identified. To utilize the
keyboard 500, first one of selection boxes 502, 503 or 504 is selected by
a touch with stylus or wand 130. To permit keyboard to fit on the screen,
the normal distance between adjacent rows of lettering may be reduced by
eliminating one or more of the intervening blank raster lines.
Microprocessor 60 reads the location of the touch from interface 76, and
based on decoding software stored within PROM 50 correlates the touch with
the category within the box in order to read and display the information
in each category. For example, as illustrated by broken-line in FIG. 16,
the user touched box 504 after completing boxes 502 and 503. After
touching box 504, microprocessor 60 is programmed to display the
subsequent letters in box 504 and to treat the letters as one or more key
words. Then the user successively touched letters "C", "A", "R" and "B" to
begin spelling the first key word "carburetor." The user may then enter
the remainder of the key word "carburetor", and other key words such as,
"Cadillac", "V-8/450HP", "fast idle" and "poor acceleration" in order to
access a procedure for making the necessary repair. Thus, this indexing
scheme diagnoses the problem as well as accesses textual and graphic
information necessary to make the repair. As further illustrated in FIG.
16, keyboard 500 was previously used to enter the name of the repair shop
by touch of box 502 followed by touch of the letter boxes on keyboard 500
which spell the repair shop "ACE REPAIR CO.". Similarly, the name of the
owner of the vehicle "J. JONES" was also entered by touch of box 503 and
then boxes on keypad 500.
Referring to FIGS. 7 and 8, after the document selection, microprocessor 60
transmits a sector address to CD-ROM interface 67 via bus 320 to locate
the selected document, and afterwards reads all the reference numbers
within the document identifying all the graphic images within the selected
document (step 109). Then CD-ROM reader 63 accesses the graphic
information under the control of processor 60, which processor then
extracts header information defining the size of the image and each region
on the screen 23 which forms a touch pad as described in more detail
below. The header information is stored in DRAM 72. Then, in step 110,
decompression processor 96 reads the compressed graphic data of the
selected document from CD-ROM 20 via interface 67 and decompresses the
data with the aid of workspace DRAM 97 and DRAM controller 114. Then,
processor 96 transmits the decompressed graphic image data to graphic
control processor 102 for storage in DRAM 99 with the aid of memory
control 116. Memory control presents the addresses specified by
microprocessor 102 to DRAM 99 in two parts in two different cycles. One
part specifies a column and the other part specifies a row. Data is read
from DRAM 99 similarly in two cycles (DRAM control 114 operates similarly
upon DRAM 97). By way of example, CCITT Group IV run length encoding was
used to compress the data originally written into CD-ROM 24 and processor
96 implements corresponding run length decoding in the decompression
process. Thus, all the graphic image data in decompressed form associated
with the selected document is available from DRAM 99 for instantaneous
display on screen 23. This satisfies one object of the invention in that
the size requirement for CD-ROM 24 is minimized because it stores graphic
image data of hundreds or thousands of graphic images in compressed form,
and at the time a procedure is identified, only the graphic images
associated with the selected procedure are decompressed and stored in DRAM
99 for instantaneous display.
Next in step 122, microprocessor 60 causes a first portion of the document
text 27, the first referenced graphic image 31, reference numbers 31-34,
and text scrolling control symbols 118-121 to be displayed on screen 23 as
illustrated in FIG. 9. To do this, microprocessor 60 transmits the address
of the text to CD-ROM reader 63 via bus 320 and interface 67. Then, a
portion of the text is read into SRAM 123 via interface 67 and text bus
interface 124. The processor 102 then determines the amount of text which
will fit on screen 23 at one time, and memory controller 116 addresses the
text in SRAM 123 via lines 125. The addressed text is transformed into
actual alpha numeric characters by a character generator 126. A pixel
controller 127 combines the text character data with decompressed graphic
data received from DRAM 99. In the illustrated embodiment of system 20,
the alphanumeric information within each of the images such as label 129
is stored and retrieved as graphic information. However, the data table 34
in addition to text 127 is stored and retrieved as text.
Interface 128 selects sixteen pixels of data from either 16, 32 or 64
pixels of data stored in DRAM 99 in accordance with a zoom level of the
image. The image presented in step 12 | | |
