 |
Description  |
|
|
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a method and apparatus for linking a
document with associated reference information. More specifically, the
present invention relates to a method and apparatus for receiving document
images and linking the received image with electronic reference
information, wherein the image is communicated using standard, existing
equipment that otherwise would not have this capability. For example, a
standard fax machine may be used to convey a document having a portion
electronically linked to electronic audio information. The present
application is a continuation-in-part of U.S. patent application Ser. No.
08/124,381, filed Sep. 17, 1993, which is a continuation of U.S. Ser. No.
07/918,150, filed Jul. 24, 1992, now abandoned, which is a continuation of
U.S. Ser. No. 07/840,808, filed Feb. 25, 1992, now abandoned.
SUMMARY OF THE INVENTION
The present invention solves this and other problems associated with prior
art linked documents. The present invention comprises an apparatus for
linking a document with reference information associated therewith
comprising means for receiving an electronic representation of a document
image, said document having a portion to be linked to electronic reference
information, wherein said portion is designated by a predetermined
attribute of the received document image; means for electronically
scanning the electronic representation of the document image to locate
said predetermined attribute of the document image; means for identifying
the linked portion of the document based on the location of said
predetermined attribute; means for acquiring the electronic reference
information associated with the linked portion; means for correlating the
linked portion of the document with the associated electronic reference
information; and means for providing a pointer from the linked portion in
the document to each piece of electronic reference information associated
therewith.
In one embodiment of the invention, the received document image may be
transmitted using standard facsimile protocols and the electronic
reference information may be acquired as audio information transmitted
using standard voice channel telephony.
BRIEF DESCRIPTION OF THE DRAWINGS:
A detailed description of preferred embodiments of the invention will be
made with reference to the accompanying drawings, wherein like numerals
designate corresponding parts in the several figures.
FIG. 1 illustrates a known copying apparatus in schematic form.
FIG. 2 depicts a preferred embodiment of the present invention mounted on
top of the window of the copying apparatus illustrated in FIG. 1.
FIG. 3 illustrates a preferred embodiment of the image-forming components
of the present invention.
FIG. 4 illustrates a reflective layer that is disposed adjacent to or near
the image-forming element of FIG. 3.
FIG. 5 illustrates the structures shown in FIG. 4 with an image present on
the image-forming member (in this particular example, a set of
alphabetical characters assembled into the word "Hello").
FIG. 6 is a perspective view from below the copier window of the structure
in FIG. 5, when the illustrated embodiment of the present invention is
mounted on the copy board of a copier.
FIG. 7 illustrates an embodiment of the invention that can be used with
copiers possessing moving copy-boards, which are common to many low cost
"personal" copiers.
FIG. 8 illustrates an alternate embodiment to that depicted in FIG. 5 in
which the image-forming element is of the emissive variety.
FIG. 9 illustrates an embodiment of the invention in which the signal
representative of the image to be printed is transmitted to the
image-forming member by an "intangible mechanism" such as an infra-red
beam, rf-signal, etc. (in contrast to a cable or electrical wire).
FIG. 10 illustrates one possible arrangement of photodetectors on an image
forming tablet.
FIG. 11 illustrates an installation of two different and optional Device
Emulation Modules, which impart to the apparatus additional capabilities
such as facsimile machine emulation.
FIG. 12 illustrates an embodiment specially adapted for "forms
handling"--that is, the computer assisted completion of forms, wherein a
form (or application) is being inserted between an image forming element
and a reflective back-layer.
FIG. 13 is a view of a "blank form" as seen through the image forming
member.
FIG. 14 illustrates an image forming member bearing information pertinent
to completion of the "blank form" generated on it.
FIG. 15 depicts the information appearing in FIG. 14 superimposed on the
"blank form".
FIG. 16 shows a "completed form" that was created by the apparatus of an
embodiment of the present invention.
FIG. 17a shows a module insertable into the apparatus 1 for reading a data
storage medium comprising a first format.
FIG. 17b shows a module insertable into the apparatus 1 for reading a data
storage medium comprising a second format.
FIG. 17c shows a module insertable into the apparatus 1 for reading a data
storage medium comprising a third format.
FIG. 17d shows a copier-print apparatus 1 on top of a photocopier. The
apparatus 1 has a display console 100, and a receiving means 177 for
receiving the modules shown in FIGS. 17a-c.
FIG. 17e shows a copier-print apparatus with receiving means 15 for
receiving user-installable option modules 16a and 16b, which are used to
extend the functional capabilities of the apparatus.
FIG. 18a shows a copier-print apparatus capable of using data from a
variety of different, and mutually incompatible computer platforms.
FIG. 18b shows the insertion of two modules into the copier-print
apparatus.
FIGS. 19(a)-19(g) illustrate an example of a process that might be involved
in creating a hard copy of a disk file using a tablet in accordance with
the present invention.
FIGS. 20(a)-(c) illustrate an example of the versatility afforded by an
embodiment of the present invention.
FIG. 21 illustrates an example of the use of a tablet in printing digital
photographs taken by an electronic still camera.
FIG. 22 illustrates an example of the incorporation of a compatibility
assurance card reader into a tablet.
FIG. 23 illustrates an example of a feature referred to as
"Pseudo-Collation".
FIG. 24 illustrates an example of a hardware configuration in one
embodiment of the present invention.
FIG. 25 illustrates an example of the application of MicroChannel Bus
architecture by a tablet so that multiple masters can be effectively
supported.
FIG. 26 illustrates an example of a process for obtaining hard copy with a
tablet from data created by a software package, that is saved on a medium
such as a diskette.
FIGS. 27 and 28 illustrate an example of an alternate method of getting
data created by an applications program into a tablet.
FIG. 29 illustrates an example of how a device controller module and a file
interpreter module of a tablet might be "borrowed" by a conventional
printer.
FIG. 30a shows a portable computer capable of producing hard copy using a
conventional photocopier from applications software run thereon.
FIG. 30b shows a switch provided on the portable computer for enabling
information to be printed using either a conventional photocopier, or a
standard printer attached to the computer.
FIG. 30c shows the display screen of the portable computer, with
photosensors and light gasketing.
FIGS. 31 through 32 illustrate an embodimennt of a portable computer
constructed specifically to permit data to be "printed" by using a display
screen with a copier.
FIG. 33 illustrates an example of a system for optimizing the angular
orientation of a hard copy image generated by an image display screen of a
tablet.
FIG. 34 illustrates an example of an operator's console screen that may be
provided on the back of a tablet to visually illustrate a calculated skew
angle.
FIG. 35 illustrates an example of an alternative display in which a skew
angle .OMEGA. is depicted as an arc of a circle.
FIG. 36a shows a set of buttons used to assist in producing hard copy on a
copier.
FIG. 36b shows a hard copy page with an improperly positioned image. The
dot D is below the top margin of the printed sheet, so the tablet must be
shifted upward.
FIG. 36c shows a hard copy page that has been correctly imaged by the
copier, with alignment dot D at the upper margin of the printed sheet.
FIG. 36d shows a tablet being shifted in a direction to form a correctly
aligned image by a copier.
FIG. 37 illustrates an example of an alternative system for optimizing the
rectilinear orientation of an image on a printed page.
FIG. 38 illustrates an example of an alternative system for optimizing the
angular orientation of an image on a printed page.
FIG. 39 illustrates an example of how a fax document might appear displayed
on an image display screen of a fax tablet.
FIG. 40 illustrates an example of a light gasket of a fax tablet.
FIG. 41a shows a fax document that has been received by the apparatus.
Electronic audio information linked to one portion of the document is
being played back.
FIG. 41b shows the playback of another linked audio message.
FIG. 42a shows a fax tablet equipped with a document scanner for scanning
hard copy documents.
FIG. 42b shows a cutaway view of the fax tablet to reveal the scanning
assembly.
FIG. 42c shows the portion of the scanner assembly that processes
electronic data storage media associated with hard copy documents.
FIG. 42d shows the portion of the scanner assembly that processes the
optical component of hard copy documents.
FIG. 43a shows examples of systems the apparatus may communicate with.
FIG. 43b shows the apparatus being used with a copier.
FIG. 43c shows a hard copy document produced by the apparatus with the
copier.
FIG. 44a shows the front face of a hard copy document produced by the
apparatus.
FIG. 44b shows the back face of a hard copy document produced by the
apparatus.
FIG. 44c shows the hard copy document of FIGS. 44a and 44b being processed
by the scanner assembly of the apparatus.
FIG. 44d shows the front face of the hard copy document after it has been
processed by the apparatus.
FIG. 44e shows the back face of the hard copy document after it has been
processed by the apparatus, with an electronic data storage medium applied
thereto.
FIG. 45a shows the front face of a hard copy document, which already has an
electronic data storage medium.
FIG. 45b shows the back face of a hard copy document which already has an
electronic data storage medium.
FIG. 45c shows the apparatus processing a hard copy document which already
has an electronic data storage medium.
FIG. 45d shows an image on the display screen of the apparatus, which
corresponds to the image on the front face of the hard copy document
processed by the apparatus.
FIG. 45e shows access of one piece of linked electronic reference
information.
FIG. 45f shows access of another piece of linked electronic reference
information.
FIG. 46a shows a document to which audio messages may be added.
FIG. 46b shows defining a highlight box enclosing a portion of the document
to which an audio passage may be added.
FIG. 46c shows a highlight box enclosing a portion of the document to which
an audio passage may be added.
FIG. 46d shows a completed highlight box.
FIG. 47a shows a highlight box that is ready to be linked to an audio
passage.
FIG. 47b shows buttons used in connection with audio passages.
FIG. 48 illustrates an example of a communications protocol for fax
transmission.
FIG. 49a shows a document having frames and numerals to indicate the linked
portions.
FIG. 49b shows a document having numerals delimiting the linked portions.
FIG. 50 illustrates an example of a voice capable desktop fax unit
containing an image display screen that is not touch sensitive.
FIG. 51 illustrates an example of a cradle into which a fax tablet may be
placed.
FIG. 52 illustrates an example of a cradle equipped with a video camera
which enables the fax tablet docked in the cradle to send, receive and
display video images.
FIG. 53 illustrates the use of coordinates to identify positions of link
regions contained in a document having electronically linked electronic
reference information associated therewith.
FIG. 54a illustrates a predetermined attribute of a document image in the
form of numerals delimiting linked portions of the document.
FIG. 54b illustrates the step of electronically scanning the electronic
representation of the document image to locate the linked portion of the
document.
FIG. 54c illustrates the recording of the positions in the document where
the predetermined attribute has been detected through scanning.
FIG. 54d illustrates the identified link regions in a document based on the
portions of the document image found to have the predetermined attribute.
FIG. 55 illustrates the manual inscription of graphical identifiers in a
document to designate portions of the document to be linked to electronic
reference information and the resulting document with link regions where
the graphical identifiers were manually placed.
FIGS. 56(a) and (b) illustrate the concept of a remote link, and ways of
storing this information in an electronic data storage medium capable of
being included on a printed document.
FIG. 57 illustrates the use of a non-standard facilities frame to modify a
facsimile transmission for transmitting linked electronic reference
information.
FIGS. 58(a-d) illustrate the communications scheme of FIG. 48 in greater
detail.
FIG. 59 illustrates the benefit of synchronizing the formatting of the hard
copy document with the storage of information to an EDSM (5117) and the
potential result if synchronization is not utilized (5113).
FIGS. 60(a) and (b) illustrate the organization of linked electronic
reference information for convenient and independent accessibility.
FIGS. 61(a) and (b) illustrate an apparatus for playing documents having
linked electronic reference information.
FIG. 62 illustrates the dynamic interaction between electronic reference
information and printed information appearing on a page for documents
retaining electronic links to electronic reference information.
DESCRIPTION OF THE PREFERRED EMBODIMENT
The following detailed description is of the best presently contemplated
mode of carrying out the invention. This description is not to be taken in
a limiting sense, but is made merely for the purpose of illustrating the
general principles of the invention. The scope of the invention is best
defined by the appended claims.
The general form of the invention comprises a device capable of generating
an image derived from an electrical representation of an image. The device
possessing the capacity to be mounted or otherwise placed in such
relationship relative to a copier that said copier can reproduce the image
onto a substrate such as paper.
The electrical signals defining the image may originate from a computer,
magnetic storage device, optical storage device, or from any kind of
source or electronic apparatus capable of generating, manipulating,
storing, or conveying electrical signals representing displayable
information. The internal components and the manner of operation of these
devices are well known in the art and, in the interest of simplifying the
present disclosure, will not be discussed in the present disclosure.
Embodiments of the invention, in a sense, can be likened to "electronic
paper" since it is usually a sheet of paper, bearing an image on it, that
is placed on a copier for the purpose of being duplicated. Embodiments of
the present invention, however, permit images to be easily altered or
manipulated as they are of electrical origin. The function of the copier
is to transform the "electronic paper" image into one on "real paper", or
one on other suitable substrates
As those skilled in the art of electronic information display are aware,
there are numerous means by which an image, emanating from an electrical
signal representative of that image, may be fashioned. Numerous strategies
embraced by that technological family may be applicable to the reduction
to practice of the present invention. Examples of potential image forming
systems are: liquid crystal devices, gas plasma devices, fluorescent
displays, cathode ray tubes, electrophoretic displays, and filed emission
displays. The particular image forming technology used to implement the
invention will influence the additional components needed to enable the
image forming element to function as intended; impact the resolution,
contrast, and quality of the printed output; and affect the overall
configuration of the apparatus. For instance, electrophoretic displays
would not require back-lighting. The aforementioned considerations are
appreciable to those skilled in the art.
Depicted in FIG. 1 is a representation of a known copying apparatus, such
as a copier. The known copying apparatus includes a body 4 and a copier
window 5. In one embodiment, the invention is in the form of an
image-forming tablet. As shown in FIG. 2, the image-forming tablet 1 may
be placed on top of a conventional copier like an ordinary document, with
the copier window 5, shown in FIG. 1, immediately beneath the tablet 1. An
electrical cable 3 may be used to convey the signal representative of the
image to the tablet 1 from a signal source 11. As described above, the
signal source 11 may include a variety of devices, such as a computer, a
magnetic storage device, an optical storage device, etc.. A light shield 2
may serve to reduce the leakage of ambient light through the copier window
5, and may be constructed of any suitable, compliant material.
An image forming element of the liquid crystal variety is pictured in FIG.
3. The liquid crystal image forming element includes a liquid crystal
image forming layer 6a, capable of forming an image 60 (in this particular
example, a set of alphabetical characters assembled into the word
"Hello").
FIG. 4 illustrates a reflective back-layer 6b which may be provided
adjacent to the liquid crystal image forming layer 6a. For purposes of
clarity, the liquid crystal image forming layer 6a and the reflective
back-layer 6b are depicted as being spatially separated by a significant
distance in FIG. 4. However, in most embodiments of the invention these
layers would be relatively closely disposed to each other.
The reflective back-layer 6b may be applied directly to the back surface of
the liquid crystal image forming layer 6a in the form of a coating. A
primary function of the reflective back-layer 6b is to provide an albedo
in the non-imaged areas of the liquid crystal layer 6a that is optically
distinct from the imaged areas of the liquid crystal layer. Non-imaged
areas of the liquid crystal layer 6a are substantially optically
transparent to radiation of wavelengths within the domain of concern. It
is also possible to substitute for the reflective back-layer 6b an active,
light emitting source, such as an electroluminescent panel. Back-lighting,
however, increases the power consumption level.
FIG. 5 depicts the elements of FIG. 4 with the inclusion of an alphabetic
character string formed on the liquid crystal layer 6a.
FIG. 6 shows a schematic view from beneath the copier window 500 of an
ordinary copying apparatus 40. The structures illustrated in FIG. 5 are
shown positioned on top of the copier window 500, in the manner that they
would be during the process of duplicating the image 60 formed by the
image forming layer 6a.
The tablet shaped embodiment of the invention described above is fully
capable of being used with low cost "personal" copiers possessing moving
copy boards. An embodiment of the invention specially adapted for use with
such copiers is illustrated in FIG. 7. As depicted in FIG. 7, the imaging
element along with its supporting members is in the form of a strip 600.
The strip 600 may be held in place by a structural support 625, which in
turn may be mounted to the body of the copier 4 by a fastener 650. Beneath
the copier window 5 can be seen that part of the copier 80 which is
sensing the pattern formed by the strip 600 for reproduction onto a
substrate. Interposed between the image forming element 600 and the copier
window 5 is a transparent copy board 7 which is the part of the copying
apparatus that undergoes translational motion, and is the member upon
which any document to be copied is ordinarily placed.
FIG. 7 is intended to demonstrate one configuration of the present
invention that may be used in conjunction with low cost "personal" copiers
possessing moving copy boards. It will be recognized by those skilled in
the art that numerous alternative configurations are possible for such
use.
FIG. 8 illustrates an embodiment of the invention in which the image
forming element is of the emissive variety; that is, of the type which
emits radiation, e.g., light. Such an image forming element may, for
example, employ a fluorescent display, a gas plasma display, etc. The
image forming element 65, during the course of operation, may include one
or more portions 65a that are not emitting light and one or more portions
65b that are emitting light. It is the sum of the non-light emitting areas
65b that collectively comprises the image to be printed.
In FIG. 8 the non-emitting areas 65a are seen to compose the character
string "HELLO" against the background of emitting areas 65b. The
photoconductor of a copier will be discharged by the light emitting
portions 65b, to leave behind on the photoconductor a latent image charge
pattern substantially identical to that defined by regions 65a. Also shown
in FIG. 8 is an anti-reflective layer 70. The function of this
anti-reflective layer is to reduce the amount of light emanating from the
copier's internal light source that is back-reflected off of the surface
of the image forming member of the apparatus of the present invention. In
practice the anti-reflective layer is more likely to be present as a
surface coating on the image forming member. An anti-reflective layer may
be included in other embodiments, such as those employing liquid crystal
components.
FIG. 9 is a diagrammatic representation of an arrangement where the
electrical signals defining the image to be printed are transmitted by an
infrared beam, rf-carrier, or other "intangible medium" from a source 300
to the apparatus of the present invention 1. The point of reception of the
information-bearing signal is shown as 30. The "intangible medium" that
substitutes for the electrical cable or connector is indicated by 35. The
copying apparatus is designated as 4; and the webbing which shields
ambient light from leaking through the tablet/copier interface is
identified as 2.
FIG. 11 illustrates the installation of two Device Emulation Modules into
"Module Bays", 15 In FIG. 11, a first module, 16a, is designed to perform
a first function, and a second module, 16b, designed to perform a second,
different function. An example of a function which a module 16a or 16b may
perform is that of facsimile machine emulation, as described in further
detail below. Whereas two Modules are shown in FIG. 11, the apparatus of
the present invention is not restricted to this number. Also, while some
embodiments contain data storage devices such as disk drives, these are
not represented in FIG. 11.
Some embodiments incorporate into the apparatus the means to read directly
from data storage media such as magnetic diskettes, magnetic tapes, or
optical discs. This facility permits text or graphical information to be
directly loaded into the apparatus and obviates the need for connection to
another device such as a computer. As some embodiments of the invention
may be powered by batteries, certain versions, especially when coupled
with the capability to read directly from data storage media are highly
self-contained and portable: requiring for operation only a conventional
copier and a diskette (for instance) containing material to be printed.
An embodiment specially adapted for "forms printing" includes a
modification to the spacing between image forming element 6a and
reflective back-layer 6b (which were discussed earlier in connection with
FIGS. 4 through 6).
As illustrated in FIG. 12, a blank form 90 is inserted between members 6a
and 6b, with the front of the blank form facing 6a. The actual spacing
between members 6a and 6b may be changeable so as to accommodate forms of
different thicknesses; and means may be provided to adjust the spacing to
suit the inserted form. Additional means may be provided to alter the
relative positions of layers 6a and 6b to facilitate insertion and removal
of blank forms, as well as to insure their proper alignment within the
tablet.
FIG. 13 demonstrates how blank form 90 would appear viewed through image
forming member 6a, which is the copier's perspective during the
reproduction process. FIG. 14 depicts the image forming member, 6a, with
alphanumeric information, 61, generated on it. In the illustrated example,
the information comprises two data fields that are pertinent to completion
of blank form 90: a name, and a street address. The information may be
derived from a software package such as a data base manager, a
spreadsheet, or a word processor. FIG. 15 portrays the visual overlay that
results when blank form 90 is situated behind image forming member 6a, and
displayable information is present on member 6a.
Exhibited in FIG. 16 is the printed output of a copier that has been used
in combination with the tablet of an embodiment of the present invention
operating in "forms printing" mode. It can be seen that the original blank
form, 90, has been duplicated and that the data discussed in connection
with FIGS. 14 and 15 have been imprinted on the replica; they are
indicated by 66. Other information, 67, relevant to the completion of
blank form 90 has, in a similar manner, likewise been imprinted. The
"filled out form" output by the copier is labeled 99.
In addition to serving as a portable conversion device that enables a
conventional copier to function as an electronic printer, high speed
printing matching and even exceeding the capability of dedicated
electronic printers can be achieved by using the present invention in
concert with high performance copying equipment. Further, other benefits
provided by such equipment including large volume printing, and elaborate
paper handling facilities like collation and stapling can be conveniently
tapped.
Not only do embodiments of the present invention permit an ordinary copier
to be utilized as a computer printer, but it also enables the conventional
copier to function as a "receiving end" facsimile printer. In one
embodiment a facsimile module can be plugged into the tablet to enable fax
data transmitted over standard telephone lines to be intercepted,
interpreted, and converted into displayable form. Once present on the
image forming member, the graphical data can be reproduced by a copier.
Further, it should be noted that the facsimile information can be directly
viewed off of the image forming member, and thus need not be printed
unless desired. In this manner the present invention provides for both
"optical fax" and conventional "hard copy fax", and permits the user to
inspect a transmitted document in entirety before deciding whether all or
only portions are to be printed. Variations on this theme include
embodiments possessing document scanning capabilities, so that data
transmission is possible, in addition to data reception. Other embodiments
are equipped with storage means so that incoming data can be saved, then
printed in a time-shifted fashion at another moment.
Embodiments of the invention may possess means to detect when a copier has
completed its scan cycle; that is, when an image to be duplicated has been
successfully captured by the copier. An example of a detection means is a
photosensor | | |
