 |
Claims  |
|
|
What is claimed is:
1. An electronic imaging system comprising:
an electronic camera for capturing images and storing captured images; and
a storage device removable from the camera for storing the images captured
by the camera, said device capable of being preloaded with software for
operating the electronic camera, wherein said camera includes
an optical section for establishing optical parameters of image capture;
an image sensing section for electrically capturing an image provided by
the optical section;
a signal processing section for processing the electrically captured image;
a programmable processor for controlling one or more of said sections of
the camera, said programmable processor including a firmware memory for
storing firmware for operating the processor; and
means for loading the programmable processor with the software preloaded in
the removable storage device for affecting operation of one or more of
said sections of the system, said software substituting for some or all
the firmware in the firmware memory.
2. An electronic imaging system as claimed in claim 1 wherein the software
preloaded in the removable storage device modifies the performance of the
optical section.
3. An electronic imaging system as claimed in claim 1 wherein the software
preloaded in the removable storage device controls the signal processing
section so as to modify the processing of the electrically-captured image.
4. An electronic imaging system as claimed in claim 1 wherein the software
preloaded in the removable storage device includes at least one
pre-existing image file that is to be combined with the electrically
captured image in the signal processing section.
5. An electronic imaging system as claimed in claim 1 wherein said imaging
system further comprises a player device including an interface for
receiving said removable storage device and a software-driven processing
unit, and wherein the software preloaded in the removable storage device
is accessed by said processing unit for use therewith to operate the
processing unit.
6. An electronic imaging system as claimed in claim 5 wherein said player
device comprises a computer that can be optionally attached to a display
screen or a printer for display or printing of the captured images,
respectively.
7. An electronic imaging system as claimed in claim 1 wherein the storage
device is a solid state memory card.
8. An electronic imaging system as claimed in claim 1 wherein the storage
device is a magnetic medium.
9. An electronic imaging system as claimed in claim 1 wherein the storage
device is a removable hard drive device.
10. An electronic camera for capturing and storing images in a removable
digital storage device also containing preloaded software, said camera
comprising:
an optical section for establishing
optical parameters of image capture;
an image sensing section for electrically capturing an image provided by
the optical section;
a signal processing section for processing the electrically captured image;
a programmable processor for controlling one or more of said sections of
the camera, said programmable processor including a firmware memory for
storing firmware for operating the processor; and
means for loading the programmable processor with the software preloaded in
the removable digital storage device for operation of the camera, said
software substituting for some or all the firmware in the firmware memory.
11. An electronic camera as claimed in claim 10 wherein the software
preloaded in the removable digital storage device modifies the performance
of the optical section.
12. An electronic camera as claimed in claim 10 wherein the software
preloaded in the removable digital storage device controls the signal
processing section so as to modify the processing of the
electrically-captured image.
13. An electronic camera as claimed in claim 11 wherein the software
preloaded in the removable digital storage device includes at least one
pre-existing image file that is combined with the electrically captured
image in the signal processing section.
14. An electronic camera as claimed in claim 10 wherein said digital
storage device is a memory card.
15. An electronic camera as claimed in claim 10 wherein said digital
storage device is a hard drive device.
16. An electronic camera for capturing and storing images in a removable
digital memory device also containing stored operating code, said camera
comprising:
an image sensor for capturing an image and generating an image signal
therefrom;
a programmable processor for operating upon the image signal;
a firmware memory for storing operating firm for the programmable
processor;
a memory interface for electrically attaching the removable digital memory
device to the camera; and
means for uploading the stored operating code from the digital memory
device through the memory interface to the firmware memory, whereby the
stored operating code substitutes for some or all the firmware in the
firmware memory and the operation of the programmable processor can
accordingly be modified from the code stored in the memory device.
17. An electronic imaging system, comprising:
an electronic camera including an image sensor and a software-driven
processor for operating the camera to capture images, said processor
including a firmware memory for storing firmware for operating the
processor; and
a removable digital memory device for storing the images captured by the
camera and software for controlling the operation of the processor in the
camera, said software substituting for some or all the firmware in the
firmware memory when the memory device is connected to the electronic
camera.
18. An imaging system as claimed in claim 17 wherein the software stored in
the removable memory device controls the performance of the camera.
19. An imaging system as claimed in claim 17 wherein the software stored in
the removable memory device controls processing of a captured image.
20. An imaging system as claimed in claim 17 wherein the software stored in
the removable memory device contains pre-existing image data that is
combined with the captured images in the camera.
21. An imaging system as claimed in claim 17 wherein the software stored in
the removable memory device updates the software-driven processor with
software improvements.
22. A digital memory device that is removably attachable to an electronic
camera of the type that captures images for storage in the memory device,
said camera including firmware memory for storing firmware for operating
the camera, said memory device comprising:
an interface section for electrically communicating with the electronic
camera; and
a memory section connected to said interface section, said memory section
including first memory space allocated to the captured images and second
memory space allocated to operating software, wherein said second memory
space is preloaded with the software capable of substituting for some or
all the firmware in the firmware memory for operating the camera.
23. A digital memory device as claimed in claim 22 wherein the software
preloaded in said second memory space is capable of modifying the
performance of the camera.
24. A digital memory device as claimed in claim 22 wherein the software
preloaded in said second memory space is capable of processing the
captured images in the camera.
25. A digital memory device as claimed in claim 22 wherein said second
memory space is preloaded with pre-existing image files for combining with
the captured images in the camera.
26. An electronic imaging system including an electronic camera for
capturing and storing images, and a computer for processing the images,
said camera comprising:
a storage device for storing images captured by the camera;
an interface for transferring stored images from the camera to the
computer, said interface also capable of uploading software from the
computer to the camera for operating the camera;
an optical section for establishing optical parameters of image capture;
an image sensing section for electrically capturing an image provided by
the optical section;
a signal processing section for processing the electrically captured image;
a programmable processor for controlling said sections of the camera, said
processor including an electrically erasable firmware memory for storing
firmware for operating the processor; and
means for loading the programmable processor with the software uploaded
from the computer through the interface for substituting for some or all
the firmware in the firmware memory and affecting operation of one or more
of said sections of the camera.
27. An electronic imaging system as claimed in claim 26 wherein the
software uploaded from the computer modifies the performance of the
optical section.
28. An electronic imaging system as claimed in claim 26 wherein the
software uploaded from the computer controls the signal processing section
so as to modify the processing of the electrically-captured image.
29. An electronic imaging system as claimed in claim 26 wherein the
software uploaded from the computer includes at least one preexisting
image file that is to be combined with the electrically captured image in
the signal processing section.
30. An electronic imaging system as claimed in claim 26 wherein the
computer is optionally attached to a display screen or a printer for
display or printing of the captured images, respectively.
31. An electronic imaging system as claimed in claim 26 wherein the storage
device is a solid state memory card.
32. An electronic imaging system as claimed in claim 26 wherein said
interface includes a cable connection between the camera and the computer.
33. An electronic imaging system as claimed in claim 26 wherein said
interface includes a removable cable connection between the camera and the
computer, and the camera is operable to capture the images while
unconnected to the computer.
34. An electronic imaging system including an electronic camera for
capturing and storing images, and a computer for processing the images,
said electronic camera comprising:
a storage device removable from the camera for storing the images captured
by the camera, said device also preloaded with software for affecting
processing of the images captured by the camera;
an optical section for establishing optical parameters of image capture;
an image sensing section for electrically capturing an image provided by
the optical section;
a signal processing section for processing the electrically captured image;
a programmable processor for controlling said sections of the camera; and
said computer comprising
an interface for receiving said removable storage device;
a software driven processing unit for processing the images downloaded
through said interface;
a RAM memory that stores firmware for operating the processing unit; and
means for loading the processing unit with the software preloaded in the
removable storage device for affecting processing of the images, wherein
the software preloaded in the removable storage device substitutes for
some or all the firmware in the RAM memory.
35. An electronic imaging system as claimed in claim 34 wherein the
software preloaded in the removable storage device includes at least one
pre-existing image file that is to be combined with the electrically
captured image in the processing unit in the computer.
36. An electronic imaging system as claimed in claim 34 wherein said
computer is optionally attached to a display screen or a printer for
display or printing of the captured images, respectively.
37. An electronic imaging system as claimed in claim 34 wherein the storage
device is a solid state memory card.
38. An electronic imaging system as claimed in claim 34 wherein the storage
device is a magnetic medium.
39. An electronic imaging system as claimed in claim 34 wherein the storage
device is a removable hard drive device.
40. An electronic camera for capturing and storing images in a removable
digital storage device also containing preloaded software, said camera
comprising:
an optical section for establishing optical parameters of image capture;
an image sensing section for electrically capturing an image provided by
the optical section;
a signal processing section for processing the electrically captured image;
a viewfinder for displaying the captured image;
a programmable processor for controlling said sections of the camera; and
means for loading the programmable processor with the software preloaded in
the removable digital storage device for operation of the camera, wherein
the software preloaded in the removable digital storage device includes at
least one pre-existing image file that is to be combined with the
electrically captured image in the signal processing section, and wherein
the pre-existing image file comprises an image overlay with at least one
opening through which the captured image is displayed on the viewfinder.
41. An electronic camera for capturing and storing images in a removable
digital storage device also containing preloaded software for subsequent
processing by a computer, said camera comprising:
an optical section for establishing optical parameters of image capture;
an image sensing section for electrically capturing an image provided by
the optical section;
a signal processing section for processing the electrically captured image;
a programmable processor for controlling said sections of the camera;
means for loading the programmable processor with the software preloaded in
the removable digital storage device for operation of the camera, wherein
the software preloaded in the removable digital storage device includes at
least one pre-existing image file that is to be combined with the
electrically captured image; and
means for selecting at least one pre-existing image file for combination
with the captured image.
42. An electronic camera as claimed in claim 41 wherein said programmable
processor effects the combination of the pre-existing image file with the
captured image.
43. An electronic camera as claimed in claim 41 wherein said computer
effects the combination of the pre-existing image file with the captured
image.
44. An electronic imaging system as claimed in claim 1 wherein the software
preloaded in the removable storage device modifies the performance of the
image sensing section.
45. An electronic camera as claimed in claim 10 wherein the software
preloaded in the removable digital storage device modifies the performance
of the image sensing section.
46. An electronic imaging system as claimed in claim 26 wherein the
software uploaded from the computer modifies the performance of the image
sensing section.
47. An electronic camera for capturing and storing images in a removable
digital storage device also containing preloaded software, said camera
comprising:
an optical section for establishing optical parameters of image capture;
an image sensing section for electrically capturing an image provided by
the optical section;
a signal processing section for processing the electrically captured image;
a viewfinder for displaying the captured image;
a programmable processor for controlling said sections of the camera; and
means for loading the programmable processor with the software preloaded in
the removable digital storage device for operation of the camera, wherein
the software preloaded in the removable digital storage device includes at
least one pre-existing image file that is to be combined with the
electrically capture image in the signal processing section, and wherein
the pre-existing image file includes a plurality of pre-existing images;
and
means for selecting one of the plurality of pre-existing images for display
in the viewfinder and for combination with the captured image. |
|
 |
|
 |
Claims |
|
|
|
Description |
|
|
FIELD OF THE INVENTION
This invention pertains to the field of electronic imaging and, in
particular, to electronic imaging with an electronic still camera that
utilizes a removable storage device for storing images.
BACKGROUND OF THE INVENTION
As understood in the prior art, a digital electronic still camera is a
device which uses an electronic sensor to capture an image; signal
processing to modify the captured image signal, e.g., as a function of
ambient light, and to represent it numerically; and some storage device to
preserve the numerical image data. Ordinarily, the image storage device is
merely a receptacle for the image data.
It is further known for a digital electronic still camera to use a
removable storage device, such as an integrated circuit memory card, to
store images. For instance, U.S. Pat. No. 5,016,107 describes an
electronic still camera utilizing image compression and providing digital
storage in a removable memory card having a static random access memory.
Software that controls the camera operation is located in non-removable
programmable read only memory (PROM) integrated circuits in the camera. In
this camera, the integrated circuits in the removable memory card store
image data and a directory locating the data.
Other electronic camera systems described in the prior art record an image
header along with the digital image data. The header typically describes
some characteristics about the image or the camera. For instance, in U.S.
Pat. No. 5,018,017, such header information indicates the classification
of the information; the imaging system in use; the date and time; the
compression mode; as well as image-specific information, such as flash
use, white balance data, exposure value, and shutter speed. Furthermore,
U.S. Pat. No. 5,153,729 shows memory capacity, a free area pointer, a
battery expiration date, and a write inhibit flag in the header area of a
memory card. Typically, each system conveys such characteristic data from
the electronic camera by way of the memory card (where the data is
temporarily stored) to a peripheral device, such as a player. The object
is to increase the downstream functionality of the system by allowing
utilization of image-related data in subsequent processing of the image
data in a downstream peripheral device. The camera or imaging device
generally utilizes little of the stored image characteristic data, one
exception being data regarding the utilization of the storage device
itself, i.e., how much memory space is remaining for further pictures. In
the latter case, the camera accesses such data to display utilization to
the camera user.
Coordination between a camera and a computer is generally shown in patent
application Ser. No. 988,517, "Electronic Camera with Memory Card
Interface to a Computer", which was filed on Dec. 10, 1992 and assigned to
common assignee with the present application. This application describes a
camera that is specially shaped so as to plug directly into the memory
card slot of a portable computer; the camera is then usable as a unit with
the portable computer. The camera contains EPROM memory with code for
in-camera white balance and gamma correction, and also stores the compiled
code which is used (by the computer) to operate the camera and to process
the images from the sensor color filter array to obtain a full resolution,
color corrected image. The image data is captured by the camera and
directly downloaded to the computer, where it is processed with code
obtained from the camera. As with prior memory card systems, the code is
used downstream (in the computer) to process image data.
In a camera intended for acquisition of image data for use in a computer,
such as described in Ser. No. 988,517, it is well understood that data
corresponding to captured images may also be stored in a storage device
that is capable of being removed from the camera. Such a storage device is
often considered analogous to film in a conventional film camera. Just as
it is known to encode film with marks that are useful in downstream
processing of the film, it is also known for an electronic image storage
device to contain non-image data which is useful in modifying the image
data. Following the film analogy, such additional data is useful in
downstream processing, such as in a computer, to modify the image data.
Unlike film, however, the additional non-image data may be read by a
variety of peripheral devices, including the camera itself. This provides
an opportunity to deal with a number of imaging problems.
For instance, in most known electronic imaging systems, the software which
controls the camera ordinarily cannot be updated without purchasing an
entirely new camera, containing a lens, CCD image sensor, etc. (Albeit, a
few high end film cameras utilize a removable program module from which
the camera can download exposure algorithms.) It is well known that
computer programs are updated more regularly than computer hardware, since
the software can be refined to provide higher performance (i.e. better
image quality) or more features while using the same hardware. An
electronic camera can use a programmable digital processor controlled by
software. Such a camera offers an opportunity for software updates, if the
system is designed to facilitate such updates. What is needed is a method
for software updates of the camera algorithms for higher performance, and
for adding new features to a camera. Such a method should be quick and
convenient for the user, preferably without requiring the use of
additional storage modules. Existing memory devices are capable of limited
two-way communication with an electronic camera, such as to report to the
camera on memory space availability. An opportunity exists for enhancing
such "upstream" communication to provide altogether new applications for
an electronic camera.
SUMMARY OF THE INVENTION
The opportunity in the prior art for upstream utilization of the memory
capability of a removable storage device is embodied, according to the
invention, by an electronic imaging system including an electronic camera
for capturing and storing images in a removable storage device which is
also preloaded with software for operating the imaging system. The imaging
system includes an optical section for establishing the optical parameters
of image capture, an image sensing section for electrically capturing an
image provided by the optical section, a signal processing section for
processing the electrically captured image, a programmable processor for
controlling the sections of the system, and means for loading the
programmable processor with the software preloaded in the removable
storage device for affecting operation of one or more of the sections of
the system.
Consequently, the invention provides an electronic still photography system
which can be controlled by software located on a removable memory (e.g., a
memory card) used with an electronic still camera. Known cameras use the
removable memory to store images and data related to an individual image
(date, color temperature of the illuminant, etc.) or data related to the
camera (type of color filter array, sensor defect locations, etc.) which
is transferred to an image reproducing device. Except for data about
memory space, the communication is one way. A camera according to this
invention, however, uses the removable media to transfer software
previously recorded on the memory card (such as improved camera firmware
to process the image, or a special access code) to the camera. The
advantageous effect is that the operation of the camera or playback device
can be improved some years after the camera is purchased, by using an
"enhanced" memory card containing improved software for operating the
camera or playback device. Moreover, such two-way communication opens use
of the storage device to other enhancement possibilities, e.g., to modify
image data in selected ways, to modify camera performance for special
situations, or to communicate non-captured images (special overlays) to
the camera.
BRIEF DESCRIPTION OF THE DRAWINGS
The prior art and the invention will be described in relation to the
drawings, wherein
FIG. 1 is a diagram of a known electronic imaging system incorporating an
electronic camera for inputting images to a computer;
FIG. 2 is a block diagram of an electronic camera configured according to
the invention to receive and process enhancement files;
FIG. 3 is a flow diagram of the steps involved in applying an enhancement
algorithm to the camera of FIG. 2;
FIG. 4 is a block diagram of the capture chain showing the points at which
processing according to the invention may occur;
FIG. 5 is a flow diagram of the steps involved in processing an image
sometime after storage in the camera of FIG. 2;
FIG. 6 is a flow diagram of the steps involved in interrupt processing in
the camera of FIG. 2;
FIG. 7 is a flow diagram of the steps involved in controlling access to
processing in the camera of FIG. 2;
FIG. 8 is a pictorial illustration of the application of pre-existing
overlay images to images captured by the camera of FIG. 2;
FIG. 9 is a pictorial illustration of the use of an electronic viewfinder
in the camera of FIG. 2 to frame the captured image with respect to an
overlay image;
FIG. 10 shows an additional embodiment of an electronic camera configured
according to the invention; and
FIG. 11 shows an electronic imaging system incorporating the camera of FIG.
10 by means of a cable connection.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
Because electronic still cameras employing electronic sensors are well
known, the present description will be directed in particular to elements
forming part of, or cooperating more directly with, apparatus in
accordance with the present invention. Elements not specifically shown or
described herein may be selected from those known in the art.
FIG. 1 shows a known electronic still photography system useful for
inputting images to a computer. The system includes an electronic camera 1
with an electronic sensing section 1a, a digital processing section 1b, a
memory card slot 2, a removable memory card 3, a computer 4 with a
built-in memory card reader 5, and a printer 6. Images are captured by the
sensing section 1a in the camera 1, manipulated in the processing section
1b, stored on the memory card 3, and transferred from the card 3 to the
computer 4. The software used to control the sensing and processing
sections 1a and 1b in the camera is entirely located in firmware memory 7
in the camera 1 and cannot be updated without opening the camera cover,
unsoldering the firmware memory circuit, and replacing it with a new
circuit containing updated code. The application software used to control
the playback operations of the computer is supplied, at least in part, by
the camera manufacturer. It is stored in a computer hard drive 8, and
downloaded to a computer random access memory (RAM) memory 9a, where the
program is used by the central processing unit (CPU) 9b. To update this
software, the user must be provided with a new program on a floppy disc,
which can be transferred to the hard drive 8. For example, the floppy disk
may contain a "plug-in" module for an imaging software application
provided with the camera. The plug-in contains both code to allow the
images to be downloaded from the camera to the computer, and software code
to create color images from the digitized camera image data. The software
code implements algorithms for processing the color filter array sampled
image data supplied by the camera. These algorithm | | |
