|
References  |
|
|
| *references marked with an asterisk below are user-added references |
|
U.S. References |
|
|
| Add a new US reference: |
| | Reference | Relevancy | Comments | Reference | Relevancy | Comments | 5321520 Inga 358/403 Jun,1994 |      Your vote accepted [0 after 0 votes] | | 5297034 Weinstein
Mar,1994 |      Your vote accepted [0 after 0 votes] | | 5291401 Robinson 382/132 Mar,1994 |      Your vote accepted [0 after 0 votes] | | 5272760 Echerer 382/132 Dec,1993 |      Your vote accepted [0 after 0 votes] | | 5249066 Fukuda 382/233 Sep,1993 |      Your vote accepted [0 after 0 votes] | | 5204756 Chevion 382/239 Apr,1993 |      Your vote accepted [0 after 0 votes] | | 5202935 Kanamori 382/162 Apr,1993 |      Your vote accepted [0 after 0 votes] | | 5189526 Sasson 382/246 Feb,1993 |      Your vote accepted [0 after 0 votes] | | 5166987 Kageyama
Nov,1992 |      Your vote accepted [0 after 0 votes] | | 5164831 Kuchta 348/231.7 Nov,1992 |      Your vote accepted [0 after 0 votes] | | 5128776 Scorse 382/240 Jul,1992 |      Your vote accepted [0 after 0 votes] | | 5058186 Miyaoka 382/154 Oct,1991 |      Your vote accepted [0 after 0 votes] | | 5042077 Burke 382/169 Aug,1991 |      Your vote accepted [0 after 0 votes] | | 4999715 Porcellio 358/426.01 Mar,1991 |      Your vote accepted [0 after 0 votes] | | 4949049 Botti 330/124R Aug,1990 |      Your vote accepted [0 after 0 votes] | | 4903317 Nishihara 382/244 Feb,1990 |      Your vote accepted [0 after 0 votes] | | 4870497 Chamzas 382/240 Sep,1989 |      Your vote accepted [0 after 0 votes] | | 4777598 Kellar 382/131 Oct,1988 |      Your vote accepted [0 after 0 votes] | | 4692806 Anderson 375/240.08 Sep,1987 |      Your vote accepted [0 after 0 votes] | | 4682869 Itoh 358/426.12 Jul,1987 |      Your vote accepted [0 after 0 votes] | | 4633326 Endoh 358/406 Dec,1986 |      Your vote accepted [0 after 0 votes] | | 4222076 Knowlton 358/470 Sep,1980 |      Your vote accepted [0 after 0 votes] | | |
|
|
|
|
U.S. References |
|
|
Foreign References |
|
|
|
|
|
|
Foreign References |
|
|
Other References |
|
|
|
|
|
|
Other References |
|
|
|
|
|
References  |
|
|
Claims  |
|
|
I claim:
1. An interactive method of transmitting detailed image data to a user over a communications channel extending between a transmitting station and a receiving station, comprising the
steps of:
transmitting a user request for image data to the transmitting station;
obtaining a digitized image data set in a computing device at the transmitting station, said image data set defining an image with a spatial resolution;
performing a lossy compression operation on the digitized image data set, using the transmitting station computing device, to produce a lossy compressed image data set;
storing the lossy compressed image data set at the transmitting station;
transmitting the lossy compressed image data set to a computing device at the receiving station with the same said spatial resolution as the digitized image data set;
decompressing the lossy compressed image data set at the receiving station, using the receiving station computing device, to produce a lossy decompressed image data set;
displaying the lossy decompressed image data set on a display device visible to the user at the receiving station, in the form of an image having the said spatial resolution;
providing an input device permitting the user at the receiving station to select at least one window of interest within the displayed image data set;
monitoring the input device to receive a user selection of the window of interest and transmitting information defining the window of interest to the transmitting station;
transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest, but inhibiting the performance of this step until the user interactively requests an
accurate reproduction of the original image data in the currently selected window of interest;
using said additional image data received at the receiving station after the user requests an accurate reproduction of the original image data in the currently selected window of interest, enhancing the displayed image within the window of
interest to produce a display within the window of interest which accurately reproduces the original digitized image data set, while maintaining the same said spatial resolution in the window of interest.
2. The method of claim 1 wherein the user request for image data includes a specification of initial image transmission parameters.
3. The method of claim 2 wherein the user request for image data specifies a desired image quality of the lossy compressed image data set.
4. The method of claim 3 wherein the user request for image data specifies a variable data compression ratio for initial data transmission.
5. The method of claim 2 wherein the user request for image data specifies a first spectral response for the initial image and including the further steps of:
receiving a user input selecting a second spectral response different from said first spectral response and transmitting information requesting said second spectral response to the transmitting station; and
transmitting, from the transmitting station to the receiving station, additional image data for said window of interest to provide a display having said second spectral response within said window of interest.
6. The method of claim 1 wherein a group of windows of interest are selected in different areas of the image and information defining the group of windows is transmitted to the transmitting station to cause transmission to the receiving station
of additional image data pertaining to all of said windows in said group.
7. The method of claim 1 wherein said additional image data is a transmission of the portion of the original digitized data set defining the image in the window of interest.
8. The method of claim 7 including the further steps of losslessly compressing the additional image data at the transmitting station before transmission, and decompressing the received losslessly compressed additional image data at the receiving
station.
9. The method of claim 1 comprising the further steps of:
providing an input device permitting the user at the receiving station to select a direction of interest;
receiving a user selected direction of interest different from a direction of collection of the digitized image data set and transmitting the selected direction of interest to the transmitting station, following the display of the lossy
decompressed image data set at the receiving station;
obtaining a new digitized image data set at the transmitting station, collected in the specified direction of interest; and
repeating the steps of performing a lossy compression operation, transmitting the lossy compressed image data set, decompressing the image data set, and displaying the image data set using the new digitized image data set collected in the
direction of interest before receiving the user selection of the window of interest.
10. The method of claim 1 wherein the transmitting station is located at a first geographic location and the receiving station is located at a second geographic location distinct from said first geographic location.
11. The method of claim 1 wherein the communications channel includes a transmission channel on a communications network linking a plurality of distant stations.
12. The method of claim 11 wherein the communications channel includes a telephone transmission link.
13. The method of claim 1 wherein the communications channel comprises a wireless communications link.
14. The method of claim 13 wherein the communications channel comprises a satellite communication link.
15. The method of claim 1 wherein the communications channel comprises a local area network link.
16. The method of claim 1 wherein said digitized image data set represents a single image and said window of interest specifies a portion of interest within said single image.
17. The method of claim 1 wherein said lossy decompressed image data set has the same number of pixels as the original digitized image data set.
18. The method of claim 1 wherein the user can selectively vary a shape of the selected window and said information transmitted to the transmitting station defining the window of interest includes information defining the selected shape of the
window.
19. The method of claim 1 wherein said lossy decompressed image data set has the same pixel resolution as the digitized image data set prior to transmission.
20. The method of claim 1 comprising the further step of:
until the user requests enhancement of the window of interest to accurately reproduce the original image data, repeating the step of receiving a user selection of a window of interest, and in response to the selection, generating and transmitting
a new lossy compressed image data set to provide a zoom image at the receiving station relating to the selected window of interest.
21. The method of claim 1 wherein the steps of receiving the user selection of the window of interest and transmitting information defining the window of interest to the transmitting station constitute the interactive instruction by the user to
request an accurate reproduction of the original image data in the selected window of interest.
22. An interactive method of transmitting detailed image data to a user over a communications channel extending between a transmitting station and a receiving station, comprising the steps of:
transmitting a user request for image data to the transmitting station;
obtaining a digitized image data set in a computing device at the transmit fine station;
performing a lossy compression operation on the digitized image data set, using the transmitting station computing device, to produce a lossy compressed image data set;
transmitting the lossy compressed image data set to a computing device at the receiving station;
decompressing the lossy compressed image data set at the receiving station, using the receiving station computing device, to produce a lossy decompressed image data set;
displaying the lossy decompressed image data set on a display device visible to the user at the receiving station:
providing an input device permitting the user at the receiving station to select at least one window of interest within the displayed image data set;
monitoring the input device to receive a user selection of the window of interest and transmitting information defining the window of interest to the transmitting station;
transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest;
using said additional image data, enhancing the displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original digitized image data set, wherein said additional image data
is difference data defining changes required to correct errors in the lossy decompressed image data set arising from the lossy compression operation and subsequent decompression; and
inhibiting the performance of the steps of transmitting additional image data and enhancing the display image until the user interactively indicates that an accurate reproduction of the original image data is desired in the currently selected
window of interest.
23. The method of claim 22 wherein said difference data is encoded in a variable length diagonal code prior to said transmission.
24. The method of claim 22 including the further steps of losslessly compressing the additional image data at the transmitting station before transmission, and decompressing the received losslessly compressed additional image data at the
receiving station.
25. A system for interactively transmitting detailed image data over a communications channel extending between a transmitting station and a receiving station under the control of an end user, comprising:
transmitting station computing means for receiving an end user request for image data, obtaining an original digitized image data set at the transmitting station, said original image data set defining an image having a spatial resolution,
performing a lossy compression operation on the digitized image data set to produce a lossy compressed image data set defining an image having the same said spatial resolution as the original image data set, and storing said lossy compressed image data
set at the transmitting station;
transmitting means for transmitting the lossy compressed image data set to the receiving station;
receiving station computing means for receiving the lossy compressed image data set, decompressing the lossy compressed image data set to produce a lossy decompressed image data set, and displaying the lossy decompressed image data set as an
image on a display device visible to the end user at the receiving station with the same said spatial resolution;
command receiving means for receiving a selection by the end user of at least one window of interest within the displayed image and transmitting information defining the window of interest to the transmitting station;
image updating means associated with the transmission station computing means for receiving said information defining the window of interest and transmitting, from the transmitting station to the receiving station, additional image data
pertaining exclusively to the image within said window of interest;
update inhibiting means for receiving a user command at the receiving station indicating that an accurate reproduction of the original image data is desired in the currently selected window of interest, and until said command is received,
inhibiting the operation of said image updating means to transmit said additional image data pertaining exclusively to the image within said window of interest; and
window display enhancing means associated with said receiving station computing means for receiving said additional image data and, while maintaining the display of the window of interest at the same said spatial resolution, enhancing the
displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original image data.
26. The system of claim 25 wherein the means for transmitting a user request includes means for specifying desired initial image transmission parameters.
27. The system of claim 26 wherein the means for transmitting a user request includes means for specifying a desired image quality of the lossy compressed image data set.
28. The system of claim 27 wherein the user request for image data specifies a variable data compression ratio for initial data transmission.
29. The system of claim 26 wherein the means for transmitting a user request includes means for specifying a spectral response for the initial image transmission and means for specifying a different spectral response for a subsequent image
transmission of data within the selected window of interest.
30. The system of claim 25 wherein the command receiving means includes means for receiving end user selections of a window group comprising a plurality of windows of interest in different areas of the image and transmitting specifications of
said group of windows of interest to the transmitting station.
31. The system of claim 25 wherein the image updating means comprises means for transmitting a portion of the original digitized data set defining the image in the window of interest as said additional data.
32. The system of claim 31 wherein the image updating means further comprises means for losslessly compressing the additional image data at the transmitting station before transmission, and the window display enhancing means further includes
means for decompressing received losslessly compressed additional image data at the receiving station.
33. The system of claim 25 further comprising:
reorientation control means associated with the receiving station for receiving a selection of a direction of interest following display of the lossy compressed image data set; and
direction adjustment means associated with the transmitting station computing means for receiving a user selected direction of interest different from a direction of collection of the digitized image data set, obtaining a new digitized image data
set collected in the specified direction of interest, performing a lossy compression operation on the new digitized image data set, and activating the transmitting means to transmit results of the lossy compression operation on the new digitized image
data set to the receiving station.
34. The system of claim 25 wherein the transmitting station is located at a first geographic location and the receiving station is located at a second geographic location distinct from said first geographic location.
35. The system of claim 24 wherein the communications channel includes a telephone transmission link.
36. The system of claim 25 wherein the communications channel includes a transmission channel on a communications network linking a plurality of distant stations.
37. The system of claim 25 wherein the communications channel comprises a wireless communications link.
38. The system of claim 37 wherein the communications channel comprises a satellite communication link.
39. The system of claim 25 wherein the communications channel comprises a local area network link.
40. The system of claim 25 wherein said digitized image data set represents a single image and said window of interest specifies a portion of interest within said single image.
41. The system of claim 25 wherein said lossy decompressed image data set has the same number of pixels as the original digitized image data set.
42. The system of claim 25 wherein the command receiving means comprises window shape varying means for receiving a user instruction to vary a shape the selected window and transmitting information defining the selected shape of the window of
interest to the transmitting station.
43. The system of claim 25 wherein said lossy decompressed image data set has the same pixel resolution as the digitized image data set prior to transmission.
44. The system of claim 25 further comprising zooming means, operating at the transmitting station, for receiving a zoom command from the user and sequentially actuating the image updating means and window enhancement means to generate and
transmit a new lossy compressed zoom image to the receiving station relating to the currently selected window of interest.
45. The system of claim 25 wherein the update inhibiting means is connected with the command receiving means such that the operation of the command receiving means to receive the user selection of the window of interest and transmit information
defining the window of interest to the transmitting station constitutes an interactive instruction by the user to request an accurate reproduction of the original image data in the selected window of interest.
46. A system for interactively transmitting detailed image data over a communications channel extending between a transmitting station and a receiving station under the control of an end user, comprising:
transmitting station computing means for receiving an end user request for image data, obtaining an original digitized image data set at the transmitting station and performing a lossy compression operation on the digitized image data set to
produce a lossy compressed image data set;
transmitting means for transmitting the lossy compressed image data set to the receiving station;
receiving station computing means for receiving the lossy compressed image data set, decompressing the lossy compressed image data set to produce a lossy decompressed image data set and displaying the lossy decompressed image data set as an image
on a display device visible to the end user at the receiving station;
command receiving means for receiving a selection by the end user of at least one window of interest within the displayed image and transmitting information defining the window of interest to the transmitting station;
image updating means associated with the transmission station computing means for receiving said information defining the window of interest and transmitting, from the transmitting station to the receiving station, additional image data
pertaining exclusively to the image within said window of interest; wherein the image updating means further comprises difference data computing means for computing difference data defining changes required to correct errors in the lossy decompressed
image data set arising from the lossy compression operation and subsequent decompression, and said image updating means includes means for transmitting said difference data as said additional data;
update inhibiting means for receiving a user command at the receiving station indicating that an accurate reproduction of the original image data is desired in the currently selected window of interest; and until said command is received,
inhibiting the operation of said image updating means to transmit said additional image data pertaining exclusively to the image within said window of interest; and
window display enhancing means associated with said receiving station computing means for receiving said difference data and enhancing the displayed image within the window of interest to produce a display within the window of interest which
accurately reproduces the original image data.
47. The system of claim 46 wherein the image updating means further comprises encoding means for encoding said difference data in a variable length diagonal code prior to said transmission.
48. The system of claim 46 wherein the image updating means further comprises means for losslessly compressing the additional image data at the transmitting station before transmission, and the window display enhancing means further includes
means for decompressing received losslessly compressed additional image data at the receiving station.
49. An interactive method of transmitting detailed image data to a user over a communications channel extending between a transmitting station and a receiving station, comprising the steps of:
transmitting a user request for image data to the transmitting station;
obtaining a digitized image data set in a computing device at the transmitting station;
performing a lossy compression operation on the digitized image data set, using the transmitting station computing device, to produce a lossy compressed image data set;
storing the transmitted lossy compressed image data set at the transmitting station;
transmitting the lossy compressed image data set to a computing device at the receiving station;
decompressing the lossy compressed image data set at the receiving station, using the receiving station computing device, to produce a lossy decompressed image data set;
displaying the lossy decompressed image data set on a display device visible to the user at the receiving station;
providing an input device permitting the user at the receiving station to select at least one window of interest within the displayed image data set;
monitoring the input device to receive a user selection of the window of interest and transmitting information defining the window of interest to the transmitting station;
transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest;
using said additional image data, enhancing the displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original digitized image data set; and
until the user indicates that an accurate reproduction of the original image data is desired in the currently selected window of interest, inhibiting the performance of the additional image data transmission and display enhancing steps and
iteratively: generating and transmitting, from the transmitting station to the receiving station, a new lossy compressed image data set relating to the window of interest, decompressing and displaying the lossy compressed image data set for the new image
data set relating to the window of interest, and receiving user modifications of the specification of the window of interest.
50. A system for interactively transmitting detailed image data over a communications channel extending between a transmitting station and a receiving station under the control of an end user, comprising:
transmitting station computing means for receiving an end user request for image data, obtaining an original digitized image data set at the transmitting station and performing a lossy compression operation on the digitized image data set to
produce a lossy compressed image data set;
storage means for storing the transmitted lossy compressed image data set at the transmitting station;
transmitting means for transmitting the lossy compressed image data set to the receiving station;
receiving station computing means for receiving the lossy compressed image data set, decompressing the lossy compressed image data set to produce a lossy decompressed image data set, and displaying the lossy decompressed image data set as an
image on a display device visible to the end user at the receiving station;
command receiving means for receiving a selection by the end user of at least one window of interest within the displayed image and transmitting information defining the window of interest to the transmitting station;
image updating means associated with the transmission station computing means for receiving said information defining the window of interest and transmitting, from the transmitting station to the receiving station, additional image data
pertaining exclusively to the image within said window of interest; and
window display enhancing means associated with said receiving station computing means for receiving said additional image data and enhancing the displayed image within the window of interest to produce a display within the window of interest
which accurately reproduces the original image data; and
window selection iterating means associated with the transmitting station for receiving the window of interest information from the command receiving means, and until the user indicates that an accurate reproduction of the original image data is
desired within the currently selected window of interest, iteratively inhibiting the operation of the image updating means and window display enhancing means, generating a new lossy compressed image data set defining an image within the window of
interest, transmitting the new lossy compressed image data set to the receiving station computing means for display, and receiving a new window of interest selection from the user.
51. An interactive method of transmitting detailed image data to a user over a communications channel extending between a transmitting station and a receiving station, comprising the steps of:
transmitting a user request for image data to the transmitting station;
obtaining a digitized image data set in a computing device at the transmitting station;
performing a lossy compression operation on the digitized image data set, using the transmitting station computing device, to produce a lossy compressed image data set;
storing the lossy compressed image data set at the transmitting station;
transmitting the lossy compressed image data set to a computing device at the receiving station;
decompressing the lossy compressed image data set at the receiving station, using the receiving station computing device, to produce a lossy decompressed image data set;
displaying the lossy decompressed image data set on a display device visible to the user at the receiving station;
providing an input device permitting the user at the receiving station to select at least one window of interest within the displayed image data set;
monitoring the input device to receive a user selection of the window of interest and transmitting information defining the window of interest to the transmitting station;
transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest;
using said additional image data, enhancing the displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original digitized image data set; and
until the user interactively indicates that an accurate reproduction of the original image data is desired in the currently selected window of interest, inhibiting the performance of the additional image data transmission and display enhancing
steps. |
|
|
|
|
Claims  |
|
|
Description  |
|
|
FIELD OF THE INVENTION
The present invention relates to a system and method for efficient interactive transmission of image data.
BACKGROUND OF THE INVENTION
It is often desirable to obtain image data of an area of interest and transmit the image data to a person having specialized knowledge, who can then review the image data and make a final decision on the basis of such review. Such transmission
of image data is desirable in many civilian and military applications. For example, it may be desirable to transmit the following types of images to a remote location for review: medical images (teleradiology), archived scientific images, fingerprint
and forensic images, images captured by spacecraft, satellite images of Earth, unmanned vehicle images, security camera output, air and vehicular traffic control images, military reconnaissance images, battlefield inspection images, and remote targeting
images.
In prior art systems, a collected image was most often collected and transmitted automatically, according to a predetermined protocol. In transmitting image data, it is necessary to provide a remotely located reviewer with an image of sufficient
detail so that the desired information can be extracted. Therefore, an image is normally broken down into a very large number of picture elements or "pixels" and transmitted over a communications channel. Unless the channel has a particularly high
channel capacity, the transmission of a detailed image in this manner can take a significant amount of time, and as a result the cost of delivery will be increased.
To reduce image transmission time, earlier systems used data compression techniques. Data can be compressed in a lossy form (i.e. some information is lost due to compression) or in a lossless form in which no original image information is lost
in the compression and subsequent expansion process. U.S. Pat. No. 4,903,317 to Nishihara et al. shows an image processing apparatus for medical diagnosis that uses both lossy and lossless compression in a Huffman code technique. The Nishihara patent
shows a circuit with a memory for storing image data, a loss-compression circuit, an expansion cir | | |