WikiPatents - Community Patent Review
Create Free Account  |  License or Sell Your Patent  |  WikiPatents Marketplace  |  WikiPatents Blog
Username:  Password:  
    
Advanced Search
Method and apparatus for video presentation from a variety of scanner imaging sources    

Custom CD of patents similar to US5099846 : Method and apparatus for video presentation from a variety of scanner imaging sources - $19.95
United States Patent5099846   
Link to this pagehttp://www.wikipatents.com/5099846.html
Inventor(s)Hardy; Tyrone L. (806 Sagebrush Ct. SE., Albuquerque, NM 87123)
AbstractThe disclosure is directed to a method and apparatus for presenting a plurality of scanning images in a video presentation. The disclosure is particularly directed to the use of such an apparatus and method in stereotactic surgery, wherein acquisition of a plurality of scanner images, conversion of these images into a selected standard format, storage of the acquired and converted images, selective recall and display of at least two of the images, and independent manipulation of each of the images for comparision are provided. Probe placement can be simulated and the images can be enhanced in various ways. The images used can be, for example, CT, PET, X-ray, DSA, isotope, and NMR scans. Brain map atlas images can be superimposed on and fitted to the scan images of a particular brain. Video displays of three dimensional simulations can also be produced.
   














 Title Information Submit all comments and votes
 
Patent Text Patent PDF Print Page Summary File History
Plain text PDF images Print Summary File History
Drawing from US Patent 5099846
Method and apparatus for video presentation from a variety of scanner

     imaging sources - US Patent 5099846 Drawing
Method and apparatus for video presentation from a variety of scanner imaging sources
Inventor     Hardy; Tyrone L. (806 Sagebrush Ct. SE., Albuquerque, NM 87123)
Owner/Assignee    
Patent assignment
All assignments
Company News
Publication Date     March 31, 1992
Application Number     07/290,316
PAIR File History     Application Data   Transaction History
Image File Wrapper   Patent Term   Fees
Litigation
Filing Date     December 23, 1988
US Classification     600/407 378/4 378/98.12 378/98.8 600/417 600/429 606/130
Int'l Classification     A61B 005/05
Examiner     Smith; Ruth S.
Assistant Examiner    
Attorney/Law Firm     Peacock; Deborah A. Duggan; Donovan F. ,
Address
Parent Case    
Priority Data    
USPTO Field of Search     128/653 128/653 AF 128/653 S 128/660.04 364/413.13 364/413.14 364/413.15 364/413.19 364/413.22 364/413.23 364/224.5 364/224.6 364/237.1 606/130
Patent Tags     video presentation variety scanner imaging sources
   
Enter a comma (,) or semicolon (;) between multiple tag words/phrases.
Describe this patent:
 Amusing   
 Clever   
 Complex   
 Efficient   
 Historic   
 Important   
 Innovative   
 Interesting   
 Practical   
 Simple   
[no votes]
Patent WIKI

Share information and news about this patent, including information and news about the technology, inventors, company, ligation and licensing.

 References Submit all comments and votes
 
*references marked with an asterisk below are user-added references
 U.S. References
 
Add a new US reference:  
ReferenceRelevancyCommentsReferenceRelevancyComments
4977505
Pelizzari
600/425
Dec,1990

[0 after 0 votes]
4884566
Mountz
606/130
Dec,1989

[0 after 0 votes]
4790026
Gennery
382/303
Dec,1988

[0 after 0 votes]
4653112
Ouimette
382/128
Mar,1987

[0 after 0 votes]
4598368
Umemura
708/308
Jul,1986

[0 after 0 votes]
4079450
Grimm
345/180
Mar,1978

[0 after 0 votes]
 Foreign References
 Other References
 Market Review Submit all comments and votes
   
Market Size
Estimate the gross annual revenues of the relevant market sector:
> $10B
$5B - $10B
$2B - $5B
$500M - $2B
$100M - $500M
$10M - $100M
$1M - $10M
$500K - $1M
$100K - $500K
< $100K
[No votes]
$0
 
$0   $2.5B   $5B   $7.5B   $10B

[0 market size comments]
Market Share
Estimate the percentage of the relevant market sector this invention will capture:
75% - 100%
50% - 74.99%
25% - 49.99%
10 - 24.99%
5 - 9.99%
2 - 4.99%
1 - 1.99%
< 1%
[No votes]
0.0%
 
0%   25%   50%   75%   100%

[0 market share comments]
Reasonable Royalty
What percentage of gross sales should the inventor or assignee be paid?
75% - 100%
50% - 74.99%
25% - 49.99%
10 - 24.99%
5 - 9.99%
2 - 4.99%
1 - 1.99%
< 1%
[No votes]
0.0%
 
0%   25%   50%   75%   100%

[0 reasonable royalty comments]
Public's "Guesstimation" of Royalty Value
Market SizeN/A[No votes]
xMarket ShareN/A[No votes]
xReasonable RoyaltyN/A[No votes]

N/A

[0 Guesstimation of Royalty Value Comments]
License Availablity
If you are NOT the owner or assignee, answer here:
Yes, license is available for purchase

No, license is not currently available



[No votes]
[0 license availability comments]
License Availablity
If you ARE the owner or assignee, answer here:
Yes, license is available for purchase

No, license is not currently available



[No votes]
[0 owner/assignee comments]
Competitive Advantage
Does this invention have a significant competitive advantage over similar technologies?
Yes

No



[No votes]
Most helpful competitive advantage comment
[No comments]

[0 competitive advantage comments]
Commercial Alternatives
Are there viable commercial alternatives for this invention?
Yes

No



[No votes]
Most helpful commercial alternative comment
[No comments]

[0 commercial alternatives comments]
 Technical Review Submit all comments and votes
 Claims Submit all comments and votes
 


I claim:

1. An apparatus for generating a video presentation of images from a variety of separate scanner imaging sources, the apparatus comprising:

means for acquiring a plurality of images from a variety of separate scanner imaging sources;

means for converting said acquired images into a selected format;

means for storing said acquired and converted plurality of images;

means for selectively recalling and displaying upon a single monitor at least two independent images of said stored plurality of images;

means for manipulating each of said selected independent images independently of each other;

means for comparing said selected independent images; and

means for determining stereotactic coordinates and performing volumetric determinations from said plurality of images.

2. The invention of claim 1 wherein said manipulating means comprises means for shaping and sizing at least one of said selected images to conform to at least one other selected image in shape and size.

3. The invention of claim 2 further comprising means for superimposing at least one selected image upon at least one other selected image.

4. The invention of claim 1 wherein said means for comparing the selected images comprises means for contrasting characteristics of at least two selected images comprises the use of at least one procedure selected from the group consisting of filtering, smoothing, sharpening, pseudocoloring, and edge detection.

5. The invention of claim 4 wherein said edge detection procedure comprises at least one method selected from the group consisting of Laplacian, Roberts, Sorbel, and Frei procedures.

6. The invention of claim 1 wherein said image acquiring means comprises means for obtaining at least one image directly from a scanner without the use of magnetic transport media.

7. The invention of claim 1 further comprising means for recording and archiving the procedural use of said apparatus.

8. The invention of claim 1 wherein all said means are software-programmable.

9. For use in stereotactic surgery, an apparatus for generating a video presentation of brain images from a variety of separate brain scanner imaging sources to provide a representation of the anatomical and physiological configuration of the brain of a patient, said apparatus comprising:

means for acquiring a plurality of brain-related images from a variety of separate brain scanner imaging sources, at least one such image being of the actual patient's brain;

means for converting said acquired images into a selected format;

means for storing said acquired and converted plurality of images;

means for selectively recalling and displaying upon a single monitor at least two independent images of said stored plurality of images;

means for manipulating at least one of said selected independent images independently of each other;

means for comparing said manipulated independent image to at least one other of said selected independent images; and

means for determining stereotactic coordinates and performing volumetric determinations from said plurality of images.

10. The invention of claim 9 wherein said image acquiring means comprises means for obtaining images from a brain map atlas and said manipulation means comprises means for fitting at least one map from said atlas to at least one selected image of the patient's brain.

11. The invention of claim 9 wherein said manipulating means comprises means for shaping and sizing at least one of said selected images to conform to at least one other selected image in shape and size.

12. The invention of claim 11 further comprising means for superimposing at least one selected image upon at least one other selected image.

13. The invention of claim 9 wherein said means for comparing said selected images comprises means for contrasting characteristics of at least two selected images comprises the use of at least one procedure selected from the group consisting of filtering, smoothing, sharpening, pseudocoloring, and edge detection.

14. The invention of claim 13 wherein said edge detection procedure comprises at least one method selected from the group consisting of Laplacian, Roberts, Sorbel, and Frei procedures.

15. The invention of claim 9 further comprising means for simulating brain probe means and means for simulating manipulation of said probe means within a video presentation.

16. The invention of claim 9 further comprising means for simulating electrode means and means for simulating manipulation of said electrode means within a video presentation.

17. The invention of claim 9 further comprising means for storing representations of physiological response points and means for selectively recalling and displaying any of said response points within the video presentation.

18. The invention of claim 9 further comprising means for providing stereotactic coordinates for a user selected point on the video presentation.

19. The invention of claim 9 wherein said image acquiring means comprises at least one means for acquiring an image from a scanner selected from the procedures consisting of computerized axial tomography (CT) scanning, nuclear magnetic resonance (NMR) scanning, positron emission tomography (PET) scanning, isotope scanning, digital subtraction angiography (DSA) scanning, and X-ray scanning.

20. The invention of claim 9 wherein said image acquisition means acquires any of a predetermined number of image types.

21. The invention of claim 9 further comprising means providing for a user to input data within a sterile environment.

22. The invention of claim 21 wherein said user input providing means comprises an infrared grid disposed across said image displaying means.

23. The invention of claim 22 further comprising means for measuring distances, volumes, and areas within the actual patient's brain.

24. The invention of claim 9 further comprising means for generating a simulated three-dimensional image of the actual patient's brain.

25. The invention of claim 24 wherein said simulated three-dimensional image comprises an image representative of at least one image selected from the groups consisting of computer axial tomography (CT) images, nuclear magnetic resonance (NMR) images, positron emission tomography (PET) images, digital subtraction angiography (DSA) images, isotope images, and X-ray images.

26. The invention of claim 25 wherein said simulated three-dimensional image comprises a composite of images from more than one source.

27. The invention of claim 9 further comprising means for determining optimum placement for an isodose implantation.

28. The invention of claim 9 further comprising means for determining optimum dosage for an isodose implantation.

29. The invention of claim 9 further comprising means for recording and archiving the procedural use of said apparatus.

30. The invention of claim 9 wherein all said means are software-programmable.

31. A method of generating a video presentation of images from a variety of separate scanner imaging sources, the method comprising the steps of:

a) acquiring a plurality of images from a variety of separate scanner imaging sources;

b) converting the acquired images into a selected format;

c) storing the acquired and converted plurality of images;

d) selectively recalling and displaying upon a single monitor at least two independent images of the stored plurality of images;

e) manipulating each of the selected independent images and comparing the selected independent images independently of each other; and

f) determining stereotactic coordinates and performing volumetric determinations from the plurality of images.

32. The invention of claim 31 wherein the manipulating step in e) comprises shaping and sizing at least one of the selected images to conform to at least one other selected image in shape and size.

33. The invention of claim 32 further comprising superimposing at least one selected image upon at least one other selected image.

34. The invention of claim 31 wherein the step of comparing the selected images in e) comprises contrasting characteristics of at least two selected images comprises the use of at least one procedure selected from the group consisting of filtering, smoothing, sharpening, pseudocoloring, and edge detection.

35. The invention of claim 34 wherein the edge detection procedure comprises at least one method selected from the group consisting of Laplacian, Roberts, Sorbel, and Frei procedures.

36. The invention of claim 31 wherein the image acquiring step in a) comprises obtaining at least one image directly from a scanner without the use of magnetic transport media.

37. The invention of claim 31 further comprising the step of recording and archiving the steps taken in practicing the method.

38. In stereotactic surgery, a method of generating a video presentation of brain images from a variety of separate brain scanner imaging sources to provide a representation of the anatomical and physiological configuration of the brain of a patient, the method comprising the steps of:

a) acquiring a plurality of brain-related images from a variety of separate brain scanner imaging sources, at least one such image being of the actual patient's brain;

b) converting the acquired images into a selected format;

c) storing the acquired and converted plurality of images;

d) selectively recalling and displaying upon a single monitor at least two independent images of the stored plurality of images;

e) manipulating at least one of the selected independent images independently of each other and comparing the manipulated independent image to at least one other of the selected independent images; and

f) determining stereotactic coordinates and performing volumetric determinations from the plurality of images.

39. The invention of claim 38 wherein the acquiring step in a) comprises obtaining images from a brain map atlas and the manipulation step comprises fitting at least one map from the atlas to at least one selected image of the patient's brain.

40. The invention of claim 38 wherein the manipulating step in e) comprises shaping and sizing at least one of the selected images to conform to at least one other selected image in shape and size.

41. The invention of claim 40 further comprising superimposing at least one selected image upon at least one other selected image.

42. The invention of claim 38 wherein the step of comparing the selected images in e) comprises contrasting characteristics of at least two selected images comprises the use of at least one procedure selected from the group consisting of filtering, smoothing, sharpening, pseudocoloring and edge detection.

43. The invention of claim 42 wherein the edge detection procedure comprises at least one method selected from the group consisting of Laplacian, Roberts, Sorbel, and Frei procedures.

44. The invention of claim 38 further comprising the step of obtaining within the actual patient's brain at least one measurement selected from the group consisting of the distance between two points within the patient's brain, the area of a selected portion of the patient's brain, and the volume of a selected part of the patient's brain.

45. The invention of claim 38 further comprising generating a simulated three-dimensional image of the actual patient's brain.

46. The invention of claim 45 wherein the three-dimensional simulation image comprises an image representative of at least one image selected from the groups consisting of computerized axial tomography (CT) images, nuclear magnetic resonance (NMR) images, positron emission tomography (PET) images, digital subtraction angiography (DSA) images, isotope images, and X-ray images.

47. The invention of claim 45 wherein the three-dimensional simulation image comprises a composite of images from more than one source.

48. The invention of claim 38 further comprising the step of determining optimum placement for an isodose implantation.

49. The invention of claim 38 further comprising the step of determining optimum dosage for an isodose implantation.

50. The invention of claim 38 further comprising the step of recording and archiving the steps taken in practicing the method.
 Description Submit all comments and votes
 


A portion of the disclosure of this patent document contains material which is subject to copyright protection. The owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.

Computer program listings comprising sequences of instructions, routines, and other contents are provided in the microfiche appendix, which is incorporated herein by reference. The microfiche appendix consists of 8 sheets of microfiche, each sheet having 65 frames, not all of which have been used.

FIELD OF THE INVENTION

The invention relates to video presentation and more particularly to a method and apparatus for generating a video presentation from a variety of scanner imaging sources, in particular for stereotactic surgery.

BACKGROUND OF THE INVENTION

Stereotactic surgical techniques allow physiological exploration and/or destruction of deep cerebral or spinal cord structures which are invisible from the surface, but which location can be determined by a knowledge of their coordinates in space relative to known anatomical and topographical landmarks. The use of stereotaxis in neurosurgical techniques seeks to avoid open operative approaches to these areas with a minimum of disturbance to surrounding structures. The technique generally involves the placement of fine electrodes or probes in strategic "target areas" which may comprise specific functional anatomical sites or morphological lesions or abnormalities. One of the major difficulties of stereotactic surgery is graphic conceptualization of the location of surgical probes inserted into deep brain structures. Not only is the probe out of the surgeon's sight, but it is tilted, rotated, and extended in many different directions, which circumstance makes it almost impossible for the surgeon to maintain a mental picture of the location of the probe in the brain core. The surgeon must imagine the location of the probe while taking into account the forward and lateral angles of the probe, the distance of the probe from the target, the direction that the electrode extends from the probe, and many other angular variables. Furthermore, the coordinate system of the stereotactic frame seldom corresponds to the "brain coordinate system," causing greater margin of error and difficulty in placement of the probe. Stereotactic surgery, therefore, is essentially a "blind" surgical procedure with many complex geometric variables. Any system which will enhance the surgeon's conceptualization of the procedure will greatly enhance its efficacy.

The introduction of stereotaxis to the armamentarium of human neurosurgical technique has been an important addition. This is evident by its use in the treatment of many neurological disorders. This technique has expanded from its earlier use, primarily in the treatment of dyskinesias and pain syndromes, to include the treatment of seizure disorders, aneurysms, brain tumors and many other neuropathological conditions. In recent years there has been a significant increase in the number and use of stereotactic surgical techniques. This has been brought about by the development of new imaging technologies, for example, computerized axial tomography (CT), nuclear magnetic resonance (NMR) scanning, various radioisotope scanning techniques, and digital subtraction angiography (DSA). These imaging techniques allow the surgeon to "see" certain brain structures and to use these imaging technologies to aid in planning stereotactic surgical procedures.

Computed tomography (CT) is well established as a valuable diagnostic and investigative imaging device and has revolutionized the evaluation and treatment of neurological conditions. Applications and use of CT technology with stereotactic and functional neurosurgery are increasing. Advancing computer technology has been the basis upon which CT scanning technology has developed; this same technology is supporting the development of the newer digital subtraction angiographic (DSA), various radioisotope scanning, and nuclear magnetic resonance (NMR) imaging systems.

The increased resolution afforded by such scanning systems allows direct identification of brain structures that could only be inferred from conventional roentgenological techniques. Stereotactic surgery, being primarily a procedure performed without the aid of direct visualization, is dependent on sophisticated imaging techniques for its accurate execution. Therefore, it necessarily follows that as computer and imaging technology improve, so do the possibilities of stereotactic surgery. The present invention is primarily concerned with the use of computer-graphics techniques and scanning techniques for generating various composite images to better aid the stereotactic surgeon in localizing structures, such as subcortical structures, lesions, or abnormalities.

Non-computer systems have been developed in the art for stereotactic surgery. These systems use spatial coordinate determinations based upon the use of special plastic type grids and measurement devices. These systems are based upon hand plotting and calculation of coordinate positions. Some disadvantages to such systems are that they are cumbersome, slow, relatively inaccurate, have very limited use, and are specific for only one type of scanning device and manufacturer.

Software routines on hand-held calculators, e.g., HP41C, Sharp, and Epson HX20, have also been developed in the art for use with stereotactic surgery. Calculations are done by the use of a calculator instead of a grid and specific measuring instruments. Parameters for coordinate determination are entered into the calculator's functions by the use of similar grids. Some disadvantages of these systems are the same as the non-computer spatial coordinate systems described above.

Some parent scanning devices, e.g., CT scanner, NMR scanner, etc., contain resident software systems. Rule grids are placed over the image in the scanner via a software graphics package of limited capabilities. Accuracy is limited, since measurements are done in "screen coordinates" and therefore the systems do not take into consideration various rotations of the patient's head or other body parts in the scanning device. These are purely systems for calculating coordinates and have no operative simulating capabilities. CT scanners and NMR scanners also have some image manipulation routines which consist of various means of ramping image grey scales for contrasting; however, they contain none of the other features of the present invention, such as brain anatomical mapping techniques, electrophysiological mapping, extensive image manipulation, image comparison, 3-D simulations, etc. By design, each of these systems is limited to use in a specific scanner and its use must be sanctioned by the scanner designer, such as shown in "The Role of Computed Tomographic and Digital Radiographic Techniques in Stereotactic Procedures for Electrode Implantation and Mapping, and Lesion Localization," by T. M. Peters, et al., Appl. Neurophysiol., Vol. 46, pp. 200-205 (1983). Image sources from several different scanners cannot be compared. Too, all functions must be carried out in each specific scanner device which monopolizes the scanner's use. Another disadvantage is that improvements or modifications to these systems cannot be made as scanner manufacturers tend to resist or disallow the addition of non-proprietary software and/or hardware to their scanning systems since they are potentially at risk of incurring additional liability should the software and/or hardware not function as intended.

Other prior art systems utilize IBM PC type computers, including clones, and other desktop type personal computer versions. In some of these versions, either a camera input interface is used to acquire scan images from an X-ray plate type hard copy into the computer's video display, or magnetic transport media is utilized, most notably magnetic computer tapes. One disadvantage of these systems is that these existing interface designs rely upon the digitized images acquired through a camera input. The camera is mounted over an X-ray type hard copy image of the scanner image section to obtain an image. These systems can be inherently inaccurate because they use various kinds of camera lens designs and different image aberrations result from different lens designs. These include warping and distortion of the image due to chromatic aberration, spherical aberration, coma, astigmatism, and various other aberrations which result from deviation of refracted or reflected light rays from a single focus, or their convergence to different foci, due to the spherical shape of the lens or mirror. It is difficult to adjust or compensate for these problems. Another disadvantage is that existing interface designs rely upon the transportation of digital data from the original scanning source via use of magnetic transport media, most commonly tapes or floppy disks. Such transport media are not standardized and different scanner manufacturers use different digital formatting methods and formats in their systems. Marketing and servicing any system utilizing magnetic transport media to obtain images is extremely difficult due to tremendous and variable software overhead and frequently incompatible hardware designs of magnetic tape and disk drives. Such systems are heavily dependent upon acquiring proprietary information from the scanning device manufacturers with regards to how their image is digitally formatted. The digital format of images varies considerably among scanner types, scanner manufacturers, and even scanner versions from a single manufacturer. Transportation and use of such systems has to be custom designed for each scanner at different institutions and frequently has to be changed, depending upon the particular image formatting version used at an institutional scanning site. Software overhead is therefore extensive and almost impossible to service. Furthermore, these systems are difficult to use since there is also considerable incompatibility among tape manufacturers, tape reading methods, and hardware. Such systems can be quite confusing for the user. Furthermore, such systems have limited use since they do not have the computer processing power which is currently available in faster outputting systems, and have no specific means of comparing images from different scanning sources. Some of these systems, however, have some rudimentary image manipulation and simulation capabilities.

Devices utilizing large computer systems which use magnetic transport media and multiple image displays also exist. There is currently one system apparently available for use which is resident in a large scanner computer which uses a tape interface for acquiring images from several sources and displays the images on a plurality of monitors. One disadvantage of such device, as previously discussed, concerns the inherent difficulties associated with magnetic transport media. In addition, difficulties encountered with resident software systems, also previously discussed, are present in this large computer using system. This system is additionally particularly large and costly and requires a computer engineer to competently operate the system, which is beyond the ability of the average neurosurgeon to operate by himself. Significantly, separate images from separate sources cannot be compared one to another or overlayed in the system. And, because of the system's very large size, it has to be housed in a separate operative suite which adds to its expense. A prior device designed by Patrick Kelly, et al., manufactured by Stereotactic Medical Systems, Inc., is such a system as described above.

The images acquired by these various prior art scanning techniques are not standardized in a common format and no method for comparing and using images from various scanners has been developed. The method and apparatus of the present invention have solved this problem, as well as other problems discussed above.

Another prior art imaging system, developed by Tyrone L. Hardy, M.D., and others (Thompson, C. J., Hardy, T. L., and Bertrand, G.; "A System for Anatomical and Functional Mapping of the Human Thalamus," Comput. Biomed. Res., Vol. 19, pp. 9-24, 1977) was designed to run on a Digital Equipment Corporation PDP-12 computer with software written in assembly-level and Fortran IV languages. This system was very large and could not be taken into an operating room. The graphics display terminal, which could be taken separately into the operating room, had to be interfaced with the computer by long coaxial linkages. Its operation was cumbersome but necessary, given the hardware constraints inherent in the computer design. Stereotactic brain maps of the diencephalon were utilized in this system. These stereotactic brain maps were the architectonics by R. Hassler ("Anatomy of the Thalamus;" Introduction to Stereotaxy with an Atlas of the Human Brain, Vol 1; G. Schaltenbrand and P. Bailey, eds. Stuttgart: Thieme, 1959, pp. 230-290) and Van Buren and Borke (Van Buren, J. M., and Borke, R. C.: "Variations and Connections of the Human Thalamus" (Springer, N.Y., 1972)), which were digitized for use in the computer. Software routines for modifying the computer displays of the brain maps corrected deficiencies in anatomical sectioning (the horizontal sections vary 8 degrees from the intercommissural plane) and variations in the sizes of the atlas maps (the frontal maps were considerably smaller than the horizontal maps). The coordinate system for the digitized atlas map sections were based, as those of the anatomical atlas maps, on a brain coordinate system constructed about the third ventricular core; that is, an intercommissural line bisected by a midcommissural line and a horizontal line representing the basal plane of the brain. This system was later extensively modified to operate in a much smaller portable computer system by Tyrone L. Hardy and Jay Koch (T. L. Hardy and J. Koch, "CASS: A Program for Computer Assisted Stereotaxic Surgery," Proceedings of the 5th Annual Symposium on Computer Application in Medical Care; Washington, D.C., 1981, pp. 1116-1126), which describes a system which ran on a smaller, more portable DEC PDP-11 MINC computer system with a Tektronix graphics terminal. This system was designed to work with older X-ray imaging technology and not with CT scans, NMR scans or PET or DSA. The system drew map images, simulated probe trajectories and printed electrophysiological data on the display terminal according to various parameters which were typed into certain program requests.

Brain stem and cerebellar maps from the newer Schaltenbrand and Wahren atlas (G. Shaltenbrand and W. Wahren, Atlas for Stereotaxy of the Human Brain (2d Ed.); Stuttgart: Thieme, 1977) afforded an opportunity to expand the computer mapping capabilities to include rhombencephalic structures. Incorporating these maps into this system required the development of a coordinate system that would allow the simultaneous display of diencephalic architectonics and the remaining brain stem and cerebellum. Allowance was also required for variations in the angle of the junction of the diencephalon with the lower brain stem. See Hardy, T. L., Koch, J., "Computer-assisted Stereotactic Surgery," Appl. Neurophysiol. Vol. 45, pp. 396-398, 1982, which describes a software modification to the above-noted system described in the 1981 paper to allow a similar use of brain stem maps and describes the development of a brain stem coordinate system. Both coordinate systems could be moved independently of each other; the size of the brain maps, including the brain-stem length, could be readily varied to match the patient's anatomical dimensions as determined from contrast ventriculograms. This was accomplished by developing a method of intersecting an upper (diencephalic) coordinate system constructed about the third ventricular core, with a lower coordinate system constructed about the fourth ventricle. For example, the angle of intersection will be closer to 90 degrees in a patient with a brachiocephalic brain in which brain-stem angulation is perpendicularly oriented. Adjustments for difference in brain-stem sizes were achieved by a software subroutine that could be prompted to expand or contract the digitized maps. As with the above-noted system described in the 1981 paper, this system was not designed to work with newer imaging technology. After the development of high-resolution, color-graphics raster display monitors that could interface with small computer systems it became possible to improve this system. The computer system was later modified so that it could use such a monitor to display CT images as well as benefit from the addition of color graphics. The result was a portable system which could store, manipulate, and selectively display CT images in the operating room independent of the CT scanner. The previously digitized atlas maps also could be superimposed on CT sections of the diencephalon. This method of graphic operative simulation served as a guide for using CT data in performing functional neurosurgery. However, this system had to be programmed separately for each type of scanner. "Computer Graphics with Computerized Tomography for Functional Neurosurgery, (T. L. Hardy, J. Koch, and A. Lassiter, Appl. Neurophysiol. Vol. 46, pp. 217-226 (1983)), describes a prototype system which could be used with CT imaging technology. This system could simulate probe trajectories but could not determine coordinates. Such parameters had to be entered by typed entry into the computer's program. The system was capable of pseudocolor, but no other image manipulation routines were possible. CT image display was limited to four bits of image capabilities which gave a gray scale capability of 2.sup.4 (16 levels). This system was fraught with difficulties and the hardware design was subsequently abandoned. Some of these difficulties were also due to the CPM based operating system which was slow, cumbersome and extremely difficult to use as a developmental platform. Hardy, T. L., Lassiter, A., and Koch, J., "A Portable Computerized Tomographic Method for Tumor Biopsy", Acta. Neurochir. [Suppl.], (Wien), p. 444, 1983, describes the above-noted system as a laboratory model for simulating tumor biopsy.

SUMMARY OF THE INVENTION

In accordance with the present invention, there is provided a method and apparatus for generating a video presentation of images from a variety of separate scanner imaging sources. The method of the invention comprises the steps of acquiring a plurality of images from a variety of separate scanner imaging sources, converting the acquired images into a selected format, storing the acquired and converted plurality of images, selectively recalling and displaying at least two of the stored plurality of images, and independently manipulating each of the selected images and comparing the selected images. The manipulating step preferably comprises shaping and sizing at least one of the selected images to conform to at least one other selected image in shape and size. The method may further comprise superimposing at least one selected image upon at least one other selected image. The method may also comprise a step of comparing the selected images, contrasting characteristics of at least two selected images using at least one of the procedures of filtering, smoothing, sharpening, pseudocoloring and edge detection. The edge detection procedure can be, for example, a Laplacian, a Roberts, a Sorbel, or a Frei procedure. The image acquiring step can comprise obtaining at least one image directly from a scanner without the use of magnetic transport media. The sequence of steps taken by a user can be recorded and archived.

The method of the invention is preferably practiced in stereotactic surgery, and comprises generating a video presentation of brain images from a variety of separate brain scanner imaging sources to provide a representation of the anatomical and physiological configuration of the brain of a patient. The method comprises the steps of acquiring a plurality of brain-related images from a variety of separate brain scanner imaging sources, at least one such image being of the actual patient's brain, converting the acquired images into a selected format, storing the acquired and converted plurality of images, selectively recalling and displaying at least two of the stored plurality of images, and independently manipulating at least one of the selected images and comparing the manipulated image to at least one other of the selected images. The acquiring step can comprise obtaining images from a brain map atlas and the manipulation step comprises fitting at least one map from the atlas to at least one selected image of the patient's brain. The manipulating step can comprise shaping and sizing at least one of the selected images to conform to at least one other selected image in shape and size. The method can further comprise superimposing at least one selected image upon at least one other selected image. The step of comparing the selected images can comprise contrasting characteristics of at least two selected images using filtering, smoothing, sharpening, pseudocoloring, or edge detection. The edge detection procedure can be a Laplacian, Roberts, Sorbel, or Frei procedure. The method can additionally comprise the step of measuring the distance between two points within the actual patient's brain, the area of a selected portion of the brain, and the volume of a selected part of the brain. The method can comprise generating a simulated three-dimensional image of the actual patient's brain, the three-dimensional simulation image preferably being representative of an image such as a computerized axial tomography (CT) image, a nuclear magnetic resonance (NMR) image, a positron emission tomography (PET) image, a digital subtraction angiography (DSA) image, isotope image, and an X-ray image. The three-dimensional simulation image comprises a composite of images from more than one source. The method can further comprise a step for determining optimum placement or dosage for an isodose implantation. An archiving step can be used to record and store the steps taken by a user.

The invention additionally comprises an apparatus for generating a video presentation of images from a variety of separate scanner imaging sources. The apparatus comprises structure for acquiring a plurality of images from a variety of separate scanner imaging sources and for converting the acquired images into a selected format. Storage is provided for the acquired and converted plurality of images. Structure for selectively recalling and displaying at least two of the stored plurality of images, for independently manipulating each of the selected images and for comparing the selected images is also provided. The image manipulating structure preferably comprises structure for shaping and sizing at least one of the selected images to conform to at least one other selected image in shape and size. The apparatus can further comprise structure for superimposing at least one selected image upon at least one other selected image. The structure for comparing the selected images preferably comprises structure for contrasting characteristics of at least two selected images using filtering, smoothing, sharpening, pseudocoloring, or edge detection. The edge detection procedure can be a Laplacian, a Roberts, a Sorbel, or a Frei procedure. The image acquiring structure can comprise structure for obtaining at least one image directly from a scanner without the use of magnetic transport media. Storage or archiving means can be provided for storing the user's procedural steps.

The apparatus of the invention is preferably for use in stereotactic surgery and comprises an apparatus for generating a video presentation of brain images from a variety of separate brain scanner imaging sources to provide a representation of the anatomical and physiological configuration of the brain of a patient. The apparatus comprises structure for acquiring a plurality of brain-related images from a variety of separate brain scanner imaging sources, at least one such image being of the actual patient's brain, structure for converting the acquired images into a selected format, structure for storing the acquired and converted plurality of images, for selectively recalling and displaying at least two of the stored plurality of images, for independently manipulating at least one of the selected images and for comparing the manipulated image to at least one other of the selected images. The image acquiring structure preferably comprises structure for obtaining images from a brain map atlas and the image manipulation structure preferably comprises structure for fitting at least one map from the atlas to at least one selected image of the patient's brain. The manipulating structure preferably comprises structure for shaping and sizing at least one of the selected images to conform to at least one other selected image in shape and size. The apparatus can further comprise structure for superimposing at least one selected image upon at least one other selected image. The structure for comparing the selected images can comprise structure for contrasting characteristics of at least two selected images using filtering, smoothing, sharpening, pseudocoloring, or edge detection. The edge detection procedure can be a Laplacian, a Roberts, a Sorbel, or a Frei procedure. The apparatus can further comprise structure for simulating a brain probe and structure for simulating manipulation of the probe within a video presentation. The apparatus can further comprise structure for simulating one or more electrodes and for simulating manipulation of electrodes within a video presentation. The apparatus can further comprise structure for storing representations of physiological response points and for selectively recalling and displaying any of the response points within a video presentation. The apparatus can further comprise structure for providing stereotactic coordinates for a user selected point on a video presentation. The image acquiring structure prefer