System and method for factoring a merged wave field into independent components

What is claimed is:

1. A method of factoring a merged wave field into independent source signals, wherein each of said independent source signals is generated by a respective one of a plurality of energy sources that together produce said merged wave field, said method comprising:

sensing said merged wave field with an array of sensors;

converting said merged wave field sensed by each of said plurality of sensors into a plurality of electrical sensor signals representing said merged wave field sensed by each of said sensors;

digitizing each of said plurality of electrical sensor signals to form sampled sensor signal data representing said merged wave field sensed by each of said sensors;

establishing a plurality of predicted source signal data arrays, for storing predicted source signal data corresponding to each of said plurality of energy sources;

determining source delay values for each of said plurality of energy sources, wherein said source delay values represent a time differential of each of said independent source signals arriving at each sensor in said array of sensors;

verifying said replicated sensor signal data by combining said predicted source signal data corresponding to each of said energy sources with respective source delay values for each of said plurality of energy sources to produce replicated sensor signal data corresponding to each sensor in said array of sensors and by calculating a prediction verification factor using said replicated sensor signal data and said sampled sensor signal data;

adjusting said predicted source signal data using a random process;

repeating the steps of verifying and adjusting said predicted source signal data for a plurality of iterations until said prediction verification factor reaches a predetermined value wherein said predicted source signals are verified; and

outputting verified predicted source signals as said factored independent source signals.

2. The method of claim 1 wherein said prediction verification factor is the mean squared difference of said sampled sensor signal data and said replicated sensor signal data.

3. The method of claim 1 wherein the step of adjusting said predicted source signal data includes:

a. choosing randomly one of an incremental increase and an incremental decrease of a predicted source signal data element from said predicted source signal data arrays;

b. calculating an incremental prediction verification factor based upon said one of said incremental increase and said incremental decrease of said predicted source signal data element;

c. determining whether to adjust said predicted source signal data element based upon said incremental prediction verification factor; and

d. repeating steps a through c for each predicted source signal data element in each of said predicted source signal data arrays.

4. The method of claim 3 wherein said step of determining whether to adjust said predicted source signal data element based upon said incremental prediction verification factor includes adjusting said predicted source signal data element only if said incremental prediction verification factor is negative.

5. The method of claim 3 wherein said step of determining whether to adjust said predicted source signal data element based upon said incremental prediction verification factor includes:

adjusting said predicted source signal data element if said incremental prediction verification factor is negative; and

adjusting said predicted source signal data element if an exponential function of said incremental prediction verification factor, exp(-dE/T), is greater than a random number between 0 and 1, where dE is said incremental prediction verification factor and T is a control parameter modified with each of said plurality of iterations.

6. The method of claim 3 wherein calculating said prediction verification factor includes:

subtracting said replicated sensor signal data from said sampled sensor signal data resulting in test arrays corresponding to each of said sensors;

squaring each data element in said test arrays;

summing the squared data elements over all of said test arrays; and

dividing the sum by a number of test array elements.

7. The method of claim 1 wherein the step of determining source delay values for each of said plurality of energy sources includes assigning at least one predetermined source delay value based upon an assumed arrangement of said energy sources and said array of sensors.

8. The method of claim 7 wherein said at least one predetermined source delay value includes a right quadrant source delay value and a left quadrant source delay value.

9. The method of claim 1 wherein the step of determining source delay values for each of said plurality of energy sources includes a cross-correlation process.

10. The method of claim 9 wherein said cross-correlation process comprises the steps of:

a. selecting segments of a pair of sampled sensor signals from said sampled sensor signal data;

b. filtering each said segment of said pair of sampled sensor signals to form first and second filtered sensor signal segments;

c. calculating a scalar product of said first and second filtered sensor signal segments;

d. saving said scalar product in a cross correlation array;

e. shifting an index of said first filtered sensor signal segment by one unit to form a shifted first filtered sensor signal segment;

f. repeating steps c-e until said shifted first filtered sensor signal segment has been shifted more than a predetermined maximum number of units; and

g. determining said source delay value based upon an index of said maximum element in said cross-correlation array.

11. The method of claim 10 further including the steps of:

selecting segments of a different pair of sampled sensor signals from said sampled sensor signal data;

repeating cross-correlation steps b-g;

storing each said source delay value in a buffer; and

selecting a most probable source delay value.

12. The method of claim 1 wherein said sensor array includes two sensors, and wherein said plurality of energy sources includes three energy sources.

13. The method of claim 1 wherein said merged wave field is a merged acoustic field having independent acoustic source signals produced by respective acoustic sources, and wherein said array of sensors includes acoustic sensors.

14. The method of claim 13 wherein said acoustic sources include speech sources.

15. The method of claim 13 wherein said array of acoustic sensors includes three acoustic sensors.

16. The method of claim 14 further including:

selecting one of said energy sources as a target source;

converting said factored independent source signal data corresponding to said target source into a factored acoustic signal; and

transmitting said factored acoustic signal to at least one ear of a user.

17. The method of claim 16 wherein said plurality of energy sources include three energy sources and said target source is a center source of said three energy sources.

18. The method of claim 14 further including recording said factored source signal data.

19. The method of claim 1 wherein said merged wave field is a merged electromagnetic field having a plurality of electromagnetic wave components produced by a plurality of electromagnetic sources.

20. A system for factoring a merged wave field into independent source signals, wherein each of said independent source signals is generated by a respective one of a plurality of energy sources that together produce said merged wave field, said system comprising:

an array of sensors, for sensing said merged wave field and converting said merged wave field into a plurality of electrical sensor signals;

a digitizer, responsive to said array of sensors, for digitizing said plurality of electrical sensor signals to form sampled sensor signal data corresponding to each of said array of sensors;

a signal processor, responsive to said digitizer, for processing said plurality of sampled sensor signals and for determining factored source signals, said signal processor including:

sampled sensor signal data arrays, responsive to said digitizer, for storing said sampled sensor signal data for each of said sensors;

predicted source signal data arrays, for storing predicted source signal data corresponding to each of said plurality of energy sources;

a predicted source signal verifier, responsive to said predicted source signal data arrays, for calculating replicated sensor signal data by combining said predicted source signal data with source delay values associated with each of said plurality of energy sources, and for verifying whether said replicated sensor signal data is acceptable by comparing to said sampled sensor signal data; and

a predicted source signal adjuster, responsive to said predicted source signal verifier, for adjusting said predicted source signal data in said predicted source signal arrays until said replicated sensor signal data is acceptable.

21. The system of claim 20 wherein said merged wave field is a merged acoustic field having a plurality of acoustic source signals produced by a plurality of acoustic sources, and wherein said array of sensors includes acoustic sensors.

22. The system of claim 20 wherein said signal processor includes:

a filter, responsive to said sampled sensor signal data arrays, for filtering segments of said sampled sensor signal data;

a source delay calculator, responsive to said filter, for calculating said source delay values using filtered segments of said sampled sensor signal data and a cross correlation process, and wherein said predicted source signal verifier is responsive to said source delay calculator, for receiving said source delay values used to calculated said predicted merged wave field data.

23. The system of claim 20 wherein said predicted source signal verifier calculates a prediction verification factor using said replicated sensor signal data and said sampled sensor signal data.

24. The system of claim 20 wherein said predicted source signal adjuster adjusts said predicted source signal data using a random process and a simulated annealing algorithm.

25. A hearing system for selectively hearing a single sound component in a merged sound field, said single sound component being generated by one of a plurality of sound sources that together produce said merged sound field, said system comprising:

an array of acoustic sensors, for sensing said merged sound field and converting said merged sound field into a plurality of electrical sensor signals;

a digitizer, responsive to said array of acoustic sensors, for digitizing said plurality of electrical sensor signals to form sampled sensor signal data corresponding to each of said array of sensors;

a signal processor, responsive to said digitizer, for processing said plurality of sampled sensor signals and for determining said single sound component, said signal processor including:

sampled sensor signal data arrays, responsive to said digitizer, for storing said sampled sensor signal data for each of said sensors;

predicted source signal data arrays, for storing predicted source signal data corresponding to each of said plurality of sound sources;

a predicted source signal verifier, responsive to said predicted source signal data arrays, for calculating replicated sensor signal data by combining said predicted source signal data with source delay values associated with each of said plurality of sound sources, and for verifying whether said replicated sensor signal data is acceptable by comparing to said sampled sensor signal data; and

a predicted source signal adjuster, responsive to said predicted source signal verifier, for adjusting said predicted source signal data in said predicted source signal arrays until said replicated sensor signal data is acceptable.

Description Submit all comments and votes

FIELD OF THE INVENTION

The present invention relates to signal processing systems and methods and in particular, to a system and method for factoring a merged wave field, such as an acoustic wave field, into independent components or source signals generated by each of the respective energy sources that create the merged wave field.

BACKGROUND OF THE INVENTION

A merged wave field is produced by multiple energy sources, such as acoustic sources, that independently generate source signals that combine to form the merged wave field. A merged wave field can be detected using conventional sensors or transducers and can be processed using conventional signal processing techniques. Prior art signal processing systems, however, have a limited ability to selectively determine the source signals attributed to each of the independent energy sources from a detected merged wave field. Factoring a merged wave field into independent source signals is particularly difficult where the signals generated by the energy sources have a complex waveform, such as speech or other complex acoustic signals.

One type of merged wave field that is commonly detected and processed is an acoustic wave field produced by multiple acoustic sources such as by a hearing aid. Transducers, microphones or other sensors are used to detect the acoustic wave field and conventional signal processing techniques are used to process the detected acoustic signal. The acoustic wave field, however, often includes many undesirable acoustic signals or noises that mask or corrupt the desired signals to be measured, transmitted or further processed. Conventional signal processing systems have attempted to filter these undesirable acoustic signals or noises and focus on one or more of the independent acoustic signals generated by respective acoustic sources.

One of the most common complaints of hearing aid users, for example, is that background noise impedes the understanding of speech. Methods currently used to reduce background noise in hearing aids employ filtering techniques in which the frequency regions containing high noise levels are eliminated. Although some steady state noises, such as automobile or other machine sounds, can be effectively suppressed, human speech is the most difficult type of noise to filter and often the most common type of acoustic noise encountered by a hearing aid. The wearer of a hearing aid often has difficulty focusing on one voice or sound source when faced with multiple voices such as is the case in, for example, party noise or a group conversation.

Another common problem is that of reverberation produced by echoes or acoustic reflections off walls, ceiling, and other surfaces in a room. The reflection of the sound acts like additional virtual independent sound sources and can interfere with both the quality and the intelligibility of the speech being detected.

Existing signal processing techniques have been unable to effectively separate a speech signal from multiple speech sources encountered. Past attempts at suppressing undesirable speech noise have employed multiple microphones and an adaptive array approach. An array of sensors or multiple microphones receive the merged acoustic wave field, and the signals from the array of sensors are combined in such a way that the resulting output maximizes the desired signal with respect to the unwanted signals. The sound or speech that the individual wants to listen to is enhanced and the noise or unwanted acoustic signals are suppressed. This approach depends upon the interaction of the different types of microphones comprising the array and the directional characteristics of the microphones. By co-processing the signals acquired by the different microphones having different directional characteristics, the noise or unwanted signals are canceled relative to the desired sound signal.

This approach has met with limited success in simple conversational settings but is unable to provide an independent source signal from a single sound source. The signal output of the adaptive array approach provides a scalar output, i.e. a weighted sum of the acoustic signals from all of the sound sources. Thus, this approach does not provide an independent acoustic signal from a single sound source alone and therefore is limited when multiple sound sources are present. The adaptive array approach is also highly dependent on microphone directivity and the accurate determination of the bearings of the sound sources. Because of the sensitivity to source bearing errors, the adaptive array approach has difficulty handling the effects of reverberation where the reverberating sound comes from so many directions.

Accordingly, a need exists for a system and method for factoring a merged wave field, such as an acoustic wave field, into independent components or source signals attributed to independent energy sources, such as one or more sound sources. A need exists for a system and method that factors the merged wave field into independent components without being significantly affected by source bearing errors and reverberation. In particular, a need exists for a hearing aid or other type of sound receiving and processing system that can selectively process and transmit a sound signal from a single sound source among multiple sound sources.

SUMMARY OF THE INVENTION

The present invention features a system and method for factoring a merged wave field, such as an acoustic wave field, into independent source signals. Each of the independent source signals is generated by a respective one of a plurality of energy sources, such as acoustic sources, that together produce the merged wave field. The present invention can also be used to factor electromagnetic fields into independent source signals as well as other types of merged energy wave fields generated by a plurality of energy sources.

The method comprises: sensing the merged wave field with an array of sensors; converting the merged wave field sensed by each of the plurality of sensors into a plurality of electrical sensor signals representing the merged wave field sensed by each of the sensors; digitizing each of the electrical sensor signals to form sampled sensor signal data representing the merged wave field sensed by each of the sensors; establishing a plurality of predicted source signal data arrays, for storing predicted source signal data corresponding to each of the energy sources; obtaining source delay values for each of the energy sources, wherein the source delay values represent a time differential of each of the independent source signals arriving at each sensor; verifying the replicated sensor signal data by combining the predicted source signal data corresponding to each of the energy sources with respective source delay values for each of the energy sources to produce replicated sensor signal data corresponding to each sensor and by calculating a prediction verification factor using the replicated sensor signal data and the sampled sensor signal data; adjusting the predicted source signal data using a random process; repeating the steps of verifying and adjusting the predicted source signal data for a plurality of iterations until the prediction verification factor reaches a predetermined value wherein the predicted source signals are verified; and outputting verified predicted source signals as the factored independent source signals.

One example of the prediction verification factor is the mean squared difference of the sampled sensor signal data and the replicated sensor signal data.

The step of adjusting the predicted source signal data preferably includes: (a) randomly choosing one of an incremental increase and an incremental decrease of a predicted source signal data element from the predicted source signal data arrays; (b) calculating an incremental prediction verification factor based upon the chosen incremental increase or incremental decrease of the predicted source signal data element; (c) determining whether to adjust the predicted source signal data element based upon the incremental prediction verification factor; and (d) repeating steps (a) through (c) for each predicted source signal data element in each of the predicted source signal data arrays.

The preferred step of determining whether to accept the adjustment of each of the predicted source signal data values includes: accepting the adjustment if the incremental prediction verification factor is negative; and accepting the adjustment if an exponential function of the incremental prediction verification factor, exp(-dE/T), is greater than a random number between zero and 1, where T is a control parameter modified with each iteration of the step.

According to one method, the step of obtaining the source delay values includes assigning predetermined source delay values for each of the energy sources based upon an assumed arrangement of the sources and sensors. According to another method, the step of obtaining source delay values includes performing a cross correlation process. The cross correlation process comprises the steps of: (a) selecting segments of a pair of sampled sensor signals; (b) filtering each segment of the pair of sampled sensor signals to form first and second filtered sensor signal segments; (c) calculating a scalar product of the first and second filtered sensor signal segments; (d) saving the scalar product in a cross-correlation array; (e) shifting an index of the first filtered sensor signal segment by one unit to form a shifted first filtered sensor signal segment; (f) repeating steps c-e until the shifted first filtered sensor signal segment has been shifted more than a predetermined maximum number of units; and (g) determining the source delay value based upon an index of the maximum element in the cross-correlation array. The cross-correlation process can be repeated using other sampled sensor signals with the source delays saved in a buffer and the most probable source delay selected.

In one example, the method further includes selecting one of the energy sources as a target source; converting the factored independent source signal data corresponding to the target source signal into a factored acoustic signal, and transmitting the factored acoustic signal to one or both ears of a user. Alternatively, the factored source signal data can be recorded or further processed.

The present invention also features a system for factoring the merged wave field into independent source signals. The system comprises an array of sensors, for sensing the merged wave field and converting the merged wave field into a plurality of electrical sensor signals. A digitizer is connected to the array of sensors, for digitizing the electrical sensor signals to form a number of sampled sensor signals corresponding to each of the sensors. A signal processor is connected to the digitizer, for processing the sampled sensor signals and for determining the factored source signals.

The signal processor preferably includes sampled sensor signal data arrays, for storing the plurality of sampled sensor signals and predicted source signal data arrays for storing the predicted source signal data corresponding to each of the energy sources. A predicted source signal verifier is responsive to the predicted source signal data arrays, for calculating replicated sensor signal data by combining the predicted source signal data with source delay values associated with each of the sources, and for verifying whether the replicated sensor signal data is acceptable by comparing them to the sampled sensor signal data. A predicted source signal adjuster, responsive to the predicted source signal verifier, adjusts the predicted source signal data in the predicted source signal arrays until the predicted source signal data is acceptable. In one embodiment, the signal processor further includes a source delay calculator, responsive to the sampled sensor signal data arrays, for calculating the source delays values using a cross-correlation process.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features and advantages of the present invention will be better understood by reading the following detailed description, taken together with the drawings wherein:

FIG. 1 is a schematic block diagram of the system for factoring a merged wave field into independent source signals, according to the present invention;

FIG. 2 is a flow chart illustrating the method of factoring a merged wave field into independent source signals, according to the present invention;

FIG. 3 is a flow chart illustrating a method of using cross-correlation to obtain source delays, according to one embodiment of the present invention; and

FIGS. 4A-4C are flow charts illustrating the method of verifying and adjusting predicted signal components, according to the preferred method of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

The system 10, FIG. 1, for factoring a merged wave field into independent components, according to the present invention, is used to factor a merged wave field 12 into independent signal components or source signals 14a-14c, which are independently generated by respective energy sources 16a-16c such that the source signals 14a-14c combine to produce the merged wave field 12. In the exemplary embodiment, the merged wave field 12 is an acoustic wave field produced by acoustic or sound sources 16a-16c, such as multiple voices or speech sources. The exemplary embodiment contemplates using this system 10 in a number of different applications including, but not limited to, a hearing aid, computer voice recognition, video conferencing, and other applications in which a single speech or sound source must be selected or isolated from among multiple sound sources. The present invention also contemplates using the concepts of the system and method described below to factor electro-magnetic wave fields or any other type of scalar or vector merged energy wave field.

The system 10 includes an array of sensors 18a-18c used to detect the merged wave field 12 and convert the merged wave field 12 into electrical sensor signals 19a-19c. In the exemplary embodiment, the sensors 18a-18c are transducers or microphones capable of detecting acoustic waves. Where the system 10 is used to factor other types of merged wave fields, the array of sensors 18a-18c includes transducers capable of detecting and converting that type of energy wave into an electrical signal.

In the exemplary embodiment, the sensor array includes three sensors--left sensor 18a, center sensor 18b, and right sensor 18c--each spaced apart by a distance d. According to the exemplary application, the system 10 is used to factor a merged wave field 12 formed by three energy sources--a left source 16a, a center source 16b and a right source 16c. The center source 16b is the on-axis source relative to the sensors 18a-18c and the left and right sources 16a, 16c are off-axis sources located in the left and right quadrants respectively. As shown, the left source 16a has a bearing angle .beta..

In the exemplary hearing aid embodiment, three miniature microphones 18 spaced approximately 6 to 8 centimeters on the center apart can be used to sense the sound field of several sound sources 16 having different bearings with respect to the microphones. The three miniature microphones could be placed, for example, on the left and right temple and the nose bridge of an individual's eyeglasses.

Alternatively, the three microphones 18 could be placed with a similar geometry on a barrette secured to the front of the users clothing. The system 10 is preferably used to factor the sound coming from a target source located generally directly ahead of the wearer of the hearing aid. In the example shown in FIG. 1, the target source is the on-axis source or center source 16b which is located generally directly ahead of the center sensor 18b.

As a result of the spacing of the sources 16a-16b and sensors 18a-18b, the source signals 14a-14c arrive at each of the sensors 18a-18c at different times. Each of the energy sources 16a-16c thus has a differential time delay or source delay with respect to each of the sensors 18a-18c. The source delays associated with the respective energy sources 16a-16c are used to determine the factored source signals, as will be described in greater detail below.

According to the exemplary arrangement of sources 16a-16c and sensors 18a-18c shown in FIG. 1, the on-axis or center source 16b generally has a zero differential time delay for the time of arrival at each of the sensors 18a-18c. For signals arriving from the left and right sources 16a, 16c, the off axis bearing produces differential time delays among the sensors 18a-18c. In other words, the left source 16a has a left source delay dt.sub.l at the left sensor 18a with respect to the center sensor 18b, and the right source 16c has a right source delay dt.sub.r at the right sensor 18c with respect to the center sensor 18b. The source delay dt associated with the off-axis sources is represented by the following equation:

where d is the sensor spacing, .beta. is the source bearing, and .nu. is the speed of sound in air.

Although the exemplary embodiment shows only three sources, the system and method can be used to factor additional energy sources having various possible arrangements. Since the number of sources factored generally depends upon the application and the goal of the factoring procedure, the system and method can factor fewer sources than are actually present. Although the exemplary embodiment uses three sensors to factor the three energy sources, two sensors can be used to factor three sources with an increase in the number of iterations to achieve comparable results to that using three sensors and thus an increase in processing time.

The present invention also contemplates using additional sensors with various spacings and arrangements depending upon the particular use for the system. Although the hearing aid embodiment preferably assumes the center or on-axis energy source 16b as the target source to be factored and transmitted to the user, the present invention can also be used to factor the off axis energy sources.

The system 10 includes a digital signal processor 20 that processes the electrical sensor signals 19a-19c representing the merged wave field 12 to factor the merged wave field 12 into the independent components or source signals 14a-14c generated by each independent energy source 16a-16c. The digital signal processor 20 can include a microprocessor 21 programmed with software to perform the factoring procedure or can include digital signal processor and/or clocked gate array circuitry that performs the factoring procedure. In the exemplary hearing aid embodiment, the digital signal processor 20 is preferably a compact device approximately 1 inch by 2.3 inches by 4 inches carried by the individual wearing the hearing aid, for example, in a shirt or dress pocket.

The digital signal processor 20 includes a digitizer 22 that digitizes or samples the electrical sensor signals 19a-19c and outputs sampled sensor signals 24a-24c. One example of the digitizer includes a multiplexed 66,150 Hz 8 bit analog to digital (A/D) converter providing 3 outputs of 22,050 Hz 8 bit. The digital signal processor 20 also includes sampled sensor signal data arrays 26, for storing the sampled sensor signals 24a-24c during processing. The digital signal processor can also set up additional arrays for storing calculated data during processing.

In general, the factoring of the merged wave field 12 into independent components is performed by predicting the components or source signals 14a-14c using a random process and then verifying the predicted source signals. The predicted source signals are verified by combining the predicted source signals with the appropriate source delays associated with the respective sources 16a-16c to replicate the sensor signals 24a-24c.

The digital signal processor 20 includes predicted source signal data arrays 28 that contain the predicted source signal data corresponding to the independent source signals 14a-14c that form the merged wave field 12. The digital signal processor 20 also includes a source delay calculator 30 that obtains or calculates the source delays associated with each of the sources 16a-16c relative to the sensors 18a-18c. The source delays can be calculated based upon an assumed geometry of the sources 16a-16c or using a cross-correlation process.

One example of determining the source delays using an assumed geometry is based upon the geometry shown in FIG. 1. According to this assumed geometry, the target or center source 16b is directly in front of the sensors 18a-18c and thus has no sensible time delay at the left and right sensors 18a, 18c with respect to the center sensor 18b. The off-axis left and right quadrant energy sources 16a, 16c are assumed to have bearing angles .beta. of 45.degree. to the left and right respectively of the center or target source 16b. If the sources 16a-16c have this assumed geometry and the sensors 18a-18c have the preferred spacing described above, e.g., about 6 cm., the differential time delays dt.sub.l, dt.sub.r are equal to 3 times the data sampling interval of the digitizer 22, i.e. .+-.3 sample intervals. As will be described in greater detail below, these assumed left and right quadrant source delays can be used to factor merged wave fields produced by energy sources that do not satisfy this particular geometry. The present invention also contemplates using fractional sample interval delays by using a Fourier transform, a frequency dependent phase shift, .omega.T.sub.0, and an inverse Fourier transform to obtain a predicted array shifted by T.sub.0.

To determine the source delays using cross-correlation, the digital signal processor includes a filter 32 that filters the sampled sensor signal data, for example, by high pass filtering. One example of the filter that can be used is a 5.sup.th order Butterworth, infinite impulse response high pass filter. The squared magnitude of the low pass analogous filter from which it is derived has the following form .vertline.H.sub.a (j.OMEGA.).vertline..sup.2 =1/(1+(j.OMEGA./j.OMEGA..sub.c).sup.2n) where n is the filter order, .OMEGA. is the radian frequency, and .OMEGA..sub.c is the cutoff frequency. The source delay calculator 30 then processes the filtered sampled sensor signal data using the cross-correlation process, as will be described in greater detail below. Using cross-correlation more accurately determines the source delays for any particular source geometry and sensor spacing.

The digital signal processor 20 also includes a predicted source signal verifier 34, responsive to the predicted source signal data arrays 28, for combining the predicted source signal data corresponding to each source signal 14a-14c together with the appropriate source delays associated with each energy source 16a-16c, to form replicated sensor signal data corresponding to the merged wave field sensed at each of the sensors 18a-18c. The predicted source signal verifier 34 compares the replicated sensor signal data to the actual sampled sensor signal data to verify the predicted source signals.

The digital signal processor 20 also includes a predicted source signal adjuster 36, responsive to the predicted source signal verifier 34, for adjusting the predicted source signal data when the predicted source signal data is not verified by the verifier 34. The predicted source signal data arrays 28 are responsive to the predicted source signal adjuster 36 and are updated to include the adjustments made to the predicted source signal data. The predicted source signal verifier 34 then verifies the adjusted predicted source signal data in the predicted source signal data arrays 28.

This process continues through a number of iterations until the predicted source signal verifier 34 verifies the predicted source signal data stored in the predicted source signal array data arrays 28. The verified predicted source signal data is then output as factored source signals 38a-38c representing the source signals 14a-14c attributed to each of the sources 16a-16c. One or more of the factored source signals 38a-38c can then be selectively transmitted to the user, recorded, or otherwise further processed.

The method 100, FIG. 2, of factoring the merged wave field into independent components or source signals according to the present invention generally begins by sensing the merged wave field 12 at each sensor 18a-18c in the array of sensors, step 110. Each of the sensors 18a-18c converts the merged wave field into the electrical sensor signals 19a-19c, step 120. The electrical sensor signals 19a-19c are then multiplexed into the digitizer 22 and digitized or sampled, step 130. Using the 66,150 Hz 8 bit analog to digital converter, for example, to digitize the three electrical sensor signals 19a-19c produces three digital streams of sound data formatted at a sample rate of 22,050 Hz at 8 bit amplitude. The sampling frequency and bit depth can vary depending upon the requirements of the particular application for signal spectral band width and fidelity.

The sampled sensor signals 24a-24c are stored in sampled sensor signal digital data arrays 26 corresponding to each sensor 18a-18c, step 116. In one example, the sampled sensor signals 24a-24c are preferably buffered in multiple arrays having lengths of 1000 elements and containing 1000 bytes digitized to 8 bits. An array length of 1000 is short enough for the processing delay to be less than a tenth of a second, allowing the system to function in real time with no apparent delay in delivering the factored source signals to the user. The sampled sensor signal data can be shifted one or more bits to the left, allowing the prediction process to have an error that is a fraction of the least significant bit. After processing 3 more bits are added to the array to be able to work with a fraction of the least significant bit in an 8 bit integer. In addition to digitizing the sensor signals, the signals can be conditioned, for example, by matching the sensor gain and frequency response in all sensors.

Once the sampled sensor signal digital data arrays 26 have been established, a block of sampled sensor signal data from the arrays 26, is selected for processing, step 118. In one example, the sampled sensor signal data arrays 26 include at least first and second sets of 1K buffers. Once the first set of buffers have been filled with data from each of the sampled sensor signals 24a-24c, the sampled sensor signal data stream flows to the second set of buffers and processing of the block of data in the first set of buffers begins.

To store the predicted source signals, predicted source signal data arrays 28 are initialized for each energy source, step 120. Before the predicted source signals are verified, the predicted source signal data in each of the arrays 26 is shifted by an amount equal to the respective source delay associated with the source that is being predicted. The source delays associated with each off axis energy source 16a, 16c are obtained, step 122, based upon an assumed energy source geometry, as described above, or can be more accurately determined using a cross-correlation procedure, as will be described in greater detail below