An approximation of entropy is determined on a set of data by comparing subsets of the data. The comparison reveals the regularity and stability of similar patterns amongst subsets of the data. The comparisons perform such that the contribution of noise to measurement of the regularity and stability is minimized. Quantitative values are assigned to measure the degree of regularity and stability. From these quantitative values a single output measure is generated indicative of the amount of patte...

A method, an apparatus (100) and a computer program product for entropy coding of discrete wavelet transform (DWT) coefficient bits that are arranged into code blocks and coded in bitplane order using three coding passes for each bitplane are disclosed. In the method, transform coefficients of a code block (200) in sign-magnitude form are pre-analyzed. Statistical data about the coefficients is stored, preferably with the coefficients. Significance state data (330), coded data (340), magnitude r...

A system is comprised of a series of trainable nonlinear processors in cascade. The processors are trained in sequence as follows. In a first phase of the sequence, a set of input signals comprising input information upon which the system is to be trained and a corresponding set of desired responses to these input signals are introduced into the first processor. When the first processor has been trained over the entire set, a second phase commences in which a second set of input signals along wi...

The present invention provides an encoding and decoding apparatus used for the compression and expansion of data. A state machine is provided having a plurality of states. Each state has at least one transition pair. Each element of the transition pair comprises zero or more bits representative of the compact code to be output and the identification of the next state to proceed to. The transition pair reflects an output for a yes and no response associated with the probability of the data to be ...

The entropy-based signal receiver uses the entropy of a received signal or a quantity that is closely related to entropy as the means to measure changes in the signal as a function of time or origin. The changes that are of interest are those associated with either signal level or signal structure. Entropy is a measure that responds in some fashion to either type of change. The entropy-based signal receiver transforms time segments of a received signal into entropy-related quantities. By compari...

The present invention provides an encoding and decoding apparatus used for the compression and expansion of data. A state machine is provided having a plurality of states. Each state has at least one transition pair. Each element of the transition pair comprises zero or more bits representative of the compact code to be output and the identification of the next state to proceed to. The transition pair reflects an output for a yes and no response associated with the probability of the data to be ...

An entropy coding system in a code assign system for processing image coded data such that for data (particular data) having a particular value, a run length coding is achieved on a run length thereof and for data (nonparticular data) having a value other than the particular value, a Huffman coding is conducted on the value thereof so as to generate a coded or resultant code. When achieving the Huffman coding on the nonparticular date, for the nonparticular data immediately following particular ...

A quantified symbol stream is sampled, using the quantified symbols prior to the current symbol, to generate a modeling value that characterizes the stream. The modeling value is used to generate, or retrieve, a probability function that provides the probability that the current symbol will be the next symbol in the symbol stream. The probability given by the probability function is then used to select the used to represent the data. The encoded symbol is later decoded using the characteristics ...

A method of quantifying perceptual information and entropy for a data input signal uses an appropriate perceptual model to produce a perceptual response. The perceptual response is then entropy converted to produce the perceptual information and entropy. The entropy conversion may include the application of a transform function, such as a Karhunen-Loeve transform function, to the perceptual response to produce a set of coefficients, which coefficients then have probabilities calculated for them ...

An EBCOT codec (1) is provided which includes a bit modeling unit (11), arithmetic codec (12), input FIFO memory (13), output FIFO memory (14) and a controller (16). The input and output FIFO memories (13) and (14) have a function to control the bit length of to-be-stored data correspondingly to that of supplied data. For the coding, the input FIFO memory (13) is supplied with a wavelet transform coefficient of 16 bits, and for the decoding, it is supplied with a code data of 8 bits. For the cod...