For processing image data generated for a color filter array, classifiers are generated from the image data. A predetermined color component is determined by directional-interpolating the image data depending on the classifiers. Chrominance components are generated from linear-interpolated image data and the directional-interpolated predetermined color component. The chrominance components are directional-interpolated, and color components are extracted from the directional-interpolated chrominance components.