In an image processing apparatus and method for converting a raster format into a block format, generated image data is separated into given color components so as to be stored in a single line memory. A block unit reading may be performed in a sequence adapted to be read in the block format such that the read image data is transmitted to an encoder. Since only one line memory is used, the size of the memory, and hence a chip size containing the memory, may be reduced.