There is provided a method and apparatus for processing images to create a novel view of a scene. The method comprises the steps of: (a) providing first and second images of a scene; (b) applying a stereo matching algorithm to the first and second images to generate a first disparity map which maps between corresponding points from the first image to the second image; (c) forward mapping the first disparity map into the coordinates of a third image to generate a second disparity map; (d) using the second disparity map, reverse mapping for at least some of the pixel positions in the third image to corresponding points in the first and second images to obtain possible color values for each of the at least some of the pixels in the third image; and (e) assigning a final color value to each of the at least some of the pixels in the third image on the basis of the possible color values, thereby providing a novel view of the scene.
