Superresolved image synthesis for multiple-plane scenes captured with an uncalibrated moving camera

In this paper, the authors propose a method to take a video sequence photographed with an uncalihrated moving camera and use the projected relationship between each frame in the sequence to merge all the frames together and generate a superresolved image, that is, one with higher resolution than the source images. By assuming that the scene can he approximated with multiple plane patches, the images are merged using a homography derived from a fundamental matrix estimated across each frame for each plane patch. In this method, blurring occurs in the generated image as a result of positional errors in the images being synthesizd: this is turned to advantage in an optimization process that maximizes the energy of the high-frequency components in the generated image; the correspondence among plane-patch vertex frames, needed to derive the homography, is used to estimate subpixel precision. To prove the effectiveness of this method, the authors conducted experiments with actual images and were able to improve resolution beyond the level of the original image.