Stable keypoint recognition using viewpoint generative learning

We propose a stable keypoint recognition method that is robust to viewpoint changes. Conventional local features such as SIFT, SURF, etc., have scale and rotation invariance but often fail in matching points when the camera pose significantly changes. In order to solve this problem, we adopt viewpoint generative learning. By generating various patterns as seen from different viewpoints and collecting local invariant features, our system can learn feature descriptors under various camera poses for each keypoint before actual matching. Experimental results comparing usual local feature matching or patch classification method show both robustness and fastness of learning.