This paper presents an interaction approach for augmented reality using the folding with a relaxed constraint. In our approach, the user can fold a paper and see virtual contents overlaid on the paper. The paper can be folded in horizontal, vertical, and diagonal direction. The folded surface is defined as two polygonal planes that are connected in the folding line. The main contribution of this paper are the automatic detection of the folding line and the plane segmentation based on the extended folding model. In addition, the virtual contents can be overlaid on each segment planes by estimating the camera pose of each plane. We develop two interactive augmented reality applications that overlay the virtual contents dynamically when the user fold the paper.