The paper proposes the motion index/search system based on real-world haptics. The motion index system indexes the human motion using the force and position stored by the motion saving system. The motion index system is able to create the motion dictionary, which includes the desired indexed motions. Meanwhile, the motion search system searches the motion of human operator by using moving covariance according to the indexed motions The motion search system proposed in this paper is utilized to recognize the human motion. By the experimental results, the validity and the possibility of the motion index/search system are confirmed.