Most user interfaces (UIs) do not consider user intentions behind their manipulations and show only fixed responses. UIs could contribute to more effective work if they are made so as to infer user intentions and to respond proactively to the operations. This paper focuses on users' swipe gestures on touch screens, and it proposes IntelliSwipe, which adaptively adjusts the scroll amount of swipe gestures based on the inference of user intentions, that is, what they want to see. The remarkable function of IntelliSwipe is to judge user intentions by considering visual features of the content that users are seeing while previous studies have only focused on the mapping from user operations to their intentions. We implemented IntelliSwipe on an Android tablet. A case study revealed that IntelliSwipe enabled users to scroll a page to the proper position just by swiping.