Semantic segmentation and difference extraction via time series aerial video camera and its application

S. N.K. Amit, S. Saito, S. Sasaki, Y. Kiyoki, Y. Aoki

Research output: Contribution to journalConference articlepeer-review

1 Citation (Scopus)


Google earth with high-resolution imagery basically takes months to process new images before online updates. It is a time consuming and slow process especially for post-disaster application. The objective of this research is to develop a fast and effective method of updating maps by detecting local differences occurred over different time series; where only region with differences will be updated. In our system, aerial images from Massachusetts's road and building open datasets, Saitama district datasets are used as input images. Semantic segmentation is then applied to input images. Semantic segmentation is a pixel-wise classification of images by implementing deep neural network technique. Deep neural network technique is implemented due to being not only efficient in learning highly discriminative image features such as road, buildings etc., but also partially robust to incomplete and poorly registered target maps. Then, aerial images which contain semantic information are stored as database in 5D world map is set as ground truth images. This system is developed to visualise multimedia data in 5 dimensions; 3 dimensions as spatial dimensions, 1 dimension as temporal dimension, and 1 dimension as degenerated dimensions of semantic and colour combination dimension. Next, ground truth images chosen from database in 5D world map and a new aerial image with same spatial information but different time series are compared via difference extraction method. The map will only update where local changes had occurred. Hence, map updating will be cheaper, faster and more effective especially post-disaster application, by leaving unchanged region and only update changed region.

Original languageEnglish
Pages (from-to)1119-1122
Number of pages4
JournalInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
Issue number7W3
Publication statusPublished - 2015 Apr 28
Event2015 36th International Symposium on Remote Sensing of Environment - Berlin, Germany
Duration: 2015 May 112015 May 15


  • Aerial images
  • Convolution neural networks
  • Difference extraction
  • Semantic segmentation

ASJC Scopus subject areas

  • Information Systems
  • Geography, Planning and Development


Dive into the research topics of 'Semantic segmentation and difference extraction via time series aerial video camera and its application'. Together they form a unique fingerprint.

Cite this