In recent years, analysis of remote sensing imagery is imperatives in the domain of environmental and climate monitoring primarily for the application of detecting and managing a natural disaster. Satellite imagery or aerial imagery is beneficial because it can widely capture the condition of the surface ground and provides a massive amount of information in a piece of satellite imagery. Since obtaining satellite imagery or aerial imagery is getting more ease in recent years, landslide detection and flood detection is highly in demand. In this paper, we propose automatic natural disaster detection particularly for landslide and flood detection by implementing convolutional neural network (CNN) in extracting the feature of disaster more effectively. CNN is robust to shadow, able to obtain the characteristic of disaster adequately and most importantly able to overcome misdetection or misjudgment by operators, which will affect the effectiveness of disaster relief. The neural network consists of 2 phases: Training phase and testing phase. We created training data patches of pre-disaster and post-disaster by clipping and resizing aerial imagery obtained from Google Earth Aerial Imagery. We are currently focusing on two countries which are Japan and Thailand. Training dataset for both landslide and flood consist of 50000 patches. All patches are trained in CNN to extract region where changes occurred or known as disaster region occurred without delay. We obtained accuracy of our system in around 80%-90% of both disaster detections. Based on the promising results, the proposed method may assist in our understanding of the role of deep learning in disaster detection.