Image-Based Approach to Determining Regression Test Results of Dynamic Web Applications

Akihiro Hori, Shingo Takada, Toshiyuki Kurabayashi, Haruto Tanno

Research output: Contribution to journalArticle

Abstract

Much work has been done on automating regression testing for applications. But most of them focus on test execution. Little work has been done on automatically determining if a test case passes or fails. This decision is often made by comparing the results of executing test cases on a base version of the application and post-modification version of the application. If the two results match, the test case passes, otherwise fails. However, to the best of our knowledge, there is no regression testing method for automatically deciding pass/fail of dynamic Web applications which use JavaScript or CSS. We propose a method that automatically decides if a dynamic Web application passes a regression test case. The basic idea is to obtain a screenshot each time the GUI of the Web application (i.e. Web page) changes its state, and then compare each corresponding screenshot to see if they match. The evaluation results showed that the accuracy rate of our approach is high and our approach can be considered as fast enough for practical use.

Original languageEnglish
Pages (from-to)1001-1025
Number of pages25
JournalInternational Journal of Software Engineering and Knowledge Engineering
Volume28
Issue number7
DOIs
Publication statusPublished - 2018 Jul 1

Fingerprint

Testing
Graphical user interfaces
World Wide Web
Websites

Keywords

  • CSS
  • JavaScript
  • regression test
  • Web application testing

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications
  • Computer Graphics and Computer-Aided Design
  • Artificial Intelligence

Cite this

Image-Based Approach to Determining Regression Test Results of Dynamic Web Applications. / Hori, Akihiro; Takada, Shingo; Kurabayashi, Toshiyuki; Tanno, Haruto.

In: International Journal of Software Engineering and Knowledge Engineering, Vol. 28, No. 7, 01.07.2018, p. 1001-1025.

Research output: Contribution to journalArticle

@article{7834cfbf33a742f1b529ee0534decf54,
title = "Image-Based Approach to Determining Regression Test Results of Dynamic Web Applications",
abstract = "Much work has been done on automating regression testing for applications. But most of them focus on test execution. Little work has been done on automatically determining if a test case passes or fails. This decision is often made by comparing the results of executing test cases on a base version of the application and post-modification version of the application. If the two results match, the test case passes, otherwise fails. However, to the best of our knowledge, there is no regression testing method for automatically deciding pass/fail of dynamic Web applications which use JavaScript or CSS. We propose a method that automatically decides if a dynamic Web application passes a regression test case. The basic idea is to obtain a screenshot each time the GUI of the Web application (i.e. Web page) changes its state, and then compare each corresponding screenshot to see if they match. The evaluation results showed that the accuracy rate of our approach is high and our approach can be considered as fast enough for practical use.",
keywords = "CSS, JavaScript, regression test, Web application testing",
author = "Akihiro Hori and Shingo Takada and Toshiyuki Kurabayashi and Haruto Tanno",
year = "2018",
month = "7",
day = "1",
doi = "10.1142/S0218194018500286",
language = "English",
volume = "28",
pages = "1001--1025",
journal = "International Journal of Software Engineering and Knowledge Engineering",
issn = "0218-1940",
publisher = "World Scientific Publishing Co. Pte Ltd",
number = "7",

}

TY - JOUR

T1 - Image-Based Approach to Determining Regression Test Results of Dynamic Web Applications

AU - Hori, Akihiro

AU - Takada, Shingo

AU - Kurabayashi, Toshiyuki

AU - Tanno, Haruto

PY - 2018/7/1

Y1 - 2018/7/1

N2 - Much work has been done on automating regression testing for applications. But most of them focus on test execution. Little work has been done on automatically determining if a test case passes or fails. This decision is often made by comparing the results of executing test cases on a base version of the application and post-modification version of the application. If the two results match, the test case passes, otherwise fails. However, to the best of our knowledge, there is no regression testing method for automatically deciding pass/fail of dynamic Web applications which use JavaScript or CSS. We propose a method that automatically decides if a dynamic Web application passes a regression test case. The basic idea is to obtain a screenshot each time the GUI of the Web application (i.e. Web page) changes its state, and then compare each corresponding screenshot to see if they match. The evaluation results showed that the accuracy rate of our approach is high and our approach can be considered as fast enough for practical use.

AB - Much work has been done on automating regression testing for applications. But most of them focus on test execution. Little work has been done on automatically determining if a test case passes or fails. This decision is often made by comparing the results of executing test cases on a base version of the application and post-modification version of the application. If the two results match, the test case passes, otherwise fails. However, to the best of our knowledge, there is no regression testing method for automatically deciding pass/fail of dynamic Web applications which use JavaScript or CSS. We propose a method that automatically decides if a dynamic Web application passes a regression test case. The basic idea is to obtain a screenshot each time the GUI of the Web application (i.e. Web page) changes its state, and then compare each corresponding screenshot to see if they match. The evaluation results showed that the accuracy rate of our approach is high and our approach can be considered as fast enough for practical use.

KW - CSS

KW - JavaScript

KW - regression test

KW - Web application testing

UR - http://www.scopus.com/inward/record.url?scp=85051058294&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051058294&partnerID=8YFLogxK

U2 - 10.1142/S0218194018500286

DO - 10.1142/S0218194018500286

M3 - Article

AN - SCOPUS:85051058294

VL - 28

SP - 1001

EP - 1025

JO - International Journal of Software Engineering and Knowledge Engineering

JF - International Journal of Software Engineering and Knowledge Engineering

SN - 0218-1940

IS - 7

ER -