Unified Reporting for Performance Testing

Czech title

Sjednocená hlášení pro výkonnostní testování

Language

English

Abstract

Modern advances in software technologies for today's application development have allowed for developers to concentrate less on issues, such as performance and resource management, and instead spend more time on developing the application functionality such that the time to market is reduced. Consequently, performance analysis and optimization become more difficult and create a need for advanced performance tools that should provide a clear report of the application in terms of its performance and allow a fast interpretation of these results. This work investigates typical performance problems of today's applications and offers approaches on how to automatically detect them. Using statistical methods like regression and correlation analysis, investigation of measured values is performed in order to detect performance deviations that possibly occurred in an application under test. The proposed approach has been implemented as a new Reporter component into an open source performance testing tool PerfCake, developed by QE engineers from Red Hat Czech s.r.o. The developed component is capable of detecting and reporting possible issues and their probability. A unified report from all pre-specified measurements is created in such a way that all detected performance issues are immediately visible. The aim is to improve an end-user experience and usability when reading the report from performance testing.

Keywords

anomalies detection, regression analysis, performance testing, perfcake, java

Department

Department of Intelligent Systems FIT BUT

Degree Programme

Information Technology, Field of Study Information Systems

Files

Status

defended, grade A

Date

22 June 2017

Reviewer

Vojnar Tomáš, prof. Ing., Ph.D.

Committee

Hruška Tomáš, prof. Ing., CSc. (DIFS FIT BUT), předseda
Burget Radek, doc. Ing., Ph.D. (DIFS FIT BUT), člen
Holík Lukáš, doc. Mgr., Ph.D. (DITS FIT BUT), člen
Očenášek Pavel, Mgr. Ing., Ph.D. (DIFS FIT BUT), člen
Trenz Oldřich, doc. Ing., Ph.D. (Mendelu), člen
Zendulka Jaroslav, doc. Ing., CSc. (DIFS FIT BUT), člen

Citation

KŮROVÁ, Martina. Unified Reporting for Performance Testing. Brno, 2017. Master's Thesis. Brno University of Technology, Faculty of Information Technology. 2017-06-22. Supervised by Pluháčková Hana. Available from: https://www-dev.fit.vutbr.cz/study/thesis/20234/

BibTeX

@mastersthesis{FITMT20234,
    author = "Martina K\r{u}rov\'{a}",
    type = "Master's thesis",
    title = "Unified Reporting for Performance Testing",
    school = "Brno University of Technology, Faculty of Information Technology",
    year = 2017,
    location = "Brno, CZ",
    language = "english",
    url = "https://www.fit.vut.cz/study/thesis/20234/"
}