Waller, Jan and Hasselbring, Wilhelm (2013) A Benchmark Engineering Methodology to Measure the Overhead of Application-Level Monitoring. [Paper] In: Symposium on Software Performance: Joint Kieker/Palladio Days 2013 (KPDAYS 2013). , November 27-29, 2013, Karlsruhe, Germany . Proceedings of the Symposium on Software Performance: Joint Kieker/Palladio Days 2013. ; pp. 59-68 .

Preview	Text Monitoring_Overhead_Benchmark_KPDays2013_preprint.pdf - Accepted Version Download (433kB) | Preview
Preview	Slideshow presentation.pdf - Presentation Download (1MB) | Preview

Abstract

Application-level monitoring frameworks, such as Kieker, provide insight into the inner workings and the dynamic behavior of software systems. However, depending on the number of monitoring probes used, these frameworks may introduce significant runtime overhead. Consequently, planning the instrumentation of continuously operating software systems requires detailed knowledge of the performance impact of each monitoring probe.

In this paper, we present our benchmark engineering approach to quantify the monitoring overhead caused by each probe under controlled and repeatable conditions. Our developed MooBench benchmark provides a basis for performance evaluations and comparisons of application-level monitoring frameworks. To evaluate its capabilities, we employ our benchmark to conduct a performance comparison of all available Kieker releases from version 0.91 to the current release 1.8.

Actions (login required)

View Item