Scalability Benchmarking of Kafka Streams Deployment Options.

Vonheiden, Björn (2021) Scalability Benchmarking of Kafka Streams Deployment Options. Open Access (Student research project), Kiel University, Kiel, 10 pp.

[thumbnail of Bjoern-Vonheiden_Scalability-Benchmarking-of-Kafka-Streams-Deployment-Options.pdf]
Preview
Text
Bjoern-Vonheiden_Scalability-Benchmarking-of-Kafka-Streams-Deployment-Options.pdf - Published Version

Download (297kB) | Preview

Abstract

Kubernetes, Kafka, and Kafka Streams are commonly used together in software systems. The Theodolite method allows to benchmark the scalability of such systems. Kafka Streams provides many configuration options. Thus, it is difficult to set the configuration options in the best possible way. Previous research with Theodolite, however, considers only few configuration options for the scalability. Therefore, we explore further configuration options for Kafka and Kafka Streams in this paper. On one hand we apply the topology optimization option, on the other hand we focus on high availability and resiliency options. We define different parameters for these configuration options and execute the Theodolite benchmark with them. Ultimately, we present and discuss the results of the benchmark executions and identify the influence of the parameters regarding the scalability of Kafka Streams applications.

Document Type: Thesis (Student research project)
Thesis Advisor: Henning, Sören and Hasselbring, Wilhelm
Keywords: Theodolite, Scalability Benchmark, Kafka Streams
Research affiliation: Kiel University > Software Engineering
Date Deposited: 20 Apr 2021 14:21
Last Modified: 20 Apr 2021 14:22
URI: https://oceanrep.geomar.de/id/eprint/52340

Actions (login required)

View Item View Item