Improving Batch Performance when Migrating to Microservices with Chunking and Coroutines.

Knoche, Holger (2019) Improving Batch Performance when Migrating to Microservices with Chunking and Coroutines. Open Access Softwaretechnik-Trends, 39 (4). pp. 20-22.

[thumbnail of SSP2019_Knoche.pdf]
Preview
Text
SSP2019_Knoche.pdf - Published Version

Download (186kB) | Preview

Abstract

When migrating enterprise software towards microservices, batch jobs are particularly sensitive to communication overhead introduced by the distributed nature of microservices. As it is not uncommon for a single batch job to process millions of data items, even an additional millisecond of overhead per item may lead to a significant increase in runtime.
A common strategy for reducing the average overhead per item is called chunking, which means that individual requests for different data items are grouped into larger requests. However, chunking is difficult to integrate into existing batch jobs, which are traditionally executed sequentially.
In this paper, we present a chunking approach based on coroutines, and investigate whether it can be used to mitigate the potential penalty to batch performance during migrations to microservices.

Document Type: Article
Keywords: Microservices
Research affiliation: Kiel University > Software Engineering
Refereed: Yes
Open Access Journal?: Yes
Publisher: Gesellschaft für Informatik e.V.
Date Deposited: 25 May 2020 09:52
Last Modified: 28 Mar 2023 07:39
URI: https://oceanrep.geomar.de/id/eprint/49739

Actions (login required)

View Item View Item