Using Large Language Models to Generate Concise and Understandable Test Case Summaries

Conference Paper (2025)
Author(s)

Natanael Djajadi (Student TU Delft)

Amirhossein Deljouyi (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Andy Zaidman (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Department
Software Technology
DOI related publication
https://doi.org/10.1109/ICPC66645.2025.00040 Final published version
More Info
expand_more
Publication Year
2025
Language
English
Department
Software Technology
Pages (from-to)
322-326
Publisher
IEEE
ISBN (electronic)
9798331502232
Event
33rd IEEE/ACM International Conference on Program Comprehension, ICPC 2025 (2025-04-27 - 2025-04-28), Ottawa, Canada
Page Views
74
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Software testing is essential, and automatic test case generation can be an important aid to software engineers. However, generated tests are sometimes difficult to understand. Test summarization approaches that provide an overview of what exactly is tested can provide help, but existing summarization approaches generate documentation that is lengthy and redundant. In this paper, we investigate whether large language models (LLMs) can be used to generate more concise, yet understandable summaries. In a small-scale user study with 11 participants, we obtained positive feedback on the LLM-generated summaries.

Files

Using_Large_Language_Models_to... (pdf)
(pdf | 0.336 Mb)
- Embargo expired in 17-12-2025
– Personal use only – Dutch Copyright Act (Article 25fa)