Quality under power - automation & AI in a practical test

The program

09:00 a.m. Admission

09: 30 Welcome and introduction

09:40 a.m. Stars, code and quality: LLMs put to the test in practice with Prof. Dr. Klemens Waldhör, FOM University of Applied Sciences

10:20 a.m. AI tools in use: magic or illusion? with Christoph Singer & Gabriela Simion, imbus

11:00 a.m. Coffee break

11:20 a.m. LLMs in everyday project work: How MCPs can support creation with Magnus Hartmann, SimplyTest

12:00 Autonomous software development with GitHub Copilot Agent: Potentials and risks in the regulated medical sector with Robert Steinhäußer, sepp.med

12:40 p.m. Lunch break

13:40 Evaluating the Potential of AI Usage in Software Development [EN] with Magdalena Bachmaier & Johannes Manner, Siemens Healthineers

14:20 Keynote: Experiencing accessibility with and without ChatGPT with Dr. Anne Kramer, Smartesting

3:10 p.m. Networking & closing / exhibition partners

16:00 End of the event

 

The lectures

Stars, code and quality: LLMs in the acid test of software development

The article examines how Large Language Models (LLMs) such as ChatGPT, Claude, Gemini and Copilot can support the software development process - in particular specification, implementation and testing. For this purpose, the development of an astronomical web application is carried out, which supports amateur astronomers in planning their observation evenings by calculating optimal observation times. The practical scenario combines manageable complexity (LLM-compatible) with technical depth: coordinate systems, time conversions and visibility calculations require domain-specific knowledge. The lecturer contributes his own experience as an amateur astronomer and has already developed comparable tools manually.

The focus is on:

  • the quality and correctness of the specifications, codes and test cases generated by the LLMs,
  • the traceability, robustness and maintainability of the generated artifacts,
  • a systematic comparison of the models based on defined QA criteria.
Prof. Dr. Klemens Waldhör

Prof. Dr. Klemens Waldhör

FOM University

Prof. for Business Informatics at the FOM. Research interests in the field of AI, ML and data science: AAL, smartwatches, wearables, sensor technology; software engineering - use of LLMs in the development process, especially in requirements analysis.

AI tools in use: magic or illusion?

AI - the new miracle component that promises a lot, including in test automation. Many tools claim to make testing more efficient and robust: self-healing, automatic test case and test data generation, intelligent error analysis. Sounds impressive - but does it really work in practice? How easy is it to use the tools? How do they influence the way we work? What opportunities do we see? What risks can the use of AI-supported tools entail? Can we trust them blindly?

We would like to answer these questions by analyzing existing AI-supported solutions.

Christoph Singer

Christoph Singer

imbus AG

Christoph Singer is a Senior Software Quality Consultant at imbus AG. His focus is on test automation. He designs test automation architectures and supports teams in setting up sustainable automation solutions.

Gabriela Simion

Gabriela Simion

imbus AG

Gabriela Simion is a Senior Software Quality Engineer at imbus AG and specializes in test automation. She has over three years of experience with robot frameworks for web and mobile applications.

LLMs in everyday project work: How MCPs facilitate the creation of automated scenarios

The presentation will highlight the practical use of Large Language Models (LLMs) in combination with the Model Context Protocol (MCP) for the efficient creation and maintenance of automated test scenarios in development projects. It demonstrates how MCP, as a standardized interface, enables the integration of LLMs with external data sources, tools and test frameworks such as Playwright, thereby reducing manual, repetitive tasks in test scenario development.

Autonomous software development with GitHub Copilot Agent: potentials and risks in the regulated medical sector

GitHub Copilot's Agent Mode enables the autonomous execution of complex development tasks and offers significant efficiency and quality benefits in the regulated medical environment - but requires clear boundaries in terms of control, responsibility and regulatory security.

Robert Steinhäußer

Robert Steinhäußer

sepp.med

Robert Steinhäußer is a technical computer scientist and graduated from the University of Applied Sciences in Würzburg. He has been contributing his expertise in the regulated environment of medical software development to sepp.med since 2006. This is underlined by certificates in the professional development of medical software, software architecture, requirements engineering and project management.

Thanks to this diverse experience, he is now able to develop and provide high-quality solutions for customers as a project manager and team leader together with his team.

Evaluating the Potential of AI Usage in Software Development: An Empirical Study at Siemens Healthineers

AI tools like GitHub Copilot are transforming how developers work-boosting productivity by up to 55%. But where do these tools truly shine, and where do they still fall short? In this talk, we present fresh insights from a developer survey and expert interviews, exploring how AI is used across the software development lifecycle. Join us to discover which phases benefit most, what challenges remain, and how AI can be better integrated into everyday workflows.

Results of our study reveal that 93% of developers use AI during implementation, but satisfaction is moderate (3.52/5). AI is also used in requirements (56%),testing (80%), and documentation (78%), with helpfulness ratings up to 4.46/5. Despite adoption, 53% feel restricted by internal policies, and only 10% trust current legal frameworks to keep pace with AI.

Magdalena Bachmaier

Magdalena Bachmaier

Siemens Healthineers

Magdalena is currently working on a customer project in Monaco, where she integrates AI tools into clinical workflows to support physicians and optimize clinical routines. Her work bridges advanced technology and healthcare practice, driving innovation in medical environments. In her free time, you'll most likely find her cycling up mountain roads-combining endurance, and a love for challenges.

Johannes Manne

Johannes Manne

Siemens Healthineers

Johannesis currently working as a technical trainer supporting with hands-on trainings. Furthermore, he works on building up asoftware community at SHS. In his spare time, he is a passionate beekeeper.

Keynote: Experiencing accessibility with and without ChatGPT

Some things can only be understood once you have experienced them yourself. In France, we don't talk about "disabled people" in the context of accessibility, but about "situationally impaired people". Sounds like politically correct language, I thought - until the ophthalmologist in the emergency room proved me wrong with a terse sentence: "You can't read for a week." Boom - off - no WhatsApp, no Google, not even a quick look at the rain radar... Definitely situationally impairing!

I put up with it for two days, then I had to find a solution. I was saved by the ChatGPT voice interface. At last I was able to look up what I was interested in on the Internet again. What was the first thing I looked for? How to have emails or PDFs read aloud on my smartphone, of course. It works - and I am very grateful to all the developers and testers of accessibility!

This memorable week has taught me a lot about the possibilities and limitations of accessibility with and without generative AI - points that I would like to share in my experience report. Because I have learned something else: accessibility is not a goal, but a path worth taking. AI will play an important role in this!

Dr. Anne Kramer

Dr. Anne Kramer

Smartesting

Anne has been involved in software quality for more than 25 years and has worked in many different projects, industries and roles. She is a well-known speaker at numerous conferences. She is also an enthusiastic trainer and book author. Since 2024 she has been fully responsible for Smartesting's training course "Faster testing with GenAI"

Organizers

Powered by

Sponsors

Media partner

Contact us

Felix Winter

FG Digital Health

winter.felix@asqf.de

Florian Gabsteiger

FG Digital Health

florian.gabsteiger@asqf.de

David Uhlenberg

FG People, Projects & Processes

david.uhlenberg@asqf.de

Bernhard Sechser

FG Safety & Security

bernhard.sechser@asqf.de

Frank Poignée

FG Safety & Security

frank.poignee@asqf.de

Utz Winter

FG Software Test

utz.winter@asqf.de

ASQF e.V.