Welcome!

I'm Johannes Kirmayr, a PhD student bridging academic research and industrial innovation. In collaboration with BMW Group, I'm pursuing an external doctorate at the University of Augsburg. My research explores how Large Language Models (LLMs) can enhance in-car voice interaction, with a focus on advanced planning and reasoning. I investigate techniques like fine-tuning and reinforcement learning to improve agentic behavior and conduct user studies to evaluate the experience of multi-step, long-horizon voice assistants.

Research Interests

Large Language Models
AI Agents
Automotive Technology
Planning and Reasoning
User Experience

Education

PhD Candidate

University of Augsburg & BMW Group | 07/2024 - 06/2027

Topic: Large Action Models: Planning & Reasoning

M.Sc. Robotics, Cognition Intelligence

Technical University Munich | 10/2021 - 07/2024

Focus on NLP, LLMs, AI, and cognitive systems.

Study Abroad

Stockholm University | 08/2022 - 01/2023

B.Sc. Elektro- und Informationstechnik

Technical University Munich | 10/2018 - 09/2021

Abitur

Gymnasium Tegernsee | 08/2010 - 07/2018

Experience

Master Thesis

TUM / BMW Group | 12/2023 - 06/2024

TUM Chair: Software Engineering for Business Information Systems (sebis)
BMW Group: Research Team Generative AI with focus on LLM integration in vehicles
Title: Combining Large Language Models and Structured Knowledge Representations for User-Personalized Conversations of In-Car Assistants

Working Student

BMW Group | 04/2023 - 12/2023

Research Team Generative AI with focus on LLM integration in vehicles
Objective: Building a RAG-LLM system for the in-car voice assistant

Internship: Roboy Student Team

Devanthro - the Robody Company / TUM | 04/2022 - 08/2022

Objective: Building a driving telepresence robot
Project website: https://roboy.github.io/rollbody/

Internship: SeaClear project

TUM - Chair of Information-oriented Control | 03/2021 - 04/2021

Objective: Creating a digital twin and simulating an Unmanned Surface Vehicle (USV) in Gazebo

Internship

Fraunhofer Institute for Building Physics (IBP) | 03/2020 - 04/2020

Research internship at one of Europe's leading research institutions.

Project: Depth-Guided Dynamic NeRF

TUM - Advanced Deep Learning for Computer Vision

Objective: Improving NeRF techniques to create new viewpoints in a dynamic 3D scene
Project website: https://philippwulff.github.io/DGD-NeRF/

Here are my recent publications.

Are you looking for an exciting Master's or Bachelor's thesis topic? I'm always seeking motivated students to work on cutting-edge research projects in collaboration with BMW and/or the University of Augsburg.

Master's Thesis In Progress

User-Study on reasoning LLMs within the in-car voice assistant

Conduct a user study to evaluate communication strategies of increased latency and amount of information due to reasoning LLMs within the in-car voice assistant.

Python Figma ProtoPie
6 months
BMW Group
Master's Thesis In Progress

Research on reinforcement learning for reasoning LLMs

Research on algorithms for reinforcement learning for reasoning LLMs. Focus on agentic behavior and planning.

Python Pytorch Full-Stack
6 months
BMW Group

How to Apply

1

Choose a Topic

Browse through the available topics and find one that matches your interests and skills.

2

Prepare Your Application

Send your CV, transcript of records, and a brief motivation letter explaining your interest.

3

Interview & Selection

We'll schedule a brief interview to discuss the topic and assess the fit.

4

Start Your Research