Physics

Title of thesis: Data-Driven Automated Reporting Solution for External Collaborations - LLM-driven KPI Definition
Abstract: This thesis presents a proof-of-concept, developed with AstraZeneca (AZ), that explores automating progress reporting for external collaborations by testing whether a large language model (LLM)-driven system can extract objectives from contracts and translate them into tailor-made key performance indicators (KPIs). Objective extraction is quite reliable, reaching several highs around the 85\%-mark, but converting objectives into KPIs that stakeholders judge as relevant, clear, actionable, and measurable, is substantially less solid. Fewer than half of the KPIs met each quality criterion on average, and 39\% met none. Survey responses noted that KPIs were often unclear, overly generic, or poorly timed, and skewed toward simple counts (e.g., “number of models”) that miss quality and impact.&nbsp; &nbsp; From interviews conducted at AZ, a set of general KPIs, that were deemed meaningful to measure in a collaboration project, could be demonstrated. The final evaluation suggests that these KPIs (e.g., external engagement and budget coherence) outperform collaboration-specific KPIs generated directly from objectives. This underscores the difficulty of creating bespoke target measures in diverse contexts.&nbsp; &nbsp; Despite these issues, the approach offers practical value. In principle, the pipeline should be better suited for agreements with explicit milestones (e.g., business or commercialisation contracts), where more clearly defined expected outcomes support better-formed KPIs. However, this cannot be conclusively established by the implementation in this thesis, due to limited data.&nbsp; &nbsp; Ultimately, translating qualitative objectives into quantitative, decision-grade KPIs remains inherently difficult. Contemporary LLMs are capable across many aspects of automation, but evidently less reliable for high-judgement and context-specific KPI design that balances relevance, clarity, actionability, and measurability, at least by following the approach outlined in this thesis. Therefore, the most defensible near-term usefulness is in metadata extraction and recommendation, while still requiring a human-in-the-loop as a safeguard. In turn, this can improve customer relationship management (CRM) metadata completeness and enable collaboration health insights and automated reporting.&nbsp; 
Examiner: Giovanni Volpe Supervisor: Jesús Pineda Opponents: Wilhelm Swegmark and Didrik Tvedt 
Location of presentation: <a rel="noopener" href="https://maps.chalmers.se/#37d8de3e-1806-4420-92e7-b0b773f4fc88" target="_blank" title="Chalmers Maps" data-anchor="#37d8de3e-1806-4420-92e7-b0b773f4fc88">FL41</a>

Architecture and Civil Engineering

Bachelor’s thesis Chemistry and Chemical Engineering

Chemistry and Chemical Engineering

Communication and Learning in Science

Computer Science and Engineering

Electrical Engineering

Industrial and Materials Science

Life Sciences

Mathematical Sciences

Mechanics and Maritime Sciences

Microtechnology and Nanoscience

Space, Earth and Environment

Technology Management and Economics

Presentation of master thesis

Choose subject

In order to play this video you must open your cookie settings and allow external media cookies.

In order to use basic functions like page navigation and access secure areas of the website, you must open your cookie settings and allow necessary cookies.

In order to use this service you must open your cookie settings and allow external services cookies.

To help us understand how visitors interact with the website you must open your cookie settings and allow statistics cookies.

Course syllabus for

Subject

Each academic year contains different courses

See programme page at universityadmissions.se

Educational area

Permissible substitutions of compulsory courses

To see your programme syllabus – select the academic year in which you started the programme.

[en: page.studyprogrammepage.syllabusesview.coursesdescription]

Presentation of master thesis

Master thesis presentations at Physics

16 January, 2026

16:00- 17:00 Marcus Lorentzon (MPCAS) & Jakob Juul (MPDSC)