Welcome to the Capstone Project – Fine-tuning LLMs, a hands-on, project-based course where you will apply your knowledge and skills to solve real-world challenges in the field of Large Language Models (LLMs).
Over the course of 4 weeks (26.02 – 26.03), you will work individually or in miniteams of 1-2 people to develop innovative solutions that enable LLMs to understand and process legacy programming languages. This capstone will focus on the complete lifecycle of fine-tuning LLMs, from data preparation to model adaptation, evaluation, and final deployment.
You will explore how to:
- Prepare and preprocess data from legacy language documentation
- Fine-tune or adapt LLMs to understand these languages
- Evaluate model performance with real benchmarks
- Develop a working prototype showcasing your adapted model
Weekly mentoring sessions will guide you through your progress, offering feedback and support as you navigate technical and conceptual challenges.
Learning Outcomes:
By the end of this course, you will be able to:
✅ Fine-tune LLMs for specialized tasks
✅ Work with legacy programming language data
✅ Evaluate LLM performance with structured benchmarks
✅ Collaborate in small teams to solve complex problems
✅ Present and document your work professionally
- Teacher
Pekka Abrahamsson