Congratulations to Muhtasim Ibteda and Ashfaq for completing their senior project.
They developed PACE a Python AI companion for Enhanced Engagement. For this work they generated synthetic data from GPT 3.5 turbo for scaffolding and conversion fine-tuning. The LORA fine tuned Gemma 2B model was used for making the system relatively lightweight. This trains the LLM model to breakdown complex problems into subproblems and generate hints and structured steps for the students. On the other hand the conversation data allows the LLM to engage with users using natural, human-like dialogue, to avoid hallucinations, to supports error correction and detailed feedback, and to enhances motivation and interest through interaction with users with different learning styles, and pace. Evaluation of the system was also performed.
A wider evaluation of the system is underway and we plan to make the version 2 of the system available to our intro to python programming students. Interaction datasets collected from students (with their consent of course) will be valuable for making such a system more reliable.
We hope to see more exciting work from Ibteda and Ashfaq in the near future.