Robust Summarization of Doctor-Patient Conversations: TalTech Systems for the Beyond Transcription Challenge
arXiv:2607.17230v1 Announce Type: new Abstract: This paper describes TalTech's submissions to the Beyond Transcription Challenge (BeTraC), which requires generating SOAP notes directly from long doctor-patient conversation recordings, without intermediate transcription. After screening open-weight speech LLMs for long-audio robustness, we adapted Voxtral Mini (lightweight track) and Voxtral Small (heavyweight track) with LoRA supervised fine-tuning followed by DAPO reinforcement learning that us