Maj Smerkol, Rok Susič, Mariša Ratajec, Helena Halbwachs and Anton Gradišek

Abstract
Digital tracking of services is one of the main administrative burdens of the healthcare staff. Here, we present a proof-of-concept
study of a so-called speech-to-service (S2S) system that is aimed
at facilitating recording of activities, extracting information from
the conversation between a healthcare provider and recipient.
The system comprises of a speech recorder, a diarization component, an LLM to interpret the conversation, and a recommendation system integrated in a smart tablet that records completed
activities and suggests possible other activities that may have
still be required. We tested the system on 350 conversations and
obtained 95% accuracy, 97% precision and 94% recall.