Skip to content

AI_LectureNote: A Retrospective Pilot Study of a Post-ASR Workflow for English-Script Rendering and Semantic Drift in Korean-English Medical Lectures

Jul 2026 · arXiv.org · Vol abs/2607.17237 · 0 citations · 1 references
Computer Science

TL;DR

This single-annotator pilot documents concrete failure modes rather than population rates and supports evaluating surface accuracy, term-script rendering, chunk-level script consistency, and medical-meaning preservation separately.

Abstract

AI_LectureNote is a historical, readability-oriented post-ASR workflow for Korean-English medical lectures. It rewrites speech-to-text output into study transcripts while restoring Latin-script medical terms rather than Korean phonetic transliterations. We retrospectively evaluate the workflow on four author-recorded lectures across five conditions. In this pilot, post-processing raised the macro English-script rendering rate from 0.39 to 0.71 on the whisper-1 path and from 0.26 to 0.65 when applied to 3-minute chunked gpt-4o-transcribe output. However, English-script rendering did not imply semantic faithfulness: the two post-processed conditions showed semantic drift in 34 and 36 of 282 reference sentences and polarity failures in 11 and 13 of 101 polarity-cue rows. A descriptive cross-input comparison suggested different candidate failure patterns: polarity-failure sets overlapped more strongly across front-ends (Jaccard 0.60; 9 shared of 15 unioned failures) than general semantic-drift sets (Jaccard 0.23; 13 shared of 57 unioned drifts). This single-annotator pilot documents concrete failure modes rather than population rates and supports evaluating surface accuracy, term-script rendering, chunk-level script consistency, and medical-meaning preservation separately.

View source

Similar papers

Open access Sep 2026

Embedding-Based Evaluation and Benchmarking Framework for Optimizing LLM Post-Processing of Medical Transcriptions from a Local Whisper System.

INTRODUCTION Locally deployed speech-to-text systems such as Whisper enable privacy-preserving transcription of medical encounters. However, the resulting transcripts are often lengthy, noisy, and insufficiently structured for direct integration into clinical documentation workflows. Large language models (LLMs) can tr...

Ahmad Wattar, Jan Christoph, Christoph Demus et al. · 0 citations

Can We Triage LLM Translation Errors in Classical Texts Without Human References? Source Novelty, GEMBA Scoring, and Budgeted Review through Pali-to-English Translation

A budgeted workflow is proposed, combining source novelty, peer disagreement, and stronger candidate-aware judging to allocate human review through Pali-to-English translation, indicating that evaluator strength matters beyond the prompt alone.

Máté Metzger · 1 citation
Review Open access Aug 2026

LLM-Assisted Translation for Korean OTT Content Localization: A Literature Review on Productivity, Quality, and Human–AI Collaboration

This paper reviews three research streams that have developed largely in isolation, namely LLM translation quality and automatic evaluation, human–AI collaboration and knowledge-worker productivity, and audiovisual translation, and integrates them through an operations-management input–process–output–outcome framework...

Soonhui Lee · 0 citations
#natural language process... Preprint Sep 2026

Right Tool, Right Job: Native-Language Evaluation, Tokenizer Sensitivity, and Methodological Findings from a French-Only BabyLM

We submit M\'eTRON-FR, a 125M GPT-2 pretrained on 92.47M words of French, to the BabyLM 2026 Strict track. It scores 85.97 +/- 0.17% on QFrBLiMP (a native Quebec-French benchmark of grammatical minimal pairs) and 62.80% on the BabyLM-weighted leaderboard. A cross-lingual GLUE (General Language Understanding Evaluation)...

A. Wasserman, David Beauchemin · 0 citations
Open access Aug 2026

Stream-Aware Vocabulary Demands in Singapore Secondary Tamil Textbooks: A Morphology- and Multiword-Unit-Sensitive Corpus Analysis, with a Textbook-Faithful GenAI Item Benchmark

Vocabulary learning research increasingly calls for curriculum-aligned evidence and methods that reflect how vocabulary is selected, sequenced, and assessed in real educational systems. However, stream-differentiated curricular pathways may entail distinct lexical demands that are rarely quantified for morphologically...

K. Palthamburaj, Mercedes Premalatha Ramesh · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.