Human-in-the-Loop Large Language Model Framework for Identification of Cutaneous Immune-Related Adverse Events
arXiv:2607.20428v1 Announce Type: new Abstract: This study evaluated a retrieval-augmented, multi-agent large language model (LLM)-driven, human-in-the-loop framework for detecting cutaneous immune-related adverse events (cirAEs) from clinical notes. Compared with unassisted manual review, the LLM-assisted workflow improved accuracy (F1 = 0.88 vs 0.77), inter-rater agreement measured by Cohen's kappa (kappa = 0.82 vs 0.50), and reduced average review time by approximately half. This framework pi



![Real task cost across GPT, Claude, Gemini and Kimi, 10.6x spread on models with only 2x price difference [R]](https://preview.redd.it/7ejtvp684xeh1.png?width=140&height=65&auto=webp&s=10790ba444afd733ece8c54a8b9da99969a86066)