LLMs Often Produce Medical Device-Like Output
This study investigates whether Large Language Models (LLMs) can generate output similar to FDA-regulated medical devices. Findings show LLMs, even without specific prompting, often produce device-like clinical decision support, highlighting the need for regulatory consideration as LLMs become integrated into healthcare. The research explores various prompting methods and clinical scenarios, revealing challenges in controlling LLM output.