Base models can make unsafe medical inferences by converting symptoms a patient reports into unconfirmed diagnoses, such as inferring anxiety and depression from sadness, stress, and difficulty sleeping.

“patient you know they start to make these medical inferences they're so smart but they start to like infer things that the doctor didn't actually explicitly say you know for instance a patient will say like i'm feeling sad and stressed out difficulty sleeping right you know the base model is going to be like patient reports increased anxiety and depression but wait a second those are diagnoses right the doctor didn't actually confirm those things”