Companies may use classifiers to detect and filter AI responses that provide medical advice when they should not.

“the right kind of architecture most of them will have some kind of guardrails in place either something coming out of the box from their model provider or they'll have built their own filters to sit in between they just don't work very well the difference between putting a classifier in place that like maybe goes and checks whether you're giving medical advice when you shouldn't and says hey if this looks like medical advice filter it out lots of companies have that in place the question is whether it works and it actually is pretty fiddly”