Training data must be stylistically consistent across domains such as finance and law, or post-training may teach models unusual formatting and style behaviors.

“And I, I don't think there's a one fixed answer to it, but what is definitely true is that the data needs to be consistent across finance and legal and all the domains that come in, because otherwise the post-training will learn very strange formatting and style behaviors.”