The speaker observes that new architectures often improve one performance parameter while regressing somewhat on others.

“in terms of accuracy and interpretability and all those things,”

“I think whenever there is like a new architecture that comes out, it's often sort of good in one parameter and then”