Impressive human-performed tasks are a narrow subset of the tasks required for competence and economic viability, so progress on them should not strongly update beliefs about AI systems' general competence.

“And but we shouldn't update too strongly about just their general competence or something,”

“because we should recognize that this is a very narrow subset of relevant tasks that humans do in order to be a competent.”

“and economically viable agent.”