The speaker considers whole-page or whole-application access and multi-step code execution among the biggest breakthroughs in computer use.

“scrolling you know so it would like take a screenshot it would try to do something it would be like oh i gotta like scroll down to the next page of results and then it would take a screenshot and then we try to do something with scroll down again and so i think um with with accessibility and other and and direct access to the dom and other things like that now the language model can actually see like an entire page or an entire application it can write code that can do multiple steps at once and so i think those have been probably the”