Accessibility information, direct DOM access, and related methods let a language model inspect an entire page or application and execute multiple computer-use steps through code.

“scrolling you know so it would like take a screenshot it would try to do something it would be like oh i gotta like scroll down to the next page of results and then it would take a screenshot and then we try to do something with scroll down again and so i think um with with accessibility and other and and direct access to the dom and other things like that now the language model can actually see like an entire page or an entire application it can write code that can do multiple steps at once and so i think those have been probably the”