The speaker believes most models—and possibly all models—still cannot meaningfully solve the games, while allowing that models can solve some individual games.

“but honestly like most models still can't really do or i don't actually think any models can solve these games very meaningfully like there are some games that they can i think i've seen astra be able to solve the kirby game and we also for this benchmark we intentionally designed a really minimal harness and i will get to this point about harnesses because i think there's a whole conversation to be had about like what is the value of a harness like what is even the”