Tom McGrath says the process's internal structures are discovered through gradient descent, while the team tries to shape the process more effectively.

“everything inside this is actually discovered as a result of gradient descent we're just trying to shape that better and i think this is where the sort of the sort of base disagreement with which certain might come in where like i think it is very hard to specify rewards correctly”