Agents submit actions as integers from one through six.

“jump out of here what agents will get is agents will get a series of frames and those frames will be 64 by 64 now generally it's just going to be one frame but you might be able to get like maybe two in a row or three in a row and that would show an animation and so beginning state middle state end state and so you can kind of get a perception of over time there what we ask for back is just one through six a series of one through six actions and it's really just integers and so you pass back a one two three four five or six”