The speaker recalls that researchers considered the delayed binary reward in cart-pole an interesting problem because it might better represent animal learning.

“signal so it's either balanced or it's not and and it's a signal from the future so you have to do a lot of stuff before that thing says yes and and at the time they thought that this was an interesting problem to solve because this is much more kind of like amenable to you know maybe it's a better representation of animal learning”