It is difficult to compare constrained and unconstrained reinforcement-learning approaches on the same task because designing a reward function that implicitly encodes a specific constraint is difficult.

“potentially but then compare them on the same task and that becomes difficult because the t because just designing a reward function which actually implicitly informs a specific constraint is difficult so maybe the probably would need to do kind of the other way around like you would need to have okay the RL agent actually figure out an optimal solution and then we need to go and and based on kind of”