Task creation involves writing an environment-appropriate prompt and authoring a rubric that specifies what counts as good agent performance.

“That process is its own form of like authoring data, right? Now you're making the task. You have the environment. You gotta, uh, write a prompt that makes sense within the context of that environment.”

“Um, so then you, you write a prompt that is sufficiently complex for the agent that makes sense within the environment. Rollout happens, and you then author the rubric that sort of codifies what does good look like for what the agent has just done.”