Storing conversation state in the Messages API could eliminate repeated transmission of full conversation histories and improve latency and efficiency, especially for long conversations.

“Like, we're starting to roll out some things that are like, you know, what if we were able to not have you have to, like, pass back and forth the entire, like, conversation state, right?”

“And, um, if you didn't have to do that on the messages API because you were open to, like, you know, a storage of that state for some period of time, right, then, like, especially for long conversations where the context really builds up, like, you get a lot of really great latency and efficiency wins there, too.”