Noam Brown

“So you would probably not see a big benefit for having 10,000 agents working on a novel together.”

Expects: Using 10,000 agents to write a novel would probably provide little benefit. · no date given · not yet resolved

“But it's going to be very hard to push that all the way to 10,000 and know for sure what was the benefit that we actually got for using 10,000 agents versus 1,000.”

Expects: The speaker expects it will be very difficult to determine the benefit of using 10,000 agents rather than 1,000 agents. · no date given · not yet resolved

“So if we're if we run out of problems to ask it that that challenge it, then that is a plausible scenario where actually like, it becomes much harder to make progress.”

Expects: The speaker considers it plausible that AI progress would become much harder if researchers ran out of problems challenging enough for the model. · no date given · not yet resolved

“And it's possible that domains like math we see a similar trajectory, but I think there is a very plausible scenario where actually that doesn't happen.”

Expects: Mathematics might follow the rapid capability trajectory seen in game-playing AI, though the speaker considers it very plausible that it will not. · no date given · not yet resolved

“if it's done well, they can end up coordinating it very effectively in these kinds of very structured ways.”

Expects: If multi-agent coordination is designed well, agents can coordinate very effectively through structured processes. · no date given · not yet resolved

“So will it feel foreign? I don't know. I've actually found that it's pretty surprisingly natural to work with these things right now. I think that could change. So, for example, we have these like ultra fast modes that enable sampling to be like. 10 or 15x faster or whatever and then like okay it's going to be pretty hard to keep up with”

Expects: The speaker thinks working with agents could become less natural or harder to keep up with as interaction speeds increase; ultra-fast modes can make sampling 10–15 times faster. · no date given · not yet resolved

“if the alignment problem is solved then you don't have the issue of misalignment between individuals and the company like at least that's mitigated like the ai's if they're fully if they're if they're aligned well they can just be aligned to the interests of the company and you can have 10 000 of them and they're all going to be working as hard as if they were like a 20 share co-founder”

Expects: If aligned well, AI workers could work for a company with effort comparable to that of a co-founder holding a 20% share. · no date given · not yet resolved

“if the alignment problem is solved then you don't have the issue of misalignment between individuals and the company like at least that's mitigated like the ai's if they're fully if they're if they're aligned well they can just be aligned to the interests of the company and you can have 10 000 of them and they're all going to be working as hard as if they were like a 20 share co-founder”

Expects: If AI alignment is solved, incumbents could mitigate internal misalignment by deploying 10,000 AIs aligned with the company's interests. · no date given · not yet resolved