Joscha Bach characterizes transformer models as statistical aggregates produced through growth, pruning, gardening, chaperoning, and training rather than being written by humans.

“They're not written by human beings. They're statistical aggregates that are woven, that are grown. And in many ways, the computer models that we're playing with today, they're, they're a result of growth, and they're pruned, and they are gardened and, uh, chaperoned and, uh, trained in, in a way that is much more in which we, uh, observe this happening in biology than it happened when we were writing computer programs by hand.”