The speaker says that language models emerging in late 2022 and early 2023 produced gibberish, while RLHF was among the approaches being used.

“Um, and there's still some of that around to, to some extent, right, as it gets more nuanced and, and language evolves. But, um, you know, uh, uh, when language models first came onto the scene, you know, late 2022, early 2023, we-- there's a bunch of RLHF and-- But the models were kinda putting out gibberish, right?”