Transformers can be trained on audio, video, text, and other data to learn patterns, and Karpathy says they work well.

“You can train transformers on audio or video or text or whatever you want, and it just learns patterns and they're very powerful and it works really well.”