GPT-4 answers that bugs are obviously real because, unlike GPT-3, it understands the intent behind the training at a deeper level.

“you don't want it to really answer that and because it was so stupid it could not understand anything deeper than like pattern matching on the phrase is x real gpt4 doesn't do this if you ask are bugs real it will tell you obviously they are because it understands kind of on a deeper level what you are trying to do with the training so we definitely think that as ais get smarter those kind of”