Ermon argues conditionally that if a model's perplexity decreases, it can achieve the corresponding compression level, indicating that structure exists in the data and the model has uncovered it.

“and so to the extent you know the numbers don't lie to the extent that you are able to drive different”

“But if it flexes down,”

“then it means that you can actually build like a compression scheme and that will get you that sort of like level of compression.”

“And so the structure must be there and the model must have been able to uncover it.”