Current scaling-law theory is insufficient to explain why sparsity helps, the magnitude of its benefit, or whether that benefit plateaus at a particular sparsity level.

“So I think we don't, I don't think we have a good enough theory of scaling laws that”

“we really understand why sparsity is helping and to what,”

“how much it'll help and if that'll like plateau at some point at a certain level of sparsity.”