The speaker says neural-network efficiency requires substantial work on tensor layout and strides and on coordinating memory movement in kernels.

“And there's a huge amount of work to do efficiency.”

“You need your tensors, you lay them out,”

“you stride them,”

“you make sure your kernels are orchestrating memory movement correctly,”

“It's all just efficiency,”

“roughly speaking.”