Language models lack deep understanding of how ideas were discovered and how those discovery processes can be used creatively to design next-generation algorithms.

“It's just the throughput to recombine those ideas and attaching them are extremely high. To some extent, those language models don't have a deep understanding of like how those ideas came from and how can I use the...”

“Like the process those ideas get discovered to design the next generation of algorithm like in a very creative way.”