Agents using scientific Python libraries such as SciPy and image-manipulation tools such as OpenCV perform significantly better than VLMs on these tasks, but their accuracy remains under 60%.

“Yeah, so we can't, um, even when we do run these as agent tasks, and we provide a bunch of, you know, Python libraries for scientific purposes like SciPy and a bunch of image manipulation libraries like OpenCV, the accuracy is significant bet-- significantly better than the VLMs, but it's still, uh, under sixty percent.”