Inference-time probes are a form of mechanistic interpretability that must operate quickly and at scale.

“like earlier in the pipeline um and this is interop right like like probes are effectively a form of like mech interop again it happens has to happen fast it has to happen at scale but yeah this like mech interop stuff is a good research problem so like you can take you know like an open weight model and like try and understand its activations i think we like gemma scope is a good tool for this um”