The speaker says subtle implementation details can make methods work or fail, leading papers to make contradictory claims; in a recent paper the speaker tried to submit to ICLR, an implementation bug did not stop the method from working to some extent.

“would essentially claim more or less contradictory things because depending on subtle details things can just work or not work and they can be really really so even if you do something completely wrong like I have recently I have a paper which I tried to get done for ICLR where I had like an implementation bug it still kind of worked”