New arXiv work shows 10.7% of passing SWE-agent trajectories are "Lucky Passes" with regressions or blind retries, highlighting that binary pass/fail signals hide messy agent behavior. AgentLens offers…

#SWEAgents #AgentEval #DeveloperTools #AIEngineering
https://arxiv.org/abs/2605.12925