You've overstated the conclusion. The SWE-bench series has had issues since its ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		sk4rekr0w 3 days ago \| parent \| context \| favorite \| on: GPT-5.6 You've overstated the conclusion. The SWE-bench series has had issues since its inception. OpenAI no longer recommends SWE-Bench-Pro as a benchmark: https://openai.com/index/separating-signal-from-noise-coding...
		help

bigfishrunning 3 days ago [–]

That's smart, they only recommend benchmarks that make them look better then their competitors.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact