Issues

• [Dataset/Harness] Unrelated FAIL_TO_PASS tests in Verified/MultiLang, whitespace truncation in parse_log_pytest, and evaluation.py patch/P2P checks

  microsoft/SWE-bench-Live#102 · Filter by author nagLio opened on Oct 23, 2026

• [Dataset/Harness] Wall-clock millisecond durations (e.g. "(1003 ms)") baked into FAIL_TO_PASS test IDs across 6/8 Redis/Valkey instances in MultiLang

  microsoft/SWE-bench-Live#101 · Filter by author nagLio opened on Oct 23, 2026

• Gold-patch validity gate: why our strict score is 46.7% but the environment-corrected score is 58.9%

  microsoft/SWE-bench-Live#100 · Filter by author mz24cn opened on Oct 23, 2026

• Issues on Windows evaluations

  microsoft/SWE-bench-Live#51 · Filter by author ccamacho opened on Aug 19, 2026
  3

• Unprocessable Entity

  microsoft/SWE-bench-Live#8 · Filter by author YellowFlemz opened on Jun 22, 2025

• Inefficient Repository Splitting

  microsoft/SWE-bench-Live#7 · Filter by author YellowFlemz opened on Jun 22, 2025