A Benchmark for Localizing Code and Non-Code Issues in Software Projects

By Ze-Jun Zhang, Jian Wang, Qing-Yun Yang, Yifan Pan, Yi Tang, Yi Li, Zhenchang Xing, Tian Zhang, Xuan-Dong Li, Guo-An Zhang. 2025

Subfields: Evaluation & Benchmarks, Software Engineering

Citations in the corpus

• Agentic Software Issue Resolution with Large Language Models: A Survey (2025, unknown): “Second, the raw data are processed with handcrafted parsing rules to filter Benchmarks BenchmarkConstruction Manual SWE-bench[76],SWE-benchLite[76],SWE-benchVerified[35],SWE-benchLite-S[164],SWE-bench-java[182],SWE-benchMultimodal[175],SWE-Bench+[9],FAUN-Eval[64],VisualSWE-bench[192],FEA-Bench[92], ”