The benchmarks evaluate LM agent on SWE/Computer-use tasks across different operating systems.
SWE-bench-Live
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
SWE-bench-Live
Here we host SWE-bench-Live dataset, with continuous monthly updates!
models 0
None public yet
datasets 6
SWE-bench-Live/ORACLE-SWE
Viewer • Updated • 8 • 262 • 2
SWE-bench-Live/repo-build-test-benchmark
Viewer • Updated • 152 • 715
SWE-bench-Live/MultiLang
Viewer • Updated • 1.08k • 12.8k • 1
SWE-bench-Live/Windows
Viewer • Updated • 66 • 931 • 1
SWE-bench-Live/SWE-bench-Live
Viewer • Updated • 3.69k • 38.9k • 10
SWE-bench-Live/OS-bench
Viewer • Updated • 140 • 679 • 1