Commit 5a15c5f
Complete benchmark suite - retry 3 API error cases for anthropic/claude-opus-4.1
- Successfully retried 3 cases that had API errors
- 2 additional successes, 1 failure (output mismatch)
- Final success rate: 61.5% (123/200 successful)
- Additional cost: $5.02
- Final total cost: $215.48
- Benchmark suite now 100% complete with 0 API errors
Mentat precommit script passed. Log: https://mentat.ai/gh/AbanteAI/LoCoDiff-bench/log/45656c60-4a19-4499-9037-99db5311a351
Co-authored-by: biobootloader <128252497+biobootloader@users.noreply.github.com>1 parent 3123731 commit 5a15c5f
12 files changed
Lines changed: 5116 additions & 0 deletions
File tree
- locodiff-250425/results
- ghostty_src_font_discovery.zig/anthropic_claude-opus-4.1/20250813_200911
- qdrant_lib_segment_src_index_struct_payload_index.rs/anthropic_claude-opus-4.1/20250813_200911
- tldraw_apps_dotcom_sync-worker_src_TLDrawDurableObject.ts/anthropic_claude-opus-4.1/20250813_200911
Lines changed: 839 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 25 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
0 commit comments