Search results

Clarify sampling parameters - defaults from model or benchlocal?

Status: Open.

#12 In stevibe/BenchLocal;

· gdevenyi opened on May 9, 2026

Walltime/other performance metrics?

Status: Open.

#11 In stevibe/BenchLocal;

· gdevenyi opened on May 8, 2026

Averaging runs

Status: Open.

#10 In stevibe/BenchLocal;

· Neiko2002 opened on May 4, 2026

Additiona bench pack samplings parameter: presence_penalty

Status: Open.

#9 In stevibe/BenchLocal;

· Neiko2002 opened on May 4, 2026

"fetch failed" is actually a timeout abort misclassified

Status: Open.

#7 In stevibe/BenchLocal;

· madcato opened on Apr 24, 2026

Bug in BF-03 — keyword matching breaks when models use inline markdown

Status: Open.

#6 In stevibe/BenchLocal;

· madcato opened on Apr 24, 2026