Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards.

Fork of LM Evaluation Harness Suite for evaluating benchmarks in paper titled "PLDR-LLMs Learn A Generalizable Tensor Operator That Can Replace Its Own Deep Neural Net At Inference"

A production-style LLM evaluation pipeline spanning vLLM serving, lm-eval-harness integration, performance metrics (TTFT/TPOT/p95), deterministic guardrails, and statistically significant benchmark improvements.

한국어 전문/기술 자격 시험 벤치마크 KMMLU-Pro, KMMLU-Redux를 lm-evaluation-harness로 평가하기 위한 태스크 정의 [LG Aimers 8기 산출물]

Local Windows app: parse lm-evaluation-harness results for 41 LLMs across 19 benchmarks. GUI + CLI + PyInstaller .exe builder. Port of jayminban/41-llms-evaluated-on-19-benchmarks.

Evaluate models and compare their scores

Independent benchmark of HuggingFace SmolLM3-3B (base) — full 5-benchmark suite, two clean vendor validations, reproducible vLLM methodology.

Wrapper of common LLM evaluation frameworks

First third-party benchmarks of Ling-mini-2.0 & Ring-mini-2.0 — honest, reproducible, methodology-transparent

Does the identity in a system prompt change performance?

Independent benchmark of DeepSeek-V2-Lite (base) — full 5-benchmark suite on the modern eval set, with a documented AIME non-termination finding. Reproducible vLLM methodology.