Skip to content

Add batch support for speculative decoding and it's pruning#38

Merged
HaibaraAiChan merged 1 commit intomainfrom
spec_dec
Feb 3, 2026
Merged

Add batch support for speculative decoding and it's pruning#38
HaibaraAiChan merged 1 commit intomainfrom
spec_dec

Commits

Commits on Feb 3, 2026