Popular repositories Loading

1. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. ProxyAttn ProxyAttn Public

   Forked from wyxstriker/ProxyAttn

   Implementation of the paper "ProxyAttn: Guided Sparse Attention via Representative Heads".

   Python

4. FastVideo FastVideo Public

   Forked from hao-ai-lab/FastVideo

   A unified inference and post-training framework for accelerated video generation.

   Python

5. RULER RULER Public

   Forked from NVIDIA/RULER

   This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

   Python