Pinned Loading

1. InferMatrixLab/system1-omni InferMatrixLab/system1-omni Public

   community maintained vllm/vllm-omni style inference engine for system1 models in Rust for extreme efficient performance

   Python 63 17

2. douyin-ai-leadgen douyin-ai-leadgen Public

   Python 12 4

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 96.2k 24.4k

4. vllm-project/vllm-omni vllm-project/vllm-omni Public

   A framework for efficient model inference with omni-modality models

   Python 7.5k 2k

5. ByteDance-Seed/VeOmni ByteDance-Seed/VeOmni Public

   VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

   Python 2.3k 314

6. NVIDIA/cudnn-frontend NVIDIA/cudnn-frontend Public

   cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

   Python 987 330