Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 91.1k 21.8k

2. ai-dynamo/dynamo ai-dynamo/dynamo Public

   A Datacenter Scale Distributed Inference Serving Framework

   Rust 8k 1.6k

3. llm-d/llm-d-kv-cache llm-d/llm-d-kv-cache Public

   Distributed KV cache scheduling & offloading libraries

   Go 176 156

4. ornladios/ADIOS2 ornladios/ADIOS2 Public

   Next generation of ADIOS developed in the Exascale Computing Program

   C++ 326 153