Skip to content

vllm.distributed.kv_transfer.kv_pipe

Modules:

Name Description
base

This file defines an interface KVPipeBase
mooncake_pipe
pynccl_pipe

This module implements a PyNccl pipe for sending and receiving