Skip to content

vllm.config.weight_transfer

Classes:

WeightTransferConfig

Configuration for weight transfer during RL training.

Attributes:

  • backend (Literal['nccl', 'ipc'] | str) –

    The backend to use for weight transfer. Validated against the

Source code in vllm/config/weight_transfer.py 
 8
 9
10
11
12
13
14
15
@config
class WeightTransferConfig:
    """Configuration for weight transfer during RL training."""

    backend: Literal["nccl", "ipc"] | str = "nccl"
    """The backend to use for weight transfer. Validated against the
    `WeightTransferEngineFactory` registry at engine creation time.
    """

backend = 'nccl' class-attribute instance-attribute

The backend to use for weight transfer. Validated against the WeightTransferEngineFactory registry at engine creation time.