vllm.v1.sample.ops ¶

Modules:

• logprobs –

  Some utilities for logprobs, including logits.

• penalties –
• topk_topp_sampler –
• topk_topp_triton –

  Combined Top-K and Top-P Triton kernels.