vllm.entrypoints.openai.chat_completion ¶
Modules:
-
batch_serving– -
protocol– -
serving– -
stream_harmony–Harmony-specific streaming delta extraction for chat completions.
vllm.entrypoints.openai.chat_completion ¶Modules:
batch_serving – protocol – serving – stream_harmony – Harmony-specific streaming delta extraction for chat completions.