vllm.entrypoints.serve.utils ¶

Modules:

• api_utils –
• constants –

  Shared constants for vLLM entrypoints.

• fingerprint –

  Build the system_fingerprint string returned by the OpenAI-compatible

• orca_metrics –

  Utility functions that create ORCA endpoint load report response headers.

• server_utils –
• ssl –
• tool_calls_utils –