vllm.entrypoints ¶
Modules:
-
anthropic– -
api_server–NOTE: This API server is used only for demonstrating usage of AsyncEngine
-
chat_utils– -
cli– -
generate– -
grpc_server–vLLM gRPC Server
-
launcher– -
llm– -
mcp– -
offline_utils– -
openai– -
pooling– -
serve– -
speech_to_text–