vllm.benchmarks.lib ¶

Benchmark library utilities.

Modules:

• endpoint_request_func –

  The request function for API endpoints.

• ready_checker –

  Utilities for checking endpoint readiness.

• utils –