Skip to content

vllm.v1.metrics.utils

Functions:

create_metric_per_engine(metric, per_engine_labelvalues)

Create a labeled metric child for each engine index.

Source code in vllm/v1/metrics/utils.py 
11
12
13
14
15
16
17
18
19
def create_metric_per_engine(
    metric: PromMetric,
    per_engine_labelvalues: dict[int, list[object]],
) -> dict[int, PromMetric]:
    """Create a labeled metric child for each engine index."""
    return {
        idx: metric.labels(*labelvalues)
        for idx, labelvalues in per_engine_labelvalues.items()
    }