Skip to content

vllm.utils.math_utils

Math utility functions for vLLM.

Functions:

cdiv(a, b)

Ceiling division.

Source code in vllm/utils/math_utils.py 
10
11
12
def cdiv(a: int, b: int) -> int:
    """Ceiling division."""
    return -(a // -b)

largest_power_of_2_divisor(n)

Return the largest power-of-2 that divides n (isolate lowest set bit).

Source code in vllm/utils/math_utils.py 
30
31
32
def largest_power_of_2_divisor(n: int) -> int:
    """Return the largest power-of-2 that divides *n* (isolate lowest set bit)."""
    return n & (-n)

next_power_of_2(n)

The next power of 2 (inclusive)

Source code in vllm/utils/math_utils.py 
15
16
17
def next_power_of_2(n: int) -> int:
    """The next power of 2 (inclusive)"""
    return 1 if n < 1 else 1 << (n - 1).bit_length()

round_down(x, y)

Round down x to the nearest multiple of y.

Source code in vllm/utils/math_utils.py 
25
26
27
def round_down(x: int, y: int) -> int:
    """Round down x to the nearest multiple of y."""
    return (x // y) * y

round_up(x, y)

Round up x to the nearest multiple of y.

Source code in vllm/utils/math_utils.py 
20
21
22
def round_up(x: int, y: int) -> int:
    """Round up x to the nearest multiple of y."""
    return ((x + y - 1) // y) * y