Skip to content

vllm.utils.mem_constants

Attributes:

  • GB_bytes

    The number of bytes in one gigabyte (GB).

  • GiB_bytes

    The number of bytes in one gibibyte (GiB).

  • KB_bytes

    The number of bytes in one kilobyte (KB).

  • KiB_bytes

    The number of bytes in one kibibyte (KiB).

  • MB_bytes

    The number of bytes in one megabyte (MB).

  • MiB_bytes

    The number of bytes in one mebibyte (MiB).

GB_bytes = 1000000000 module-attribute

The number of bytes in one gigabyte (GB).

GiB_bytes = 1 << 30 module-attribute

The number of bytes in one gibibyte (GiB).

KB_bytes = 1000 module-attribute

The number of bytes in one kilobyte (KB).

KiB_bytes = 1 << 10 module-attribute

The number of bytes in one kibibyte (KiB).

MB_bytes = 1000000 module-attribute

The number of bytes in one megabyte (MB).

MiB_bytes = 1 << 20 module-attribute

The number of bytes in one mebibyte (MiB).