vllm.utils.mem_constants ¶
Attributes:
-
GB_bytes–The number of bytes in one gigabyte (GB).
-
GiB_bytes–The number of bytes in one gibibyte (GiB).
-
KB_bytes–The number of bytes in one kilobyte (KB).
-
KiB_bytes–The number of bytes in one kibibyte (KiB).
-
MB_bytes–The number of bytes in one megabyte (MB).
-
MiB_bytes–The number of bytes in one mebibyte (MiB).
GB_bytes = 1000000000 module-attribute ¶
The number of bytes in one gigabyte (GB).
GiB_bytes = 1 << 30 module-attribute ¶
The number of bytes in one gibibyte (GiB).
KB_bytes = 1000 module-attribute ¶
The number of bytes in one kilobyte (KB).
KiB_bytes = 1 << 10 module-attribute ¶
The number of bytes in one kibibyte (KiB).
MB_bytes = 1000000 module-attribute ¶
The number of bytes in one megabyte (MB).
MiB_bytes = 1 << 20 module-attribute ¶
The number of bytes in one mebibyte (MiB).