vllm.model_executor.models.transformers ¶

Wrapper around transformers models

Modules:

• base –

  Transformers modeling backend base class.

• causal –

  Transformers modeling backend mixin for causal language models.

• legacy –

  Transformers modeling backend mixin for legacy models.

• moe –

  Transformers modeling backend mixin for Mixture of Experts (MoE) models.

• multimodal –

  Transformers modeling backend mixin for multi-modal models.

• pooling –

  Transformers modeling backend mixins for pooling models.

• utils –

  Transformers modeling backend utilities.

Functions:

• __getattr__ –

  Handle imports of non-existent classes with a helpful error message.

 98
 99
100
101
102
103
104
105
106

def __getattr__(name: str):
    """Handle imports of non-existent classes with a helpful error message."""
    if name not in globals():
        raise AttributeError(
            "The Transformers modeling backend does not currently have a class to "
            f"handle the requested model type: {name}. Please open an issue at "
            "https://github.com/vllm-project/vllm/issues/new"
        )
    return globals()[name]