Class GradientLLM

The GradientLLM class is used to interact with Gradient AI inference Endpoint models. This requires your Gradient AI Access Token which is autoloaded if not specified.

Hierarchy

  • LLM<BaseLLMCallOptions>
    • GradientLLM

Constructors

constructor

Properties

baseModel modelSlug gradientAccessKey? inferenceParameters? workspaceId?

Methods

setBaseModel

Constructors

constructor

  • Parameters

    Returns GradientLLM

Properties

baseModel

baseModel: any

modelSlug

modelSlug: string = "llama2-7b-chat"

Optional gradientAccessKey

gradientAccessKey?: string

Optional inferenceParameters

inferenceParameters?: Record<string, unknown>

Optional workspaceId

workspaceId?: string

Methods

setBaseModel

  • Returns Promise<void>

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc