The WatsonxAI class is used to interact with Watsonx AI Inference Endpoint models. It uses IBM Cloud for authentication. This requires your IBM Cloud API Key which is autoloaded if not specified.

Hierarchy

  • LLM<BaseLLMCallOptions>
    • WatsonxAI

Constructors

  • Parameters

    Returns WatsonxAI

Properties

endpoint: string
modelId: string = "meta-llama/llama-2-70b-chat"
region: string = "us-south"
version: string = "2023-05-29"
ibmCloudApiKey?: string
ibmCloudToken?: string
ibmCloudTokenExpiresAt?: number
modelKwargs?: Record<string, unknown>
modelParameters?: Record<string, unknown>
projectId?: string

Methods

  • Returns Promise<string>

Generated using TypeDoc