Class Bedrock

A type of Large Language Model (LLM) that interacts with the Bedrock service. It extends the base LLM class and implements the BaseBedrockInput interface. The class is designed to authenticate and interact with the Bedrock service, which is a part of Amazon Web Services (AWS). It uses AWS credentials for authentication and can be configured with various parameters such as the model to use, the AWS region, and the maximum number of tokens to generate.

Hierarchy

Constructors

constructor

Properties

codec credentials fetchFn model region streaming endpointHost? maxTokens? modelKwargs? stopSequences? temperature?

Methods

invocationParams

Constructors

constructor

  • Parameters

    • Optional fields: Partial<BaseBedrockInput> & BaseLLMParams

    Returns Bedrock

Properties

codec

codec: EventStreamCodec = ...

credentials

credentials: CredentialType

fetchFn

fetchFn: ((input, init?) => Promise<Response>)

Type declaration

    • (input, init?): Promise<Response>

    • Parameters

      • input: RequestInfo | URL
      • Optional init: RequestInit

      Returns Promise<Response>

model

model: string = "amazon.titan-tg1-large"

region

region: string

streaming

streaming: boolean = false

Optional endpointHost

endpointHost?: string

Optional maxTokens

maxTokens?: number = undefined

Optional modelKwargs

modelKwargs?: Record<string, unknown>

Optional stopSequences

stopSequences?: string[]

Deprecated

Optional temperature

temperature?: number = undefined

Methods

invocationParams

  • Parameters

    • Optional options: Omit<BaseLLMCallOptions, never>

    Returns {
        maxTokens: undefined | number;
        model: string;
        modelKwargs: undefined | Record<string, unknown>;
        region: string;
        stop: undefined | string[];
        temperature: undefined | number;
    }

    • maxTokens: undefined | number
    • model: string
    • modelKwargs: undefined | Record<string, unknown>
    • region: string
    • stop: undefined | string[]
    • temperature: undefined | number

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc