Interface LlamaCppCallOptions

Hierarchy

  • BaseLanguageModelCallOptions
    • LlamaCppCallOptions

Properties

maxTokens? onToken?

Properties

Optional maxTokens

maxTokens?: number

The maximum number of tokens the response should contain.

Optional onToken

onToken?: ((tokens) => void)

Type declaration

    • (tokens): void

    • A function called when matching the provided token array

      Parameters

      • tokens: number[]

      Returns void

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc