Class WatsonxAI

The WatsonxAI class is used to interact with Watsonx AI Inference Endpoint models. It uses IBM Cloud for authentication. This requires your IBM Cloud API Key which is autoloaded if not specified.

Hierarchy (view full)

Constructors

constructor

Properties

endpoint modelId region version ibmCloudApiKey? ibmCloudToken? ibmCloudTokenExpiresAt? modelKwargs? modelParameters? projectId?

Methods

generateToken

Constructors

constructor

Properties

endpoint

endpoint: string

modelId

modelId: string = "meta-llama/llama-2-70b-chat"

region

region: string = "us-south"

version

version: string = "2023-05-29"

OptionalibmCloudApiKey

ibmCloudApiKey?: string

OptionalibmCloudToken

ibmCloudToken?: string

OptionalibmCloudTokenExpiresAt

ibmCloudTokenExpiresAt?: number

OptionalmodelKwargs

modelKwargs?: Record<string, unknown>

OptionalmodelParameters

modelParameters?: Record<string, unknown>

OptionalprojectId

projectId?: string

Methods

generateToken

Settings

Member Visibility

On This Page

Constructors
Properties
Methods