Skip to content

BedrockModelConfig

Defined in: src/models/bedrock.ts:236

Configuration interface for AWS Bedrock model provider.

Extends BaseModelConfig with Bedrock-specific configuration options for model parameters, caching, and additional request/response fields.

Example

Section titled “Example”
const config: BedrockModelConfig = {
  modelId: 'global.anthropic.claude-sonnet-4-6',
  maxTokens: 1024,
  temperature: 0.7,
  cacheConfig: { strategy: 'auto' }
}

Extends

Section titled “Extends”

Extended by

Section titled “Extended by”

Properties

Section titled “Properties”

maxTokens?

Section titled “maxTokens?”
optional maxTokens?: number;

Defined in: src/models/bedrock.ts:242

Maximum number of tokens to generate in the response.

See

Section titled “See”

https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InferenceConfiguration.html

Overrides

Section titled “Overrides”

BaseModelConfig.maxTokens

temperature?

Section titled “temperature?”
optional temperature?: number;

Defined in: src/models/bedrock.ts:249

Controls randomness in generation.

See

Section titled “See”

https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InferenceConfiguration.html

Overrides

Section titled “Overrides”

BaseModelConfig.temperature

topP?

Section titled “topP?”
optional topP?: number;

Defined in: src/models/bedrock.ts:256

Controls diversity via nucleus sampling.

See

Section titled “See”

https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InferenceConfiguration.html

Overrides

Section titled “Overrides”

BaseModelConfig.topP

stopSequences?

Section titled “stopSequences?”
optional stopSequences?: string[];

Defined in: src/models/bedrock.ts:261

Array of sequences that will stop generation when encountered.

cacheConfig?

Section titled “cacheConfig?”
optional cacheConfig?: CacheConfig;

Defined in: src/models/bedrock.ts:268

Configuration for prompt caching.

See

Section titled “See”

https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html

additionalRequestFields?

Section titled “additionalRequestFields?”
optional additionalRequestFields?: JSONValue;

Defined in: src/models/bedrock.ts:273

Additional fields to include in the Bedrock request.

additionalResponseFieldPaths?

Section titled “additionalResponseFieldPaths?”
optional additionalResponseFieldPaths?: string[];

Defined in: src/models/bedrock.ts:278

Additional response field paths to extract from the Bedrock response.

additionalArgs?

Section titled “additionalArgs?”
optional additionalArgs?: JSONValue;

Defined in: src/models/bedrock.ts:284

Additional arguments to pass through to the Bedrock Converse API.

See

Section titled “See”

https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/ConverseStreamCommand/

stream?

Section titled “stream?”
optional stream?: boolean;

Defined in: src/models/bedrock.ts:294

Whether or not to stream responses from the model.

This will use the ConverseStream API instead of the Converse API.

See

Section titled “See”

includeToolResultStatus?

Section titled “includeToolResultStatus?”
optional includeToolResultStatus?: boolean | "auto";

Defined in: src/models/bedrock.ts:302

Flag to include status field in tool results.

  • true: Always include status field
  • false: Never include status field
  • 'auto': Automatically determine based on model ID (default)

guardrailConfig?

Section titled “guardrailConfig?”
optional guardrailConfig?: BedrockGuardrailConfig;

Defined in: src/models/bedrock.ts:308

Guardrail configuration for content filtering and safety controls.

See

Section titled “See”

https://docs.aws.amazon.com/bedrock/latest/userguide/guardrails.html

useNativeTokenCount?

Section titled “useNativeTokenCount?”
optional useNativeTokenCount?: boolean;

Defined in: src/models/bedrock.ts:319

Whether to use the native Bedrock CountTokens API.

When true, countTokens() calls the Bedrock CountTokens API for accurate counts. When false or not set (default), skips the API call and uses the character-based heuristic estimator.

Default Value

Section titled “Default Value”
false

modelId?

Section titled “modelId?”
optional modelId?: string;

Defined in: src/models/model.ts:183

The model identifier. This typically specifies which model to use from the provider’s catalog.

Inherited from

Section titled “Inherited from”

BaseModelConfig.modelId

contextWindowLimit?

Section titled “contextWindowLimit?”
optional contextWindowLimit?: number;

Defined in: src/models/model.ts:216

Maximum context window size in tokens for the model.

This value represents the total token capacity shared between input and output. When not provided, it is automatically resolved from a built-in lookup table based on the configured model ID. An explicit value always takes precedence.

When modelId is changed via updateConfig(), this value is automatically re-resolved if it was initially auto-populated. Explicitly set values are preserved.

Inherited from

Section titled “Inherited from”

BaseModelConfig.contextWindowLimit