Cohere¶
Cohere provides cutting-edge language models. These are accessible accessible through OpenAI's SDK via the Compatibility API. This allows easy and portable integration with the Strands Agents SDK using the familiar OpenAI interface.
Installation¶
The Strands Agents SDK provides access to Cohere models through the OpenAI compatiblity layer, configured as an optional dependency. To install, run:
pip install 'strands-agents[openai]'
Usage¶
After installing the openai
package, you can import and initialize the Strands Agents' OpenAI-compatible provider for Cohere models as follows:
from strands import Agent
from strands.models.openai import OpenAIModel
from strands_tools import calculator
model = OpenAIModel(
client_args={
"api_key": "<COHERE_API_KEY>",
"base_url": "https://api.cohere.ai/compatibility/v1", # Cohere compatibility endpoint
},
model_id="command-a-03-2025", # or see https://docs.cohere.com/docs/models
params={
"stream_options": None
}
)
agent = Agent(model=model, tools=[calculator])
agent("What is 2+2?")
Configuration¶
Client Configuration¶
The client_args
configure the underlying OpenAI-compatible client. When using Cohere, you must set:
api_key
: Your Cohere API key. Get one from the Cohere Dashboard.base_url
:https://api.cohere.ai/compatibility/v1
Refer to OpenAI Python SDK GitHub for full client options.
Model Configuration¶
The model_config
specifies which Cohere model to use and any additional parameters.
Parameter | Description | Example | Options |
---|---|---|---|
model_id |
Model name | command-r-plus |
See Cohere docs |
params |
Model-specific parameters | {"max_tokens": 1000, "temperature": 0.7} |
API reference |
Troubleshooting¶
ModuleNotFoundError: No module named 'openai'
¶
You must install the openai
dependency to use this provider:
pip install 'strands-agents[openai]'
Unexpected model behavior?¶
Ensure you're using a model ID compatible with Cohere’s Compatibility API (e.g., command-r-plus
, command-a-03-2025
, embed-v4.0
), and your base_url
is set to https://api.cohere.ai/compatibility/v1
.