Skip to content

Nebius Token Factory

Community Contribution

This is a community-maintained package that is not owned or supported by the Strands team. Validate and review the package before using it in your project.

Have your own integration? We'd love to add it here too!

Language Support

This provider is only supported in Python.

Nebius Token Factory provides fast inference for open-source language models. Nebius Token Factory is accessible through OpenAI's SDK via full API compatibility, allowing easy and portable integration with the Strands Agents SDK using the familiar OpenAI interface.

Installation

The Strands Agents SDK provides access to Nebius Token Factory models through the OpenAI compatibility layer, configured as an optional dependency. To install, run:

pip install 'strands-agents[openai]' strands-agents-tools

Usage

After installing the openai package, you can import and initialize the Strands Agents' OpenAI-compatible provider for Nebius Token Factory models as follows:

from strands import Agent
from strands.models.openai import OpenAIModel
from strands_tools import calculator

model = OpenAIModel(
    client_args={
        "api_key": "<NEBIUS_API_KEY>",
        "base_url": "https://api.tokenfactory.nebius.com/v1/",
    },
    model_id="deepseek-ai/DeepSeek-R1-0528",  # or see https://docs.tokenfactory.nebius.com/ai-models-inference/overview
    params={
        "max_tokens": 5000,
        "temperature": 0.1
    }
)

agent = Agent(model=model, tools=[calculator])
agent("What is 2+2?")

Configuration

Client Configuration

The client_args configure the underlying OpenAI-compatible client. When using Nebius Token Factory, you must set:

  • api_key: Your Nebius Token Factory API key. Get one from the Nebius Token Factory Console.
  • base_url: https://api.tokenfactory.nebius.com/v1/

Refer to OpenAI Python SDK GitHub for full client options.

Model Configuration

The model_config specifies which Nebius Token Factory model to use and any additional parameters.

Parameter Description Example Options
model_id Model name deepseek-ai/DeepSeek-R1-0528 See Nebius Token Factory Models
params Model-specific parameters {"max_tokens": 5000, "temperature": 0.7, "top_p": 0.9} API reference

Troubleshooting

ModuleNotFoundError: No module named 'openai'

You must install the openai dependency to use this provider:

pip install 'strands-agents[openai]'

Unexpected model behavior?

Ensure you're using a model ID compatible with Nebius Token Factory (e.g., deepseek-ai/DeepSeek-R1-0528, meta-llama/Meta-Llama-3.1-70B-Instruct), and your base_url is set to https://api.tokenfactory.nebius.com/v1/.

References