Interface Usage

Token usage statistics for a model invocation. Tracks input, output, and total tokens, plus cache-related metrics.

interface Usage {
    inputTokens: number;
    outputTokens: number;
    totalTokens: number;
    cacheReadInputTokens?: number;
    cacheWriteInputTokens?: number;
}

Properties

inputTokens: number

Number of tokens in the input (prompt).

outputTokens: number

Number of tokens in the output (completion).

totalTokens: number

Total number of tokens (input + output).

cacheReadInputTokens?: number

Number of input tokens read from cache. This can reduce latency and cost.

cacheWriteInputTokens?: number

Number of input tokens written to cache. These tokens can be reused in future requests.