The input messages sent to the model
| Property | Value |
|---|---|
| Type | string |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | [{"role": "user", "message": "hello"}] |
Used to reduce repetitiveness of generated tokens. The higher the value, the stronger a penalty is applied to previously present tokens, proportional to how many times they have already appeared in the prompt or prior generation.
| Property | Value |
|---|---|
| Type | double |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | 0.5 |
| Aliases | ai.frequency_penalty |
Used to reduce repetitiveness of generated tokens. Similar to frequency_penalty, except that this penalty is applied equally to all tokens that have already appeared, regardless of their exact frequencies.
| Property | Value |
|---|---|
| Type | double |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | 0.5 |
| Aliases | ai.presence_penalty |
The seed, ideally models given the same seed and same other parameters will produce the exact same output.
| Property | Value |
|---|---|
| Type | string |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | 1234567890 |
| Aliases | ai.seed |
For an AI model call, the temperature parameter. Temperature essentially means how random the output will be.
| Property | Value |
|---|---|
| Type | double |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | 0.1 |
| Aliases | ai.temperature |
Limits the model to only consider the K most likely next tokens, where K is an integer (e.g., top_k=20 means only the 20 highest probability tokens are considered).
| Property | Value |
|---|---|
| Type | integer |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | 35 |
| Aliases | ai.top_k |
Limits the model to only consider tokens whose cumulative probability mass adds up to p, where p is a float between 0 and 1 (e.g., top_p=0.7 means only tokens that sum up to 70% of the probability mass are considered).
| Property | Value |
|---|---|
| Type | double |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | 0.7 |
| Aliases | ai.top_p |
The reason why the model stopped generating.
| Property | Value |
|---|---|
| Type | string |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | COMPLETE |
| Aliases | ai.finish_reason |
Unique identifier for the completion.
| Property | Value |
|---|---|
| Type | string |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | gen_123abc |
| Aliases | ai.generation_id |
The vendor-specific ID of the model used.
| Property | Value |
|---|---|
| Type | string |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | gpt-4 |
| Aliases | ai.model_id |
The provider of the model.
| Property | Value |
|---|---|
| Type | string |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | openai |
| Aliases | ai.model.provider |
Name of the tool utilized by the agent.
| Property | Value |
|---|---|
| Type | string |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | Flights |
| Aliases | ai.function_call |
The number of tokens used in the GenAI input (prompt).
| Property | Value |
|---|---|
| Type | integer |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | 10 |
| Aliases | ai.prompt_tokens.used, gen_ai.usage.prompt_tokens |
The number of tokens used in the GenAI response (completion).
| Property | Value |
|---|---|
| Type | integer |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | 10 |
| Aliases | ai.completion_tokens.used, gen_ai.usage.completion_tokens |
The total cost for the tokens used.
| Property | Value |
|---|---|
| Type | double |
| Has PII | false |
| Exists in OpenTelemetry | No |
| Example | 12.34 |
The total number of tokens used to process the prompt. (input tokens plus output todkens)
| Property | Value |
|---|---|
| Type | integer |
| Has PII | false |
| Exists in OpenTelemetry | No |
| Example | 20 |
| Aliases | ai.total_tokens.used |
These attributes are deprecated and will be removed in a future version. Please use the recommended replacements.
The number of tokens used in the GenAI response (completion).
| Property | Value |
|---|---|
| Type | integer |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | 10 |
| Deprecated | Yes, use gen_ai.usage.output_tokens instead |
| Aliases | ai.completion_tokens.used, gen_ai.usage.output_tokens |
The number of tokens used in the GenAI input (prompt).
| Property | Value |
|---|---|
| Type | integer |
| Has PII | false |
| Exists in OpenTelemetry | Yes |
| Example | 20 |
| Deprecated | Yes, use gen_ai.usage.input_tokens instead |
| Aliases | ai.prompt_tokens.used, gen_ai.usage.input_tokens |