Skip to main content

GEN_AI__USAGE__INPUT_TOKENS

relay_conventions::attributes

Constant GEN_AI__USAGE__INPUT_TOKENS 

Source 
pub const GEN_AI__USAGE__INPUT_TOKENS: &str = "gen_ai.usage.input_tokens";
Expand description

The number of tokens used to process the AI input (prompt) including cached input tokens.

  • PII: Maybe
  • Rewriting behavior: None

ยงAliases