Skip to main content

GEN_AI__USAGE__INPUT_TOKENS__CACHED

relay_conventions::attributes

Constant GEN_AI__USAGE__INPUT_TOKENS__CACHED 

Source 
pub const GEN_AI__USAGE__INPUT_TOKENS__CACHED: &str = "gen_ai.usage.input_tokens.cached";
Expand description

The number of cached tokens used to process the AI input (prompt).

  • PII: Maybe
  • Rewriting behavior: None