Skip to main content

GEN_AI__USAGE__CACHE_READ__INPUT_TOKENS

relay_conventions::attributes

Constant GEN_AI__USAGE__CACHE_READ__INPUT_TOKENS 

Source 
pub const GEN_AI__USAGE__CACHE_READ__INPUT_TOKENS: &str = "gen_ai.usage.cache_read.input_tokens";
Expand description

The number of cached tokens used to process the AI input (prompt).

  • Scrubbing: Manual
  • Rewriting behavior: None

ยงAliases