Skip to main content

GEN_AI__USAGE__INPUT_TOKENS__CACHED

relay_conventions::attributes

Constant GEN_AI__USAGE__INPUT_TOKENS__CACHED 

Source 
pub const GEN_AI__USAGE__INPUT_TOKENS__CACHED: &str = "gen_ai.usage.input_tokens.cached";
👎Deprecated:

Use GEN_AI__USAGE__CACHE_READ__INPUT_TOKENS (gen_ai.usage.cache_read.input_tokens) instead.

Expand description

The number of cached tokens used to process the AI input (prompt).

  • Scrubbing: Manual
  • Rewriting behavior: Backfill

§Aliases