Skip to main content

GEN_AI__COST__CACHE_READ__INPUT_TOKENS

relay_conventions::attributes

Constant GEN_AI__COST__CACHE_READ__INPUT_TOKENS 

Source 
pub const GEN_AI__COST__CACHE_READ__INPUT_TOKENS: &str = "gen_ai.cost.cache_read.input_tokens";
Expand description

The cost of cached input tokens in USD.

  • Scrubbing: Manual
  • Rewriting behavior: None