Skip to main content

GEN_AI__RESPONSE__TOKENS_PER_SECOND

relay_conventions::attributes

Constant GEN_AI__RESPONSE__TOKENS_PER_SECOND 

Source 
pub const GEN_AI__RESPONSE__TOKENS_PER_SECOND: &str = "gen_ai.response.tokens_per_second";
Expand description

The total output tokens per seconds throughput.

  • PII: Maybe
  • Rewriting behavior: None