Skip to main content

GEN_AI__REQUEST__MAX_TOKENS

relay_conventions::attributes

Constant GEN_AI__REQUEST__MAX_TOKENS 

Source 
pub const GEN_AI__REQUEST__MAX_TOKENS: &str = "gen_ai.request.max_tokens";
Expand description

The maximum number of tokens to generate in the response.

  • PII: Maybe
  • Rewriting behavior: None