Skip to main content

GEN_AI__CONTEXT__WINDOW_SIZE

relay_conventions::attributes

Constant GEN_AI__CONTEXT__WINDOW_SIZE 

Source 
pub const GEN_AI__CONTEXT__WINDOW_SIZE: &str = "gen_ai.context.window_size";
Expand description

The maximum context window size supported by the model for this generation.

  • PII: Maybe
  • Rewriting behavior: None