Skip to main content

GEN_AI__REQUEST__TOP_K

Constant GEN_AI__REQUEST__TOP_K 

Source
pub const GEN_AI__REQUEST__TOP_K: &str = "gen_ai.request.top_k";
Expand description

Limits the model to only consider the K most likely next tokens, where K is an integer (e.g., top_k=20 means only the 20 highest probability tokens are considered).

  • PII: Maybe
  • Rewriting behavior: None

ยงAliases