Constant GEN_AI__REQUEST__TOP_P 

pub const GEN_AI__REQUEST__TOP_P: &str = "gen_ai.request.top_p";

Limits the model to only consider tokens whose cumulative probability mass adds up to p, where p is a float between 0 and 1 (e.g., top_p=0.7 means only tokens that sum up to 70% of the probability mass are considered).

• PII: Maybe
• Rewriting behavior: None

Aliases

• AI__TOP_P (ai.top_p)