Skip to main content

AI__TOP_P

relay_conventions::attributes

Constant AI__TOP_P 

Source 
pub const AI__TOP_P: &str = "ai.top_p";
👎Deprecated:

Use GEN_AI__REQUEST__TOP_P (gen_ai.request.top_p) instead.

Expand description

Limits the model to only consider tokens whose cumulative probability mass adds up to p, where p is a float between 0 and 1 (e.g., top_p=0.7 means only tokens that sum up to 70% of the probability mass are considered).

  • PII: Maybe
  • Rewriting behavior: Backfill

§Aliases