Skip to main content

GEN_AI__REQUEST__FREQUENCY_PENALTY

Constant GEN_AI__REQUEST__FREQUENCY_PENALTY 

Source
pub const GEN_AI__REQUEST__FREQUENCY_PENALTY: &str = "gen_ai.request.frequency_penalty";
Expand description

Used to reduce repetitiveness of generated tokens. The higher the value, the stronger a penalty is applied to previously present tokens, proportional to how many times they have already appeared in the prompt or prior generation.

  • PII: Maybe
  • Rewriting behavior: None

ยงAliases