Skip to main content

AI__FREQUENCY_PENALTY

Constant AI__FREQUENCY_PENALTY 

Source
pub const AI__FREQUENCY_PENALTY: &str = "ai.frequency_penalty";
๐Ÿ‘ŽDeprecated:

Use GEN_AI__REQUEST__FREQUENCY_PENALTY (gen_ai.request.frequency_penalty) instead.

Expand description

Used to reduce repetitiveness of generated tokens. The higher the value, the stronger a penalty is applied to previously present tokens, proportional to how many times they have already appeared in the prompt or prior generation.

  • PII: Maybe
  • Rewriting behavior: Backfill

ยงAliases