pub const AI__FREQUENCY_PENALTY: &str = "ai.frequency_penalty";๐Deprecated:
Use GEN_AI__REQUEST__FREQUENCY_PENALTY (gen_ai.request.frequency_penalty) instead.
Expand description
Used to reduce repetitiveness of generated tokens. The higher the value, the stronger a penalty is applied to previously present tokens, proportional to how many times they have already appeared in the prompt or prior generation.
- PII: Maybe
- Rewriting behavior: Backfill
ยงAliases
GEN_AI__REQUEST__FREQUENCY_PENALTY(gen_ai.request.frequency_penalty)