Skip to main content

GEN_AI__REQUEST__STOP_SEQUENCES

relay_conventions::attributes

Constant GEN_AI__REQUEST__STOP_SEQUENCES 

Source 
pub const GEN_AI__REQUEST__STOP_SEQUENCES: &str = "gen_ai.request.stop_sequences";
Expand description

List of sequences that the model will use to stop generating further tokens.

  • Scrubbing: Manual
  • Rewriting behavior: None