Skip to main content

GEN_AI__RESPONSE__TIME_TO_FIRST_TOKEN

relay_conventions::attributes

Constant GEN_AI__RESPONSE__TIME_TO_FIRST_TOKEN 

Source 
pub const GEN_AI__RESPONSE__TIME_TO_FIRST_TOKEN: &str = "gen_ai.response.time_to_first_token";
Expand description

Time in seconds when the first response content chunk arrived in streaming responses.

  • PII: Maybe
  • Rewriting behavior: None