Struct ModelMetadata 

pub struct ModelMetadata {
    pub version: u16,
    pub models: HashMap<Pattern, ModelMetadataEntry>,
}

Metadata for AI models including costs and context size.

Example JSON:

{
  "version": 1,
  "models": {
    "gpt-4": {
      "costs": {
        "inputPerToken": 0.0000003,
        "outputPerToken": 0.00000165,
        "outputReasoningPerToken": 0.0,
        "inputCachedPerToken": 0.0000015,
        "inputCacheWritePerToken": 0.00001875
      },
      "contextSize": 1000000
    }
  }
}

Fields

version: u16

The version of the model metadata struct.

models: HashMap<Pattern, ModelMetadataEntry>

The mappings of model ID => metadata as a dictionary.

Implementations

impl ModelMetadata

pub fn is_empty(&self) -> bool

true if the model metadata is empty or the version is unsupported.

pub fn is_enabled(&self) -> bool

false if the version is unsupported.

pub fn cost_per_token(&self, model_id: &str) -> Option<&ModelCostV2>

Gets the cost per token for a given model, if defined.

pub fn context_size(&self, model_id: &str) -> Option<u64>

Gets the context window size for a given model, if defined.

Returns None for a zero context size, as it is not a meaningful value.

pub fn get(&self, model_id: &str) -> Option<&ModelMetadataEntry>

Gets the metadata for a given model, if defined.

Trait Implementations

impl Clone for ModelMetadata

fn clone(&self) -> ModelMetadata

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelMetadata

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ModelMetadata

fn default() -> ModelMetadata

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ModelMetadata

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for ModelMetadata

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.