Skip to content

fenic.core.types.provider_routing

Provider routing shared types and constants.

Defines the allowed provider sorting strategies for OpenRouter provider routing.

Attributes:

  • DataCollection –

    Type alias representing provider data collection policies.

  • ModelQuantization –

    Type alias representing supported quantization formats for provider models.

  • ProviderSort –

    Type alias representing provider sorting strategies used by OpenRouter routing.

  • StructuredOutputStrategy –

    Type alias representing the strategy to use when a model supports both

DataCollection module-attribute 

DataCollection = Literal['allow', 'deny']

Type alias representing provider data collection policies.

Valid values:

  • "allow": Permit providers that may retain or train on prompts non-transiently.
  • "deny": Restrict to providers that do not collect/store user data.

ModelQuantization module-attribute 

ModelQuantization = Literal['int4', 'int8', 'fp4', 'fp6', 'fp8', 'fp16', 'bf16', 'fp32', 'unknown']

Type alias representing supported quantization formats for provider models.

Common values:

  • "int4", "int8": Integer quantization for smaller, faster models.
  • "fp4", "fp6", "fp8": Low-precision floating point formats.
  • "fp16", "bf16": Half-precision formats commonly used on GPUs/TPUs.
  • "fp32": Full precision floating point.
  • "unknown": Provider did not specify a quantization.

ProviderSort module-attribute 

ProviderSort = Literal['price', 'throughput', 'latency']

Type alias representing provider sorting strategies used by OpenRouter routing.

Valid values:

  • "price": Prefer providers with the lowest recent price.
  • "throughput": Prefer providers with the highest recent throughput.
  • "latency": Prefer providers with the lowest recent latency.

StructuredOutputStrategy module-attribute 

StructuredOutputStrategy = Literal['prefer_tools', 'prefer_response_format']

Type alias representing the strategy to use when a model supports both tool-calling and response-format-based structured outputs.

Valid values:

  • "prefer_tools": Prefer tool/function calling with a JSON schema.
  • "prefer_response_format": Prefer response_format structured outputs.