Routing controls: provider policies and usage limits

Routing preferences

• Provider scope can be limited to first-party routes or include all routes

• Ordering strategies include price, throughput, latency and availability

• Append a suffix such as @price to the model name to select a strategy for one request

• Requests in the same session prefer the same route to preserve context-cache hits

Usage limits

• Members and API keys can have daily, weekly, monthly and lifetime limits

• New requests are blocked before reaching an upstream once a limit is reached

Configuration scope

• Personal and organization accounts keep separate routing settings