LLM Router

Multi-model LLM routing and request distribution

Total Requests

48,291

Avg Response Time

1.2s

Model Performance

ModelRequestsAvg LatencySuccess Rate
Claude 3.5 Sonnet241521.4s99.9%
GPT-4o158471.8s99.7%
Gemini 2.0 Flash82920.8s99.8%