Resources · Providers
Provider Capability Matrix
A production-facing comparison of provider capabilities, routing strategy, failover policy, and standardized output behavior.
Capability Matrix
| Provider | Text | Image | Audio | Video | Notes |
|---|---|---|---|---|---|
| OpenAI | ✓ | ✓ | ✓ | — | Primary lane for chat + voice + image generation. |
| Gemini | ✓ | ✓ | — | — | Strong multimodal reasoning lane (non-voice path). |
| Claude | ✓ | — | — | — | Text-focused fallback for reasoning-heavy tasks. |
| Replicate | — | ✓ | — | ✓ | Specialized lane for image/video generation pipelines. |
Routing Policy
- Requests are classified by intent and modality before provider selection.
- Primary provider is chosen by capability + latency profile.
- Fallback providers activate on timeout, circuit open, or policy failure.
- Usage and metadata are normalized across all providers.
- Final payload remains contract-stable regardless of backend provider.
Failover & SLA Strategy
Failover Policy
- Timeout thresholds are modality-specific (image/video/OCR/voice).
- Circuit breakers isolate unstable providers automatically.
- Retry strategies follow idempotency-safe rules.
- Fallback chain order is environment-configurable.
SLA Signals
- Availability is monitored per provider and per modality lane.
- Latency budgets are tracked end-to-end with trace correlation.
- Error-rate thresholds trigger automatic routing shifts.
- Recovery windows restore providers gradually after stabilization.
Standardized Output Contract
{
"success": true,
"content": "...",
"provider": "...",
"usage": {},
"metadata": {},
"images": [],
"files": [],
"videos": []
}