Models
7 models configured · 5 active
| Model | Status | RPM | p50 latency | Monthly cost | Version | |
|---|---|---|---|---|---|---|
gpt-4o OpenAI | active | 2,840 | 312ms | $1240.50 | 2024-11-20 | |
claude-3-5-sonnet Anthropic | active | 1,920 | 278ms | $890.20 | 20241022 | |
gemini-1.5-pro | active | 1,240 | 195ms | $562.80 | 002 | |
llama-3.1-70b Meta / Groq | active | 3,840 | 85ms | $210.40 | 3.1 | |
mistral-large-2 Mistral | degraded | 420 | 890ms | $180.10 | 2407 | |
phi-3-medium Microsoft | active | 980 | 68ms | $95.60 | 4k-instruct | |
o1-preview OpenAI | inactive | — | — | — | 2024-09-12 |