Good morning, there 👋

Sunday, April 5 · Starter Plan

Latency degradation on mistral-large-2

p99 latency spiked to 2,100ms — auto-failover redirecting to claude-3-5-sonnet

+2 this week

6

3 providers

+18% vs last month

4.2B

this month

80% used

$2,979

of $3,000 budget

+124 today

1,847

running now

Token Usage

Billions of tokens · 30d

+250% vs 30d ago
Mar 1Mar 15Mar 27

Cost by Model

This month · $2,979 total

gpt-4o$1240.50
claude-3-5-sonnet$890.20
gemini-1.5-pro$562.80
others$486.10

Daily spend trend

Models

View All
ModelStatusRPMp50 (ms)p99 (ms)Cost

llama-3.1-70b

Meta / Groq

active3,84085160$210.40

gpt-4o

OpenAI

active2,840312680$1240.50

claude-3-5-sonnet

Anthropic

active1,920278520$890.20

gemini-1.5-pro

Google

active1,240195380$562.80

phi-3-medium

Microsoft

active98068120$95.60

mistral-large-2

Mistral

degraded4208902100$180.10

Recent Activity

gpt-4o deployed to production edge

3 regions · v2.4.1

2m ago

mistral-large-2 latency spike

p99 > 2000ms · auto-failover active

8m ago

Agent workflow 'data-pipeline' completed

1,247 steps · 3.2M tokens

15m ago

Monthly budget alert: 80% used

$2,352 of $3,000 budget

1h ago

claude-3-5-sonnet auto-scaled

3 → 10 replicas · high traffic

2h ago

Agent 'customer-support-v3' updated

New system prompt deployed

3h ago