OP

Operations Admin

Dashboard Teams Billing MK

Dashboard / Services / Inference API

Inference API

Overview Activity Access

Requests today

2.4M

12% above the daily average

Success rate

99.98%

Within the 99.9% target

P95 latency

182 ms

18 ms below the alert threshold

Service details

Current production configuration.
Region
us-central-1
Model
Llama 3.3 70B Instruct
Deployment
inference-api-v42
Event Actor Time Status Deployed inference-api-v42 Maya Kim 18 minutes ago Completed Updated autoscaling target Jon Bell 2 hours ago Applied Rotated service credentials System Yesterday Applied

Platform administrators

Owner

12 members can deploy, configure, and manage access.

ML operations

Editor

28 members can deploy and update service configuration.