Token throughput8.4MUpdated 5 minutes ago
Inference cost$1,280Updated 5 minutes ago
Avg. response0.82sUpdated 5 minutes ago
Active users3.4KUpdated 5 minutes ago

System load

  • Chat orchestration42%
  • Code generation27%
  • RAG retrieval19%
  • Summarization12%
  • Resource health

  • CPU58%
  • Memory71%
  • GPU64%
  • Queue12 jobs
  • Recent events

  • Model switchQwen3-0.6B
  • API key rotatedSuccess
  • Safety checkPassed