Observability

UCM provides comprehensive observability capabilities to monitor and analyze the performance of your KV cache management system.

Key Features

• Prometheus Metrics: Export detailed metrics through the vLLM connector
• Grafana Dashboards: Pre-built dashboards for visualization
• Real-time Monitoring: Track cache hit rates, latency, throughput, and more

Available Documentation

• Metrics: Complete guide on configuring and using UCM metrics with Prometheus and Grafana