API Metrics
Track request rate, error rate, latency, saturation, and dependency health.
Latency should be measured using percentiles rather than only averages. Averages can hide a severe tail-latency problem.
Useful measurements include p50, p95, and p99 latency, HTTP status distribution, requests per second, database latency, queue depth, and external dependency failures.
A useful service-level objective might specify that 99% of successful API requests should complete within a target latency under defined conditions.
Golden Signals
Latency:
How long requests takeMeasure percentiles to understand tail behavior.
Traffic:
Requests per secondShows workload volume.
Errors:
Failed requestsTrack status classes and business failures.
Saturation:
Resource pressureCPU, memory, database connections, queues, and other constrained resources.