Monitoring & Analytics for LLM Tool Usage: Keeping an Eye on Performance
How to instrument LLM tool calls with structured events, Prometheus metrics, and OpenTelemetry traces — and which per-tool signals (latency, errors, tokens, cost, cache, rate limits) to dashboard and alert on.