Agent skill · data analytics · yonatangross

monitoring-observability

Monitoring and observability patterns for Prometheus metrics, Grafana dashboards, Langfuse v4 LLM tracing (as_type, score_current_span, should_export_span, LangfuseMedia), and drift detection. Use when adding logging, metrics, distributed tracing, LLM cost tracking, or quality drift monitoring.

Why this skill is useful

Provides specific patterns and integration details for Prometheus metrics and Langfuse LLM tracing that the AI wouldn't reliably generate on its own.

What it needs

Requires langfuse installed locally. About 4k tokens when loaded. Last updated 2026-08-06. 215 stars on the source repository.

What this skill does

Monitoring & Observability A wrap around Prometheus, Grafana, OpenTelemetry and Langfuse, not a re-teaching of them. This skill carries OrchestKit's delta (version floors, house decisions, scars) and points at the vendor for everything else. Start at references/ork-delta.md. Upstream coverage (do not restate) These topics are fully covered first-party. Read the source, do not add a local copy. Topic First-party source ------- -------------------- Prometheus metric types, RED method, cardinality, PromQL <https://prometheus.io/docs/practices/> Alertmanager grouping, inhibition, escalation, runbooks <https://prometheus.io/docs/alerting/latest/configuration/> Grafana dashboards, Loki and LogQL, Promtail <https://grafana.com/docs/> OpenTelemetry spans, sampling, context propagation <https://opentelemetry.io/docs/> Langfuse Python SDK (@observe, astype, scorecurrentspan, shouldexportspan, LangfuseMedia) <https://langfuse.com/docs/sdk/python> Langfuse v2 to v4 Python and v3 to v5 JS migration paths <https://langfuse.com/docs/sdk/python/v4-migration> Langfuse self-hosting (ClickHouse, Redis, S3, Helm) <https://langfuse.com/docs/deployment/self-host> Langfuse cost tracking, model pricing, Metrics API v2 <https://langfuse.com/docs/model-usage-and-cost> Langfuse scores, online evaluators, annotation queues, prompt management <https://langfuse.com/docs/scores/overview> Langfuse framework integrations (LangChain, LangGraph, CrewAI, Pydantic AI, Bedrock, LiveKit) <https://langfuse.com/docs/integrations> Agent Graphs, observation types, rendered tool calls <https://langfuse.com/docs/tracing-features/agent-graphs> PSI, KS test, KL and JS divergence, Wasserstein, embedding drift <https://www.evidentlyai.com/blog/data-drift-detection-large-datasets> EWMA control charts <https://www.itl.nist.gov/div898/handbook/pmc/section3/pmc324.htm> structlog, Winston, correlation IDs, log sampling <https://www.structlog.org/en/stable/> Quick Reference Category Rules Impact When to Use ---------- - …

How to use it

Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:

@skills yonatangross/monitoring-observability--9eec66

View the source on GitHub

Browse the @skills marketplace