Agent skill · data analytics · erichowens
chatbot-analytics
Implement AI chatbot analytics and conversation monitoring. Use when adding conversation metrics, tracking AI usage, measuring user engagement with chat, or building conversation dashboards.
Why this skill is useful
Provides specific implementation patterns and metrics for tracking AI chatbot performance that the AI wouldn't reliably generate on its own.
What it needs
About 4k tokens when loaded. Last updated 2026-07-14. 180 stars on the source repository.
What this skill does
AI Chatbot Analytics This skill helps you implement analytics for the AI coaching chat feature while maintaining HIPAA compliance. Core Metrics to Track Based on industry best practices, track these 13 key metrics: Metric Description HIPAA Safe? -------- ------------- ------------- Total Sessions Number of chat sessions Yes Avg Messages/Session Messages per conversation Yes Avg Session Duration Time spent in chat Yes Engagement Rate % users who use chat Yes Completion Rate Sessions ended naturally Yes Abandonment Rate Sessions ended early Yes Response Time AI response latency Yes Token Usage Total/avg tokens consumed Yes Error Rate Failed responses Yes Fallback Rate "I don't understand" responses Yes Topic Categories What users discuss Metadata only Sentiment Trend Emotional direction Derived only Crisis Triggers Emergency detection Metadata only HIPAA-Compliant Analytics What to Track What NOT to Track Implementation Pattern Tracking Conversation Start Tracking Message Exchange Tracking Conversation End Category Detection (Metadata-Based) Detect conversation categories WITHOUT reading content: Dashboard Aggregations Session Metrics Token Usage for Cost Tracking Category Breakdown Alert Configuration Set up alerts for concerning patterns: Database Schema Testing Analytics Resources Chatbot Analytics Guide Botpress Analytics 13 Core Metrics Admin Suite Design: docs/ADMIN-DEVELOPER-SUITE.md
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills erichowens/chatbot-analytics