Glossary

Bot Analytics provides pre-built dashboards that offer immediate insights into your bot's performance, user engagement, and interaction patterns. These default metrics are organized into five dashboards.


Overview Dashboard

The Overview dashboard provides a quick snapshot of your bot's key performance indicators.

Active Users (Gauge)

Shows total active users compared to the total user base.

MetricDescription
Active UsersUsers who interacted with or saw bot messages in the selected period
Total UsersTotal users with access to the bot

Toggle: Include terminated users - Include/exclude users who have left the organization

Drilldown: Active Users Table → User's Sessions → Session Interactions


Most Used Policy

Displays the HR policy with the highest number of user queries.

Drilldown: Policy Usage Table → Policy Wise Users


Most Used Feature

Shows the most clicked quick reply, webview, or URL button.

Drilldown: Feature Usage Table → User Wise Feature Details


User Feedback (Pie Chart)

Distribution of thumbs up vs thumbs down feedback from users.

How it's tracked: Counts explicit feedback button clicks on bot responses.

Drilldown: Thumbs Up/Down Table → Feedback Request Details


Handled Requests (Gauge)

Ratio of successfully handled requests to total typed requests.

MetricDescription
Handled RequestsQueries successfully answered by bot or AI agent
Typed RequestsAll plain text messages from users

Drilldown: Handled/Not Handled Table → Request Details


Total Session Count

Total number of user sessions in the selected period.

Drilldown: Active Users Table → User's Sessions


Average Session Time

Average duration of user sessions, shown as "Xm Ys" format.

How it's calculated:

  • Sum of all session durations ÷ Number of sessions
  • Sessions with zero duration (single message) are excluded

Drilldown: Average Session Time Table → Channel Wise Average Session Time


Average Interactions Per Session

Mean number of interactions per session.

How it's calculated: Total interactions (excluding "seen") ÷ Total sessions

Drilldown: Average Interactions Per Session Table


User Metrics Dashboard

Detailed insights into user acquisition, engagement, and distribution patterns.

Active Users (Gauge)

Same as Overview dashboard - shows active vs total users.


Key User Metrics (Stacked Bar)

MetricHow it's calculated
New UsersUsers whose first ever message to the bot falls within the selected period
Active UsersUsers with any interaction or seen message in the period
Repeating UsersUsers with 2 or more sessions in the period
Logged-In UsersUsers who have logged into the bot application

Drilldown paths:

  • New Users → New Users Table → User's Sessions
  • Active Users → Active Users Table → User's Sessions
  • Repeating Users → Repeating Users Table → User's Sessions
  • Logged-In Users → Logged-In Users Table → Sessions/Logins

Users Over Time (Area Chart)

Trend visualization of user metrics over time.

Toggle Options:

  • Daily/Monthly - Switch granularity
  • Include terminated users - Include/exclude terminated users

User Distribution (Stacked Bar)

Distribution of active users by channel or demographics.

View OptionDescription
Channel WiseDistribution by communication channel
Demographic WiseDistribution by custom demographic fields

Drilldown: Channel Wise Active Users → User's Sessions


Bot Performance Metrics Dashboard

Focuses on bot effectiveness, response quality, and interaction patterns.

User Feedback (Pie Chart)

Same as Overview dashboard - distribution of thumbs up/down feedback.


Handled Requests (Gauge)

Same as Overview dashboard - handled vs typed requests ratio.


Bot Message Count

Total messages sent by the bot to users.

Drilldown: Bot Messages Table → Session Wise Interactions


Total Interactions

Total user interactions (typed queries + button clicks).

Note: "Seen" messages are excluded from this count.

Drilldown: Total Interactions Table → Session Wise Interactions


Total Requests

Combined count of Bot Flow and Autonomous Agent requests.

How it's calculated:

  • Count of interactions without AI agent involvement (Bot Flow)
  • Plus unique AI agent request IDs (Autonomous Agents)

Drilldown: Total Interactions Table


First Response Time

Average time between user message and bot's first response.

How it's calculated:

  • For each message: Bot response timestamp − User message timestamp
  • Averaged across all interactions, displayed in seconds

Drilldown: Channel Wise First Response Time → Request Details → Interaction Details


Channel Wise Interactions (Bar Chart)

Distribution of interactions across communication channels.

Drilldown: Channel Interactions Table


Peak Usage Time

Hour of day with maximum interactions.

How it's calculated:

  1. Group all interactions by hour (0-23)
  2. Find hour with highest count
  3. Display in 12-hour format with timezone adjustment

Drilldown: Usage Hour Table


Requests Over Time (Area Chart)

Trend of handled vs not handled requests.


Session Metrics Dashboard

Detailed insights into user session behavior and patterns.

Effective Sessions (Gauge)

Ratio of effective sessions to total sessions.

MetricDescription
Effective SessionsSessions where at least one message was successfully handled
Abandoned SessionsSessions where no message was successfully handled

How it's calculated: A session becomes "effective" the moment any interaction within it gets handled. The status is updated in real-time as messages are processed. "Seen" messages don't affect effectiveness.

Drilldown paths:

  • Effective Sessions → Effective Sessions Table → User Wise Effective Sessions
  • Abandoned Sessions → Abandoned Sessions Table

Average Session Time

Same as Overview dashboard - average duration of sessions.

Drilldown: Average Session Time Table → Channel Wise Average Session Time


Average Time Between Sessions

Average interval between consecutive sessions by the same user.

How it's calculated:

  1. For each user, list all sessions chronologically
  2. Calculate gap between consecutive session start times
  3. Average all gaps (excluding zero-duration gaps)

Drilldown: Average Time Between Sessions Table → Details


Average Interactions Per Session

Same as Overview dashboard - mean interactions per session.

Drilldown: Average Interactions Per Session Table


Sessions Over Time (Stacked Column Chart)

Trend of effective vs abandoned sessions over time.


Channel-Wise Sessions (Stacked Bar)

Distribution of sessions by channel, showing effective vs abandoned breakdown.

Drilldown: Channel Wise Session Table → Channel User Wise Session Table


Channel-Wise Average Session Time (Bar Chart)

Average session duration by channel.

Drilldown: Channel Wise Average Session Time Table


Sessions & Interactions Over Time (Area Chart)

Comparison of session count vs interaction count trends.


Queries & Interactions Dashboard

Analysis of user queries, feature usage, and interaction patterns.

Most Used Policy

Same as Overview dashboard - policy with highest user interactions.

Drilldown: Policy Usage Table → Policy Wise Users


Most Used Feature

Same as Overview dashboard - most clicked feature.

Drilldown: Feature Usage Table → User Wise Feature Details


Most Used Skill

Most frequently invoked skill by the autonomous agent.

Drilldown: Tool Call Table → User Tool Call Table → Tool Call Details


Total Button Clicks

Total button click interactions.

Included message types:

  • Button, Quick Reply, Webview, Webview Open
  • URL Click, Menu Button, FAQ Response, Related Intent

Survey responses are excluded.

Drilldown: Button Clicks Table → User Wise Button Clicks → Button Click Details


Queries Handled by Smart Answers

Queries answered using knowledge base/helpdesk articles.

How it's tracked: Counts interactions where NLU response category is "Smart Answer"

Drilldown: Smart Answers Table → Smart Answer Details


Usage (Trend Line Chart)

Usage trends for features, policies, and skills over time.

ViewDescription
FeaturesTop features and usage over time
PoliciesTop policies and access over time
SkillsTop AI agent skills and invocation over time

Drilldown paths:

  • Feature → Feature Wise Table → User Wise Feature Details
  • Policy → Policy Details Table → Policy Wise Users
  • Skill → Tool Call Table → User Tool Call Table

Interactions Type (Bar Chart)

Distribution of user message types.

Drilldown: Message Type User Table → Message Type User Details


Intents (Bar Chart)

Distribution of user queries by detected intent/category.

Drilldown: Intent Details Table → Intent Wise User Table


Voice Calls Dashboard

The Voice Calls dashboard provides analytics for voice-based bot interactions. This dashboard is only visible when voice calling is enabled for your bot.

Voice Calls Completed (Gauge)

Shows completed voice calls compared to total connected calls.

MetricDescription
Completed CallsVoice calls where user sent at least one message
Connected CallsTotal calls that were successfully connected

How it's calculated:

  • A call is connected when it has a successful connection event OR a disconnection event
  • A call is completed when the user sends at least one message during the call

Drilldown tabs:

  • Completed → Completed Calls Table → Call Details
  • Non-completed → Non-Completed Calls Table

Voice Call Users (Gauge)

Shows users who made voice calls compared to total active users.

MetricDescription
Voice Call UsersUsers who completed at least one voice call
Total Active UsersAll active users in the selected period

Drilldown tabs:

  • Voice call users → Voice Call Users Table
  • Non-voice call users → Non-Voice Call Users Table

Effective Voice Calls (Gauge)

Shows effective voice calls compared to total completed calls.

MetricDescription
Effective CallsCompleted calls with at least one handled query
Completed CallsAll calls with user messages

How it's calculated: A call becomes "effective" when the bot successfully handles at least one user query during the call.

Drilldown tabs:

  • Effective → Effective Calls Table
  • Non-Effective → Non-Effective Calls Table

Total Call Duration

Sum of all call durations in the selected period.

How it's calculated:

  • If both connected and disconnected timestamps exist: Disconnected time − Connected time
  • If only disconnected exists: Disconnected time − First message time
  • If only connected exists: Last message time − Connected time

Drilldown: Call Duration by User Table


Voice Calls Connected

Percentage of calls successfully connected after initialization.

How it's calculated: (Calls with successful connection ÷ Total initialized calls) × 100

Drilldown: Connection Rate Table


Average Voice Call Duration

Average duration of voice calls.

How it's calculated: Total call duration ÷ Number of calls with duration > 0

Drilldown: Call Duration by User Table


Average User Messages Per Voice Call

Average number of messages users send per completed call.

How it's calculated: Total user messages in completed calls ÷ Number of completed calls

Drilldown: User Messages Per Call Table


Voice Calls Over Time (Line Chart)

Trend showing connected and completed voice calls over time.

Lines displayed:

  • Connected calls - Calls that were successfully connected
  • Completed calls - Calls where user sent at least one message

Drilldown tabs:

  • Completed → Completed Calls Table
  • Non-completed → Non-Completed Calls Table

Key Concepts

What is a Session?

A session represents a continuous conversation between a user and the bot.

How sessions are calculated:

  • A session starts when a user sends their first message to the bot
  • The session continues as long as the user keeps interacting within 30 minutes of their last message
  • If there's more than 30 minutes of inactivity (no user message), the current session ends
  • Any new message after this 30-minute gap starts a new session

Session timing:

  • Start Time: Timestamp of the first message in the session
  • End Time: Timestamp of the last message in the session
  • Session Duration: Time difference between end time and start time

Example: If a user messages at 10:00 AM, then again at 10:15 AM, and finally at 10:45 AM, all three messages are part of one session. But if their next message is at 11:30 AM (45 minutes later), that starts a new session.


What is Request Status?

Request Status indicates the outcome of a user's request. The values differ based on whether the request was processed by Bot Flow or Autonomous Agents.

For Bot Flow Requests

StatusDescription
HandledBot successfully understood and responded to the query
Not handledBot couldn't process the request (fallback response triggered)

For Autonomous Agents Requests

StatusDescription
Handled SuccessfullyAI agent completed the task successfully
Handled UnsuccessfullyAI agent attempted but couldn't complete the task successfully
HandledRequest was processed (used when no specific sub-status applies)
UnhandledAI agent couldn't handle the request
FailedAI agent encountered an error during processing
User AbortedUser cancelled the AI agent interaction
User AbandonedUser left the conversation before the AI agent completed

What is Request Type?

Request Type indicates which system processed the user's query:

Request TypeDescription
Bot FlowQuery handled by standard bot conversation flows (pre-configured responses)
Autonomous AgentsQuery processed by AI-powered autonomous agent (can perform complex tasks)

What is Content Details?

Content Details shows what the bot identified or used to respond to the user's query. The value depends on how the request was processed:

ScenarioContent Details Shows
Query matched a knowledge articleThe article name(s) that were used to respond
Query triggered a skill/toolThe skill or tool name(s) that were invoked
Query couldn't be matchedThe actual user message text

Examples:

  • "Leave Policy, Attendance Policy" - Bot found relevant HR policies
  • "create_ticket, get_ticket_status" - Autonomous agent used these skills
  • "how do I reset my password" - User's original message (when no specific match)

What is Interaction Type?

Interaction Type describes how the user sent their message:

Interaction TypeDescription
Plain TextUser typed a free-form message
ButtonUser clicked a button in a card or message
Quick ReplyUser selected a quick reply option
WebviewUser interacted through a webview form
URL ClickUser clicked a URL/link
Menu ButtonUser clicked a menu button
FAQ ResponseUser selected from FAQ suggestions
PostbackUser clicked a button that triggers an action

Handled vs Not Handled

  • Handled: The bot successfully understood and responded to the user's query
  • Not Handled: The bot couldn't process the request - typically results in a fallback response or escalation

Active Users vs Interactions

Active Users includes anyone who:

  • Sent a message to the bot, OR
  • Clicked a button, OR
  • Simply saw/viewed a bot message

Interactions counts only active engagements:

  • Typed messages
  • Button clicks
  • Quick replies
  • Form submissions

Note: "Seen" messages (where user only viewed but didn't respond) are included in Active Users but excluded from Interaction counts.


Available Channels

ChannelDescription
MS TeamsMicrosoft Teams
WebWeb chat interface
SlackSlack workspace
WhatsAppWhatsApp
WorkplaceMeta Workplace
Google ChatGoogle Chat

Voice Call Terms

TermDescription
Connected CallA call that has a successful connection event or disconnection event
Completed CallA connected call where the user sent at least one message
Effective CallA completed call where at least one user query was successfully handled
Call DurationTime between call connection and disconnection

Understanding Drilldown Tables

When you click on a metric, you can drill down into the data for more details. Here's what the common columns mean:

User Table Columns

ColumnDescription
User IDUser's display name or identifier
Employee IDEmployee ID from HR system
Is TerminatedWhether user has left the organization (Yes/No)
Session CountNumber of sessions by this user in the selected period
First Active TimeWhen user first accessed the bot

Session Table Columns

ColumnDescription
Session IDUnique identifier for the session
ChannelCommunication channel (MS Teams, Web, etc.)
Start TimeWhen session began (first message)
End TimeWhen session ended (last message)
Interaction CountNumber of interactions in this session
Is EffectiveWhether at least one message was handled

Request/Interaction Table Columns

ColumnDescription
Content DetailsWhat was matched - article names, skill names, or user message
Request TypeBot Flow or Autonomous Agents
Request StatusOutcome of the request (Handled, Not handled, Failed, etc.)
Interaction TypeHow user sent the message (Plain Text, Button, etc.)
Request CountNumber of requests with this content
Interaction CountTotal interactions for this content
TimestampWhen the interaction occurred
User MessageThe actual message sent by user
Bot ResponseThe bot's reply

Quick Reference

Session Rules

  • New session starts: After 30+ minutes of inactivity
  • Session duration: Last message time − First message time
  • Effective session: At least one handled message

What's Counted Where

Metric TypeIncludes "Seen" Messages?
Active Users✅ Yes
Interactions❌ No
Session Count✅ Yes (session still counts)
Handled Requests❌ No (only typed messages)

Request Type & Status

Request TypeProcessed By
Bot FlowStandard bot conversation flows
Autonomous AgentsAI-powered autonomous agent
Request Status (Bot Flow)Meaning
HandledSuccessfully responded
Not handledFallback triggered
Request Status (Autonomous Agents)Meaning
Handled SuccessfullyTask completed successfully
Handled UnsuccessfullyAttempted but failed
UnhandledCouldn't process
FailedError occurred
User AbortedUser cancelled
User AbandonedUser left mid-conversation