Using the Analytics Dashboards
Learn how to use the analytics dashboards in the Management Portal to monitor platform usage, agent activity, user activity, and token consumption.
Overview
The Analytics section of the sidebar has four dashboards:
| Sidebar item | Page title | Purpose |
|---|---|---|
| Overview | Analytics Overview | Platform totals and daily messages by agent |
| Users | User Analytics | Daily active users and per-user activity |
| Agent Analytics | Agent Analytics | Daily messages and users by agent, and per-agent metrics |
| Token Usage | Token Usage Analytics | Token consumption by model deployment, agent, and user |
Analytics never include message content. They use conversation and message metadata (sessions, agent names, user principal names, timestamps, tool executions) and token usage records. For metric definitions, see the Analytics Reference.
Prerequisites
- Access to the Management Portal
- The Analytics Reader role. This role is mandatory for analytics queries: other roles, including Owner, do not grant access to analytics on their own.
Open the Analytics Dashboards
- Sign in to the Management Portal.
- In the sidebar, select Analytics, and then select Overview, Users, Agent Analytics, or Token Usage.
Work with Date Ranges
Every dashboard has a date range button at the top (for example, Jul 12-Oct 12). All data on the page is limited to the selected range.
The default range is the last three months, ending today. The selected range is shared by all four dashboards, so it stays the same as you move between them. It resets when you reload the browser page.
Change the Date Range
- Select the date range button.
- Pick a range from the panel. Each option shows a preview of its dates.
| Panel section | Options |
|---|---|
| Recommended | Last 7 days, This month, Custom date range |
| Relative dates | Last 7 days, Last 30 days |
| Calendar months | This month, This quarter, This year, Last month, Last quarter, Last 3 months, Last 6 months, Last 12 months, Custom date range |
- This month, This quarter, and This year cover the whole current period, through its last day.
- Last 3 months, Last 6 months, and Last 12 months start on the first day of the month that many months ago and end today.
- Custom date range opens the Custom Date Range dialog. Pick a Start Date and End Date, and then select Apply.
Move Month by Month
At the top of the panel, select < PREVIOUS or NEXT > to jump to the previous or next calendar month. The range becomes the first through the last day of that month.
Analytics Overview
The Analytics Overview page summarizes platform activity.
Summary Cards
| Card | Description |
|---|---|
| Total Conversations | Conversations with activity in the selected range. |
| Total Tokens | Tokens consumed in the selected range, from token usage records. |
| Active Users | Distinct users with conversation activity in the selected range. |
| Active Agents | Distinct agents that sent at least one response in the selected range. |
Daily Usage by Agent
A stacked bar chart shows the number of agent messages (responses) per day, with one color per agent.
- Select a bar segment or a legend entry to filter the page to that agent. The chart shows only that agent and the summary cards reload with that agent's totals.
- Select the same agent again, or double-click the chart, to clear the filter.
User Analytics
The User Analytics page shows how many users are active and how much each user consumes.
Active Users per Day
A bar chart shows the number of distinct users who had conversation activity on each day.
User Table
Use Search usernames to filter the table. Select a column header to sort. The table shows 20 rows per page.
| Column | Description |
|---|---|
| Username | The user principal name (UPN). |
| Total Conversations | Conversations in which the user had activity. |
| Operations | Distinct completion operations recorded for the user in token usage records. |
| Total Tokens | Tokens consumed by the user. |
Agent Analytics
The Agent Analytics page compares agents.
Charts
- Daily Usage by Agent: agent messages (responses) per day, stacked by agent.
- Number of Users per Day by Agent: distinct users per day who received responses from each agent, stacked by agent.
Select a bar segment or a legend entry in either chart to show only that agent in both charts. Select the same agent again, or double-click a chart, to clear the filter. The table below is not filtered.
Agent Table
Select a column header to sort. The table shows 20 rows per page.
| Column | Description |
|---|---|
| Agent Name | The agent name. |
| Unique Users | Distinct users who received responses from the agent. |
| Total Conversations | Conversations in which the agent responded. |
| Total Tokens | Tokens consumed by the agent, from token usage records. |
| Avg Number of Tools Used | The average number of tool executions per agent response, with two decimal places. |
If one part of the page fails to load, the page shows an error message and still displays the parts that loaded.
Token Usage Analytics
The Token Usage Analytics page breaks down token consumption. All numbers on this page come from token usage records.
Summary Cards
| Card | Description |
|---|---|
| Total Tokens Used | Total tokens consumed in the selected range. |
| Total Users | Distinct users with token usage. |
| Total Agents | Distinct agents with token usage. |
| Total Model Deployments | Distinct model deployments with token usage. |
Charts
- Top 10 Users by Token Consumption: the nine users with the most tokens, plus an Other (N users) slice for everyone else.
- Token Usage by Model Deployment: the nine deployments with the most tokens, plus an Other (N deployments) slice for the rest.
Tables
All three tables are sorted by Total Tokens (highest first) by default, show 10 rows per page, and can be sorted by selecting a column header. % of Total is the row's share of the table's total tokens.
Token Usage by Model Deployment aggregates tokens by the model deployment recorded in each token usage record, including tool, rewrite, and embedding models.
| Column | Description |
|---|---|
| Model Name | The name of the AI model that uses the deployment, or the deployment name if no AI model matches. |
| Deployment | The model deployment name, or Unknown when the record has no deployment. |
| Agents Using | Distinct agents with token usage on the deployment. |
| Total Tokens | Tokens consumed on the deployment. |
| % of Total | Share of total tokens. |
Token Usage by Agent
| Column | Description |
|---|---|
| Agent Name | The agent name. |
| Unique Users | Distinct users with token usage on the agent. |
| Conversations | Distinct conversations with token usage on the agent. |
| Total Tokens | Tokens consumed by the agent. |
| % of Total | Share of total tokens. |
Token Usage by User (use Search usernames to filter)
| Column | Description |
|---|---|
| Username | The user principal name (UPN). |
| Total Conversations | Distinct conversations with token usage by the user. |
| Operations | Distinct completion operations by the user. |
| Total Tokens | Tokens consumed by the user. |
| % of Total | Share of total tokens. |
Scenarios
Find the agents that drive the most traffic
- Open Analytics > Overview.
- In Daily Usage by Agent, look for the largest segments, and select one to see that agent's totals in the summary cards.
Compare agent adoption
- Open Analytics > Agent Analytics.
- Sort the table by Unique Users, then by Total Conversations, to tell broad adoption apart from heavy use by a few users.
Find the most expensive models, agents, and users
- Open Analytics > Token Usage.
- Review the % of Total column in each table. An agent with a high share of tokens but few conversations consumes many tokens per conversation.
Track engagement over time
- Open Analytics > Users.
- Choose Last 6 months or Last 12 months and review Active Users per Day for trends.