Roleplay performance analytics

Learn how to use the Roleplay Performance dashboard to monitor team practice activity, scorecard results, and coaching across all AI roleplay sessions.

The Performance section gives managers and admins a view across their team's practice activity, scorecard results, course progress, and coaching. Go to Performance in the left sidebar.

Dashboard tabs

Performance has three views in the left sidebar: Activity, Scorecards, and Practice. On Activity and Scorecards, a switch at the top lets you choose Real Calls or Practice Calls; this article covers Practice Calls. Each view is divided into tabs covering a different dimension of performance:

  • Performance > Activity
  • Team Activity: practice call volume, average scores, talk-to-listen ratios, question rates, and engagement metrics across all Practice Calls.
  • Comments: a log of manager feedback left on Practice Calls.
  • Listened Calls: available for both Real Calls and Practice Calls.
  • Manager Scorecards, Call Status and Trackers are for Real Calls only.
  • Performance > Scorecards
  • Scorecards: opens on a list of scorecards with Scorecard Title, Avg. Score, Practice Calls, low, average and high-scoring Practice Calls, Team Members Evaluated and At-Risk Team Members. Click a scorecard to see objective-level results and identify which specific skills team members are passing or failing.
  • Performance > Practice
  • Batches: completion and performance data filtered by course batch (cohort).
  • Courses: completion and progress data for courses.
  • Call Blitz: active Call Blitzes, active team members, Practice Calls and a leaderboard for each Call Blitz.
  • Workflows: per-workflow results such as average handling time, completion status, team members attempted, and average efficiency.
  • Roleplay Agents: usage and performance data broken down by individual agent.

Metrics in Team Activity

The Team Activity tab shows a row for each team member with the following columns (for Practice Calls): Avg. Score, Practice Calls, Scored Practice Calls, Total Duration, Avg. Duration, Avg. Talk-to-Listen Ratio, Avg. Interactivity, Avg. Question Rate, Avg. Longest Monologue and Avg. Longest Customer Monologue. If your workspace tracks deals, deal columns such as Number of Deals, Deal Progression, Discover-to-Demo Conversion and Closing Effectiveness also appear. Hover over a column header for what it measures.

Performance ></span> Activity page, Team Activity tab with metrics for each team member

The Team Activity tab, showing the per-team-member metric columns listed above.

Click any team member's row to drill into their individual Practice Call history.

Filters

  • Date: set a primary period to analyze. Turn on Compare to add a second period and see change over time.
  • Team: All: filter to one team.
  • Individual / Team: switch the rows between team members and teams.
  • Search: find a specific team member by name.

Exporting data

Click Download as Excel to download the visible data as an Excel file. The export includes all metric columns and manager assignment data. File name format: performance_YYYY-MM-DD.xlsx.

How to use the dashboard

A few common use cases:

  • Identify lagging skills: use the Scorecards tab to find criteria where pass rates are consistently low across the team; those criteria point to training gaps.
  • Track improvement: set a comparison date range in Team Activity to see whether scores and engagement metrics improved after a training program.
  • Prep for 1:1s: drill into an individual team member's Practice Call history before a coaching conversation to have specific examples ready.
  • Measure a blitz: after running a Call Blitz, check the Call Blitz tab to see who completed it, their Practice Calls and their average scores.

Hope this article was helpful. For any queries, please write to support@outdoo.ai