Roleplay performance analytics
Learn how to use the Roleplay Performance dashboard to monitor team practice activity, scorecard results, and coaching across all AI roleplay sessions.
The Roleplay Performance dashboard gives managers and admins a view across their team's practice activity, scorecard results, course progress, and coaching. Go to Roleplay > Performance.
Dashboard tabs
The dashboard is divided into tabs, each covering a different dimension of performance:
- Team Activity — session volume, average scores, talk/listen ratios, question rates, and engagement metrics across all roleplays
- Scorecard — scorecard criterion-level results across the team; identify which specific skills reps are passing or failing
- Batches — completion and performance data filtered by course batch (cohort)
- Call Blitz — leaderboard and per-agent results for all blitz sessions
- Coaching Comments — a log of manager feedback left on roleplay sessions
- Screen — accuracy data from software simulation (Screens) completions
- Roleplay Agents — usage and performance data broken down by individual agent
Metrics in Team Activity
The Team Activity tab shows per-rep rows with the following columns:
- Average score
- Total sessions
- Average session duration
- Talk/listen ratio
- Question rate
- Longest monologue
- Longest customer story
- Interactivity
- Roleplays scored
Click any rep's row to drill into their individual session history.
Filters
- Date range — set a primary period to analyse; optionally enable a comparison period to see change over time
- Team / Manager — filter to a specific manager's direct reports
- Scoring type — filter to sessions scored by AI only, by a manager only, or all scored sessions
- Search — find a specific rep by name
Exporting data
Click Export on any tab to download the visible data as an Excel file. The export includes all metric columns and manager assignment data. File name format: performance_YYYY-MM-DD.xlsx.
How to use the dashboard
A few common use cases:
- Identify lagging skills — use the Scorecard tab to find criteria where pass rates are consistently low across the team; those criteria point to training gaps
- Track improvement — set a comparison date range in Team Activity to see whether scores and engagement metrics improved after a training program
- Prep for 1:1s — drill into an individual rep's session history before a coaching conversation to have specific examples ready
- Measure a blitz — after running a Call Blitz, check the Call Blitz tab to see who completed it, their scores, and which agents had low success rates
If you need help, contact us at support@outdoo.ai.