Scorecard prioritization
Two scorecard settings help you control how calls and roleplays are scored:
- Order sets the scorecard's priority, which is its position in your list of scorecards.
- Weighted Distribution lets you give each objective in a scorecard its own weight, so the criteria that matter most count more toward the overall score.
Both are set in Manage > Scorecards.
Objective weights
What it is
When Score Methodology is set to Weighted Distribution, each objective has a weight from 1 to 10. A higher weight means that objective counts more toward the overall score. With Equal Distribution, every objective counts the same.
Weights apply to the objectives inside one scorecard. There is no setting that weights one scorecard against another.
Weighted Distribution lets you assign a 1-10 weight per objective; Equal Distribution weighs them all the same.
Set objective weights
- Go to Manage > Scorecards.
- Create a new scorecard or open an existing one.
- Select Overall Score in the left panel and set Score Methodology to Weighted Distribution.
- Set a weight from 1 to 10 for each objective.
- Save the scorecard.
Every objective needs a weight between 1 and 10 when Weighted Distribution is selected. Otherwise the editor shows "Weight must be between 1 and 10".
Best practices
- Give higher weight (for example 8-10) to must-have behaviors such as compliance and key discovery questions.
- Use medium weight (for example 4-6) for important but not critical criteria.
- Use lower weight (for example 1-3) for optional or nice-to-have criteria.
- Keep weight spreads meaningful; avoid giving every objective the same weight.
Scorecard order
What it is
Order is in the Scorecard Details section of every scorecard. In the app it is described as "Where this scorecard appears in the list". You have three options:
- Top pins the scorecard to the start of the list (position 1).
- Last pins it to the end of the list.
- Custom lets you type an exact position. The allowed range is shown next to the field and depends on how many scorecards your workspace has.
The order is saved as the scorecard's priority. When more than one scorecard could apply to the same call, higher-priority scorecards are meant to take precedence, so keep your most specific scorecards near the top.
Set the order
- Go to Manage > Scorecards.
- Open the scorecard.
- In Scorecard Details, find Order.
- Select Top, Last or Custom. For Custom, enter a position within the range shown.
- Save the scorecard.
Adding or removing scorecards changes the allowed range, so check Order again after you create or delete scorecards.
What a scorecard applies to
Order only matters between scorecards that apply in the first place. The Apply to setting in Scorecard Details sets that scope:
- Roleplay Agent (the default): the scorecard is used only for roleplay sessions.
- Team, Team Member, Category, or Deal Stage: pick which ones the scorecard applies to.
Best practices
- Put your most specific scorecards (for example Discovery or Negotiation) near the top, and generic or fallback scorecards at Last.
- Use Custom to slot a scorecard between others (for example Discovery at 1, Negotiation at 2, Generic at 3).
- Review the order of all scorecards from time to time so it still matches your team structure.
Troubleshooting
The wrong scorecard was applied to my call
- Check the Apply to setting of the scorecard you expected. The call must match it (for example category, deal stage, team or team member). A scorecard set to Roleplay Agent is used only for roleplay sessions.
- Compare the Order of the scorecard you expected with the one that was applied, and move the one you want higher.
- See Why aren't specific calls being scored on Outdoo AI? for other causes.
Weight validation errors
- When Weighted Distribution is selected, every objective needs a whole number from 1 to 10. Fill in all weights and fix any highlighted errors in the Overall Score section.
Hope this article was helpful. For any queries, please write to support@outdoo.ai