Skip to main content
When you import a rubric into a roleplay, the evaluation criteria come with standardized guidance. In some cases, however, you may need to add more detailed or scenario-specific grading instructions that go beyond what the rubric alone provides.

​
When to Use Scenario-Specific Instructions

Add scenario-specific instructions when:
  • The rubric criteria are too general for a particular roleplay
  • You need graders (or AI evaluation) to look for specific behaviors or details
  • A scenario requires additional context not captured in the base rubric
  • You want to fine-tune how a skill is assessed without modifying the original rubric
This approach lets you customize evaluation without breaking the link to the original rubric.

​
Prerequisites

The roleplay must use evaluation criteria imported from a rubric

You must have editing access to the roleplay
Scenario-specific instructions only work for criteria that are tied to a rubric template.

​
Step 1: Open Evaluation Criteria

Screenshot2025 12 18at3 16 11PM Pn
  1. Open the roleplay you want to edit.
  2. Scroll to the Evaluation Criteria section.
  3. Click Edit.

​
Step 2: Select the Criterion to Customize

Screenshot2025 12 18at3 16 59PM Pn
  1. Find the specific rubric criterion you want to adjust.
  2. Click the three dots (⋯) next to that criterion.
  3. Select Edit.

​
Step 3: Add Scenario-Specific Instructions

Screenshot2025 12 18at3 21 44PM Pn
Inside the criterion editor, you’ll see a section labeled Scenario-Specific Instructions. This is where you can add detailed guidance that applies only to this roleplay.
Example: If the rubric criterion is Discovery and Needs Uncovering and the general guidance is: “Ask at least two open-ended questions” You could add scenario-specific instructions such as: “At least one open-ended question must uncover the customer’s current pain points with their logistics vendor.” These instructions add precision without changing the rubric itself.

​
Step 4: Save Your Changes

Screenshot2025 12 18at3 23 02PM Pn
  1. Click Save Changes.
  2. The criterion will now display scenario-specific context.
This additional guidance will be leveraged during grading and taken into account when evaluating roleplay sessions.

​
How Scenario-Specific Instructions Are Used

  • They supplement (not replace) rubric criteria
  • They apply only to the current scenario
  • They are used during evaluation to guide scoring
  • They do not affect other roleplays using the same rubric
Best Practices:
  • Keep instructions clear and measurable
  • Focus on behaviors that matter most for this scenario
  • Avoid duplicating rubric language - add only what’s unique
  • Use scenario-specific instructions instead of editing the rubric when customization is limited to one roleplay