Skip to main content

Be first to evaluate your learners with Custom Rubrics in AI Virtual Coaching [IN BETA] 

  • April 8, 2026
  • 4 replies
  • 80 views

We're opening a private beta for Custom Rubrics in AI Virtual Coaching  and we're inviting customers. 

 

Right now, AIVC evaluates every simulation against the same default criteria. Custom Rubrics changes that. You define what 'good' looks like for your specific scenario, AI evaluates against it, and learners see feedback tied to the criteria that matter for your organization. 

 

  • Phase 1 (April 14): Stop evaluating against generic defaults. Build a rubric with up to 5 criteria that reflect your actual training standards, each with observable examples of strong and developing performance. A default rubric ships on every new scenario so you're never starting from scratch.

 

  • Phase 2 (May 11 April 28): Human review enters the loop. Assign reviewers to any scenario and let learners submit their best attempt for human evaluation. Reviewers receive the full AI report as a starting point, then add their own judgment on top.

 

What we're asking of you

  • Create at least one new scenario and configure a custom rubric
  • Run at least 10 simulations and review the learner reports
  • Complete two short feedback surveys  
  • Share what surprised you,  where the AI nailed it, and where it missed

 

Time commitment: roughly 6–8 hours across 4 weeks.

 

What you get

  • 2,200 complimentary AI credits (enough for 20+ full simulations) to the first 20 participants
  • Direct access to the product team throughout the beta
  • Your feedback will directly shape the GA release

 

The beta starts April 14. To apply, complete this survey

 

Questions? Drop them below. 

 

4 replies

Hey! Thanks for allowing us to take part in this. I have feedback on the simulation itself as well as rubrics - can I provide this here.


The rubrics report is stating Good when it should be Developing.

 

 

 


rosa.odjidja
Docebian

Hi ​@isobellerodgers thank you for sharing this, the team are going to investigate and follow up with you if they need any more clarifications. Please keep your feedback coming, we really appreciate it.


janan.lewars
Docebian
  • Docebian
  • April 30, 2026

Hey everyone!

We've officially hit the halfway point of the Custom Rubrics beta! 

We've already seen some of you building rubrics from scratch, running simulations against real training scenarios, and pushing the feature in ways we didn't anticipate. That's exactly what makes a beta like this valuable, and it means a lot to the team.

Now we'd love to hear how it's actually going for you. We put together a short mid-point survey which takes about 5 minutes to complete. Your answers will directly shape what we prioritize next.

👉 Take the survey: https://forms.gle/uR3FH5Kd5VwydFaq5 

And as always, this is the place to ask questions, share what's working, or flag anything that isn't. We're here and available to answer questions.