The calibration team checks the call and the evidence behind its score.
The problem
How might a BPO team understand agent performance and act on call quality?
Teams needed to review calls scored by AI, help human agents improve, and give managers a clear way to follow up. I designed an MVP that connects those tasks across five levels of access.
to better action.
Pre-launch project: the role needs and workflows came from stakeholder input. There was no product user data to validate yet.
One call. Five levels of responsibility.
Each portal focuses on the decisions that person needs to make. Clients can add custom roles at the level that fits their organization.
- 01Tenant adminOversees all client accounts.
- 02Client adminSets up teams and access for one client.
- 03ManagerTracks performance across supervisors.
- 04SupervisorReviews calls and coaches agents.
- 05Call agentSees call scores and review feedback.

Let people check the AI—and teach it from the result.
AI-scored calls can be reviewed by a separate calibration team. This is especially useful when a new program starts and the team needs to see how well the scoring fits its criteria.
Reviewers record where their assessment differs and why.
The calibrated data feeds directly into training, creating a clear improvement loop.

Turn a call signal into a clear next step.
Instead of manually chasing every quality finding, teams can define what should happen when a call meets a condition. Here’s one example from the workflow builder.
A complete MVP design, moving into development.
I completed the requested designs for role-based portals, call calibration, and workflow automation. Development is nearing completion.
The product is pre-launch, so there are no usage or performance results to report yet.
Back to selected work