Credentialing at Scale
8 exams. 800+ questions. Fully automated.
One pipeline handles enrollment, grading, scoring, and badge issuance across every exam.
Challenge
Launching a global certification program for a large QMS and manufacturing SaaS company, serving admins, partners, employees, and developers, meant scaling a fair, secure, and rigorous exam process. The client needed to evaluate hundreds of learners with varied workflows, prevent question fatigue, and eliminate manual work like account creation and badge delivery.
Solution
Authored 800+ questions targeting core competencies across every user type, refined each with stakeholder SMEs to balance clarity and challenge, and tuned the exam with pilot data before launch.
Python and JavaScript workflows ran enrollment, grading, and sandbox setup; the Credly API auto-issued each digital badge the moment an examinee passed; and a dynamic email system delivered credentials, scores, and next steps, with no admin involvement.
A Domo dashboard unified Qualtrics, Skilljar, and Credly data into one live view, surfacing real-time program health and learner feedback to leadership after every exam.
Exam Structure
Part 1
2
Sandbox tasks
Examinees create credentials to the sandbox site via API. No confusing back-and-forth with program administrators.
Part 2
20
Short-answer questions
Grading, personalized feedback, and citations offered via Artificial Intelligence Agents.
Part 3
60
Timed objective-response questions
Multiple-choice and true/false items.
My Role
I owned this program end to end: strategy, evidence-based assessment design, automation engineering, and analytics, working solo with stakeholders and SMEs to validate and scale it.
Impact
96%
Learner satisfaction (+88 NPS)
75%
Decrease in admin overhead
650+
Credentials issued to date
Scalable
Repeatable model for future programs
Bring this to your team
Want a result like this for your organization? Tell me what you're trying to accomplish and I'll show you how I can help.
Start a project