AIS106 · AI Risk Assessment and Audit in Practice
About Course
Assess AI risks systematically and audit AI systems against policies and frameworks. You plan an audit, gather and test evidence, rate findings and write a report that leadership can act on.
Who it is for
Risk, compliance, internal audit and security professionals who must evaluate whether AI systems are safe, fair and well controlled.
Prerequisites
Complete AIS105; experience with AIS103 and AIS104 labs is strongly recommended.
What you will be able to do
- Conduct an AI risk assessment using a structured method aligned with ISO/IEC 23894 and the NIST AI RMF
- Plan an AI audit with objectives, criteria, scope and a risk-based test program
- Collect and test evidence, including re-performing fairness and robustness checks
- Write audit findings with condition, criteria, cause, effect and recommendation, and track remediation
Lessons
- Lesson 1 · Structured AI risk assessment
- Lesson 2 · Planning and performing an AI audit
- Lesson 3 · Findings, reporting and follow-up
- Lesson 4 · Lab and assignment
Lab: Audit an AI customer-service assistant
You audit a fictional retailer's AI assistant that answers customers and approves small refunds. Using the evidence pack, you build an audit program, test controls such as approval workflows and logging, re-perform a fairness check on refund decisions in Colab, and record findings in a working-paper spreadsheet.
Free tools: Google Sheets or LibreOffice Calc, Google Colab with pandas and Fairlearn, and a provided fictional evidence pack (policies, logs, evaluation results and decision samples)
Assessed assignment
Produce an AI risk assessment and audit report for an AI system of your choice, real in concept but with fictional data. Include the system description, risk assessment with inherent and residual ratings, audit objectives and criteria, the test program, at least five findings written in the condition-criteria-cause-effect-recommendation format, an overall opinion and a remediation tracker with owners and dates.
| Criterion | Weight | What excellent work looks like |
|---|---|---|
| Risk assessment | 25% | Risks are identified across categories, rated for inherent and residual risk with justified control effectiveness. |
| Audit planning and testing | 25% | Objectives, criteria and scope are clear, and tests are risk-based, repeatable and linked to evidence. |
| Findings quality | 30% | Each finding has all five elements, accurate severity and practical recommendations. |
| Opinion and follow-up | 20% | The overall opinion is supported by findings, and the remediation tracker is specific and realistic. |
Portfolio piece
An AI risk assessment and audit report with working papers and a remediation tracker.
Next step
Continue with AIS107 · Final Project: An AI Governance Plan for an Organization · 8 hours · $56.00
Course Content
AIS106 · AI Risk Assessment and Audit in Practice (8 h)
-
Lesson 1 · Structured AI risk assessment
-
Lesson 2 · Planning and performing an AI audit
-
Lesson 3 · Findings, reporting and follow-up
-
Lesson 4 · Lab and assignment
-
AIS106 Assessment · AI Risk Assessment and Audit in Practice
