Question 1
A risk practitioner learns that an AI system used by a manufacturer for quality control (QC) has produced inaccurate responses that could potentially impact user safety. Which of the following is the risk practitioner's BEST recommendation to mitigate this risk?
- AOption A:
Implement human-in-the-loop reviews.
- BOption B:
Conduct bias and fairness testing.
- COption C:
Augment the model with synthetic data.
- DOption D:
Provide AI prompt engineering training.
Show answer and explanation
Correct answer: A
When an AI system used for safety-critical quality control produces inaccurate responses that could harm users, the most immediate and effective safeguard is inserting human judgment into the decision process before unsafe outputs can reach production or end users.
Why A is Correct: The ISACA AAIR human oversight guidance identifies human-in-the-loop reviews as the most effective mitigation when AI outputs pose safety risks. In safety-critical applications like manufacturing quality control, human reviewers can catch and correct AI errors before they result in unsafe products reaching consumers. This control is immediately implementable, does not require model retraining, and directly addresses the safety risk. It is the appropriate response when AI accuracy cannot be fully trusted.
Why B is Wrong: Bias and fairness testing is a model evaluation activity that assesses whether outputs are systematically skewed. While useful for improving the model, it does not provide immediate protection against the safety risk of current inaccurate outputs.
Why C is Wrong: Synthetic data augmentation may improve model quality over time but requires model retraining and does not prevent currently inaccurate outputs from causing harm in the interim.
Why D is Wrong: Prompt engineering training improves how users interact with AI systems to elicit better outputs. It is useful for generative AI applications but does not directly address safety risks from QC system inaccuracies, which require operational oversight rather than improved prompting.