Exam CT-AI Topic 9 Question 133 Discussion

The correct answer is C . A requirement that an AI-based system be 100% accurate with no tolerance for failure creates a major testing challenge because many AI-based systems are probabilistic and may require accuracy tolerances rather than absolute expected outcomes. The CT-AI syllabus states that the probabilistic nature of many AI-based systems can make it necessary to specify tolerances for quality requirements such as prediction accuracy.
Option A is also challenging because natural language interfaces increase flexibility and make it difficult to document all possible interactions, but it is not as absolute as requiring perfect accuracy. Option B is a conventional performance efficiency requirement and can normally be tested using timing and resource measurements. Option D relates to autonomy and may require scenario-based testing, but it is still testable if the operational envelope and failure conditions are well specified. The decisive issue with option C is that it provides no tolerance range, no probabilistic acceptance model, and no practical allowance for statistical uncertainty. This creates both a specification problem and a test oracle problem.
References/topics: CT-AI Syllabus Chapter 7, Section 7.1 "Specification of AI-Based Systems"; Chapter
8, Section 8.4 "Challenges Testing Probabilistic and Non-Deterministic AI-Based Systems."
=========