Exam CT-AI Topic 8 Question 50 Discussion

When verifyingautonomous AI-based systems, a critical aspect is ensuring that they maintain an appropriate level of autonomy whileonly requesting human intervention when necessary. If an AI system unnecessarily asks for human input, it defeats the purpose of autonomy and can:
* Slow down operations.
* Reduce trust in the system.
* Indicate improper confidence thresholds in decision-making.
This is particularly crucial inautonomous vehicles, AI-driven financial trading, and robotic process automation, where excessive human intervention would hinder performance.
* A. Test cases to verify that the system automatically confirms the correct classification of training data# This is relevant for verifying training consistency but not for autonomy validation.
* B. Test cases to detect the system appropriately automating its data input# While relevant, data automation does not directly address the verification of autonomy.
* D. Test cases to verify that the system automatically suppresses invalid output data# This focuses on output filtering rather than decision-making autonomy.
Why are the other options incorrect?Thus, the mostcritical test casefor verifyingautonomous AI-based systemsis ensuring that itdoes not unnecessarily request human intervention.
* Section 8.2 - Testing Autonomous AI-Based Systemsstates that it is crucial to testwhether the system requests human intervention only when necessaryand does not disrupt autonomy.
Reference from ISTQB Certified Tester AI Testing Study Guide: