Question 1
Some automated regression test scripts run by a TAS in a given test environment make calls to private APIs that require authentication for all requests (the authentication method is the same for all APIs). The SUT is a business-critical system. The following two changes are planned: a change in the authentication method of all APIs and a minor upgrade of the OS (Operating System) in the test environment. You have updated the test scripts to cope with the change in the API authentication method. Which of the following sequences of activities is BEST to ensure that the test scripts are not adversely affected by these changes?
- AOption A:
First upgrade the OS, then implement the change in the API authentication method, and finally run all the updated test scripts
- BOption B:
Implement one change at a time and run a subset of the updated test scripts after each change, and finally run all the
updated test scripts
- COption C:
First implement the change in the API authentication method, then upgrade the OS, and finally run all the
updated test scripts
- DOption D:
Implement one change at a time and run a subset of the updated test scripts after each change
Show answer and explanation
Correct answer: B
TAE recommends controlled change management to isolate causes when multiple changes are introduced. When you apply more than one change at once, diagnosing failures becomes harder because you cannot easily attribute effects to a specific change. The best practice is to implement changes incrementally, validating automation and system behavior after each change using a representative subset of tests (e.g., smoke/build verification or targeted regression) to quickly detect issues. Because the system is business-critical, risk mitigation is stronger: you want early detection and clear attribution. After each change is validated with a subset, you then execute the full updated regression suite to ensure overall coverage and confidence. Options A and C apply two changes before running tests, which reduces diagnostic clarity and increases the risk of late discovery. Option D describes incremental changes with subset testing but omits the final full-suite run, which TAE would recommend to ensure broad coverage after all changes have been applied. Therefore, the best sequence is: change one item, run a subset, repeat for the next change, then run all updated scripts.