ISTQB AI Testing (CT-AI) Masterclass and Exam Prep | RCV Academy
Course · ISTQB Specialist · AI Testing

Learn all eleven chapters of the ISTQB CT-AI syllabus: how AI and machine learning work, the quality characteristics of AI-based systems, how to test them, and how to use AI in testing.

Or get it with every other course: $5.99/month or $99 lifetime · Compare plans
144 lessons in 14 sections14 free preview lessonsCertificate of completion
ISTQB CT-AI Test AI and machine learning systems, chapter by chapter
  • 144 lessons
  • 14 free previews
  • Exam: 40 questions · 60 min
Watch free preview lessons
144lessons
11syllabus chapters
32quizzes and practice tests
14free previews

What you'll learn

The course follows the CT-AI syllabus chapter by chapter, with quizzes throughout.

AI and machine learning basics

What AI is, ML workflows and forms of machine learning, ML data preparation, and neural networks.

Quality characteristics of AI

Flexibility and adaptability, autonomy, evolution, bias, ethics, side effects, reward hacking, transparency and explainability.

ML functional performance metrics

The confusion matrix, further metrics for classification, regression and clustering, their limitations, how to choose metrics, and ML benchmark suites.

Testing AI-based systems

Test levels for AI systems, test data, testing AI-specific quality characteristics, and test environments for AI.

Methods and techniques

Adversarial attacks and data poisoning, pairwise and metamorphic testing, A/B and back-to-back testing, and experience-based testing of AI.

Using AI for testing

AI technologies for testing, analysing reported defects, test case generation, regression suite optimisation, defect prediction and testing user interfaces with AI.

Your path to the CT-AI certificate

Learn, check, practise, then book the exam.

1

Get CTFL first

ISTQB requires the Foundation Level certificate before CT-AI.

2

Learn the syllabus

Work through the eleven CT-AI chapters in order.

3

Check each chapter

Take the quizzes to find weak areas early.

4

Practise and book

Sit the practice test, then book your exam with an exam provider.

The official exam at a glance

Certified Tester AI Testing (CT-AI) v1.0, as published by ISTQB.

40multiple-choice questions
31 / 47passing score (points)
60minutes (+25% if not in your native language)
CTFLrequired before this exam

Version change: CT-AI v1.0 exams end on 21 April 2027 in English (21 October 2027 in other languages). ISTQB has released CT-AI v2.0 as the replacement. This course covers the v1.0 syllabus.

Course curriculum

14 sections144 lessons0 downloadable practice files14 free previews
1Introduction1 lesson+
21. Introduction to AI17 lessons+
  • 1. Introduction to AIFree preview
  • 1.1 Definition of AI and AI Effect
  • 1.2 Narrow, General and Super AI
  • 1.3 AI-Based and Conventional Systems
  • 1.4 AI Technologies
  • 1.5 AI Development Frameworks
  • 1.6 Hardware for AI-Based Systems
  • 1.7 AI as a Service (AIaaS)
  • 1.7.1 Contracts for AI as a Service
  • 1.7.2 AIaaS Examples
  • 1.8 Pre-Trained Models
  • 1.8.1 Introduction to Pre-Trained Models
  • 1.8.2 Transfer Learning
  • 1.8.3 Risks of using Pre-Trained Models and Transfer Learning
  • 1.9 Standards, Regulations and AI
  • Module 1 - Resources to download
  • Module 1 Quiz 1
32. Quality Characteristics for AI-Based Systems18 lessons+
  • 2. Quality Characteristics for AI-Based SystemsFree preview
  • 2.1 Flexibility and AdaptabilityFree preview
  • 2.2 Autonomy
  • 2.3 Evolution
  • 2.4 Bias
  • 2.5 Ethics
  • 2.6 Side Effects and Reward Hacking
  • 2.7 Transparency, Interpretability and Explainability
  • 2.8 Safety and AI
  • Module 2 - Resources to download
  • Module 2 Quiz 1
  • Module 2 Quiz 2
  • Module 2 Quiz 3
  • Module 2 Quiz 4
  • Module 2 Quiz 5
  • Module 2 Quiz 6
  • Module 2 Quiz 7
  • Module 2 Quiz 8
43. Machine Learning (ML) – Overview18 lessons+
  • 3. Machine Learning (ML) – OverviewFree preview
  • 3.1 Forms of ML
  • 3.1.1 Supervised Learning
  • 3.1.2 Unsupervised Learning
  • 3.1.3 Reinforcement Learning
  • 3.2 ML Workflow
  • 3.3 Selecting a Form of ML
  • 3.4 Factors Involved in ML Algorithm Selection
  • 3.5 Overfitting and Underfitting
  • 3.5.1 Overfitting
  • 3.5.2 Underfitting
  • Module 3 - Resources to download
  • Module 3 Quiz 1
  • Module 3 Quiz 2
  • Module 3 Quiz 3
  • Module 3 Quiz 4
  • Module 3 Quiz 5
  • Module 3 Quiz 6
54. ML - Data13 lessons+
  • 4 ML - DataFree preview
  • 4.1 Data Preparation as Part of the ML Workflow
  • 4.1.1 Challenges in Data Preparation
  • 4.2 Training, Validation and Test Datasets in the ML Workflow- Part 1
  • 4.2 Training, Validation and Test Datasets in the ML Workflow- Part 2
  • 4.3 Dataset Quality Issues
  • 4.4 Data Quality and its Effect on the ML Model
  • 4.5 Data Labelling for Supervised Learning
  • 4.5.1 Approaches to Data Labelling
  • 4.5.2 Mislabeled Data in Datasets
  • Module 4 - Resources to download
  • Module 4 Quiz 1
  • Module 4 Quiz 2
65. ML Functional Performance Metrics9 lessons+
  • 5 ML Functional Performance MetricsFree preview
  • 5.1 Confusion Matrix
  • 5.2 Additional ML Functional Performance Metrics for Classification, Regression and Clustering
  • 5.3 Limitations of ML Functional Performance Metrics
  • 5.4 Selecting ML Functional Performance Metrics
  • 5.5 Benchmark Suites for ML
  • Module 5 - Resources to download
  • Module 5 Quiz 1
  • Module 5 Quiz 2
76. ML - Neural Networks and Testing6 lessons+
  • 6. ML - Neural Networks and TestingFree preview
  • 6.1 Neural Networks
  • 6.2 Coverage Measures for Neural Networks
  • Module 6 - Resources to download
  • Module 6 Quiz 1
  • Module 6 Quiz 2
87. Testing AI-Based Systems Overview17 lessons+
  • 7. Testing AI-Based Systems OverviewFree preview
  • 7.1 Specification of AI-Based Systems
  • 7.2 Test Levels for AI-Based Systems
  • 7.2.1 Input Data Testing
  • 7.2.2 ML Model Testing
  • 7.2.3 Component Testing
  • 7.2.4 Component Integration Testing
  • 7.2.5 System Testing
  • 7.2.6 Acceptance Testing
  • 7.3 Test Data for Testing AI-based Systems
  • 7.4 Testing for Automation Bias in AI-Based Systems
  • 7.5 Documenting an AI Component
  • 7.6 Testing for Concept Drift
  • 7.7 Selecting a Test Approach for an ML System
  • Module 7 - Resources to download
  • Module 7 Quiz 1
  • Module 7 Quiz 2
98. Testing AI-Specific Quality Characteristics12 lessons+
  • 8. Testing AI-Specific Quality CharacteristicsFree preview
  • 8.1 Challenges Testing Self-Learning Systems
  • 8.2 Testing Autonomous AI-Based Systems
  • 8.3 Testing for Algorithmic, Sample and Inappropriate Bias
  • 8.4 Challenges Testing Probabilistic and Non-Deterministic AI-Based Systems
  • 8.5 Challenges Testing Complex AI-Based Systems
  • 8.6 Testing the Transparency, Interpretability and Explainability of AI Based Systems
  • 8.7 Test Oracles for AI-Based Systems
  • 8.8 Test Objectives and Acceptance Criteria
  • Module 8 - Resources to download
  • Module 8 Quiz 1
  • Module 8 Quiz 2
109. Methods and Techniques for the Testing of AI-Based Systems13 lessons+
  • 9. Methods and Techniques for the Testing of AI-Based SystemsFree preview
  • 9.1 Adversarial Attacks and Data Poisoning
  • 9.1.1 Adversarial Attacks
  • 9.1.2 Data Poisoning
  • 9.2 Pairwise Testing
  • 9.3 Back-to-Back Testing
  • 9.4 A/B Testing
  • 9.5 Metamorphic Testing (MT)
  • 9.6 Experience-Based Testing of AI-Based Systems
  • 9.7 Selecting Test Techniques for AI-Based Systems
  • Module 9 - Resources to download
  • Module 9 Quiz 1
  • Module 9 Quiz 2
1110. Test Environments for AI-Based Systems6 lessons+
  • 10. Test Environments for AI-Based SystemsFree preview
  • 10.1 Test Environments for AI-Based Systems
  • 10.2 Virtual Test Environments for Testing AI-Based Systems
  • Module 10 - Resources to download
  • Module 10 Quiz 1
  • Module 10 Quiz 2
1211. Using AI for Testing12 lessons+
  • 11. Using AI for TestingFree preview
  • 11.1 AI Technologies for Testing
  • 11.2 Using AI to Analyze Reported Defects
  • 11.3 Using AI for Test Case Generation
  • 11.4 Using AI for the Optimization of Regression Test Suites
  • 11.5 Using AI for Defect Prediction
  • 11.6 Using AI for Testing User Interfaces
  • 11.6.1 Using AI to Test Through the Graphical User Interface (GUI)
  • 11.6.2 Using AI to Test the GUI
  • Module 11 - Resources to download
  • Module 11 Quiz 1
  • Module 11 Quiz 2
13ISTQB AI Tester Practice Test1 lesson+
  • ISTQB AI Tester Practice Test
14Conclusion1 lesson+

Lessons marked Free preview open without enrolling. Enroll for $29.99 →

Who this course is for

Testers working on AI products

Learn what is different about testing systems that use machine learning.

QA engineers adding AI skills

Understand ML concepts, metrics and risks well enough to plan tests for them.

Test leads and managers

Plan test approaches and environments for AI-based systems.

CTFL holders going further

Add the ISTQB AI Testing Specialist certificate to your Foundation Level.

What you need

  • The ISTQB Foundation Level (CTFL) certificate, which ISTQB requires before you can sit the CT-AI exam.
  • No programming or data science background is required.

Meet your instructor

Manish Verma, instructor

Manish Verma

Founder, Software Testing Mentor & RCV Academy
20+ years in QA52,000+ students235,000+ YouTube subscribers

20+ years in QA and test automation at organisations including IBM, Infosys, Capgemini, National Australia Bank, Westpac, ANZ and Coles. Most recently a Senior QA Automation Engineer and Framework Architect, leading a migration to a modern Playwright framework in JavaScript/TypeScript.

He holds the ISTQB Foundation Level, Advanced Level Test Analyst and Advanced Level Test Manager certifications, and has taught 52,000+ students.

Choose how you want to learn

Buy this course on its own, or get it with every other RCV Academy course.

This course only

One-time

$29.99
one-time payment · 30-day money-back guarantee
  • Lifetime access to this course
  • Certificate of completion
Buy this course
All courses

Monthly

$5.99
per month · cancel anytime · 7-day full refund
  • This course and all other published courses
  • Certificates of completion
  • Access while your membership is active
Start monthly
Best value
All courses, forever

Lifetime

$99
one-time · 30-day money-back guarantee
  • This course and all current courses
  • Every future course included
  • Certificates and lifetime updates
Get lifetime access

Try it risk-free

This course and the Lifetime plan come with a 30-day money-back guarantee. The Monthly plan has a full refund within the first 7 days.

Questions

Frequently asked questions

Which syllabus does this course cover?+
The ISTQB Certified Tester AI Testing (CT-AI) v1.0 syllabus. English v1.0 exams are available until 21 April 2027; after that, ISTQB exams use CT-AI v2.0.
Do I need to know machine learning or Python?+
No. The course explains AI and ML concepts from the start, and the exam does not require programming.
Can I watch some lessons before buying?+
Yes. The first lesson of each chapter is a free preview, for example Introduction to AI and Using AI for Testing.
Is the exam fee included?+
No. You book and pay for the official exam separately with an ISTQB member board or exam provider.
What is the difference between the plans?+
One-time gives you lifetime access to this course. Monthly ($5.99) gives you this course and every other published course while your membership is active. Lifetime ($99) gives you every current and future course, permanently.
What should I take next?+
For more exam practice, try the CT-AI practice tests (200 questions). For Generative AI, see the ISTQB CT-GenAI course.
Enroll for $29.99
Lifetime access to this course · 30-day money-back guarantee
$29.99One-time · lifetime access
Enroll now

Course Curriculum