-
1. Introduction to AI
17 Lessons-
Preview1. Introduction to AI
-
Start1.1 Definition of AI and AI Effect
-
Start1.2 Narrow, General and Super AI
-
Start1.3 AI-Based and Conventional Systems
-
Start1.4 AI Technologies
-
Start1.5 AI Development Frameworks
-
Start1.6 Hardware for AI-Based Systems
-
Start1.7 AI as a Service (AIaaS)
-
Start1.7.1 Contracts for AI as a Service
-
Start1.7.2 AIaaS Examples
-
Start1.8 Pre-Trained Models
-
Start1.8.1 Introduction to Pre-Trained Models
-
Start1.8.2 Transfer Learning
-
Start1.8.3 Risks of using Pre-Trained Models and Transfer Learning
-
Start1.9 Standards, Regulations and AI
-
StartModule 1 - Resources to download
-
StartModule 1 Quiz 1
-
-
2. Quality Characteristics for AI-Based Systems
18 Lessons-
Preview2. Quality Characteristics for AI-Based Systems
-
Preview2.1 Flexibility and Adaptability
-
Start2.2 Autonomy
-
Start2.3 Evolution
-
Start2.4 Bias
-
Start2.5 Ethics
-
Start2.6 Side Effects and Reward Hacking
-
Start2.7 Transparency, Interpretability and Explainability
-
Start2.8 Safety and AI
-
StartModule 2 - Resources to download
-
StartModule 2 Quiz 1
-
StartModule 2 Quiz 2
-
StartModule 2 Quiz 3
-
StartModule 2 Quiz 4
-
StartModule 2 Quiz 5
-
StartModule 2 Quiz 6
-
StartModule 2 Quiz 7
-
StartModule 2 Quiz 8
-
-
3. Machine Learning (ML) – Overview
18 Lessons-
Preview3. Machine Learning (ML) – Overview
-
Start3.1 Forms of ML
-
Start3.1.1 Supervised Learning
-
Start3.1.2 Unsupervised Learning
-
Start3.1.3 Reinforcement Learning
-
Start3.2 ML Workflow
-
Start3.3 Selecting a Form of ML
-
Start3.4 Factors Involved in ML Algorithm Selection
-
Start3.5 Overfitting and Underfitting
-
Start3.5.1 Overfitting
-
Start3.5.2 Underfitting
-
StartModule 3 - Resources to download
-
StartModule 3 Quiz 1
-
StartModule 3 Quiz 2
-
StartModule 3 Quiz 3
-
StartModule 3 Quiz 4
-
StartModule 3 Quiz 5
-
StartModule 3 Quiz 6
-
-
4. ML - Data
13 Lessons-
Preview4 ML - Data
-
Start4.1 Data Preparation as Part of the ML Workflow
-
Start4.1.1 Challenges in Data Preparation
-
Start4.2 Training, Validation and Test Datasets in the ML Workflow- Part 1
-
Start4.2 Training, Validation and Test Datasets in the ML Workflow- Part 2
-
Start4.3 Dataset Quality Issues
-
Start4.4 Data Quality and its Effect on the ML Model
-
Start4.5 Data Labelling for Supervised Learning
-
Start4.5.1 Approaches to Data Labelling
-
Start4.5.2 Mislabeled Data in Datasets
-
StartModule 4 - Resources to download
-
StartModule 4 Quiz 1
-
StartModule 4 Quiz 2
-
-
5. ML Functional Performance Metrics
9 Lessons-
Preview5 ML Functional Performance Metrics
-
Start5.1 Confusion Matrix
-
Start5.2 Additional ML Functional Performance Metrics for Classification, Regression and Clustering
-
Start5.3 Limitations of ML Functional Performance Metrics
-
Start5.4 Selecting ML Functional Performance Metrics
-
Start5.5 Benchmark Suites for ML
-
StartModule 5 - Resources to download
-
StartModule 5 Quiz 1
-
StartModule 5 Quiz 2
-
-
7. Testing AI-Based Systems Overview
17 Lessons-
Preview7. Testing AI-Based Systems Overview
-
Start7.1 Specification of AI-Based Systems
-
Start7.2 Test Levels for AI-Based Systems
-
Start7.2.1 Input Data Testing
-
Start7.2.2 ML Model Testing
-
Start7.2.3 Component Testing
-
Start7.2.4 Component Integration Testing
-
Start7.2.5 System Testing
-
Start7.2.6 Acceptance Testing
-
Start7.3 Test Data for Testing AI-based Systems
-
Start7.4 Testing for Automation Bias in AI-Based Systems
-
Start7.5 Documenting an AI Component
-
Start7.6 Testing for Concept Drift
-
Start7.7 Selecting a Test Approach for an ML System
-
StartModule 7 - Resources to download
-
StartModule 7 Quiz 1
-
StartModule 7 Quiz 2
-
-
8. Testing AI-Specific Quality Characteristics
12 Lessons-
Preview8. Testing AI-Specific Quality Characteristics
-
Start8.1 Challenges Testing Self-Learning Systems
-
Start8.2 Testing Autonomous AI-Based Systems
-
Start8.3 Testing for Algorithmic, Sample and Inappropriate Bias
-
Start8.4 Challenges Testing Probabilistic and Non-Deterministic AI-Based Systems
-
Start8.5 Challenges Testing Complex AI-Based Systems
-
Start8.6 Testing the Transparency, Interpretability and Explainability of AI Based Systems
-
Start8.7 Test Oracles for AI-Based Systems
-
Start8.8 Test Objectives and Acceptance Criteria
-
StartModule 8 - Resources to download
-
StartModule 8 Quiz 1
-
StartModule 8 Quiz 2
-
-
9. Methods and Techniques for the Testing of AI-Based Systems
13 Lessons-
Preview9. Methods and Techniques for the Testing of AI-Based Systems
-
Start9.1 Adversarial Attacks and Data Poisoning
-
Start9.1.1 Adversarial Attacks
-
Start9.1.2 Data Poisoning
-
Start9.2 Pairwise Testing
-
Start9.3 Back-to-Back Testing
-
Start9.4 A/B Testing
-
Start9.5 Metamorphic Testing (MT)
-
Start9.6 Experience-Based Testing of AI-Based Systems
-
Start9.7 Selecting Test Techniques for AI-Based Systems
-
StartModule 9 - Resources to download
-
StartModule 9 Quiz 1
-
StartModule 9 Quiz 2
-
-
10. Test Environments for AI-Based Systems
6 Lessons -
11. Using AI for Testing
12 Lessons-
Preview11. Using AI for Testing
-
Start11.1 AI Technologies for Testing
-
Start11.2 Using AI to Analyze Reported Defects
-
Start11.3 Using AI for Test Case Generation
-
Start11.4 Using AI for the Optimization of Regression Test Suites
-
Start11.5 Using AI for Defect Prediction
-
Start11.6 Using AI for Testing User Interfaces
-
Start11.6.1 Using AI to Test Through the Graphical User Interface (GUI)
-
Start11.6.2 Using AI to Test the GUI
-
StartModule 11 - Resources to download
-
StartModule 11 Quiz 1
-
StartModule 11 Quiz 2
-
About This Course
AI is no longer coming to software testing. It is already here. Organizations are deploying machine learning systems, autonomous decision engines, and AI powered products at a pace most QA teams are not equipped to keep up with. Testing these systems requires a completely different mindset and skillset than traditional software testing. The ISTQB CT AI certification is the credential that proves you have it, and this course gets you there.
This course covers the full CT AI syllabus with engaging lessons, real world examples from actual AI projects, and expert exam strategies built specifically for the ISTQB format. Whether you are a QA professional looking to move into AI testing, a test lead wanting to guide your team through AI adoption, or anyone working alongside AI systems who needs to understand quality and risk, this course is structured for you.
You will learn how AI and machine learning systems actually work, including supervised and unsupervised learning, model behavior, accuracy and robustness. You will master testing strategies for ML systems, understand how data quality and bias affect AI outcomes, apply ethical principles in your testing work, identify risks and failure modes unique to AI, and map AI testing tasks to Agile, DevOps, and traditional delivery workflows.
By the end of this course you will not only be prepared to pass the ISTQB CT AI exam on your first attempt, you will also be ready to apply AI testing techniques in real projects from day one. This is your opportunity to future proof your career and join the next generation of certified AI testers.
What You'll Learn
AI and Machine Learning Fundamentals
Understand how AI systems work including artificial intelligence, machine learning, and deep learning. You do not need to be a data scientist. This section gives you the conceptual grounding you need to test AI systems intelligently and communicate confidently with AI development teams.
How AI Changes Software Testing
Explore the impact of AI on software testing and learn why traditional testing methods are not sufficient for AI based systems. Understand the specific challenges that machine learning introduces and how the role of the tester evolves in AI driven projects.
Testing Strategies for ML Models
Master testing strategies for supervised and unsupervised learning algorithms. Learn how to test model behavior, accuracy, and robustness, and understand what makes an AI model pass or fail from a quality assurance perspective.
Data Quality and Its Role in AI Testing
Understand how biased, incomplete, or noisy training data can directly affect AI system performance and reliability. Learn how to evaluate data quality, spot data related defects, and incorporate data testing into your QA approach for AI projects.
Ethical Principles in AI Testing
Apply ethical principles to your AI testing work. Learn how to assess fairness, transparency, and accountability in AI systems so that the products you test meet responsible AI standards and do not cause unintended harm to end users or communities.
AI Risks and Failure Modes
Identify the risks and failure modes specific to AI systems including overfitting, adversarial inputs, model drift, and unintended consequences. Learn how to spot these issues before they reach users and how to design test strategies that target AI specific vulnerabilities.
AI Testing in Agile, DevOps, and Traditional SDLC
Map AI testing activities to the software development lifecycle. Learn where AI testing fits within Agile sprints, continuous delivery pipelines, and traditional waterfall projects so you can integrate AI quality practices into whatever delivery model your team uses.
ISTQB CT AI Exam Preparation
Prepare confidently for the ISTQB CT AI exam. Get a clear breakdown of the exam structure, question types, and proven strategies to pass on your first attempt. Practice questions throughout the course reinforce each topic and help you identify gaps before exam day.
Meet Your Instructor

Manish Verma
Founder & Senior QA Architect | ISTQB Certified AI Testing Expert
20+ years of QA and project management experience, holding ISTQB certifications including AI Testing and Testing with Generative AI, with deep hands on expertise in testing AI and machine learning systems, data quality assessment, ethical AI principles, and preparing QA professionals to pass the ISTQB CT AI exam
Manish is the founder of RCV Academy and a recognized leader in software testing and QA education. With extensive experience delivering QA programs across IBM, Capgemini, and multiple enterprise environments, he brings practical testing knowledge grounded in real projects, not just textbook theory.
His teaching approach is practical and outcome focused. He simplifies complex topics like agentic AI, multi agent orchestration, and LLM based test automation into clear, actionable lessons that testers at every level can apply immediately. Over 225,000 students trust his content across multiple platforms, making him one of the most recognized QA and AI educators in the industry.
Choose Your Learning Plan
Start learning today with flexible pricing options designed for every budget and commitment level.
Monthly
Start with flexibility
$5.99/month
Cancel anytime. First payment is non refundable.
- 13 hours of content
- Lifetime access
- All course materials
- Certificate included
- Cancel anytime
One Time
Best value for commitment
$29.99once
Own it forever with no recurring charges
- 13 hours of content
- Lifetime access
- All course materials
- Certificate included
- 30 day guarantee
Most Popular
Lifetime
Ultimate value package
$99once
Access all courses + future releases
- All RCV Academy courses
- Lifetime updates
- All new courses included
- Priority support
- 30 day guarantee
What You Need
Course Requirements
- Anyone can take this course. No prior experience needed.
- To gain ISTQB CT AI certification, you must hold the Certified Tester Foundation Level (CTFL) certificate.
Frequently Asked Questions
Do I need a technical background or AI experience to take this course?
No. Anyone can take this course. You do not need prior AI knowledge, programming skills, or data science experience. The course explains AI and machine learning concepts from a tester's perspective so they are accessible to QA professionals at any level. The only requirement for the actual ISTQB CT AI certification is the CTFL foundation level certificate.
What is the ISTQB CT AI certification and who is it for?
CT AI stands for Certified Tester AI Testing. It is an ISTQB specialist certification that validates your ability to test AI and machine learning based systems. It is designed for QA professionals, test leads, business analysts, and anyone who works on projects where AI is part of the system under test. As AI becomes standard in software products, this certification is fast becoming one of the most valuable credentials in the testing industry.
Does this course cover the complete ISTQB CT AI syllabus?
Yes. This course covers the full ISTQB CT AI syllabus including AI fundamentals, ML testing strategies, data quality, ethical AI testing, risk and failure modes, and integration with the SDLC. You also get practice questions and exam tips throughout so you are fully prepared for the real exam format.
How is testing AI systems different from traditional software testing?
Traditional software testing checks that deterministic systems produce expected outputs for given inputs. AI systems behave differently because their outputs are probabilistic and their behavior depends on training data, not just code. This means you need different strategies to test model accuracy, fairness, robustness, and drift over time. This course teaches exactly those strategies.
How much time do I need to complete this course?
The course has 13 hours of video content plus 14 articles and 120 downloadable resources. Most students complete it over one to two weeks studying a few hours each day. All content is self paced so you can revisit any section as many times as you need before booking your exam.
Will this course help me in real AI testing projects, not just the exam?
Absolutely. The course is built around real world AI testing scenarios and examples, not just theory. You will understand how to apply each concept on an actual project and how AI testing fits into the delivery models your team already uses. The goal is to make you effective at AI testing at work from day one, not just certified on paper.
Who This Course Is For
Software Testers, QA Engineers and SDETs
If you are working in software testing and want to stay relevant as AI becomes a standard part of the systems you test, this course gives you the knowledge, techniques, and ISTQB recognized credential to confidently take on AI testing work.
QA Leads, Test Leads, Test Managers and Quality Managers
Testing leaders who need to build AI testing capability within their teams or guide quality strategy on AI projects will find this certification gives them both the technical grounding and the credibility to lead that work effectively.
Business Analysts, Software Dev Managers and Project Managers
Anyone who shapes requirements, manages delivery, or makes decisions about AI product quality benefits from understanding how AI systems are tested. This course gives you the vocabulary and framework to engage meaningfully with AI testing conversations on your projects.
Operations Team Members
Operations professionals responsible for monitoring and maintaining AI systems in production need to understand AI failure modes, model drift, and quality risks. This course provides the foundational knowledge to recognize and respond to AI quality issues in live environments.
IT Directors
Technology leaders overseeing AI adoption need to understand what responsible AI testing looks like and what risks go unmanaged without it. This certification gives you an informed perspective on AI quality governance that supports sound decision making across the organization.
Management Consultants
Consultants advising organizations on AI adoption, digital transformation, or software quality strategy will find this certification adds structured knowledge and credibility. It positions you to address the testing and risk dimensions of AI projects with authority.
30 Day Money Back Guarantee
Your satisfaction is guaranteed. Enroll risk free. If the course is not what you expected within 30 days, get a full refund with no questions asked. We are this confident you will love it.
