-
1. Introduction to AI
16 Lessons-
Preview1. Introduction to AI
-
Start1.1 Definition of AI and AI Effect
-
Start1.2 Narrow, General and Super AI
-
Start1.3 AI-Based and Conventional Systems
-
Start1.4 AI Technologies
-
Start1.5 AI Development Frameworks
-
Start1.6 Hardware for AI-Based Systems
-
Start1.7 AI as a Service (AIaaS)
-
Start1.7.1 Contracts for AI as a Service
-
Start1.7.2 AIaaS Examples
-
Start1.8 Pre-Trained Models
-
Start1.8.1 Introduction to Pre-Trained Models
-
Start1.8.2 Transfer Learning
-
Start1.8.3 Risks of using Pre-Trained Models and Transfer Learning
-
Start1.9 Standards, Regulations and AI
-
StartModule 1 - Resources to download
-
-
2. Quality Characteristics for AI-Based Systems
10 Lessons-
Preview2. Quality Characteristics for AI-Based Systems
-
Preview2.1 Flexibility and Adaptability
-
Start2.2 Autonomy
-
Start2.3 Evolution
-
Start2.4 Bias
-
Start2.5 Ethics
-
Start2.6 Side Effects and Reward Hacking
-
Start2.7 Transparency, Interpretability and Explainability
-
Start2.8 Safety and AI
-
StartModule 2 - Resources to download
-
-
3. Machine Learning (ML) – Overview
12 Lessons-
Preview3. Machine Learning (ML) – Overview
-
Start3.1 Forms of ML
-
Start3.1.1 Supervised Learning
-
Start3.1.2 Unsupervised Learning
-
Start3.1.3 Reinforcement Learning
-
Start3.2 ML Workflow
-
Start3.3 Selecting a Form of ML
-
Start3.4 Factors Involved in ML Algorithm Selection
-
Start3.5 Overfitting and Underfitting
-
Start3.5.1 Overfitting
-
Start3.5.2 Underfitting
-
StartModule 3 - Resources to download
-
-
4. ML - Data
11 Lessons-
Preview4 ML - Data
-
Start4.1 Data Preparation as Part of the ML Workflow
-
Start4.1.1 Challenges in Data Preparation
-
Start4.2 Training, Validation and Test Datasets in the ML Workflow- Part 1
-
Start4.2 Training, Validation and Test Datasets in the ML Workflow- Part 2
-
Start4.3 Dataset Quality Issues
-
Start4.4 Data Quality and its Effect on the ML Model
-
Start4.5 Data Labelling for Supervised Learning
-
Start4.5.1 Approaches to Data Labelling
-
Start4.5.2 Mislabeled Data in Datasets
-
StartModule 4 - Resources to download
-
-
5. ML Functional Performance Metrics
7 Lessons-
Preview5 ML Functional Performance Metrics
-
Start5.1 Confusion Matrix
-
Start5.2 Additional ML Functional Performance Metrics for Classification, Regression and Clustering
-
Start5.3 Limitations of ML Functional Performance Metrics
-
Start5.4 Selecting ML Functional Performance Metrics
-
Start5.5 Benchmark Suites for ML
-
StartModule 5 - Resources to download
-
-
7. Testing AI-Based Systems Overview
15 Lessons-
Preview7. Testing AI-Based Systems Overview
-
Start7.1 Specification of AI-Based Systems
-
Start7.2 Test Levels for AI-Based Systems
-
Start7.2.1 Input Data Testing
-
Start7.2.2 ML Model Testing
-
Start7.2.3 Component Testing
-
Start7.2.4 Component Integration Testing
-
Start7.2.5 System Testing
-
Start7.2.6 Acceptance Testing
-
Start7.3 Test Data for Testing AI-based Systems
-
Start7.4 Testing for Automation Bias in AI-Based Systems
-
Start7.5 Documenting an AI Component
-
Start7.6 Testing for Concept Drift
-
Start7.7 Selecting a Test Approach for an ML System
-
StartModule 7 - Resources to download
-
-
8. Testing AI-Specific Quality Characteristics
10 Lessons-
Preview8. Testing AI-Specific Quality Characteristics
-
Start8.1 Challenges Testing Self-Learning Systems
-
Start8.2 Testing Autonomous AI-Based Systems
-
Start8.3 Testing for Algorithmic, Sample and Inappropriate Bias
-
Start8.4 Challenges Testing Probabilistic and Non-Deterministic AI-Based Systems
-
Start8.5 Challenges Testing Complex AI-Based Systems
-
Start8.6 Testing the Transparency, Interpretability and Explainability of AI Based Systems
-
Start8.7 Test Oracles for AI-Based Systems
-
Start8.8 Test Objectives and Acceptance Criteria
-
StartModule 8 - Resources to download
-
-
9. Methods and Techniques for the Testing of AI-Based Systems
11 Lessons-
Preview9. Methods and Techniques for the Testing of AI-Based Systems
-
Start9.1 Adversarial Attacks and Data Poisoning
-
Start9.1.1 Adversarial Attacks
-
Start9.1.2 Data Poisoning
-
Start9.2 Pairwise Testing
-
Start9.3 Back-to-Back Testing
-
Start9.4 A/B Testing
-
Start9.5 Metamorphic Testing (MT)
-
Start9.6 Experience-Based Testing of AI-Based Systems
-
Start9.7 Selecting Test Techniques for AI-Based Systems
-
StartModule 9 - Resources to download
-
-
11. Using AI for Testing
10 Lessons-
Preview11. Using AI for Testing
-
Start11.1 AI Technologies for Testing
-
Start11.2 Using AI to Analyze Reported Defects
-
Start11.3 Using AI for Test Case Generation
-
Start11.4 Using AI for the Optimization of Regression Test Suites
-
Start11.5 Using AI for Defect Prediction
-
Start11.6 Using AI for Testing User Interfaces
-
Start11.6.1 Using AI to Test Through the Graphical User Interface (GUI)
-
Start11.6.2 Using AI to Test the GUI
-
StartModule 11 - Resources to download
-
