Skip to content

AWS Certified AI Practitioner — Task Statement 1.1 Study Notes

Explain Basic AI Concepts and Terminologies

This task statement tests whether you understand the fundamental vocabulary of artificial intelligence, machine learning, generative AI, data, model training, inferencing, and learning methods.


1. Artificial Intelligence Fundamentals

1.1 Artificial Intelligence — AI

Artificial intelligence (AI) is the field of computer science focused on creating systems that perform tasks normally associated with human intelligence.

Examples of human-like capabilities include:

  • Learning from data
  • Recognizing images and speech
  • Understanding language
  • Making predictions
  • Finding patterns
  • Generating content
  • Making decisions
  • Solving problems
  • Detecting anomalies

The overall goal of AI is to build systems that can derive useful meaning from data and perform tasks with limited explicit human instructions.

Examples of AI applications

  • Fraud detection
  • Medical image analysis
  • Product recommendations
  • Chatbots and virtual assistants
  • Demand forecasting
  • Resume screening
  • Predictive maintenance
  • Translation
  • Image and video analysis
  • Personalized content recommendations

Exam point

AI is the broadest term. It includes many approaches, including:

  • Rule-based systems
  • Machine learning
  • Deep learning
  • Generative AI
  • Reinforcement learning
  • Agentic AI

Not all AI systems learn from data. A simple rules-based expert system can be considered AI even though it does not use machine learning.


1.2 Machine Learning — ML

Machine learning (ML) is a subset of AI in which systems learn patterns from data and use those patterns to make predictions or decisions.

Instead of explicitly programming every rule, developers provide:

  1. Data
  2. An algorithm
  3. Sometimes the expected answers or labels

The ML system adjusts its internal values during training so that it can make useful predictions on new data.

Example

An online store can use ML to recommend products based on:

  • Customer browsing history
  • Previous purchases
  • Product ratings
  • Similar customers’ behavior
  • Product characteristics

Key ML concepts

Term Meaning
Feature An input variable used by a model
Label/target The expected output, mainly used in supervised learning
Algorithm A mathematical or computational procedure used to learn patterns
Model The trained result produced by applying an algorithm to data
Parameter An internal value learned or adjusted during training
Training The process of learning from data
Inference Using a trained model to generate a prediction or output
Prediction The output produced by a model
Model artifact The saved trained parameters, model definition, and related metadata

Important distinction: algorithm versus model

  • An algorithm is the procedure or method used to learn.
  • A model is the trained result after the algorithm has processed data.

For example:

  • Linear regression is an algorithm.
  • A trained equation that predicts height from weight is a model.

1.3 Deep Learning

Deep learning is a specialized type of machine learning that uses multilayer neural networks.

Deep learning models are particularly useful for complex and high-dimensional data, such as:

  • Images
  • Video
  • Audio
  • Speech
  • Text
  • Natural language

Neural networks

A neural network is made up of connected computational units called nodes, inspired loosely by biological neurons.

A typical neural network contains:

  1. Input layer
    Receives the input features.

  2. Hidden layers
    Transform the input and learn increasingly complex patterns.

  3. Output layer
    Produces the prediction or result.

The model assigns weights to inputs. During training, these weights are repeatedly adjusted to reduce the difference between the predicted output and the expected output.

Why deep learning is useful

Traditional ML often requires people to manually select and extract useful features. Deep learning can learn many features automatically.

For example, in image recognition:

  • Early layers may learn edges.
  • Middle layers may learn shapes.
  • Later layers may identify objects such as fish, cars, or faces.

Traditional ML versus deep learning

Characteristic Traditional ML Deep learning
Typical data Structured/tabular data Images, video, audio, text
Feature engineering Often requires manual feature selection Learns features automatically
Data requirement Usually lower Often requires very large datasets
Compute requirement Generally lower Generally higher
Interpretability Often easier Often more difficult
Common use cases Churn, recommendations, classification Computer vision, NLP, speech

Exam trap

Deep learning is not separate from ML. It is a subset of ML, and ML is a subset of AI.

The relationship is:

AI ⟶ Machine Learning ⟶ Deep Learning


2. Computer Vision and Natural Language Processing

2.1 Computer Vision

Computer vision is the use of AI and ML to process and understand images and video.

Common computer vision tasks include:

  • Image classification
  • Object detection
  • Facial recognition
  • Image segmentation
  • Optical character recognition
  • Defect detection
  • Image moderation
  • Activity recognition
  • Anomaly detection

Common computer vision outputs

A model might return:

  • The class of an image
  • A probability or confidence score
  • The coordinates of an object
  • A bounding box
  • A segmentation mask
  • Detected text
  • Whether an image contains unsafe content

Example

A manufacturing system can inspect circuit boards and detect:

  • Scratches
  • Missing components
  • Incorrect assembly
  • Surface defects

2.2 Natural Language Processing — NLP

Natural language processing (NLP) enables computers to understand, interpret, translate, analyze, and generate human language.

NLP applications include:

  • Chatbots
  • Virtual assistants
  • Language translation
  • Text classification
  • Sentiment analysis
  • Text summarization
  • Question answering
  • Speech-to-text
  • Text-to-speech
  • Entity extraction
  • Document analysis

For example, an NLP system can understand that a customer’s message expresses dissatisfaction even if the customer does not use the exact word “complaint.”

NLP and generative AI

NLP is a broad field. Generative AI is one type of technology that can be used for NLP tasks, such as:

  • Generating an answer
  • Summarizing a document
  • Translating text
  • Writing an email

3. Algorithms, Models, Training, and Inference

3.1 Algorithm

An algorithm is a defined mathematical or computational method for solving a problem or learning a relationship in data.

Examples include:

  • Linear regression
  • Logistic regression
  • Decision trees
  • Random forests
  • K-means clustering
  • Neural networks
  • Transformer architectures

An algorithm determines how data is processed and how a model learns.


3.2 Features

A feature is an input property used by a model.

Examples:

  • Customer age
  • Income
  • Number of previous purchases
  • Temperature
  • CPU utilization
  • Pixels in an image
  • Words or tokens in a document

In a tabular dataset, features are often represented as columns.

Example

Weight Age Height
70 kg 30 175 cm
  • Weight and age could be features.
  • Height could be the label or target.

3.3 Labels

A label is the known correct output associated with a training example.

Examples:

  • “Fraud” or “Not fraud”
  • “Fish” or “Not fish”
  • House price
  • Customer churn: “Yes” or “No”
  • Disease diagnosis
  • Customer sentiment

Labels are required for traditional supervised learning.


3.4 Training

Training is the process of using data to adjust a model’s internal parameters so that it produces useful outputs.

A simplified training process is:

  1. Provide training data to an algorithm.
  2. The model produces a prediction.
  3. Compare the prediction with the known answer, if available.
  4. Calculate the error or loss.
  5. Adjust model parameters.
  6. Repeat until the model performs sufficiently well.

Model parameters

Parameters are values learned during training.

For linear regression:

\[ y = mx + b \]

  • \(x\) is the input.
  • \(y\) is the output.
  • \(m\) is the slope.
  • \(b\) is the intercept.

The values of \(m\) and \(b\) are adjusted during training to find the best-fitting line.


3.5 Model Artifacts

Training typically produces model artifacts, which may contain:

  • Learned parameters
  • Model architecture or definition
  • Preprocessing information
  • Configuration
  • Metadata

These artifacts are commonly stored in Amazon S3 and packaged with inference code to create a deployable model.

AWS exam connection

Amazon S3 is commonly used as a source or destination for ML data because it offers:

  • High durability
  • Large-scale storage
  • Support for many data formats
  • Integration with AWS ML services
  • Cost-effective object storage

3.6 Inference

Inference is the process of using a trained model to produce an output from new data.

Examples:

  • Predict whether a transaction is fraudulent.
  • Classify an image as containing a fish.
  • Forecast next month’s sales.
  • Generate a response to a prompt.
  • Estimate the probability that a customer will leave.

Important point

An inference is generally a prediction or probabilistic result, not guaranteed truth.

A classification model might return:

  • Fish: 0.93 probability
  • Not fish: 0.07 probability

The model output is based on learned patterns and may be incorrect.


4. Types of Inferencing

The exam may ask you to select an inference method based on latency, request volume, cost, and whether results are needed immediately.

4.1 Real-Time Inference

Real-time inference uses a persistent endpoint that is continuously available to receive requests.

Characteristics

  • Low latency
  • Immediate response
  • Persistent compute resources
  • Suitable for interactive applications
  • Handles a sustained flow of requests

Use cases

  • Fraud detection during a transaction
  • Online recommendations
  • Chatbot responses
  • Image classification in an application
  • Predicting customer churn while a user is online

AWS examples

  • Amazon SageMaker real-time endpoints
  • Amazon Bedrock model invocation
  • Applications using an API that requires an immediate response

Exam clue

If the question says:

  • “Low latency”
  • “Immediate response”
  • “Online prediction”
  • “Interactive application”
  • “Endpoint always available”

The answer is usually real-time inference.


4.2 Batch Inference

Batch inference processes a large volume of data at once, usually on a schedule.

Characteristics

  • Data is available upfront.
  • Results do not need to be returned immediately.
  • Compute runs for the batch job and then stops.
  • Often more cost-effective for large offline workloads.
  • No continuously available endpoint is required.

Use cases

  • Monthly sales forecasting
  • Scoring an entire customer database
  • Generating recommendations overnight
  • Processing historical data
  • Producing a daily report
  • Predicting inventory requirements

AWS example

Amazon SageMaker Batch Transform can generate predictions for an entire dataset without deploying a persistent endpoint.

Exam clue

If the question says:

  • “Offline”
  • “Large dataset”
  • “Run once per day or month”
  • “Results can wait”
  • “Cost optimization”
  • “No persistent endpoint”

The answer is usually batch inference.


4.3 Asynchronous Inference

Asynchronous inference is appropriate when requests may take a long time to process or contain large input payloads, and the client does not need an immediate response.

The client submits a request and receives the result later.

Typical workflow

  1. Client submits input.
  2. The request is placed in a queue.
  3. The model processes the request.
  4. The output is stored, commonly in Amazon S3.
  5. The client is notified or checks for the result.

Use cases

  • Large image or video processing
  • Long-running document analysis
  • Large text generation requests
  • Requests with unpredictable processing time
  • Applications that can tolerate delays

Exam clue

If the question describes:

  • A request that takes time
  • A response that can be returned later
  • Large payloads
  • Queue-based processing
  • Notifications when processing finishes

The answer is likely asynchronous inference.


4.4 Serverless Inference

Serverless inference runs inference without requiring the customer to manage or maintain dedicated infrastructure.

Resources are provisioned when needed and may scale down when idle.

Characteristics

  • No server management
  • Suitable for intermittent or unpredictable traffic
  • Can reduce cost when the endpoint is not constantly used
  • May have startup or cold-start latency
  • Not always ideal for strict, consistently low-latency requirements

AWS examples

  • Amazon SageMaker Serverless Inference
  • Amazon Bedrock managed model invocation

Exam trap

“Serverless” describes how infrastructure is managed and billed. It is not necessarily the same as batch or real-time.

For example:

  • Serverless inference can support an on-demand request.
  • Batch inference can use temporary compute.
  • Real-time inference can be serverless in some architectures, although persistent low latency may favor provisioned resources.

4.5 Comparison of Inference Types

Type Response timing Infrastructure Best for
Real-time Immediate Persistent endpoint Interactive, low-latency requests
Batch Later, after job completion Runs during batch Large offline datasets
Asynchronous Later per request Queue-based or managed processing Long-running or large requests
Serverless Depends on service and invocation Managed, automatically provisioned Intermittent or unpredictable traffic

5. Data Types Used in AI and ML

5.1 Structured Data

Structured data follows a defined schema and is usually organized in rows and columns.

Examples:

  • CSV files
  • Relational database tables
  • Sales records
  • Customer records
  • Financial transactions
  • Inventory data

AWS examples

  • Amazon RDS
  • Amazon Redshift
  • Amazon S3 containing CSV files

Structured data is commonly queried using SQL.


5.2 Semi-Structured Data

Semi-structured data does not follow a strict table structure but contains tags, keys, or metadata that provide organization.

Examples:

  • JSON
  • XML
  • Log files
  • Event records
  • Web data

Attributes may be missing or vary between records.

AWS examples

  • Amazon DynamoDB
  • Amazon DocumentDB
  • Amazon S3 storing JSON documents

5.3 Unstructured Data

Unstructured data does not follow a predefined data model or tabular schema.

Examples:

  • Images
  • Video
  • Audio
  • Documents
  • Emails
  • Social media posts
  • Free-form text

Unstructured data is commonly stored as objects in Amazon S3.

ML features may need to be extracted from unstructured data using techniques such as:

  • Tokenization for text
  • Image preprocessing
  • Speech recognition
  • Embeddings
  • Object detection
  • Feature extraction

5.4 Labeled and Unlabeled Data

Labeled data

Labeled data includes both:

  • Input features
  • Expected output

Example:

Image Label
Image of fish Fish
Image of dog Not fish

Labeled data is used primarily in supervised learning.

Unlabeled data

Unlabeled data contains input data but no known target output.

Examples:

  • Customer transactions without fraud labels
  • Images without object labels
  • Network traffic without incident labels

Unlabeled data is used in unsupervised learning and can also be used in some self-supervised and generative AI approaches.


5.5 Tabular Data

Tabular data is organized into rows and columns.

Examples:

  • Customer churn data
  • Loan applications
  • Product catalogs
  • Sales history
  • Employee records

Tabular data is often structured, but tabular data and structured data are not exactly identical concepts. Tabular data describes the representation, while structured data describes how consistently the data follows a schema.


5.6 Time-Series Data

Time-series data consists of observations recorded in sequence and associated with timestamps.

Examples:

  • Stock prices
  • CPU utilization
  • Temperature readings
  • Sales per day
  • Website traffic
  • Transactions per second
  • Sensor readings

Time-series data is useful for:

  • Forecasting
  • Capacity planning
  • Demand prediction
  • Predictive maintenance
  • Anomaly detection

Example

Historical CPU usage can be used to predict when additional infrastructure capacity will be required.

Exam clue

If the question mentions:

  • Historical values
  • Dates or timestamps
  • Forecasting future values
  • Seasonal patterns
  • Sequential measurements

The answer likely involves time-series data or regression/forecasting.


5.7 Image, Video, Audio, and Text Data

These are generally considered unstructured data.

Images and video

Used for:

  • Defect detection
  • Object identification
  • Facial recognition
  • Content moderation
  • Medical analysis

Text

Used for:

  • Sentiment analysis
  • Classification
  • Summarization
  • Search
  • Translation
  • Question answering

Audio

Used for:

  • Transcription
  • Speaker identification
  • Voice assistants
  • Call-center analysis

6. Machine Learning Learning Methods

6.1 Supervised Learning

In supervised learning, the model trains on labeled data.

The model learns the relationship between:

  • Input features
  • Known target outputs

Common supervised learning tasks

Classification

Predicts a category or class.

Examples:

  • Fraud or not fraud
  • Fish or not fish
  • Spam or not spam
  • Approved or rejected
  • Positive, negative, or neutral sentiment

Regression

Predicts a numerical value.

Examples:

  • Sales amount
  • House price
  • Temperature
  • Number of customers
  • Future demand

Supervised learning workflow

  1. Collect labeled examples.
  2. Provide features and expected outputs.
  3. Train the model.
  4. Measure errors.
  5. Adjust parameters.
  6. Use the trained model for predictions.

Main challenge

Obtaining high-quality labels can be expensive and time-consuming.

AWS connection

Amazon SageMaker Ground Truth helps create labeled datasets. It can use human workers and can integrate with Amazon Mechanical Turk for crowdsourced labeling.

Exam trap

Supervised learning is not defined by whether a human is directly involved during prediction. It is defined by the use of labeled training data.


6.2 Unsupervised Learning

In unsupervised learning, the model receives data without predefined labels.

The model attempts to discover hidden structure or patterns.

Common unsupervised tasks

  • Clustering
  • Grouping similar data
  • Anomaly detection
  • Dimensionality reduction
  • Pattern discovery

Examples

  • Grouping customers by purchasing behavior
  • Identifying unusual network traffic
  • Detecting an abnormal sensor reading
  • Discovering different types of users
  • Organizing documents into topics

Clustering

Clustering divides data into groups based on similarity.

For example, a retailer might group customers into segments such as:

  • Occasional buyers
  • Frequent buyers
  • High-value customers
  • Discount-focused customers

Anomaly detection

Anomaly detection identifies observations that differ significantly from normal patterns.

Examples:

  • Unusual credit-card activity
  • A sensor reporting an abnormal temperature
  • A sudden drop in application traffic
  • A suspicious network event

Exam trap

Unsupervised learning has no specified correct output during training. It does not mean the model has no objective at all; it means the objective is usually to discover structure rather than match labeled answers.


6.3 Reinforcement Learning

Reinforcement learning (RL) trains an agent to make decisions by interacting with an environment.

The agent:

  1. Observes the current state.
  2. Takes an action.
  3. Receives a reward or penalty.
  4. Learns which actions are more likely to achieve its goal.

Key RL terms

Term Meaning
Agent The decision-making system
Environment The world or system in which the agent acts
Action A choice made by the agent
State The current condition of the environment
Reward Feedback indicating how desirable an action was
Policy A strategy for selecting actions

Example: AWS DeepRacer

  • Agent: The race car
  • Environment: The racetrack
  • Action: Steering, accelerating, or slowing down
  • Goal: Stay on the track and complete the course
  • Reward: Positive feedback for staying on track and moving efficiently

Exploration versus exploitation

An RL agent must balance:

  • Exploration: Trying new actions to discover whether they are useful.
  • Exploitation: Choosing actions already known to produce good rewards.

Difference from unsupervised learning

Both can operate without labeled examples, but they are different:

Unsupervised learning Reinforcement learning
Finds patterns in data Learns through interaction
No predefined target label Has a goal or reward objective
Often clusters or detects anomalies Chooses actions
No reward feedback required Uses rewards and penalties

Exam trap

Reinforcement learning is not simply “learning without labels.” The defining characteristics are:

  • An agent
  • An environment
  • Actions
  • Rewards or penalties
  • A goal

7. Model Fit: Overfitting and Underfitting

7.1 Model Fit

Fit describes how well a model represents the relationship between its input data and expected output.

A good model should generalize: it should perform well not only on training data but also on new, unseen data.


7.2 Overfitting

Overfitting occurs when a model performs very well on training data but poorly on new data.

The model has learned the training examples too specifically, including noise or irrelevant details.

Example

A fish classifier is trained mostly on fish swimming underwater. It performs well on those images but fails to recognize a fish outside water.

Causes

  • Too little training data
  • Training data is not diverse
  • Model is too complex
  • Training for too long
  • Model learns noise
  • Data leakage in the training process

Possible solutions

  • Use more diverse training data.
  • Add more training examples.
  • Use regularization.
  • Simplify the model.
  • Stop training earlier.
  • Use data augmentation.
  • Evaluate using unseen validation and test data.

Exam clue

High training accuracy + low test accuracy = overfitting.


7.3 Underfitting

Underfitting occurs when a model is too simple or insufficiently trained to learn the underlying relationship.

It performs poorly on both:

  • Training data
  • New data

Causes

  • Model is too simple
  • Insufficient training
  • Too few features
  • Dataset is too small
  • Excessive regularization
  • Poor feature selection

Possible solutions

  • Train for longer.
  • Use a more complex model.
  • Add useful features.
  • Obtain more representative data.
  • Reduce excessive regularization.

Exam clue

Low training accuracy + low test accuracy = underfitting.


7.4 Generalization

Generalization is the ability of a model to perform well on data it has not seen before.

The objective is not to memorize the training data. The objective is to learn patterns that apply to new examples.


8. Bias and Fairness

8.1 Bias in AI Models

Bias occurs when a model produces systematically skewed or unequal results, especially across different groups.

Bias may cause a model to favor or disadvantage a particular class or population.

Example

A loan approval model trained on data that lacks approved applications from a particular demographic group may incorrectly learn that the group should not receive loans.

Sources of bias

Bias can enter at many stages:

  • Biased data collection
  • Underrepresentation of groups
  • Historical discrimination in training data
  • Incorrect labels
  • Poor feature selection
  • Proxy variables
  • Sampling errors
  • Biased evaluation metrics
  • Human assumptions in system design

Proxy variables

A feature may act as a proxy for a protected characteristic even if the protected feature is removed.

For example:

  • Postal code may correlate with race or socioeconomic status.
  • School attended may correlate with demographic background.

Simply removing a field such as gender does not automatically eliminate bias.


8.2 Fairness

Fairness means that a model’s results should not unjustifiably disadvantage individuals or groups based on protected or sensitive characteristics.

Fairness must be considered throughout the ML lifecycle:

  1. Define fairness requirements.
  2. Inspect training data.
  3. Identify representation gaps.
  4. Evaluate model performance across groups.
  5. Monitor deployed predictions.
  6. Adjust the data, model, or decision process when necessary.

Important point

Fairness is not automatically guaranteed by removing sensitive attributes. Other inputs may still contain indirect information about those attributes.

AWS exam connection

AWS services and practices can support responsible AI through:

  • Dataset analysis
  • Bias detection
  • Model evaluation
  • Human review
  • Monitoring
  • Documentation
  • Governance controls

For this task statement, focus primarily on understanding the concepts of bias and fairness rather than memorizing a specific service.


9. Generative AI

9.1 Definition

Generative AI (GenAI) is AI that creates new content based on patterns learned from training data.

It can generate:

  • Text
  • Images
  • Audio
  • Video
  • Music
  • Code
  • Summaries
  • Conversational responses

Example

A user provides a prompt such as:

“Write a product description for a waterproof hiking backpack.”

The model generates an original response based on its learned patterns.


9.2 Prompts and Responses

A prompt is the input provided to a generative AI model.

The output may be called:

  • Response
  • Completion
  • Generated content
  • Model output

Prompt quality affects the usefulness of the result. Clear instructions, context, constraints, and examples often improve results.


9.3 Large Language Models — LLMs

A large language model (LLM) is a deep learning model trained on very large collections of text data.

LLMs learn statistical relationships between tokens and can perform tasks such as:

  • Text generation
  • Summarization
  • Translation
  • Question answering
  • Classification
  • Code generation
  • Information extraction
  • Conversational interaction

Tokens

A token is a unit of text processed by a language model. A token may be:

  • A whole word
  • Part of a word
  • Punctuation
  • A symbol

LLMs generate outputs by predicting likely next tokens based on the input and prior generated tokens.

Transformers

Modern LLMs commonly use transformer neural networks.

Transformers are effective because they can examine relationships between elements of a sequence using mechanisms such as attention.

Important clarification

Transformers can process many input tokens in parallel during training, which is more efficient than processing every input word strictly one at a time. During generation, however, output tokens are generally produced sequentially.

Model parameters

LLMs may contain billions of learned parameters. These parameters capture statistical patterns from training data. They do not represent a literal database of facts or guaranteed human understanding.


9.4 Generative AI versus Traditional Predictive ML

Characteristic Traditional predictive ML Generative AI
Main output Prediction, classification, score New content
Example output Fraud probability: 0.97 Written fraud explanation
Common training Often task-specific Often pre-trained on broad datasets
Input Features Prompt or multimodal input
Typical use Forecasting, classification Text, image, code, audio generation
Output certainty Often probability or numeric value Generated and potentially variable

Exam trap

Generative AI does not mean the output is necessarily correct, original in a legal sense, or free of bias. Generated content still requires evaluation and appropriate safeguards.


10. Agentic AI

10.1 Definition

Agentic AI refers to AI systems that can pursue goals by planning, reasoning, selecting actions, using tools, and adapting based on results.

An agentic system may:

  1. Receive a goal.
  2. Break the goal into steps.
  3. Decide what action to take.
  4. Use external tools or data sources.
  5. Observe the result.
  6. Continue, revise, or stop.

Example

A travel-planning agent could:

  • Understand a user’s travel requirements.
  • Search flight and hotel systems.
  • Compare options.
  • Ask for clarification.
  • Create an itinerary.
  • Book a reservation after receiving approval.

Components commonly associated with agentic AI

  • Foundation model or LLM
  • Planning and reasoning
  • Memory or state
  • Tool/API access
  • Workflow orchestration
  • Guardrails
  • Human approval
  • Feedback and monitoring

Agentic AI versus generative AI

Generative AI Agentic AI
Generates content or responses Pursues a goal and takes actions
Often responds to a single prompt May perform multiple steps
Usually produces an answer May use tools and interact with systems
Does not necessarily act independently Has some degree of autonomy
Example: write an email Example: send the email after checking the calendar

Exam trap

An LLM chatbot is not automatically an agent. It becomes more agentic when it can:

  • Plan multiple steps
  • Invoke tools
  • Access external systems
  • Take actions
  • Maintain state
  • Work toward a goal with limited human intervention

Agentic AI is still AI and may use ML, deep learning, LLMs, and GenAI. These terms describe different aspects of the system.


11. Relationships and Differences Between Key AI Terms

11.1 Hierarchy

A useful hierarchy is:

Artificial Intelligence
└── Machine Learning
    └── Deep Learning
        └── Some Generative AI models, including many LLMs

Agentic AI is better viewed as a system behavior or application architecture. It may use generative AI and LLMs, but it is not simply another layer in the same hierarchy.


11.2 Summary comparison

Term What it describes Typical capability
AI Broad field of intelligent computer systems Reasoning, perception, decision-making
ML AI that learns patterns from data Predictions and classifications
Deep learning ML using multilayer neural networks Complex image, speech, and text tasks
GenAI AI that creates new content Text, images, code, audio, video
LLM Large deep learning model trained primarily on text Language understanding and generation
Agentic AI Goal-oriented AI system that plans and acts Tool use, multi-step execution, autonomous actions

Critical exam points

  • AI is the broadest category.
  • ML is a subset of AI.
  • Deep learning is a subset of ML.
  • GenAI commonly uses deep learning but is defined by its ability to generate content.
  • LLMs are a type of model, generally based on deep learning and transformers.
  • Agentic AI is defined by goal-directed behavior and action, not merely by generating text.

12. Exam Tips and Common Traps

Tip 1: Look for the defining characteristic

Do not select an answer based only on a familiar keyword.

  • Labeled data → supervised learning
  • No labels and grouping → unsupervised learning
  • Agent, environment, reward → reinforcement learning
  • New content generation → generative AI
  • Goal, planning, tools, actions → agentic AI
  • Images/video → computer vision
  • Human language → NLP

Tip 2: Distinguish training from inference

  • Training changes or learns model parameters.
  • Inference uses the trained model to produce an output.

A model is not retrained every time it makes a prediction.


Tip 3: Distinguish batch, real-time, and asynchronous inference

  • Immediate response → real-time
  • Large scheduled dataset → batch
  • Response later for a long-running request → asynchronous
  • No infrastructure management → serverless

These categories may overlap. For example, an application may use a serverless architecture for asynchronous processing.


Tip 4: Remember that predictions are probabilistic

An inference is usually not a guaranteed fact. Classification models frequently return probabilities or confidence scores.

A model can be highly accurate and still produce incorrect predictions.


Tip 5: Identify overfitting from training and test behavior

  • Good training performance, poor new-data performance → overfitting
  • Poor training and poor new-data performance → underfitting
  • Good performance on both → better generalization

Tip 6: Do not confuse bias with variance or randomness

For this exam context, bias generally refers to systematic disparities or unfair outcomes across groups.

A model can be accurate overall but still unfair to a particular group.


Tip 7: Structured and labeled are different concepts

These terms describe different properties:

  • Structured/unstructured describes data format.
  • Labeled/unlabeled describes whether expected outputs are provided.

Examples:

  • A CSV file can be structured and labeled.
  • An image dataset can be unstructured and labeled.
  • Customer records can be structured and unlabeled.
  • Text documents can be unstructured and unlabeled.

Tip 8: Deep learning is not automatically better

Deep learning may provide better results for complex unstructured data, but it often requires:

  • More data
  • More compute
  • More training time
  • More operational complexity
  • More difficult interpretation

Traditional ML may be more efficient for structured tabular data.


Tip 9: Generative AI does not guarantee factual accuracy

Generative AI can produce fluent and convincing content that is incorrect. This is commonly associated with hallucination.

The model generates likely content; it does not inherently verify truth.


Tip 10: Agentic AI requires more than conversation

A system that only answers questions is generally generative AI.

An agentic system can typically:

  • Plan
  • Use tools
  • Make decisions
  • Take actions
  • Coordinate multiple steps
  • Operate toward a goal

13. Rapid Review Cheat Sheet

  • AI: Broad field of creating intelligent systems.
  • ML: AI that learns patterns from data.
  • Deep learning: ML based on multilayer neural networks.
  • Computer vision: AI for images and video.
  • NLP: AI for understanding and generating human language.
  • Algorithm: Method used to learn or solve a problem.
  • Model: Trained result of applying an algorithm to data.
  • Training: Learning parameters from data.
  • Inference: Using a trained model to make a prediction or generate output.
  • Feature: Model input.
  • Label: Known expected output.
  • Overfitting: Performs well on training data, poorly on new data.
  • Underfitting: Performs poorly on both training and new data.
  • Bias: Systematic unfair or skewed outcomes.
  • Fairness: Avoiding unjustified disparities across groups.
  • GenAI: Produces new content.
  • LLM: Large deep learning model for language.
  • Agentic AI: Goal-oriented AI that plans, uses tools, and takes actions.
  • Real-time inference: Immediate response.
  • Batch inference: Large offline workload.
  • Asynchronous inference: Result returned later.
  • Serverless inference: Managed infrastructure without server administration.
  • Supervised learning: Uses labeled data.
  • Unsupervised learning: Finds patterns in unlabeled data.
  • Reinforcement learning: Agent learns actions through rewards and penalties.