AI Problems: Toy Problems
In Artificial Intelligence, a problem is a situation in which an intelligent system must determine a sequence of actions that transforms an initial state into a desired goal state.
Before solving complicated real-world problems, AI researchers use simplified problems called Toy Problems.
Toy problems are small, well-defined problems designed to test, demonstrate, and understand AI problem-solving and search techniques.
They are called “toy” not because they are unimportant, but because they provide a controlled environment where AI algorithms can be studied easily.
1. Why Do We Need Toy Problems?
Real-world problems are extremely complicated.
For example, consider:
“Find the best route for a delivery vehicle across an entire city.”
There may be:
- Thousands of roads
- Traffic conditions
- Road closures
- Weather
- Fuel constraints
- Delivery deadlines
- Multiple destinations
It would be difficult for students to understand an AI search algorithm directly using such a problem.
Instead, AI uses a small problem such as:
8-Puzzle
or:
Water Jug Problem
The algorithm can then be studied step by step.
Therefore:
Toy Problem → Understand Algorithm → Test Algorithm → Apply to Real-World Problem
2. Characteristics of Toy Problems
A good toy problem generally has the following characteristics:
1. Small
The number of possible states is relatively small.
2. Well-defined
The initial state, actions and goal are clearly specified.
3. Deterministic
In many classical toy problems, an action produces a predictable result.
4. Easy to represent
The problem can usually be represented using:
- States
- Operators/actions
- Goal conditions
5. Easy to evaluate
We can easily determine whether a solution is correct.
6. Suitable for algorithms
Toy problems are useful for testing:
- BFS
- DFS
- A*
- Heuristic Search
- Game-playing algorithms
- Knowledge representation
3. Formal Representation of an AI Problem
An AI problem can be represented using five major components:
Initial State + Actions + Transition Model + Goal Test + Path Cost
Let’s understand each.
3.1 Initial State
The situation from which the problem begins.
Example in 8-Puzzle:
1 2 3
4 _ 6
7 5 8
Here _ represents the empty space.
3.2 Actions / Operators
The possible actions available to the system.
For example, in the 8-Puzzle, the empty space can move:
- Up
- Down
- Left
- Right
provided the move is valid.
3.3 Transition Model
The transition model tells us:
What happens when an action is performed?
For example:
Move Blank Up
↓
New Puzzle State
3.4 Goal Test
The goal test checks whether the desired state has been reached.
For example:
1 2 3
4 5 6
7 8 _
If this is the required final arrangement, then:
Goal Test = TRUE
3.5 Path Cost
Path cost represents the cost of reaching the goal.
For a simple puzzle:
Cost of every move = 1
If the solution requires 10 moves:
Total Path Cost = 10
In real-world problems, cost might represent:
- Time
- Distance
- Money
- Energy
- Risk
4. Major Toy Problems in Your Syllabus
Your syllabus specifically mentions:
- Tic-Tac-Toe
- Water Jug Problem
- 8-Puzzle
- 8-Queens Problem
- Question Answering
Let’s discuss each.
5. Toy Problem 1 — Tic-Tac-Toe
Tic-Tac-Toe is a simple two-player game played on a 3×3 board.
One player uses:
X
and the other uses:
O
The objective is to get three identical symbols in a row:
- Horizontal
- Vertical
- Diagonal
Example:
X | X | X
---------
O | O | -
---------
- | - | -
X wins.
5.1 Why is Tic-Tac-Toe an AI Problem?
An AI player must decide:
Which move should I make?
At every turn, several possible moves exist.
The AI needs to:
- Examine the current board.
- Generate possible moves.
- Predict the consequences.
- Evaluate resulting positions.
- Select a good move.
This is a search problem.
5.2 Game Tree
Tic-Tac-Toe can be represented as a game tree.
Current Board
|
┌──────────────┼──────────────┐
↓ ↓ ↓
Move 1 Move 2 Move 3
| | |
States States States
| | |
... ... ...
The AI searches through possible future moves.
This introduces an important AI technique:
Minimax Algorithm
The AI tries to:
- maximize its own chance of winning
- minimize the opponent’s chance of winning
6. Toy Problem 2 — Water Jug Problem
This is one of the classic AI state-space problems.
Suppose we have:
- One 4-litre jug
- One 3-litre jug
Neither jug has measurement markings.
The objective is:
Measure exactly 2 litres of water.
6.1 Possible Actions
The AI can perform operations such as:
- Fill the 4-litre jug.
- Fill the 3-litre jug.
- Empty the 4-litre jug.
- Empty the 3-litre jug.
- Pour 4-litre jug into 3-litre jug.
- Pour 3-litre jug into 4-litre jug.
Each situation is a state.
We can represent a state as:\[ (x,y) \]
where:
- \(x\) = amount of water in 4-litre jug
- \(y\) = amount of water in 3-litre jug
Initial state:\[ (0,0) \]
A goal state might be:\[ (2,0) \]
or:\[ (0,2) \]
6.2 State-Space Representation
A simplified representation is:
(0,0)
/ \
/ \
Fill 4L Fill 3L
↓ ↓
(4,0) (0,3)
↓ ↓
Pour/Empty Pour/Empty
↓ ↓
Other states...
↓
Goal State
The AI searches through the possible states until it finds a goal.
7. Toy Problem 3 — 8-Puzzle
The 8-Puzzle is one of the most important AI search problems.
It contains:
- 8 numbered tiles
- 1 empty space
- 3×3 board
Example:
1 | 2 | 3
---------
4 | 5 | 6
---------
7 | _ | 8
Goal:
1 | 2 | 3
---------
4 | 5 | 6
---------
7 | 8 | _
The blank tile is moved to rearrange the numbered tiles.
8. 8-Puzzle as a State-Space Problem
Each board configuration represents a state.
For example:
State A
1 2 3
4 5 6
7 _ 8
Possible actions:
- Move blank left
- Move blank right
- Move blank up
- Move blank down
Not all actions are valid at every state.
The AI generates new states until the goal state is reached.
9. Heuristics in 8-Puzzle
The 8-Puzzle is particularly useful for teaching heuristic search.
Two common heuristics are:
1. Misplaced Tiles
Count the number of tiles that are not in their goal positions.
Example:
If 3 tiles are incorrectly positioned:\[ h(n)=3 \]
2. Manhattan Distance
Calculate how far each tile is from its correct position.
For each tile:\[ |x_1-x_2| + |y_1-y_2| \]
The total gives the heuristic value.
These heuristics can be used by:
A* Search
where:\[ f(n)=g(n)+h(n) \]
This makes the 8-Puzzle an excellent example for your Informed Search Strategies unit.
10. Toy Problem 4 — 8-Queens Problem
The 8-Queens problem is another classical AI problem.
The objective is:
Place 8 queens on an 8×8 chessboard so that no two queens attack each other.
A queen can attack another queen:
- Horizontally
- Vertically
- Diagonally
Therefore:
No two queens can be in the same row, column or diagonal.
10.1 Example
A solution can look like:
. Q . . . . . .
. . . . Q . . .
. . . . . . . Q
. . . . . Q . .
Q . . . . . . .
. . Q . . . . .
. . . Q . . . .
. . . . . . Q .
Each Q represents a queen.
11. Why is 8-Queens an AI Problem?
The system needs to search through possible arrangements.
There are many possible configurations.
A simple approach could be:
- Place a queen.
- Check whether the position is valid.
- Place the next queen.
- If a conflict occurs, backtrack.
- Try another position.
- Continue until all 8 queens are placed.
This demonstrates:
Backtracking Search
It can also be solved using:
- Hill Climbing
- Genetic Algorithms
- Constraint Satisfaction techniques
Therefore, 8-Queens connects several AI concepts.
12. Toy Problem 5 — Question Answering
Question answering is different from the puzzles above because it involves language and knowledge.
Suppose a knowledge base contains:
India is a country.
New Delhi is the capital of India.
Question:
What is the capital of India?
The AI needs to:
- Understand the question.
- Identify relevant information.
- Search its knowledge.
- Infer the answer.
- Return the answer.
Answer:
New Delhi.
This introduces concepts related to:
- Knowledge Representation
- Natural Language Processing
- Inference
- Semantic analysis
13. Toy Problems and State Space
One of the most important concepts in your syllabus is the state space.
A state space is:
The collection of all possible states that can be reached from the initial state by applying valid actions.
For example, in the Water Jug Problem:
Initial State
↓
Possible States
↓
More States
↓
Goal State
AI searches this space to find a solution.
14. General Structure of a Toy Problem
For MCA students, teach this general structure:
AI PROBLEM
|
┌────────────┼────────────┐
↓ ↓ ↓
Initial State Actions Goal State
| | |
└────────────┼────────────┘
↓
State Space
↓
SEARCH
↓
SOLUTION
15. Toy Problems vs Real-World Problems
This distinction is very important because your syllabus explicitly mentions:
Toy Problems, Real World Problems
| Toy Problem | Real-World Problem |
|---|---|
| Small | Usually large |
| Clearly defined | Often ambiguous |
| Limited states | Huge state space |
| Controlled environment | Dynamic environment |
| Usually deterministic | Often uncertain |
| Easy to test | Difficult to test |
| Simplified | Complex |
| Used for teaching/research | Used for practical applications |
Example
Toy Problem:
8-Puzzle
Real-world equivalent:
Autonomous robot navigation in a warehouse.
16. Why Toy Problems Are Important
Toy problems are valuable because they allow researchers and students to:
1. Test algorithms
For example:
Compare BFS and DFS on 8-Puzzle.
2. Study efficiency
Compare:
- Time complexity
- Space complexity
- Number of nodes explored
3. Study optimality
Does the algorithm find the best solution?
4. Understand heuristics
For example:
Compare A* using misplaced tiles versus Manhattan distance.
5. Demonstrate intelligent behaviour
Students can see how an AI system:
Perceives → Searches → Evaluates → Decides → Acts
17. Toy Problems and AI Algorithms
Different toy problems are useful for different AI algorithms.
| Toy Problem | AI Technique |
|---|---|
| Tic-Tac-Toe | Minimax, Game Search |
| Water Jug | State-Space Search |
| 8-Puzzle | BFS, DFS, A*, Heuristics |
| 8-Queens | Backtracking, Hill Climbing, Genetic Algorithm |
| Question Answering | Knowledge Representation, NLP, Inference |
This is an important table for students to remember.
18. Toy Problem → Real-World Application
The purpose of toy problems is not merely to solve puzzles. They provide simplified models of real problems.
| Toy Problem | Real-World Application |
|---|---|
| Water Jug | Resource allocation |
| 8-Puzzle | Route/state planning |
| 8-Queens | Scheduling and constraint satisfaction |
| Tic-Tac-Toe | Strategic decision making |
| Question Answering | Chatbots and virtual assistants |
| Maze | Robot navigation |
| Blocks World | Planning and robotics |
For example:
8-Queens
Toy problem:
Place queens without conflicts.
Real-world analogy:
Schedule employees, classes or machines without violating constraints.
The problem structure is similar:
Choose positions while satisfying constraints.
19. Important Concept: Problem Formulation
Before an AI system can solve a problem, the problem must be formulated properly.
A problem formulation normally specifies:
1. Initial State
Where do we start?
2. Actions
What can we do?
3. Transition Model
What happens after an action?
4. Goal Test
How do we know that we have succeeded?
5. Path Cost
What does a solution cost?
This is the bridge between:
Real-world situation → Computational AI problem
20. Example: 8-Puzzle Problem Formulation
| Component | 8-Puzzle |
|---|---|
| Initial State | Given starting arrangement |
| Actions | Move blank tile |
| Transition Model | New board after a valid move |
| Goal Test | Board matches target arrangement |
| Path Cost | Number of moves |
21. Key Examination Definition
Short answer
Toy problems in Artificial Intelligence are simplified, well-defined problems used to study and test AI problem-solving, search, reasoning and decision-making techniques. Examples include the Water Jug Problem, 8-Puzzle, 8-Queens and Tic-Tac-Toe.
Long answer
Toy problems are small and controlled problems used in Artificial Intelligence research and education to understand how intelligent systems formulate problems, represent states, search through possible solutions and reach goals. They have clearly defined initial states, actions, transition models, goal tests and often a path cost. Examples include the Water Jug Problem, 8-Puzzle, 8-Queens and Tic-Tac-Toe. Although these problems are simplified, they provide fundamental concepts that can later be applied to complex real-world problems such as robotics, route planning, scheduling and decision-making.
22. Most Important Points for MCA Students
Remember these five concepts:
1. State
A particular situation of the problem.
2. Initial State
Where the problem starts.
3. Operators/Actions
What the AI can do.
4. Goal State
The desired final situation.
5. Search
The process of exploring possible states to find a solution.
So:
Initial State + Actions + State Space + Goal Test + Search = AI Problem Solving
And the key examples from your syllabus are:
Tic-Tac-Toe → Game Playing
Water Jug → State-Space Search
8-Puzzle → Heuristic Search
8-Queens → Constraint/Backtracking Search
Question Answering → Knowledge + NLP + Inference
