Comparing design solutions

Learn it by playing

Answer these questions to earn energy, then fish and explore. No account needed.

For educators: ready-to-use lesson slides, revision notes for Comparing design solutions (NGSS Middle School Science, Engineering Design) — use them in your lesson, or run the topic as an interactive class activity your learners play as a live game.

Lesson notes

The Engineering Design Process

Engineers do not just pick a good idea. They first define the problem and research its criteria (the outcomes a successful solution must achieve) and constraints (the limits on cost, materials, time, or safety).
Next, the team brainstorms many possible solutions, then selects the one that best fits the criteria and constraints.
The chosen solution is designed, built, tested, and revised — called optimizing the solution. These steps can repeat and are not always carried out in the same order.

Defining the Problem: Criteria and Constraints

Real design problems often start with an everyday situation. Example: a student's feet feel cold on tile floors compared with carpet, so a team is asked to design slippers that reduce heat loss from the feet to the floor.
Possible criteria for the slippers: keep feet warm, be comfortable, be durable enough for everyday wear.
Possible constraints: a fixed set of materials to choose from, a cost per sheet of material, and the sole needing to hold up to normal walking.

Feet on a tile floor and on carpet

Comparing Material Options

Before choosing a material, engineers list its benefits and its considerations (drawbacks) side by side, using the same categories for every option, so the comparison is fair.
Felt and fleece are warm but not very durable; foam is lightweight and flexible but has limited insulation and can flatten over time; cardboard is easy to shape but not durable; cotton socks are breathable and comfortable but not sturdy enough for a sole.
No single material wins on every point — comparing them side by side against the same criteria is what makes the choice systematic instead of a guess.

Slipper material options: benefits and considerations

Choosing a Systematic Testing Method

A systematic comparison also needs a fair way to test each candidate design. Engineers choose a testing method before comparing results, so every design is measured the same way.
Three ways to test how well a slipper resists heat loss: place a thermometer under it on a cold surface and compare readings after a set time (Temperature Measurement Test); use a heating pad or warm water bottle inside it and time how long the temperature takes to drop (Heat Source Test); or use a heat-sensitive camera to track surface temperature and heat loss over time (Heat Transfer Rate Test).
The best method depends on what equipment is available and how precisely the team needs to measure heat loss.

Choosing a testing method for the slipper

Using a Decision Matrix to Rate Materials

A decision matrix turns the criteria into numbers: each material is rated on a scale (here, 1 = poor to 5 = excellent) for every criterion, plus its cost.
Ratings let materials be compared directly: foam rates highest for insulation (5) but lowest for comfort (2); fleece rates highest for comfort (5) but low for durability (2).
Because each column captures a different criterion, no material has to be "best overall" — the matrix shows exactly where each one is strong and where it is weak.

Decision matrix: rating each slipper material

Making Trade-offs

Because constraints limit resources, engineers almost never get a material that scores highest on every criterion — they must make trade-offs.
Combining materials is one way to balance trade-offs: pairing a comfortable material like fleece with a more insulating material like foam can meet more criteria together than either material meets alone.
Which trade-off is worth making depends on which criteria matter most for that particular design — durability might matter more for a sole, comfort more for the inner lining.

Optimizing: Testing and Revising the Design

Choosing a design from a decision matrix is not the end of the process — a prototype still has to be built and tested using the systematic method chosen earlier.
If test results show the design does not meet a criterion well enough, engineers analyze the data and revise the design, then test it again.
This cycle of designing, testing, and revising is called optimizing: no solution is perfect, but repeated testing and refinement produce a workable one.

Slides

Step through every slide for this topic — plus flashcards and revision notes — with a free account.

Practice questions

Free preview — 8 of 39 questions. Sign up to see them all.

1.What is the main purpose of a decision matrix in engineering design?
Easy
- ATo randomly select a design solution
- BTo systematically compare design solutions against criteria and constraints
- CTo list all possible design ideas without evaluation
- DTo calculate the cost of each design solution
2.In a decision matrix, what do the rows and columns typically represent?
Easy
- ARows represent criteria and columns represent alternatives
- BRows represent alternatives and columns represent criteria
- CRows represent weights and columns represent scores
- DRows represent constraints and columns represent criteria
3.A team is comparing two bridge designs: Design A and Design B. They use a decision matrix with criteria: Cost (weight 3), Safety (weight 5), and Aesthetics (weight 2). Design A scores: Cost 4, Safety 3, Aesthetics 5. Design B scores: Cost 5, Safety 4, Aesthetics 3. What is the total weighted score for Design A?
Medium
- A12
- B37
- C47
- D41
4.In a decision matrix, what does a high weight for a criterion indicate?
Medium
- AThe criterion is less important
- BThe criterion is more important
- CThe criterion is difficult to measure
- DThe criterion is a constraint
5.Which of the following best describes a belief decision matrix?
Hard
- AEach element is a single numerical score
- BEach element is a belief distribution representing uncertainty in the assessment
- CEach element is a grade from a set of predefined grades
- DEach element is a binary value (0 or 1)
6.When using a decision matrix, what does a higher total weighted score indicate?
Medium
- AThe design is more expensive
- BThe design better meets the criteria
- CThe design has more constraints
- DThe design is less safe
7.What is a constraint in engineering design?
Easy
- AA desired feature of the design
- BA limitation or restriction that the design must satisfy
- CA method to test the design
- DA score in a decision matrix
8.A decision matrix has criteria: Durability, Cost, and Environmental Impact. Each is scored on a scale of 1 to 5. If a design scores 4, 3, and 2 respectively, and all criteria have equal weight, what is the total score?
Medium
- A9
- B24
- C12
- D27

Revision notes

## Comparing Design Solutions ### Key Idea Engineers compare competing designs using a **systematic process** (like a **trade-off matrix** or **decision matrix**) to evaluate how well each solution meets the **criteria** and **constraints**. ### Decision Matrix A decision matrix is a table with **rows for alternatives** and **columns for criteria**. Each cell (Xij) shows the performance of alternative *i* on criterion *j*. Scores (e.g., 1–5) are assigned, then summed to rank solutions. **Example:** | Alternative | Cost (1-5) | Durability (1-5) | Safety (1-5) | Total | |-------------|------------|------------------|--------------|-------| | Design A | 4 | 3 | 5 | 12 | | Design B | 5 | 4 | 2 | 11 | ### Weighted Criteria Not all criteria are equally important. **Weighting** adjusts scores by importance. Multiply each score by its weight, then sum. **Formula:** Weighted Score = Σ (Weight_j × Score_ij) ### Steps to Compare Solutions 1. List **criteria** (desired features) and **constraints** (limits like budget, materials). 2. Assign **weights** to criteria based on importance. 3. Rate each design on each criterion (e.g., 1–5). 4. Calculate **weighted scores** for each design. 5. Compare totals and select the best solution. ### Belief Decision Matrix A more advanced version where each cell is a **belief distribution** (e.g., 60% Excellent, 40% Good) instead of a single score. This handles uncertainty. ### Remember - Always base decisions on **evidence** and **trade-offs**. - The best solution balances all criteria, not just one. - A decision matrix makes comparisons **objective** and **transparent**.

Decision matrix: A table that lists alternatives in rows and criteria in columns, with each cell showing the performance of an alternative on a criterion. Used to systematically compare design solutions.
Criteria: Desired features or requirements that a design solution should meet (e.g., low cost, high durability).
Constraints: Limitations or restrictions on the design (e.g., budget, available materials, time).
Trade-off: A situation where improving one criterion may worsen another; decisions involve balancing these trade-offs.
Weighting: Assigning relative importance to criteria, often as a numerical weight, to reflect their priority in the decision.
Belief decision matrix: A decision matrix where each cell contains a belief distribution (e.g., 60% Excellent, 40% Good) instead of a single score, used to handle uncertainty.

Flashcards

What is a decision matrix?

A decision matrix is a table that lists alternatives in rows and criteria in columns, with each cell showing how well an alternative meets a criterion. It helps systematically compare design solutions.

What are criteria and constraints in engineering design?

Criteria are the desired features or requirements a solution must meet (e.g., low cost, high durability). Constraints are limitations or restrictions (e.g., budget, time, materials).

How does a trade-off matrix help compare design solutions?

A trade-off matrix lists each solution against criteria and constraints, often using scores or ratings. It makes trade-offs visible, helping to identify which solution best balances competing factors.

What is the purpose of weighting criteria in a decision matrix?

Weighting criteria assigns importance values to each criterion. This allows the matrix to reflect that some criteria matter more than others when comparing solutions.

Define multiple-criteria decision analysis (MCDA).

MCDA is a systematic process for evaluating alternatives based on multiple criteria. A decision matrix is a common tool used in MCDA.

In a decision matrix, what do rows and columns represent?

Rows typically represent the alternative design solutions. Columns represent the criteria used to evaluate them.

How are scores assigned in a decision matrix?

Each alternative is rated on each criterion using a numerical scale (e.g., 1–5) or qualitative grades (e.g., Poor, Good, Excellent). These scores are then summed or weighted to compare overall performance.

What is a belief decision matrix?

A belief decision matrix uses belief distributions instead of single scores. Each cell contains a set of grades with associated belief degrees (e.g., 60% Excellent, 40% Good) to capture uncertainty.

How does a conventional decision matrix differ from a belief decision matrix?

In a conventional matrix, each cell has one score or grade. In a belief matrix, each cell has multiple grades with probabilities, allowing for uncertainty in assessments.

Give an example of a criterion for comparing car designs.

Engine quality could be a criterion, assessed on a scale like {Exceptional, Good, Average, Below Average, Poor}.

What does Xij represent in a decision matrix?

Xij is the element in row i and column j, representing the performance of alternative i on criterion j.

How can you rank design solutions using a decision matrix?

After scoring each alternative on all criteria, sum the weighted scores for each alternative. The alternative with the highest total score is ranked best.

What is a trade-off in engineering design?

A trade-off occurs when improving one criterion (e.g., durability) worsens another (e.g., cost). Comparing design solutions involves analyzing these trade-offs.

Why is it important to use a systematic process when comparing design solutions?

A systematic process, like using a decision matrix, ensures all criteria and constraints are considered objectively, reducing bias and leading to a more informed decision.

What is the first step in creating a decision matrix?

Identify the design alternatives (solutions) and the criteria and constraints that will be used to evaluate them.

How do you handle criteria that are not equally important?

Assign weights to each criterion based on its importance. Multiply each score by its weight before summing to get a weighted total.

Can a decision matrix include qualitative criteria?

Yes. Qualitative criteria (e.g., aesthetics) can be rated using a numerical scale or grades, then converted to scores for comparison.

What does a high score in a decision matrix indicate?

A high score indicates that a design solution performs well on that particular criterion. A high total score indicates the solution best meets the overall criteria.

What is a constraint in the context of comparing design solutions?

A constraint is a limit or restriction that must be satisfied, such as a maximum budget, minimum strength, or available materials. Solutions that violate constraints are eliminated.

How do you compare solutions when one excels in some criteria but fails in others?

Use the decision matrix to weight criteria and compute totals. The solution with the best overall weighted score is chosen, even if it doesn't excel in every criterion.

What is the role of a trade-off matrix in engineering design?

A trade-off matrix helps visualize the pros and cons of each design solution, making it easier to see which solution offers the best balance among competing criteria.

Give an example of a constraint for a bridge design project.

A constraint could be a maximum budget of $10,000 or a requirement to use only recycled materials.

How can you reduce subjectivity in scoring a decision matrix?

Use clear, measurable criteria (e.g., cost in dollars, strength in Newtons) and involve multiple evaluators to average scores.

What is the difference between a criterion and a constraint?

A criterion is a desired feature or goal (e.g., high durability). A constraint is a fixed limit or requirement (e.g., must cost less than $50).

Unlock all 39 questions, flashcards & more

Create a free account to see every question, the slides, flashcards and revision notes for this topic.

Past papers

Past-paper practice for this topic is coming soon.

Coming soon