Understanding Design of Experiments
Understanding Design of Experiments
1
Design of Experiments
DoE
• It is important to obtain maximum realistic information
with the minimum number of well designed experiments.
• An experimental program recognizes the major “factors”
that affect the outcome of the experiment.
• The factors may be identified by looking at all the
quantities that may affect the outcome of the experiment.
• The most important among these may be identified using:
– a few exploratory experiments or
– From past experience or
– based on some underlying theory or hypothesis.
• Factorial Design
• Taguchi Method
• Response Surface Design
Factorial Design: Full factorial design
Trial A B C
1 Lo Lo Lo
2 Lo Lo Hi
3 Lo Hi Lo
4 Lo Hi Hi
5 Hi Lo Lo
6 Hi Lo Hi
7 Hi Hi Lo
8 Hi Hi Hi
DOE - Factorial Designs - 23
Trial A B C
1 -1 -1 -1
2 -1 -1 +1
3 -1 +1 -1
4 -1 +1 +1
5 +1 -1 -1
6 +1 -1 +1
7 +1 +1 -1
8 +1 +1 +1
Output Matrix
Trial xA xB xC
y1 -1 -1 -1
y2 -1 -1 +1
y3 -1 +1 -1
y4 -1 +1 +1
y5 +1 -1 -1
y6 +1 -1 +1
y7 +1 +1 -1
y8 +1 +1 +1
xmean
xA
-1,+1,-1
+1,+1,-1
-1,-1,-1 +1,-1,-1
Spread of A
• It is easily seen that the parameter p0 is simply the mean
value of y.
• This is obtained by putting xA= xA= xC=0 corresponding to
the mean values for the factors.
• It is thus seen that the values of y- p0 at the corners of
the square indicate the deviations from the mean value.
• The mean of the square of these deviations is the
variance of the sample data collected in the
experiment.
• The influence of the factors may then be gauged by the
contribution of each term to the variance.
The deviation with respect to the mean is obviously given by
SST = 8 p A + pB + pC + p AB + pBC + pCA + p ABC
2 2 2 2 2 2 2
The sample variance is thus given by
SST
S = 2
N −1
y
Contributions to the sample variance are given by 8 times the
square of the respective parameter (p) and hence we also have
SSA = 8 p A2 ;
SSB = 8 pB2 ;
............;
SSABC = 8 p ABC
2
y1 + - -
y2 - + -
y3 - - +
y4 + + +
y1 - + +
y2 + - +
y3 + + -
y4 - - -
27
Who is Dr. Genichi Taguchi?
• Born in 1924 in the town of
Tokamachi, Japan
• Widely acknowledged leader in
the U.S. industrial quality
movement.
• Credited for starting the “Robust
Design” movement in Japan in
1950’s.
• Helped correct postwar Japan's
telephone system.
• 1980 introduced Taguchi method
to AT&T.
28
Taguchi Method/Taguchi Designs
• Introduced by Dr. Genichi Taguchi (1980)
✓Comparable in importance to Statistical
Process Control (SPC), the Deming approach
and the Japanese concept of TQC
29
Taguchi Method/Taguchi Designs
• The concern is deviation of a characteristic
from its nominal value. Uncontrollable
factors (noise) are often responsible for
this deviation (loss of quality).
30
– The quality loss function as defined by Taguchi is
the loss imparted to the society by the product
from the time the product is designed to the time
it is shipped to the customer.
– In fact, he defined quality as the conformity
around a target value with a lower standard
deviation in the outputs.
– Taguchi doesn’t agree with traditional
quality thought as it relates to
specifications.
– Normally, when specifications are set, a
target is specified with some allowance for
variation. Taguchi states that any deviation
from target specs results in loss to society
produced.
31
The Taguchi Quality Loss Function
32
Example (heat treatment process
for steel)
• Heat treatment process used to harden steel
components
Parameter Parameters Level 1 Level 2 unit
number
1 Temperature 760 900 OC
Noise
Factors
Product/Process
inputs Response
Control Factors
35
Identify Control and Noise Factors
36
A design which leads to a product or process
which is capable of delivering close-to-target
performance even in the presence of noise
factors.
37
Robust Design
• The Taguchi concept of robust design states that products and
services should be designed so that they are inherently defect free
and of high quality.
• Taguchi devised a three-stage process that achieves robust design
through what he terms: concept design; parameter design and
tolerance design
• Applies engineering and scientific principles and
together with the necessary experience to
System/concept
generate product prototype that would meet or
design
exceed the functional necessities and also forms
the process that makes it
• Comprises the optimal settings of the process
Parameter
and product factors with the purpose of
design
minimising performance variability
• Comprises “tightening tolerances on those
product/process parameters whose fluctuations
Tolerance cause large variation of the quality characteristic.
design It should be stressed that this should only be
done if the results obtained during the parameter
design stage are not satisfactory variability”
38
Taguchi Method : When to Select a ‘larger’ OA
to perform “Factorial Experiments”
• We always ‘think’ about ‘reducing’ the number of
experiments (to minimize the ‘resources’ – equipment,
materials, manpower and time)
• However, doing ALL / Factorial experiments is a good
idea if
– Conducting experiments is ‘cheap/quick’ but
measurements are ‘expensive/take too long’
– The experimental facility will NOT be available later
to conduct the ‘verification’ experiment
– We do NOT wish to conduct separate experiments
for studying interactions between Factors
Taguchi Method/Taguchi Designs
• Taguchi designed a number of orthogonal arrays
to aid in the development of experiments
• These orthogonal arrays are balanced fractional
orthogonal designs and can be used to estimate
main effects using only a few experimental runs.
• Two of the Taguchi’s simpler Orthogonal arrays
are: L4(23) and the L8(27)
40
Taguchi Method Design of Experiments
The general steps involved in the Taguchi Method are as
follows:
[Link] the process objective, or more specifically, a target
value for a performance measure of the process.
– Determine the design parameters affecting the process.
[Link] number of levels that the parameters should be varied
at must be specified.
[Link] orthogonal arrays for the parameter design
indicating the number of and conditions for each experiment.
– The selection of orthogonal arrays is based on the number of
parameters and the levels of variation for each parameter, and will
be expounded below.
[Link] the experiments indicated in the completed array to
collect data on the effect on the performance measure.
[Link] data analysis to determine the effect of the
different parameters on the performance measure.
Taguchi’s Two Level Designs
43
Taguchi’s Two Level Designs
44
Taguchi’s Three Level Designs
45
Signal to Noise (SN) Ratios
• To determine the effect each variable has
on the output, the signal-to-noise ratio, or
the SN number, needs to be calculated for
each experiment conducted.
• The signal to noise ratios are derived from
the Taguchi loss function.
• The following three signal to noise ratios
are widely used:
46
Signal to Noise (SN) Ratios
Experimental goal
47
Determining Parameter Design Orthogonal
Array
• The effect of many different factors on the performance
characteristic in a condensed set of experiments can be
examined by using the orthogonal array experimental design
proposed by Taguchi.
• The main factors affecting a process that can be controlled
(control Factors) should be determined.
• The levels at which these parameters should be varied must be
determined.
• Determining what levels of a variable to test requires an in-depth
understanding of the process, including the minimum,
maximum, and current value of the parameter.
• If the difference between the minimum and maximum value of a
parameter is large, the values being tested can be further apart
or more values can be tested.
• If the range of a parameter is small, then less values can be
tested or the values tested can be closer together.
• Typically, the number of levels for all parameters in the
experimental design is chosen to be the same to aid in the
selection of the proper orthogonal array.
Number of Orthogonal Array Selector
Levels
Number of Factors
Taguchi Method :
How to Select a ‘larger’ OA
to perform “Factorial Experiments”
Control Factors Factorial Suitable
and Levels Combinations OA
2 CF / 2-levels 4 L4
3 CF / 2-levels 8 L8
4 CF / 2-levels 16 L16
5 CF / 2-levels 32 L32
L27 Array
L 50 Array
Just-in-Time and Lean
Operations
53
Developments of JIT and Lean Operations
• Evolved in Japan after World War II, as a result of
their diminishing market share in the auto industry
• 1960’s: Developed as Toyota Production System
by Taiichi Ohno and his colleagues
• Toyota Motor Company- first to implement fully
functioning and successful JIT system, in 1970’s.
• 1970’s: U.S. and European auto makers began to
apply JIT to improve quality and productivity
• 1990’s and beyond: Expanded the JIT concept to
streamline all types of operations 54
Developments of JIT and Lean Operations
• The philosophy of JIT can be traced back to Henry Ford,
but formalized JIT originated in Japan as the Toyota
Production System. W. Edwards Deming’s lesson of
variability reduction was a huge influence.
55
Just In Time
• Just in Time is an integrated set of activities
designed to achieve high volume production using
minimal inventories of raw materials, work in
process, and finished goods.
• Raw materials are arrived at Just in time, parts are
processed at just in time.
• JIT is based on the logic that nothing is produced
until it is needed.
• Need is created by actual demand of the product.
• When item is sold, the market pulls another unit
from last position of the system.
• JIT is called Pull system.
56
56
• Many people believes that / it is true that
– JIT is an inventory reduction technique
– JIT is a KANBAN system
– JIT is alternative to MRP
• But it is beyond everything mentioned
above.
• JIT is a production control technique by
elimination of waste.
57
Comparison – JIT - MRP
JIT MRP
It is a Pull system. It is a Push system.
Material / Parts ordered when they Material / Parts ordered when
are required. stock is less.
Material / Parts manufactured Material / Parts manufactured
when they are required. when stock is less.
59
59
Definition of JIT
60
What Could Be the Expected Benefits of
JIT?
61
Expected Benefits of JIT
1. Elimination of waste
2. Quality at the source
3. Balanced and flexible work flow
4. Respect for people
5. Continuous improvement (Kaizen)
6. Simplification and visual control
7. Focus on customer needs
8. Partnerships with key suppliers
63
What is A “Waste?”
64
Wastes
• Anything that exceeds the minimum resources
needed for the appropriate value
• Toyota’s seven deadly wastes (now they are
8):
• Overproduction (excessive production resources)
• Inventory
• Waiting
• Transportation
• Processing
• Motion
• Defective parts
• Skills/under utilization of talent
65
Waste Definition
Overproduction Manufacturing an item before it is needed.
Inappropriate Using expensive high precision equipment when simpler
Processing machines would suffice.
Waiting Wasteful time incurred when product is not being moved or
processed.
Transportation Excessive movement and material handling of
product between processes.
Motion Unnecessary effort related to the ergonomics of bending,
stretching, reaching, lifting, and walking.
Inventory Excess inventory hides problems on the shop floor, consumes
space, increases lead times, and
inhibits communication.
Defects Quality defects result in rework and scrap, and add
wasteful costs to the system in the form of lost
capacity, rescheduling effort, increased
inspection, and loss of customer good will.
Underutilization of Failure of the firm to learn from and capitalize on
Employees its employees’ knowledge and creativity impedes
long term efforts to eliminate waste. 66
67
8. Skills/under utilization of employee
Why is Inventory Reduction
Important?
68
Importance of Inventory Reduction
75
Sort – (Seiri)
• The first S focuses on eliminating unnecessary
items from the workplace.
76
Sort – (Seiri)…..
• An effective visual method to identify these unneeded
items is called red tagging. A red tag is placed on all
items not required to complete your job.
• These items are then moved to a central holding area.
This process is for evaluation of the red tag items.
Occasionally used items are moved to a more organized
storage location outside of the work area while
unneeded items are discarded.
77
Sort – (Seiri)…..
• Sorting frees up valuable floor space and eliminates
such things as broken tools, obsolete jigs and fixtures,
scrap and excess raw material.
• The Sort process also helps prevent the ‘hoarder’ job
mentality (“I might need it”).
78
Set in Order – (Seiton)
• The second S focuses on efficient and effective storage
methods.
• You must ask yourself these questions:
1. What do I need to do my job?
2. Where should I locate this item?
3. How many do I need?
80
Shine – (Seiso)
• Workers will also begin to notice changes in equipment
and facility location such as air, oil and coolant leaks,
repeat contamination and vibration, broken, fatigue,
breakage, and misalignment.
• These changes, if left unattended, could lead to
equipment failure and loss of production. Both add up to
impact your company’s bottom line.
81
Standardize – (Seiketsu)
• Once the first three of the 5S’s have been implemented, you should
concentrate on standardizing best practice in your work area.
• Allow your employees to participate in the development and
documentation of such standards.
• They are a valuable but often overlooked source of information
regarding their work.
• Standardize means establishing “Best Manufacturing
Practices”, including:
i. Workplace Layout and Design
ii. Materials Handling Analysis
iii. Clear and Concise Work Instructions
iv. Well Defined Work Methods
v. Safe (Ergonomic) Working Practices
vi. Cycle Time Reduction
vii. Training
[Link] 82
The “5S” Philosophy
• Once fully implemented, the 5S process can increase
moral, create positive impressions on customers, and
increase efficiency and organization.
83
Benefits of the “5S” Philosophy
Improvements in:‐
• Workforce morale
• Company image
• Health and Safety
• Machine maintenance
• Quality
• Productivity
… Leading to Increased Competitiveness
84
WHY DO IT? The “5S” Philosophy
QUALITY EFFICIENCY
ELIMINATING
BREAKDOW SAFETY
NS
85
86
Kaizen
• It is small improvements carried out by an
employee in the course of daily work.
90
JIT: Partnerships with Suppliers
94
JIT for Non-Manufacturing
Operations (Lean Operations)
97
Toyota’s Secrets of Success
(Steve Spear, HBR, May 2004)
98
Suggested Readings
100
• A ship in port is safe, but that’s not what ships
are built for. (Grace Hopper)
103
Value
1. Cost Value – Cost of Manufacturing a
product / component.
2. Use Value – Functional value / Service
rendered
3. Esteem Value – Appearance value
4. Exchange Value – It is exchanged for
something else.
Why do Projects have “Unnecessary” Costs?
107
Value Engineering is:
• A structured and systematic problem
solving methodology
• Function oriented
• Focused on
110
Value Engineering is also known as:
• Value Analysis,
• Value Planning,
• Value Management
111
History of VE
• Larry Miles (1904 – 1985), a
purchasing engineer for
General Electric, developed
VE concepts during WW2.
• Pratt&Whitney Canada
still have a VE program for
development of engines. 113
Who Uses VE?
• Value Engineering is used anywhere
• Value for money is a concern:
• Purchasing
• Construction,
• Manufacturing
• Engineering
• Services Industry
• Health Care
• Government
114
Why Use VE?
• Knowledge of Value Engineering will improve
your ability to manage projects, solve problems,
innovate, and communicate.
• Function analysis
116
Why Does VE Work
• Function analysis ensures compatibility
between capital decisions and program
requirements
• Focus of a VE study is
• “How Can We Improve Value?”
117
• Function:
• is the fundamental concept underlying
Value Engineering.
Function analysis
• “Heart” of VE process
• A new way of thinking
• A catalyst to a paradigm shift
118
Pencil Example
• What is the function of a pencil?
119
Pencil Example
• What is the function of a pencil?
120
Pencil Example
• Pencil make marks
• Eraser S remove marks
• Band S hold eraser
• Barrel S hold graphite
• Paint S protect wood/add beauty
• Markings S identify product
• Graphite B make marks
• B – Basic Function
• S – Secondary/Supporting Function
121
VE Process Diagram
122
Information Phase
Key Questions “WHY”
• What is the problem?
• Why is it a problem?
• Why must it be solved?
• Why was it solved as proposed?
• What does it cost?
123
Pareto’s Law of Distribution
• “The 80 / 20
Rule”
• 20% of the items
in any complex
thing account for
80% of the cost.
124
Workshop - Function Phase
Techniques
• Creative thinking - brainstorming
• Set aside policies & rules
• Depart from the norm
• Good human relations 126
Evaluation (or Judgement) Phase
Techniques
• Explain & Validate Concepts
• Develop Scenarios to compare to base case
• Make Comparisons – measure performance &
cost of scenarios and base case
127
Presentation Phase
Techniques
• Oral Presentation
• Written Report
• Answer Questions
• Discover Oversights 128
Some value societies
• SAVE International [Link]
[Link]/
• Canadian Society of Value Analysis
(CSVA) [Link]
• Indian Value Engineering Society
(INVEST) [Link]
129
Where can VE help?
• VE can help where there is scope for change:
• Difficult or contentious projects – cost –
schedule – scope
• Projects and processes where communications
are difficult (silos) and horizontal integration is
desired.
• Projects or products where innovation is
required.
• High value projects – capital – labour – services
130
Benefits of a VE Program?
• Accomplish more projects for the same money
• Validate that capital expenditures are
appropriate for program needs
• Validate planning & design decisions
• Validate project costs
• Improve project designs, function, performance
& safety
131
What are the Benefits of a VE Program?
• Save money and time
132
The Concept of Zero
Defects in Quality
Management
133
Zero Defects
• Zero Defects, a term coined by Mr. Philip Crosby in his
book “Absolutes of Quality Management” has emerged
as a popular and highly-regarded concept in quality
management – so much so that Six Sigma is adopting
it as one of its major theories.
• Unfortunately, the concept has also faced a fair degree
of criticism, with some arguing that a state of zero
defects simply cannot exist.
• Others have worked hard to prove the naysayers wrong,
pointing out that “zero defects” in quality management
doesn’t literally mean perfection, but rather refers to a
state where waste is eliminated and defects are reduced.
• It means ensuring the highest quality standards in
projects.
134
What Do We Mean by Zero Defects?
• From a literal standpoint, it’s pretty obvious that attaining zero
defects is technically not possible in any sizable or complex
manufacturing project.
• True perfection might not be achievable but at least the quest will
push quality and improvements to a point that is acceptable under
even the most stringent metrics.
135
Zero Defects: The Theory and Implementation
• Zero defects theory ensures that there is no waste existing in
a project. Waste refers to all unproductive processes, tools,
employees and so on.
2. Right the first time. Quality should be integrated into the process
from the beginning, rather than solving problems at a later stage.
137
Zero Defects: Pros and Cons
• The clear advantage of achieving a zero-defect level is waste and
cost reduction when building products to customer specifications.
• There can also be negative implications when you consider the full
supply chain with other manufacturers that might have a different
definition of zero defects.
138
Reference
• [Link]
zero-defects-quality-management-article
139
Assignment 1
Discuss the organization for total quality management
by detailing on the departmental purpose analysis,
competitive bench marking, structuring the quality
function, quality information system, quality manual,
training for quality, TBS and ISO standards on quality.
Then, contrast between TBS and ISO standards on
quality by performing SWOT/SWOC analysis which
can be capitalized by imminent researchers.