Dmaic Six Sigma 1699396223
Dmaic Six Sigma 1699396223
Dmaic Six Sigma 1699396223
Suppl
iers st o ut SIPO C
O
me I np
ut
VO C
Con rs
pu
Project Scope
trac Emplo
tors yees
st
P-M a p, X Y, FM EA
(X1) (X2) (X3) (X4) (X8) (X11) (X9) Ca pa bility
(X6) (X7) (X5) (X10)
Box Plot, Sca tter
(X3) (X4) (X1) (X11) Plots, Regression
(X5) (X8)
(X8)
(X2)
(X11)
(X4)
Improve Phase
Welcome to Improve
Now that we have completed the Analyze Phase we are going to jump into the Improve Phase. In
Welcome to Improve we will give you a brief look at the topics we are going to cover.
Welcome to Improve
Overview
Well,, now that the
Analyze Phase is over,
W elcom e to Im prove
on to a more difficult
phase. The good news
is….you’ll hardly ever Process M odeling: Regression
use this stuff, so pay
close attention! Adva nced Process M odeling:
We will examine the M LR
meaning of each of
these and show you Designing Ex perim ents
how to apply them.
Ex perim enta l M ethods
DMAIC Roadmap
Process Owner
Champion/
Estimate COPQ
Establish Team
Measure
We are currently in the Improve Phase and by now you may be quite sick of Six Sigma, really! In this
module we are going to look at additional approaches to process modeling, its actually quite fun in a
weird sort of way!
Welcome to Improve
Improve Phase
Analysis Complete
Validate N ew Process
Implement N ew Process
After completing the Improve Phase you will be able to put to use the steps as depicted here.
Improve Phase
Process Modeling Regression
Now we will continue in the Improve Phase with “Process Modeling: Regression”.
Overview
W
W elcom
elcomee to
to Im
Improve
prove Correlation
Correlation
Process
Process M
Modeling:
odeling: Regression
Regression Introduction
Introduction to
to Regression
Regression
Adva
Advanced
nced Process
Process M
M odeling:
odeling: Simple
Simple Linear
Linear Regression
Regression
M
MLR
LR
Designing
Designing Ex
Experim
periments
ents
Ex
Experim
perimenta
entall M
Methods
ethods
Full
Full Fa
Factoria
ctoriall Ex
Experim
periments
ents
FFractiona
Fra ti
ctiona ll Fa
FFactoria
t i ll
ctoria
Ex
Experim
periments
ents
W
W ra
rapp Up
Up &
& Action
Action Item
Itemss
In this module of Process Modeling we will study Correlation, Introduction to Regression and
Simple Linear Regression. These are some powerful tools in our data analysis tool box.
We will examine the meaning of each of these and show you how to apply them.
Correlation
The primary purpose of linear correlation analysis is to measure the strength of linear
association between two variables (X and Y). You have already seen correlation graphically when
you created a Scatter Plot
Plot.
The correlation is positive when Y tends to increase and negative when Y tends to decrease.
If the ordered pairs (X, Y) tend to follow a straight line path, there is a linear correlation.
The preciseness of the shift in y as x increases determines the strength of the linear correlation.
To conduct the study you need:
- Bivariate Data – Two pieces of data that are variable
- Bivariate data is comprised of ordered pairs (X/Y)
- X is the independent variable
- Y is the dependent variable
Correlation Coefficient
The correlation
Th l ti coefficient
ffi i t off th
the population,
l ti R
R, iis estimated
ti t d bby the
th sample
l
correlation coefficient, r:
The null hypothesis for correlation is: there is no correlation, the alternative is there is correlation.
The correlation coefficient (always) assumes a value between –1 and +1.
The graphics shown here are labeled as the type and magnitude of their correlation: Strong,
Moderate or Weak correlation.
Limitations of Correlation
To properly
understand • A strong positive or negative correlation between X and Y does not indicate
regression you causality.
must first • Correlation provides an indication of the strength but does not provide us
understand with an exact numerical relationship (i.e. Y=f(x)).
correlation. Once • The magnitude of the correlation coefficient is somewhat relative and should
be used with caution.
a relationship is
• Just like any other statistic, you need to assess whether the correlation
described, then a
coefficient is statistically significant
significant, as well as practically significant.
significant
regression can be
performed. • As usual, statistical significance is judged by comparing a p-value with the
chosen degree of alpha risk.
A strong positive • Guidelines for practical significance are as follows:
or negative – If | r | > 0.80, relationship is practically significant
correlation
between X and Y – If | r | < 0.20, relationship is not practically significant
does not
ot indicate
d cate
Area of
Area ofnega
negative
tive Area of positive
causality. linear rcorrela
correlation
tion N o linea r correla tion linea r correla tion
linea
Correlation
provides an
indication of the -1 .0 -0 .8 -0 .2 0 0 .2 0 .8 + 1 .0
strength but does
not provide us with an exact numerical relationship. Regression however provides us with that data
more specifically a y equals f of x equation. Just like any other statistic, be sure to assess the
correlation coefficient is both statistically significant and practically significant
significant.
Correlation Example
X va lues Y va lues
The correla tion coefficient [r]:
Pa y
yton ca rries Pa y ton y
ya rds
• Is a positive value if one variable 196 679
increases as the other variable 311 1390
increases. 339 1852
• Is a negative value if one variable 333 1359
decreases as the other increases. 369 1610
317 1460
339 1222
148 596
Correla tion Form ula
314 1421
381 1684
Σ ( X i − X )(Yi − Y )
r= 324 1551
∑ ( X i − X ) ∑ (Yi − Y )
2 2 321 1333
146 586
We will use some data from a National Football League player, Walter Payton of the Chicago
Bears. Open MINITABTM worksheet “RB Stats Correlation.mtw” as shown here.
Correlation Analysis
Correlation Example
theoretical distribution.
Lowess smoothers are 1000
1000
most useful when the
curvature of the relationship 750
750
positive correlation.
p Correla tions: Pa y ton ca rries, Pa yton y a rds
Pea rson correla tion of Pa yton ca rries a nd Pa y ton ya rds = 0 .9 3 5
The P-value is low at P-Va lue = 0 .0 0 0
.935 so we reject the
null hypothesis by
saying that there is significant correlation between Payton’s carries and the number of yards.
Regression Analysis
The regression equation from MIN ITABTM is the BEST FIT for the plotted
data.
Prediction Equations:
Y= a + bx (Linear or 1 st order model)
Y= a + bx + cx2 (Quadratic or 2 nd order model)
Y= a + bx + cx2 + dx3 (Cubic or 3 rd order model)
Y= a (bx) (Exponential)
Correlation ONLY tells us the strength of a relationship while Regression gives the mathematical
relationship or the prediction model.
Fitted
FittedLine
LinePlot
Plot
payton
paytonyards
yards== --163.5
163.5++4.916
4.916payton
paytoncarries
carries
2000
2000 SS 153.985
153.985
R-Sq
R-Sq 87.3%
87.3%
R-Sq(adj)
R-Sq(adj) 86.2%
86.2%
1750
1750
1500
1500
yards
paytonyards
1250
1250
payton
1000
1000
750
750
500
500
150
150 200
200 250
250 300
300 350
350 400
400
payton
paytoncarries
carries
There are two ways to perform a Simple Regression. One is the Fitted Line Plot which will give a
Scatter Plot with a Fitted Line and will generate a limited regression equation in the Session Window
of MINITABTM as shown above.
Follow the MINITABTM command prompt shown here, double-click “payton yards” for Response (Y)
and double-click “payton carries” for the Predictor (X) and click “OK” which will produce this output.
Let’s look at the Regression Analysis Statistical Output. The difference between R squared and
adjusted R squared is not terribly important in Simple Regression.
In Multiple Regression where there are many X’s it becomes more important which you will see
in the next module.
The Regression
Analysis generates a Regression Ana lysis: Pa yton ya rds versus Pa yton ca rries
prediction model The regression equation is
based on the best fit
line through the data Payton yards = -163.497 + 4.91622 Payton carries
represented by the
equation shown here.
To p
predict the Consta nt Level of X
number of yards that
Coefficient
Payton would run if
he had 250 carries
To predict how many yards Payton would run if he had 250 carries use the
you simply fill in that
prediction equation above.
value in the equation
and solve.
Payton
y yyards = - 163.497 + 4.91622(250 ) = 1,065.6
You could
Y ld
make an fairly Compa re to the Fitted Line.
accurate
estimate by Fitted
FittedLine
LinePlot
Plot
payton
paytonyards
yards== --163.5
163.5++4.916
4.916payton
paytoncarries
using the Line carries
2000
2000
Plot also. SS
R-Sq
153.985
153.985
87.3%
R-Sq 87.3%
R-Sq(adj)
R-Sq(adj) 86.2%
86.2%
1750
1750
1500
1500
yards
paytonyards
payton 1250
1250
~1067 yds
1000
1000
750
750
500
500
150
150 200
200 250
250 300
300 350
350 400
400
payton
paytoncarries
carries
Q ua dra tic a nd Cubic – Check the r 2 va lue a ga inst the linea r m odel to
determ ine if the difference betw een the va ria nce ex pla ined by our
equa tion is significa nt.
MINITABTM will also generate both quadratic and cubic fits. Select the appropriate variables for (Y) and
(X) and for the type of Regression Model choose “Quadratic” or “Cubic” for the regression model type.
Fitted
FittedLine
LinePlot
Plot
payton
paytonyards
yards== --199.7
199.7++5.239
5.239payton
paytoncarries
carries
--0.00064
0.00064payton
paytoncarries**2
carries**2
2000
If the R-Sq va lue im proves
2000 SS 161.474
R-Sq
R-Sq significa ntly, or if the
161.474
87.3%
87.3%
R-Sq(adj) 84.8%
1750
1750 Q ua dra tic R-Sq(adj)
a ssum ptions of the residua ls a re
84.8%
1500
1500
better m et a s a result of utilizing
yards
paytonyards
1000
1000 fitting
g equa
q tion.
750
750
Fitted
FittedLine
LinePlot
Plot
500
500 payton
paytonyards
yards== 2188
2188- -24.71
24.71payton
paytoncarries
carries
150
150 200
200 250
250 300
300 350
350 400
400 ++0.1147
0.1147payton
paytoncarries**2
carries**2--0.000141
0.000141payton
paytoncarries**3
carries**3
payton
paytoncarries
carries
2000
2000 SS 164.218
164.218
R-Sq
R-Sq 88.2%
88.2%
R-Sq(adj)
R-Sq(adj) 84.3%
84.3%
1750
1750
Cubic
1500
1500
yards
yton yards
1250
1250
ayton
pay
pa
1000
1000
750
750
500
500
150
150 200
200 250
250 300
300 350
350 400
400
payton
paytoncarries
carries
Use the best fitting equation by looking at the R-Sq value. If it improves significantly, or if the
assumptions of the residuals are better met as a result of utilizing the quadratic or cubic equation
you should use it.
Here there is no big difference so we will stick with the linear model.
Residuals
As in AN OVA
OVA, the residuals should:
– Be normally distributed (normal plot of residuals)
– Be independent of each other
• no patterns (random)
• data must be time ordered (residuals vs. order graph)
– Have a constant variance (visual
(visual, see residuals versus fits chart
chart,
should be (approximately) same number of residuals above and
below the line, equally spread.)
Residuals (cont.)
Residual Plots can be generated from both the fitted line plot and
regression selection in MIN ITABTM .
Residual Plots can be generated from both the Fitted Line Plot and regression selection when using
MINITABTM.
Here we produced the graph by selecting the “Four
Four in one”
one option.
option
2
Standardized Resid
90
1
Percent
50
0
10 -1
1 -2
-2 -1 0 1 2 600 900 1200 1500 1800
Standardized Residual Fitted Value
Independence a ssum ption
Histogram of the Residuals Residuals Versus the Order of the Data
8
esidual
2
6
Standardized Re
Frequency
y
1
4 0
2 -1
0 -2
-2 -1 0 1 2 1 2 3 4 5 6 7 8 9 10 11 12 13
Standardized Residual Observation Order
Residual Analysis
Standardized Stat>Regression>Regression
residuals greater
than 2 and less Regression Analysis: payton yards versus payton carries
The regression equation is
than -2 are
payton yards = - 163 + 4.92 payton carries
usually Predictor Coef SE Coef T P
considered large Constant -163.5 172.0 -0.95 0.362
and MINITABTM payton c 4.9162 0.5645 8.71 0.000
labels these
observations with S = 154.0 R-Sq = 87.3% R-Sq(adj) = 86.2%
To view a normal
probability plot in N orma lly distributed response a ssumption.
MINITABTM select
“Stat>Regression>Fit Normal
NormalProbability
ProbabilityPlot
Plotof
(response
ofthe
theResiduals
Residuals
(responseisispayton
paytonyards)
yards)
ted Line Plot” and 99
99
60
60
50
are four options to 50
40
40
pencil of ea ch
choose from. For
30
30
20
other).
20
to see a “funnel
00
effect” where the
residuals gets -1
-1
bigger and bigger
as the Fitted Value -2
-2
gets bigger or 500
500 750
750 1000
1000 1250
1250 1500
1500 1750
1750
Fitted
FittedValue
Value
smaller.
Independence Assumption
Residuals
ResidualsVersus
Versusthe
theOrder
Orderof
ofthe
theData
Data
((response
esponse isispayton
(response pa ton yards)
payton a ds)
yards)
33
Should show no trends
either up or dow n a nd
22
should ha ve
Residual
ndardizedResidual
points a bove a nd
00
below the line
( pprox im
(a i a tely
t l
Stan
-1
-1
consta nt va ria nce).
-2
-2
11 22 33 44 55 66 77 88 99 10
10 11
11 12
12 13
13
Observation
ObservationOrder
Order
Residuals
R id l versus th the order
d off d
data
t iis used
d tto evaluate
l t ththe IIndependence
d d A
Assumption.
ti It should
h ld nott
show trends either up or down and should have approximately the same number of points above
and below the line.
Scatterplot
Scatterplotof
of dorsett
dorsettyards
yards vs
vs dorsett
dorsett carries
carries
1750
1750
1500
1500
yards
1250
orsett yards
1250
dorsett
1000
1000
do
750
750
500
500
100
100 150
150 200
200 250
250 300
300 350
350
dorsett
dorsett carries
carries
Fitted
FittedLine
LinePlot
Plot
dorsett
dorsettyards
yards== --160.1
160.1++4.993
4.993dorsett
dorsettcarries
carries
1750
1750 SS 79.3033
79.3033
R-Sq
R-Sq 95.0%
95.0%
R-Sq(adj)
R-Sq(adj) 94.5%
94.5%
1500
1500
yards
1250
dorsett yards
1250
dorsett
1000
1000
750
750
500
500
100
100 150
150 200
200 250
250 300
300 350
350
dorsett
dorsettcarries
carries
If Dorsett carries the football 325 times the predicted value would be
determined as follows…
If Dorsett carries the football 325 times the predicted value would be determined that Dorsett
would carry the football for 1782.825 yards – approximately!
N 12
StandardizedResidual
N 12
AD 0.309
90 AD 0.309
90 P-Value 0.510 11
P-Value 0.510
Percent
Percent
00
Standardized
50
50
-1-1
10
10
-2-2
11
SS
-2
-2 -1
-1 00 11 22 500
500 750
750 1000
1000 1250
1250 1500
1500
Standardized
StandardizedResidual
Residual Fitted
FittedValue
Value
Histogram
Histogramof
ofthe
theResiduals
Residuals Residuals
ResidualsVersus
Versusthe
theOrder
Orderof
ofthe
theData
Data
22
33
Residual
StandardizedResidual
11
Frequency
Frequency
22
00
Standardized
11 -1-1
-2-2
00
-2.0
-2.0 -1.5
-1.5 -1.0
-1.0 -0.5
-0.5 0.0
0.0 0.5
0.5 1.0
1.0 1.5
1.5 11 22 33 44 55 66 77 88 99 1010 11
11 12
12
Standardized
StandardizedResidual
Residual Observation
ObservationOrder
Order
Notes
Improve Phase
Advanced Process Modeling
Now we will continue with the Improve Phase “Advanced Process Modeling MLR”.
Overview
W
W elcom
elcomee to
to Im
Improve
prove
Review
Review Corr./
Corr./ Regression
Regression
Process
Process M
Modeling:
odeling: Regression
Regression
N
Non-Linear
on-Linear Regression
Regression
Adva
Advanced
nced Process
Process M
Modeling:
odeling:
M
MLR
LR
Transforming
Transforming Process
Process Data
Data
Designing
Designing Ex
Experim
periments
ents
Multiple
Multiple Regression
Regression
Ex
Ex perim
perimenta
entall M
Methods
ethods
Full
Full Fa
Factoria
ctoriall Ex
Ex perim
periments
ents
Fra
Fractiona
ctionall Fa
Factoria
ctoriall
Ex
Ex perim
periments
ents
W
W ra
rapp Up
Up &
& Action
Action Item
Itemss
W will
We ill examine
i ththe meaning
i off each
h off th
these and
d show
h you h
how tto apply
l th
them.
Recall momentarily the Simple Linear Regression and Correlation proposed earlier in the Analyze
Phase. The essential tools presented here describe the relationship between two variables. A
independent or input factor and typically an output response. Causation is NOT always proved;
however, the tools do present a guaranteed relationship.
Correlation Review
The Pearson
coefficient, Correla tion is used to m ea sure the linea r rela tionship betw een tw o
represented here as continuous va ria bles (bi-va ria te da ta ).
“r”; shows the Pea rson correla tion coefficient “ r” w ill a lw a ys fa ll betw een –1
strength of a a nd + 1 .
relationship in A Correla tion of –1 indica tes a strong nega tive rela tionship, one
Correlation. fa ctor increa ses the other decrea ses.
Between -1 and +1 A Correla tion of + 1 indica tes a strong positive rela tionship, one
are the only values f ctor
fa t increa
i ses so does
d the
th other.
th
in which the value
of the coefficient P-Value ≤ 0.05, Ho: N o relationship
P-Value < 0.05, Ha: Is relationship
can be found and
zero has NO
“ r”
relationship.
Strong No Strong
Correla tion Correla tion Correla tion
The P-value proves
the statistical
th t ti ti l
confidences of our -1 .0 0 + 1 .0
representing
possibility that
relationship exists, simultaneously; the Pearson correlation coefficient shows the “strength” of the
relationship. For example, P-value standardized at .05, then 95% confidence in a relationship is
exceeded by the two factors tested.
tested
by 30 times .4566,
S 0.919316
R-S q 93.4%
R - S q ( ad j) 92.7%
moreover, 1 7 .5
subtracting .289 1 5 .0
Impurit y
Correlation Review
Numerical
relationship is left Correla tion only tells us the strength of a linea r rela tionship,
out when speaking not the numerica l rela tionship.
of Correlation. The la st step to proper a na lysis of continuous da ta is to
Correlation shows determine the regression equa tion.
potency of linear
relationship, The regression equa tion ca n ma thema tica lly predict Y for
mathematical a ny given X .
relationship is The regression equa tion from M IN ITABTM is the best fit for
shown by and the plotted da ta .
through the
prediction equation Prediction Equa tions:
of regression. As Y = a + bx (Linea r or 1 st order model)
shown, these Y = a + bx + cx 2 (Q ua dra tic or 2 nd order
correlations or model)
regressions are not Y = a + bx + cx 2 + dx 3 (Cubic or 3 rd order model)
proven casual Y = a (b )x (Ex ponentia l)
relationships, we
are in attempt for
PROVING statistical commonality. Exponential, quadratic, simple linear relationships, or even
predictable outputs (Y) concerns REGERRESION equations. More complex relationships are
approaching.
Simply Regressions
have one X and are Simple Regression
referenced as the – O ne X , O ne Y
regressors or
predictors;
di t multiple
lti l – Ana lyze in M IN ITABTM using
X’s give reason to • Sta t>Regression>Fitted Line Plot or
output or response • Sta t>Regression>Regression
variable, this is
Multiple Regression
accounts. M ultiple Regression
– Tw o or M ore X ’s, O ne Y
g of the
Strength
regression known – Ana
A llyze in
i M IN ITABTM Using
U i
quantity by R • Sta t>Regression>Best Subsets
squared and dictates • Sta t>Regression>Regression
overall variation in
output (Y),
In both ca ses the R-sq va lue estima tes the
independent variable
a mount of va ria tion ex pla ined by the model.
subjected to the
regression equation.
equation
g
How to run a Regression
Th ba
The b sici steps
t to
t follow
f ll in
i Regression
R i a re a s follow
f ll s:
is directed above. Using
a Scatter Plot, and 1 . Crea te Sca tter Plot (Gra ph>Sca tterplot)
understanding the 2 . Determine correla tion (Sta t> Ba sic Sta tistics> Correla tion – p-va lue less
tha n 0 .0 5 )
variation between the
3 . Run fitted line plot choosing linea r option (Sta t>Regression>Fitted
X’s and Y’s, then Line Plot)
activate a Correlation 4 . Run regression (Sta t> Regression> Regression) (Unusua l
Analysis allowing a O bserva tions?)
potential
t ti l lilinear 5 . Eva lua te R2 , a djusted R2 a nd p-va
p va lues
relationship indication. 6 . Run non-linea r regression if necessa ry (Sta t>Regression>Fitted Line
Plot)
Third step is to find 7 . Ana lyze residua ls to va lida te a ssumptions.
existing linear (Sta t>Regression>Fitted Line Plot> Gra phs)
mathematical 1 . N orm a lly distributed
relationships which calls 2 . Equa l va ria nce
for a prediction equation, 3 . Independence
4 . Confirm one or tw o points do not overly influence m odel.
and fourth to find the
potency or strength of One step at a time….
the linear relationship
that does exist. Linear
regression accompanied by the variation of the input gives a variety of output results and a
completion of the fifth step denoted, the amount percentage a given output has, including the
answer to strength of statistical confidence within our Linear Regression.
To conclude a Linear Regression exists; majority has that a 95% statistical confidence or above
has to be obtained. If unsatisfied conclusions are drawn, a point of contingency, step 6 is
essential. At present, in step 6, we contemplate the potential Non-linear Regression, however, this
is only vital if we can not find a regression equation (statistical and practical) variation of output by
way of scoping the input; analyzing the model error for correctness. Step 7, is depicted in
subsequent slides, validating residuals are a necessity for a valid model.
Recollection of learning This da ta set is from the mining industry . It is a n eva lua tion
tools in and throughout of ore concentra tors.
the Analyze Phase,
presented here is a Scatterplot
Scatterplotof
ofPGM
PGMconcentrate
concentrate(g/ton)
(g/ton)vs
vsAgitator
AgitatorRPM
RPM
simple Regression 70
70
example examining a 60
60
piece
i off equipment
i t
(g/ton))
concentrate(g/ton)
50
pertaining to a mining 50
PGMconcentrate
20
20
steps and noticing how
the equipment is agitated 10
10
10
10 15
15 20
20 25
25 30
30 35
35 40
40 45
45
by output of PGM Agitator
A gitatorRPM
RPM
concentrate.
Opening the MINITABTM named “Concentrator.MTW” will show how output is always applied to the
Y axis (dependent), as input is always applied to the X axis (independent).
Example Correlation
Pea rson correla tion of PGM concentra te (g/ ton) a nd Agita tor RPM = 0 .8 4 7
P Va lue = 0 .0
P-Va 001
Fitted
FittedLine
LinePlot
Plot
PGM
PGMconcentrate
concentrate(g/ton)
(g/ton)== 1.119
1.119++1.333
1.333Agitator
AgitatorRPM
RPM
70
70 SS 9.08220
9.08220
R-Sq
R-Sq 71.8%
71.8%
R-Sq(adj)
R-Sq(adj) 69.0%
69.0%
60
60
(g/ton)
centrate (g/ton)
50
50
ncentrate
40
40
PGMconc
con
30
30
PGM
20
20
10
10
10
10 15
15 20
20 25
25 30
30 35
35 40
40 45
45
Agitator
A gitatorRPM
RPM
Example
p Regression
g Line
Fitted
FittedLine
LinePlot
Plot
PGM
PGMconcentrate
concentrate(g/ton)
(g/ton)== 30.53
30.53--1.460
1.460Agitator
AgitatorRPM
RPM
++0.05586
0.05586Agitator
AgitatorRPM**2
RPM**2
70
70 SS 7.61499
7.61499
R-Sq
R-Sq 82.2%
82.2%
R-Sq(adj)
R-Sq(adj) 78.2%
78.2%
60
60
(g/ton)
ate(g/ton)
50
50
concentrate
PGMconcentra
40
40
30
30
PGM
20
20
10
10
10
10 15
15 20
20 25
25 30
30 35
35 40
40 45
45
Agitator
A gitatorRPM
RPM
Noticing how the new line is more appropriate for our diagram, this is in essence of choosing a
Non-linear Regression and choosing Quadratic Regression. The model option can be used, simply
by clicking the “Quadratic:”. The curvature better fits the plotted points by the distances. Can you
see the difference?
presents
Source DF SS MS F P
Regression 2 2404.04 1202.02 20.73 0.000
estimated Error 9 521.89 57.99
Total 11 2925.93
St d d
Standard
Deviation of Sequential Analysis of Variance
Source DF SS F P
errors, Non- Linear 1 2101.07 25.47 0.001
Quadratic 1 302.97 5.22 0.048
linear model has
a lower decimal.
Referenced earlier in Measure Phase is Standard Deviation. Take a look if necessary. Let us now
consider the model error, you need not be perplexed, model error has many variables in and of
itself. Output dependency on the impact of other input variables and measurement system errors of
output and inputs can be causes. MINITABTM Session Window displays these very Regression
Analyses feel free to use.
The recommendation here would be to use standardized residuals and “Four in one” option for
plotting. In the upper left window “Graph” NEEDS to be clicked, appropriate modeling and
analyzing the residuals will conclude the seventh step.
In identifying Non-linear Relationships, graphically looking at the variation of output to input on any
given Scatter Plot the Non-linear Relationship is self evident. Using step four of the Regression
Analysis methodology, unusual observation will ask us to focus deeper at Fitted Line Plots to see
what is the solution for the historical data. Detecting a Non-linearity carefully look at the Residuals
vs. Fitted Values graph of a Linear Regression. Finding clustering and/or trends of data could
conclude to a Non-linear Regression. Relying on a team or expert whom has prior knowledge can
avail much information, also.
This ex a mple
Thi l w ill demonstra
d t te
t how
h to
t use confidence
fid a nd
d
prediction interva ls.
W ha t percent discount should be offered to a chieve a
m inimum 1 0 % response from the m a iling?
The discount is in sa les coupons
being sent in the m a il.
Clip ’em!
Open the MINITABTM file called “Mailing Response vs. Discount.mtw”. This shows transactions by
a retail store chain, in essence, giving data relationship between discount amounts impact and
response of customers to the mailed coupons
coupons. With input variable being displayed in C1 and output
displayed in C2, Belts need to establish the discount rate that will yield 10% response of customers
mailed. The coupons used to buy merchandise by the % of customers whom received the mailings
is the measured % response.
curvature. 60
60
mailing
frommailing
50
50
40
responsefrom
40
%response
30
30
20
20
%
10
10
00
00 10
10 20
20 30
30 40
40
%
%discount
discount
Now we are testing for a Linear Relationship by running a Correlation, the results of the analysis a
strong confidence because the P-value strikes under .05.
Do you notice the Pearson Correlation Coefficient is almost 1.0 indicating a strong correlation?
R-squared. 70 S
R-Sq
5.60971
94.5%
step is to consider 20
10
a Non-linear 0 Regression Analysis: % response from mailing versus % discount
Regression -10
0 10 20 30 The40regression equation is
Analysis, % discount
% response from mailing = - 11.2 + 1.83 % discount
following right Predictor Coef SE Coef T P
along the N ote there a re no Constant
% discount
-11.215
1.8301
2.541 -4.41 0.001
0.1179 15.52 0.000
methodology. unusua l observa tions. S = 5.60971 R-Sq = 94.5% R-Sq(adj) = 94.1%
Analysis of Variance
Even though the R Source DF SS MS F P
squa red va lues a re Regression 1 7580.0 7580.0 240.87 0.000
Residual Error 14 440.6 31.5
g , a N on-linea r fit
high, Total 15 8020
8020.5
5
ma y be better ba sed
on the Fitted Line Plot.
Fitted
FittedLine
LinePlot
Plot
%
%response
responsefrom
frommailing
mailing== - -0.416
0.416++0.1526
0.1526%
%discount
discount
++0.04166
0.04166%%discount**2
discount**2
80
80 S 2.91382
S 2.91382
R-Sq 98.6%
R-Sq 98.6%
70
70 R-Sq(adj) 98.4%
R-Sq(adj) 98.4%
mailing
frommailing
60
60
50
50
eefrom
40
40
response
30
30
20
20 the N on-linea r fit
increa sed to 9 8 .6 % from
%
10
10
00 9 4 .5 % in the Linea r
00 10 20 30 40
10 20
% discount
% discount
30 40 Regression.
Polynomial Regression Analysis: % response from mailing versus % discount
The regression equation is
% response from mailing = - 0.416 + 0.1526 % discount + 0.04166 % discount**2
S = 2.91382 R-Sq = 98.6% R-Sq(adj) = 98.4%
Analysis of Variance
Source DF SS MS F P
Regression 2 7910.14 3955.07 465.83 0.000
Error 13 110.37 8.49
Total 15 8020.51
Sequential Analysis of Variance
Source DF SS F P
Linear 1 7579.95 240.87 0.000
Quadratic 1 330.19 38.89 0.000
W are satisfied!
We ti fi d! The
Th application
li ti off a N
Non-linear
li R
Regression
i M Model
d l shows
h an iincreased
dRR-
squared.
IIn order
d to t a nsw er the
th origina
i i l question
ti it is
i necessa ry to
t
eva lua te the confidence a nd prediction interva ls.
W ha t percent discount should be offered to a chieve a 1 0 %
response from the ma iling?
…..O ptions
A powerful option is the Fitted Line Plot analysis, so click “options” after running
“statregressionfittedlineplot” command. Now select “Display confidence interval” and “Display
prediction interval” and leave the Confidence Level at 95%.
Taking a look at
what has changed in
the MINITABTM Fitted
FittedLineLine Plot
Plot
%
%response
response from
from mailing
mailing == -- 0.416
0.416 ++0.1526
0.1526 %%discount
discount
window by selecting ++0.04166
0.04166 % %discount**2
discount**2
both interval options, Regression
80
80 Regression
Confidence and 95%
95%CI CI
70
70 95%
95%PI PI
Prediction; each
ailing
ailing
R-Sq(adj) 98.4%
50
50 intersects the low er R-Sq(adj) 98.4%
a color code, the red
response from
30
the green is 30
Prediction. In the 20
20
M a nua lly dra w a
previous “Option” 10
10 horizonta l line a t 1 0 %.
%
equation usually 80
80
Regression
Regression
95%
95%CICI
causes the 70
70 95%
95%PIPI
Confidence mailing
ailing
SS 2.91382
2.91382
60
60 R-Sq
R-Sq 98.6%
98.6%
Intervals to flare
mm
R-Sq(adj) 98.4%
50
50 R-Sq(adj) 98.4%
response from
from
out at the 40
40
extreme ends; if
%response
30
30
a prediction
20
20 The Prediction Interva l is the ra nge w here a new
equation exists, observa tion is ex pected to fa ll. In this ca se, w e a re
10
10
it would be
%
Considering the question of yielding 10% or more, finding the regression equation is of menial
importance than to estimate where the data ought to predicted within the relationship. The
prediction intervals will provide a degree of confidence in how the customers will respond, this
estimate is of great importance
importance.
Residual Analysis
Confirming the validity, taking into
To complete the ex a mple, the Residua l Ana lysis
consideration our residuals and va lida tes the a ssumptions for Regression Ana lysis.
completing step seven is next. Having a
variation of outputs is due to a high Residual
ResidualPlots
Plotsfor
for%
%response
responsefrom
frommailing
mailing
Normal
NormalProbability
ProbabilityPlot
Plotof
ofthe
theResiduals Residuals
ResidualsVersus
Versusthe
theFitted
FittedValues
level in R-squared, but from that 99
99
Residuals Values
Residual
StandardizedResidual
22
information we cannot draw the 90
90
11
Percent
Standardized
50
50 00
6.0
StandardizedResidual
22
Standardized
1.5 -1
store should give a discount of 18% and 1.5
0.0
-1
-2
0.0 -2
see if they redeem their 10% of -1
-1 00
Standardized
11
StandardizedResidual
Residual
22 11 22 33 44 55 66 77 88 99 10
Observation
1011
1112
ObservationOrder
Order
1213
1314
1415
1516
16
customers mailed.
Now does the present data for the response fit the equation as predicted?
Majority has it that Belts find data that is abnormally distributed. We have learned doing Non-linear
Regression, but another approach is to transform it into Linear Regression. Outputs or inputs can
be transformed and many people will wonder "what'swhat s the point?”
point? Simplicity is very valuable.
{ }
Square 2
xp
xtrans= N o Change 1
log(x) Square Root 0.5
Logarithm 0
Reciprocal Root -0.5
Reciprocal -1
Effect of Transformation
Using g a mathematical
Before Transform
function we have
transformed this data.
25
Frequency
15
distribution became 0
function. 15
Frequency
10
0
0 10 20 30 40 50 60 70 80 90 100
Sqrt
StDev
applied to the data. In 1.5
right plot obviously shows a Before Tra nsform After Tra nsform Lambda
showing abnormal
Percent
Percent
60 60
50 50
40 40
x 0.50 or x
30 30
0.1
1
0.1
-2 -1 0 1 2 3 4 5 6
symbolized by a P-value of
0.0 0.5 1.0 1.5 2.0 2.5
Pos skew BoxCox
Before executing the transformation, make sure the word “number” is highlighted, and now within the
f
function
ti the
th new column
l shall
h ll appear iin th
the “Expression:”
“E i ”b box. Th
The ttransformed
f dddata
t will
ill show
h alongside
l id
the unchanged data, providing you clicking the “OK” button.
When using MINITABTM The output should resem ble this view .
for the majority of Confirm if the new da ta set found in C3 is
commands, the order of norm a lly distributed.
columns is unimportant,
Probability
ProbabilityPlot
Plotof
ofSquare
SquareRoot
moreover; if the square Normal
Normal
Root
a different column it is
N 100
AD 0.265
95 AD 0.265
95 P-Value 0.687
P-Value 0.687
90
Percentt
70
Percent
60
Normally Distributed 20
20
10
10
5
M odel error (residua ls) is im pa cted by the a ddition of m ea surem ent error
for a ll the input va ria bles.
In review, we only do Regression on historical data and Regression is not applied to experimental
data, furthermore, we covered performing Regression involving one input and one output. Now
taking into account Multiple Linear Regressions and when they are applicable, these allow us to
identify Linear Regression including one output and more than one input at the same time. If you
haven’tt identified enough of the output variation,
haven variation recall briefly R-squared measures the amount of
variation for the output in correlation with the input you selected. In looking at the equations on this
page we can assume that in Multiple Linear Regressions each input are independent of one another,
no correlation exists. Having the inputs independent of one another gives each of them their own
slope and we also see the epsilon at the end of the equation, every Regression has model error.
With many different input variables on hand and only one output it can be so tedious to find if
variations come from one particular input, using a Matrix Plot can greatly speed up the process and
it will show which is impacting the output the most. After narrowing the field of variables use the best
given command to complete the Multiple Linear Regression,
Regression we identify the correct command by
examining R-squared, R-squared adjustable, #’s of predictors, S variable and Mallows Cp; following
this we must iteratively confirm inputs are statistically significantly. We have then only confirmation
of this valid model and we MUST especially in consideration for Multiple Linear Regressions
process and witness the presently performing Regression.
W hen compa ring a nd verify ing models consider the follow ing:
1 . Should be a rea sona bly sma ll difference betw een R2 a nd R2
- a djusted (much less tha n 1 0 % difference).
2 . W hen more terms a re included in the model, does the
a djusted R2 increa se?
3 . Use the sta tistic M a llow s’ Cp. It should be sma ll a nd less
tha n the number of terms in the model.
4 . M odels w ith sma ller S (sta nda rd devia tion of error for the
model) a re desired.
5 . Simpler models should be w eighed a ga inst models w ith
multiple predictors (independent va ria bles).
6 . The best technique is to use M IN ITABTM ’s Best Subsets
comma nd.
Using “Best Subsets Regression” we will be given multiple statistics, provided by MINITABTM, it
is in our best interest to use the least confusing Multiple Linear Regression model using these
particular guidelines.
600
Altitude
Altitude
600
flight speeds vs. 37.0
37.0
F
T u
u e
r l
b /
i A
A n i
l e r
t
i A r
t n a T
u g t I e
Mallows d l i C m
Vars R-Sq R-Sq(adj) C-p S e e o R p
1 72.1 71.1 38.4 28.054 X
1 39.4 37.2 112.8 41.358 X
2 85.9 84.8 9.0 20.316 X X
2 82
82.0
0 80
80.6
6 17
17.9
9 22
22.958
958 X X
3 87.5 85.9 7.5 19.561 X X X
3 86.5 84.9 9.6 20.267 X X X
4 89.1 87.3 5.7 18.589 X X X X
4 88.1 86.1 8.2 19.481 X X X X
5 89.9 87.7 6.0 18.309 X X X X X
In MINITABTM using “Best Subsets Regression” command is efficient and powerful by loading all inputs
to a single output; we use the “Free predictors:” box and place all inputs of interest inside it. This
particular command can be helpful in other circumstances,
circumstances however,
however now by placing the output column
of data in the “Response:” box it should be on the right of your screen. This is very simple, evaluation is
done and results are given to you in rows; 1st column - # of variables, 2nd column - R squared, 3rd
column - R squared adjusted, 4th column is mallows Cp, 5th column - Standard Deviation of the model
error and finally the 6th column - input variables.
T
F
u
List of a ll the
u e Predictors (X ’s)
r l
b /
i A
A n i
l e r
t
i A r
t n a T
u g t I e W ha t model w ould you select?
Mallows d l i C m
Vars R-Sq R-Sq(adj) C-p S e e o R p
1 72.1 71.1 38.4 28.054 X Let’s consider the 5 predictor m odel:
1
2
39.4
85.9
37.2
84.8
112.8
9.0
41.358
20.316
X
X X
• Highest R-Sq(a dj)
2 82.0 80.6 17.9 22.958 X X • Low est M a llow s Cp
3
3
87.5
86.5
85.9
84.9
7.5
9.6
19.561
20.267 X
X X
X
X
X
• Low est S
4 89.1 87.3 5.7 18.589 X X X X • How ever there a re m a ny term s.
4 88.1 86.1 8.2 19.481 X X X X
5 89.9 87.7 6.0 18.309 X X X X X
In choosing the correct model our attention goes to the bottom5 term Linear Regression. Are they
all statistically significant?
Stat>Regression>Regression>Options
Let’s go back to “Stat>Regression>Regression” again and click on the “Options” button. Place all
outputs in the “Response:” box and the inputs in the “Predictors:” box.
Predictor Coef SE Coef T P VIF The VIF for tem p indica tes it
Constant 770.4 229.7 3.35 0.003
should be rem oved from the
Altitude 0.15318 0.06605 2.32 0.030 2.3
Turbine Angle 5.806 2.843 2.04 0.053 1.4 m odel. Go ba ck to the Best
F l/Ai ratio
Fuel/Air ti 8
8.696
696 3
3.327
327 2
2.61
61 0
0.016
016 3
3.2
2 Subsets a na ly sis a nd select
ICR -52.269 6.157 -8.49 0.000 2.6
the best m odel tha t does not
Temp 4.107 3.114 1.32 0.200 5.4
include the predictor tem p.
S = 18.3088 R-Sq = 89.9% R-Sq(adj) = 87.7%
Va ria nce Infla tion Fa ctor (VIF) detects correla tion a m ong
predictors.
• VIF = 1 indica tes no rela tion a mong g predictors
p
• VIF > 1 indica tes predictors a re correla ted to som e degree
• VIF betw een 5 a nd 1 0 indica tes regression coefficients a re
poorly estim a ted a nd a re una ccepta ble.
Do you notice any similarities here? A foreign column has appeared, labeled VIF, this appears if a
high correlation among inputs exists. Temp has a high VIF, so we will remove it.
To start step four we want to take into account the Regression Model that does not include TEMP.
We have satisfied the Best Subsets model; we need not rerun this command.
Regression Analysis: Flight Speed versus Turbine Angl, Fuel/Air rat, ICR
Re-run the
The P-va lue for Turbine
Angle now indica tes it
Regression
should be rem oved a nd re-
run the Regression
beca use p > 0 .0 5
Here we have removed Altitude from the “Predictors:” box and the Regression
g output
p now
shows the Turbine Angle is not statistically significant.
Shown here is the entire Regression output for a complete discussion of the final Multiple Linear
Regression model. We have 2 predictor variables and all are statistically significant.
Now having a final model, it is VITAL to confirm the residuals are correct and the model is valid. How do
we do this? Graph and appropriate commands to analyze.
Residual
Residual Plots
Plots for
for Flight
FlightSpeed
Speed
Normal
NormalProbability
Probability Plot
Plot of
of the
the Residuals
Residuals Residuals
ResidualsVersus
Versusthe
theFitted
Fitted Values
Values
99
99
Residual
StandardizedResidual
90 22
90
Percent
Percent
50
Standardized
50
00
10
10
11 -2
-2
-3.0
-3.0 -1.5
-1.5 0.0
0.0 1.5
1.5 3.0
3.0 450
450 500
500 550
550 600
600 650
650
Standardized
StandardizedResidual
Residual Fitted
FittedValue
Value
Histogram
Histogramof
of the
the Residuals
Residuals Residuals
ResidualsVersus
Versusthe
theOrder
Orderof
of the
theData
Data
88
Residual
StandardizedResidual
22
66
Frequency
Frequency
Standardized
44
00
22
00 -2
-2
-2
-2 -1
-1 00 11 22 22 44 66 88 10
10 12
12 14
14 16
16 18
18 20
20 22
22 24
24 26
26 28
28
Standardized
StandardizedResidual
Residual Observation
ObservationOrder
Order
Notes
Notes
Improve Phase
Designing Experiments
Now we are going to continue with the Improve Phase “Designing Experiments”.
Designing Experiments
Overview
Within this
module we W
W elcom
elcomee to
to Im
Improve
prove
will provide an
introduction to
Process
Process M
Modeling:
odeling: Regression
Regression
Design of
Experiments, Adva
Advanced
nced Process
Process M
M odeling:
odeling:
explain what M LR Reasons
Reasons for
for Experiments
Experiments
M LR
they are, how
they work and Designing
D i i
Designing Ex
E
Experim
i ents
perim t
ents Graphical
G hi l Anal
Graphical Analysis
A l sis
Analysisi
when to use
them. DOE
DOEMethodology
Methodology
Ex
Ex perim
perimenta
entall M
Methods
ethods
Full
Full Fa
Factoria
ctoriall Ex
Experim ents
periments
Fra
Fractiona
ctionall Fa
Factoria
ctoriall
Ex
Ex perim
periments
ents
W
W ra
rapp Up
Up &
& Action
Action Item
Itemss
Designing Experiments
iers Cu ts
Suppl st o pu SIPO C
O
m n
ut
ersI
VO C
Con
pu
Project Scope
trac Emplo
tors yees
st
P-M a p, X Y, FM EA
(X1) (X2) (X3) (X4) (X8) (X11) (X9) Ca pa bility
(X6) (X7) (X5) (X10)
Box Plot, Sca tter
(X3) (X4) (X1) (X11) Plots, Regression
(X5) (X8)
(X2)
(X11)
(X4)
This is reoccurring awareness. By using tools we filter the variables of defects. When talking of the
Improve Phase in the Six Sigma methodology we are confronted by many designed experiments;
transactional, manufacturing, research.
Designs of Experiments help the Belt to understand the cause and effect between the process
output or outputs of interest and the vital few inputs. Some of these causes and effects may include
the impact of interactions often referred to synergistic or cancelling effects.
Designing Experiments
The objective is to
minimize the response.
The physica l m odel is
not important for our
business objective. The
DO E M odel will focus in
the region of interest.
Designing Experiments
Design
D i off E
Ex perim t (DO E) is
i ents i a scientific
i tifi method
th d off Design of Experiment
pla nning a nd conducting a n ex periment tha t w ill yield shows the cause and effect
the true ca use-a nd-effect rela tionship betw een the X relationship of variables of
va ria bles a nd the Y va ria bles of interest. interest X and Y. By way of
input variables, designed
DO E a llow s the ex perimenter to study the effect of ma ny
input va ria bles tha t m a y influence the product or process experiments have been
simulta neously, a s w ell a s possible intera ction effects (for noted within the Analyze
ex a mple synergistic effects). Phase then are executed in
the Improve Phase. DOE
The end result of ma ny ex periments is to describe the tightly controls the input
results a s a m a thema tica l function.
variables and carefully
y = f (x )
monitors the uncontrollable
The goa l of DO E is to find a design tha t w ill produce the variables.
inform a tion required a t a minimum cost.
P
Properly
l designed
d i d DOE’s
DOE’ are more efficient
ffi i experiments.
i
Let’s assume a Belt has O ne Fa ctor a t a Time (O FAT) is a n ex perimenta l style but not a
found in the Analyze Phase pla nned ex perim ent or DO E.
that p
pressure and The ggra phic
p show s yield
y contours for a process
p tha t a re
temperature impact his unk now n to the ex perim enter.
Trial Temp Press Yield
process and no one knows Yield Contours Are 1 125 30 74
what yield is achieved for the Unknown To Experimenter 75 2 125 31 80
3 125 32 85
possible temperature and 4 125 33 92
pressure combinations. 80 5 125 34 86
6 130 33 85
ure (psi)
7 120 33 90
If a Belt inefficiently did a One 135
6
85
90
125
1 2 3 4 5 Optimum identified
(referred to as OFAT), one 95 with OFAT
120
variable would be selected to 7
The curves shown on the graph above represent a constant process yield if the Belt knew the
theoretical relationships of all the variables and the process output of pressure. These contour lines
are familiar if you’ve ever done hiking in the mountains and looked at an elevation map which shows
contours of constant elevation. As a test we decided to increase temperature to achieve a higher
yield. After achieving a maximum yield with temperature, we then decided to change the other factor,
pressure. We then came to the conclusion the maximum yyield is near 92% because it was the highest
p g
yield noted in our 7 trials.
With the Six Sigma methodology, we use DOE which would have found a higher yield using
equations. Many sources state that OFAT experimentation is inefficient when compared with DOE
methods. Some people call it hit or miss. Luck has a lot to do with results using OFAT methods.
Certified Lean Six Sigma Black Belt Book Copyright OpenSourceSixSigma.com
472
Designing Experiments
Fractional Factorials or screening designs are used when the process or product knowledge is low.
We may have a long list of possible input variables (often referred to as factors) and need to screen
them down to a more reasonable or workable level.
Full Factorials are used when it is necessary to fully understand the effects of interactions and when
there are between 2 to 5 input variables.
Response surface methods (not typically applicable) are used to optimize a response typically when
the response surface has significant curvature.
Value Chain
Designing Experiments
Let’s
Let s consider a 2 squared
design which means we have 2 600 (-1,+1) (+1,+1)
300
levels for 2 factors. The factors Temp
of interest are temperature and 350
2
pressure. There are several 2 Press
500
ways to visualize this 2 level Press
Full Factorial design. In 600 500
experimenting we often use Uncoded levels for factors (-1,-1) (+1,-1)
Back when we had to calculate the effects of experiments by hand it was much simpler to use coded
variables. Also when you look at the prediction equation generated you could easily tell which
variable had the largest effect. Coding also helps us explain some of the math involved in DOE.
The representation
Consider a 2 3 design on a ca ta pult...
here has two cubed
designs and 2
8.2 4.55 A B C Response
levels of three
factors and shows Run Start
Number Angle
Stop
Angle Fulcrum
Meters
Traveled
a treatment 3.35 1.5 1 -1 -1 -1 2.10
combination table 2 1 -1 -1 0.90
using coded inputs
Stop Angle
3 -1 1 -1 3.35
level settings. The 5.15 2.4
4 1 1 -1 1.50
table has 8 5 -1 -1 1 5.15
6 1 -1 1 2.40
experimental runs. Fulcrum
7 -1 1 1 8.20
Run 5 shows start
8 1 1 1 4.55
angle, stop angle 2.1 Start Angle 0.9
Designing Experiments
MINITABTM generates
Stat>DOE>Factorial>Factorial Plots … Cube, select response and factors
various plots, the cube plot is
one. Open the MINITABTM This gra ph is used by the ex perimenter to visua lize how the
response da ta is distributed a cross the ex perimenta l spa ce.
worksheet “Catapult.mtw”.
Cube
CubePlot
Plot(fitted
(fittedmeans)
means)for
forDistance
Distance
This cube plot is a 2 cubed How do you rea d
design for a catapult using or interpret this 8.20
8.20 4.55
4.55
plot?
three variables:
Start Angle 3.35
3.35 1.50
1.50
11
Stop Angle
Fulcrum
W ha t a re
Stop
StopAngle 5.15 2.40
Here we used coded variable these? 11
Angle 5.15 2.40
Make sense?
Mean of Distance
The Main Effects Plots shown here display the effect that the input values have on the output
response.
The y axis is the same for each of the plots so they can be compared side by side.
Which has the steepest Slope? What has the largest impact on the output?
Answer: Fulcrum
Certified Lean Six Sigma Black Belt Book Copyright OpenSourceSixSigma.com
475
Designing Experiments
Avg Distance at Low Setting of Start Angle: 2.10 + 3.35 + 5.15 + 8.20 = 18.8/4 = 4.70
Main Effects Plot (data means) for Distance
-1 1 -1 1 -1 1
5.2
4.4
Dist
3.6
28
2.8
2.0
Start Angle Stop Angle Fulcrum
Avg. distance at High Setting of Start Angle: 0.90 + 1.50 + 2.40 + 4.55 = 9.40/4 = 2.34
Run # Start Angle Stop Angle Fulcrum Distance
1 -1 -1 -1 2.10
2 1 -1 -1 0.90
3 -1 1 -1 3.35
4 1 1 -1 1.50
5 -1
1 -1
1 1 5 15
5.15
6 1 -1 1 2.40
7 -1 1 1 8.20
8 1 1 1 4.55
In order to create the Main Effects Plot we must be able to calculate the average response at the low
and high levels for each Main Effect. The coded values are used to show which responses must be
used to calculate the average.
Let’s review what is happening here. How many experimental runs were operated with the start angle
at the high level or 1. The answer is 4 experimental runs shows the process to run with the start angle
at the high level. The 4 experimental runs running with the start angle at the high level are run number
2, 4, 6 and 8. If we take the 4 distances or process output and take the average, we see the average
distance when the process had the start angle running at the high level was 2.34 meters. The second
dot from the left in the Main Effects Plots shows the distance of 2.34 with the start angle at a high
level.
Interaction Definition
Intera ctions occur w hen va ria bles a ct together to impa ct the output of
the process. Intera ctions plots a re constructed by plotting both va ria bles
together on the sa m e gra ph. They ta k e the form of the gra ph below .
N ote tha t in this gra ph, the rela tionship betw een va ria ble “ A” a nd Y
cha nges a s the level of va ria ble “ B” cha nges. W hen “ B” is a t its high (+)
level, va ria ble “ A” ha s a lm ost no effect on Y. W hen “ B” is a t its low (-)
level, A ha s a strong effect on Y. The fea ture of intera ctions is non-
pa ra llelism betw een the tw o lines.
Higher
B-
Y
W hen B cha nges
from low to high,
utput
W hen
h B cha
h nges dra ma tica lly.
lly
from low to high,
B+
the output drops
Lower
very little.
- A +
Designing Experiments
interaction.
B+
Low Low Low
A common - A + - A + - A +
misunderstanding is that Strong Interaction Moderate Reversal
the lines must actually High
B- High
B-
cross each other for an
interaction to exist but Y Y
that’s NOT true. The lines
B+
may cross at some level B+ B+
Low Low
OUTSIDE of the - A + - A +
experimental region, but
we really don’t know that.
Parallel lines show absolutely no interaction and in all likelihood will never cross.
Let’s review what is happening here. The dot indicated by the green arrow is the mean distance when
the fulcrum is at the low level as indicated by a -1 and when the start angle is at the high level as
i di t d b
indicated by a 1
1. EEarlier
li we said
id th
the point
i t iindicated
di t d bby th
the green arrow h
had
d th
the ffulcrum
l att th
the llow
level and the start angle at the high level. Experimental runs 2 and 4 had the process running at those
conditions so the distance from those two experimental runs is averaged and plotted in reference to a
value of 1.2 on the vertical axis. You can note the red dotted line shown is for when the start angle is
at the high level as indicated by a 1.
Certified Lean Six Sigma Black Belt Book Copyright OpenSourceSixSigma.com
477
Designing Experiments
generates
t the
th 3 Fulcrum on Y -1-1
1
Start
11 -1-1
1 11
Start 66
Stop
bla ck line Stop
AAngle
ngle
66
-1-1
represents the Stop 11
StopAAngle
ngle
44
effects of 2
2
Fulcrum on Y
w hen Sta rt Fulcr um
Fulcrum
Angle is a t its
low level.
MINITABTM will also plot the mirror images, just in case it is easier to interpret with the variables
flipped. If you care to create the mirror image of the interaction plots, while creating interaction plots,
click on “Options”
p and choose “Draw full interaction pplot matrix” with a checkmark in the box. These
mirror images present the same data but visually may be easier to understand.
Interaction
InteractionPlot
Plot(data
(datameans)
means)for
forDistance
Distance
-1-1 11
Start
Start
66
AAngle
ngle
-1-1
44
Star t AAngle
ngle 11
Start
22
Stop
Stop
66
AAngle
ngle
-1-1
44
Stop
St 11
StopAAngle
ngle
l
-1 1 -1 1
-1 1 -1 1
Designing Experiments
DOE Methodology
It is easy to
generate full
factorial designs in
MINITABTM.
Follow the
command path
shown here.
These are the
designs that
MINITABTM will
create. They are
color coded using
th R
the Red,
d Y
Yellow
ll
and Green. Green
are the “go”
designs, yellow
are the “use
caution” designs
and red are the
stop, wait and
“stop,
think” designs. It
has a similar
meaning as do
street lights.
Designing Experiments
Let’s create a three factor full factorial design using the MINITABTM command shown at the top of the
graphic above. This design we selected will give us all possible experimental combinations of 3 factors
using 2 levels for each factor.
factor
Be sure to have changed the number of factors as seen in the upper left to “3”. Also be sure not to forget
to click on the “Full factorial” line within the Designs box shown in the lower right of the graphic.
Designing Experiments
One warning to you as a new Belt to using MINITABTM. Never copy, paste, delete or move columns
within the first 7 columns or MINITABTM may not recognize the design you are attempting to use.
Is our experiment done? Not at all. The process must now be run at the 8 experimental set of
conditions shown above and the output or outputs of interest must be recorded in columns to the
right of our first 7 columns shown. After we have collected the data we will then analyze the
experiment. Remember the 11 Step DOE methodology from earlier?
Designing Experiments
Notes
Improve Phase
Experimental Methods
Experimental Methods
Experimental Methods
Designing
Designing Experiments
Experiments Methodology
Methodology
Experimental
Experimental Methods
Methods Considerations
Considerations
Full
Full Factorial
Factorial Experiments
Experiments Steps
Steps
Fractional
Fractional Factorial
Factorial Experiments
pp
Experiments
Wrap
Wrap Up
Up &
& Action
Action Items
Items
DOE Methodology
In this module we will describe the 11 step DOE methodology some basic concepts and lots of
fun and exciting terminology. Once again great content for dinner conversation later tonight!
Experimental Methods
So you’ve decided to use Designed Experiments. Shown here are 10 basic project management
considerations before running any experiment. This is obviously not an exhaustive list, but certainly
some important questions to consider and answer.
What is behind some of these questions? Let’s briefly discuss a few aspects individually.
1.Access to a process is necessary for proper monitoring and execution of a project. If restricted
access for whatever reason exists, then work around must exist.
2.If the team members or subject matter experts aren’t fully involved, then potential conflicts or
unrealistic designs may be awaiting you for a poor experiment.
3.If the Process Owners and stakeholders are unknown to you before execution of an experiment rude
awakenings such as cancellations, scheduling conflicts and other nightmares can occur.
4 No one wants to be told what will happen to the process they are managing so if you don’t involve
4.No
them in the experimental design even if it involves reviewing the team’s designed experiment, how do
you expect cooperation?
5.If the Process Owners don’t understand what your DOE is, how can they assist you?
6.Does your DOE intend to make a wide range of quality product or potentially produce an
unacceptable product in the quest to improve the process? If the Process Owner has never known
what your DOE intentions were, how can they not be upset if they are surprised by the results of the
DOE?
7.Time and money impact scheduling, randomization, testing concerns. All of these must be
considered especially when using the actual process.
8.It is often desirable to run DOE’s in a pilot plant or facility but this is not often the case. If a pilot
facility is to be used, do the results match the process when translated outside of the laboratory?
9.Noise variables cannot be controlled, by definition, but if ambient weather is considered to have an
effect on your process, why would you execute an experiment when a cold or warm front is passing
through your area. This is one example of a known disturbance being designed around.
10 Manage your project to know if the DOE is intended to stretch the boundaries of conceived product
10.Manage
creation or work well within a small experimental area.
There are many considerations to consider. Often learning comes through experience so if you are
unsure about your future experiment in this project or another, consult with mentors or Six Sigma belts.
Experimental Methods
Technical Considerations
What are the objectives/goals for the experiment:
1. What factors are important? (narrowed from Analyze Phase)
USL
2. What is the operating range for each factor?
3. How can I minimize both the cost of DOE and the cost of
6 Sigma
running the process? 5 Sigma
4. How much change in the process do we require?
4 Sigma
5. How close to optimal does the process currently run?
6. Are we tackling a centering or variation problem? 3 Sigma
7. What impact to the process while running the DOE?
2 Sigma
8. What is the cost of competing DOE designs?
1 Sigma
9. What do you know about the process interactions?
The technical considerations to be made, these need be answered before running an experiment.
Making sense of these at the present is not necessary.
Experimental Methods
• Objective must include the critical characteristics and the desired outcome.
– If the experiment
p and pproject
j is tackling
g recurring
g issues,, consider a
different critical characteristic.
• The characteristic may require a different physical phenomenon
being measured or with a differing measurement system.
• The measurement system precision and accuracy may influence the
specific output to be measured.
• Identify the desired experimental outcome.
1 Eliminate Root Cause
1.
2. Reduce Variation
3. Achieve a target
4. Maximize Output Response
5. Minimize Output Response
6. Robust process or product
Step 3 is knowing that a DOE is going to be performed, does it makes sense to go an extra mile?
Let’s get our money’s worth by measuring more than one output if it could benefit us in any way.
Experimental Methods
• Use the Analyze Phase and subject matter experts to select these factors.
• All factors must be independent of each other.
• Consider past results from previous experiments.
• Test the most likely candidates first.
• Factors not included in the designed experiment should be held constant
and recorded.
• N oise
i or uncontrollable
t ll bl ffactors
t (t
(typically
i ll environmental
i t l conditions)
diti ) should
h ld
be monitored and the experimental design may be impacted (see Step 6).
The inputs selected by the tea m follow ing the Six Sigm a m ethodology a re
dw ell tim e (sec), tem pera ture of solution (deg F) a nd concentra tion of solution
((% solids).
) N oise fa ctors of a mbient tem ppera ture a nd hum idity
y w ere
recorded a nd m onitored.
Step 5 is to choose
the levels for the 5 . Choose the Levels for the Input Va ria bles
input variables. The
• Factor levels must be considered to create the desired change in Output
factor levels must be
Response identified in Step 3.
considered to create
the desired change • Do N OT create unsafe conditions or beyond the feasibility of the process.
in the output – This does N OT mean constraining Input Variable levels to current
response as process range.
identified in Step 3
3. – Be wary y if operating
p g near the extremes or operating
p g limits.
Poor choices for • Realize some experimental runs may produce unacceptable product or
input variable level process results. These results must be weighed against the risk of future
settings could very production.
well render an • Even when designing your experiment with coded levels for the factors, the
experiment useless team MUST be aware of what the levels mean in the process language.
so be smart. • Factor levels can be impacted by the Experimental Objective in Step 2.
– Screening g experiments
p have wider settings
g for factors
– Full Factorials have narrower settings than screening experiments
– Response surface Designed Experiments have quite narrow settings
Experimental Methods
“-” “+”
F
Factor Settings
S i
Be aware you do not want to set the factor levels too low either. We could be shown no difference in
output to input relationship.
“ -” “ +” Factor Settings
Experimental Methods
ponse
experimental noise.
A
Assume this
thi graphic
hi was a
Output Resp
sketch generated from our
basic understanding of the
theory. We don’t know
exactly what factor setting Factor Settings
would produce the output “ -”
response but we do know “ +”
the ggeneral shape
p of the The ex p perim ent is usingg coded levels:
curve. Notice that we Dw ell tim e: +1 (2 0 sec); -1 (1 0 sec)
Temp of sol’n: + 1 (8 0 deg F); -1 (1 0 0 deg F)
stayed away from the sharp Conc. of sol’n: + 1 (4 0 %) ; -1 (2 0 %)
peak. It is very easy to slide
off such a steep peak,
unless your process controls are very tight it would be better to find the nice robust region where the
output response is high but flat, meaning that the factor settings can change a bit, but it does not
have much effect on the output response. If the concern for spending too much time on this comes
up, also,
l consider
id h how many d defects
f t are ttaken
k iin when h th the statistical
t ti ti l significance
i ifi iis d
deemed d
inadequate.
You might think we have spent too much time on just setting the levels for the input variables or
factors in your experiment. However, consider the learning of others who have had to go back to
their Process Owners or Champions and explain that no factors were deemed statistically significant
because the design was inadequate.
Experimental Methods
Remembering that noise variables can’t be controlled but managed around, blocking is a technique
for managing your experiment around noise variables considered of importance. Remember, you are
interested in understanding the effects and interactions of your controlled variables so you want
statistical confidence
confidence.
Randomization has an
impact on your statistical Randomization has an impact on your statistical confidence because your
experimental noise is spread across the runs.
confidence because your
experimental noise is
spread across the runs.
What would happen if
another unknown significant
variable changed halfway
during our experiment?
It is possible that an
unknown significant variable
such as machine warm up
would g get confused with the What would happen if
C variable because without another unknown
randomization all the low significant variable
changed halfway
levels would be generate thru our experiment?
first and then all the high
levels?
Experimental Methods
Determining sample
size is very similar to
what we did in the Sa m ple size m ust be determ ined.
Analyze Phase.
There are a few
Determine
distinctions. Much of d by Step
4.
For full
fa ctoria ls,
explanatory.
2 L
2-Level
l F
Factorial
t i l DDesign
i
MINITABTM
then shows Alpha = 0.05 Assumed standard deviation = 1
2 Reps.
Center Total Target
WHAT THE Points Effect Reps Runs Power Actual Power
HECK IS A 0 2 2 16 0.9 0.936743
REP??
Experimental Methods
A replication is
NOT a duplicate or
a repeat. Look at
the two designs
shown here. The
g
first is a single
replicate design,
which means there
is only one value
for each unique experimental run. The terminology is a bit confusing, but don’t worry.
The replicated design has double the runs. The design is fully randomized whenever possible so this is
not the order in which it is run.
Notice how experimental run #1 and #9 have the three factors which are start angle, stop angle and
fulcrum, running with the same combination of levels and then experimental run #9 is a replicate of run
#1.
Experimental Methods
Recall from the Analyze Phase the Multi-Vari tool described the three
families of variation. Consider these families of variation to determine
how to sample with replication for an experiment.
– W ithin Unit or Positional
• W ithin piece variation related to the geometry of the part.
• Variation across a single unit containing many individual parts
such as a wafer containing many computer processors.
• Location in a batch process such as plating.
– Between Unit or Cyclical
• Variation among consecutive pieces.
• Variation among groups of pieces.
• Variation among consecutive batches.
• Temporal or Over time
• Shift-to-Shift
• Day-to-Day
• W eek-to-W eek
• Discuss the experimental scope, time and cost with the process owners
prior to the experiment.
• Some team members must be present during the entire experiment.
• After the experiment has started, are you getting output responses you
expected?
– If not, quickly evaluate for N oise or other factors and consider
stopping or canceling the experiment.
• Use a log book to make notes of observations, other factor settings, etc.
• Communicate with the operators, technicians, staff about the
experimental details and why the experiment is being discussed before
running the experiment.
– This communication can prevent “ helping” by the operators,
technicians, etc. that might damage your experimental design.
• Alert the laboratory or quality technicians if your experiment will
increase the number of samples arriving during the experiment
experiment.
Experimental Methods
Experimental Methods
• After finding the Practical Results from Step 9, verify the results:
– Set the factors at the Practical Results found with Step 9 and see
if the process output responds as expected. This verification
replicates the result of the experiment.
– Do not forget your model has some error.
1 1 . Implement Solutions
You will p
probably
y not fully
y appreciate
pp all the comments in the modules of this p
phase until yyou have
designed, managed, executed and analyzed a few real life experiments for yourself.
Experimental Methods
Notes
Improve Phase
Full Factorial Experiments
p
In this module
we will discuss W
W elcom
elcomee to
to Im
Improve
prove
the Full
Factorial in Process
Process M
Modeling:
odeling: Regression
Regression
detail.
Adva
Advanced
nced Process
Process M
Modeling:
odeling:
M
MLR
LR
Designing
gg gg Ex
Designing Ex perim
pperim
p ents
ents
Mathematical
Mathematical Models
Models
Ex
Experim
perimenta
entall M
Methods
ethods
Balance
Balance and
and Orthogonality
Orthogonality
Full
Full Fa
Factoria
ctoriall Ex
Ex perim
periments
ents
Fit
Fit and
and Diagnose
Diagnose Model
Model
Fra
Fractiona
ctionall Fa
Factoria
ctoriall
Ex
Experim
periments
ents Center
Center Points
Points
W
W ra
rapp Up
U &
Up & Action
A
Action
ti Item
Itemss
It
Two level Full Factorial designs are the most powerful and efficient set of experiments.
This may look similar to regression, but the important difference is that DOE is considered true
cause and effect because of the controlled nature of experimentation. This is an important tool in
manufacturing environments.
The only difference between the model equation and the prediction equation shown is that the
prediction equation is simplified for describing the data gathered in the experiment and using it to
predict future events
events. Just because you end up with a prediction equation in an experiment does not
mean it is a good predictive model. We will discuss this further when we introduce Center Points.
65
65
60 55
% Reacted % Reacted
1 1
55
45
-1
0
Cn -1
0
Cn
0 -1 0 -1
Ct 1 T 1
Linear Models are usually sufficient for most industrial experimental objectives. This goes back to
the difference between a physical model and a DOE model. Just because we know by theory that
the model should not be linear, it may express itself as sufficiently Linear in the particular design
space.
People can get confused between the concept of curvature and twisted response planes. We do
not have enough information (not enough levels for each variable) to describe true curvature. Take
a piece
i off paper which
hi h will
ill representt 2 iinputt variables.
i bl Lift opposite
it corners. Th
Thatt iis a graphical
hi l
representation of an interaction. The response plane (paper) is twisted. Now lift up the paper to eye
level and rotate until the projection looks like a curved line. We are simply looking at the projection
of the twisted plane with Linear Models. There may be true curvature in the real world, we simply
can’t describe it with a Linear Model.
HOWEVER, in most manufacturing processes the Linear Model is very powerful because of the
constrained design space. Draw a box on the paper and hold it up by two opposite corners.
Depending on how much twist you give the paper and how big the box is you will either see a
curve or not in the defined space.
The surface plot on the left has no significant interaction, but both Main Effects are significant. The
surface plot on the right shows a significant interaction with T and Cn.
Here is a surface plot of true curvature in a Quadratic Model. This shape is referred to as a saddle
for obvious reasons.
Quadratic Models can be obtained with designs not described in this module.
Quadratic Models explain curvature, maximums, minimums and twisted
maximums and minimums when interactions are active.
– The following is the quadratic prediction model used in some response
surface models not covered in this training.
– The simpler 2k models do not include enough information to generate
the Quadratic Model.
21
16
C6
11
1.5
1.0
6 0.5
-1.5
5 -0.5
0.0
B
-1.0
-1 0 -0.5
05 -1.0
-1 0
0.0 05
0.5 -1.5
A 1.0
0 1.5
Treatment Combinations
Minuses and plusses can be used to indicate low and high factor level
settings, center points are indicated with zeros.
The design matrix for 2 k factorials are shown in standard order (not
randomized).
– The low level is indicated by a “ -” and the high level by a “ +” .
– This order is commonly referred to Yates standard order for Dr.
Frank Yates.
Here we h
H have
standard notation for
2 to the 4 design and
above using 2 cubes,
a common
representation; now
for the low levels of
tthe
e 4 the
t e factor
acto and
a d
one for the high.
This ttable
Thi bl created
t d with
ith Factors
the factors is referred to
as a table of contrasts.
The contrast columns are
the minus ones and plus
ones in the factor
columns. In order to
calculate contrast
columns for interactions,
we need the contrast
columns for the main
factors.
Warning, whatever you do, do not change the names of the columns by simply typing over the
names. MINITABTM creates a model that it uses for the analysis later. If it can’t find the column
names used to generate the worksheet, it will give an error message.
Balanced Design
Factorial designs should be
Factorial Designs should be balanced for proper interpretation of the
balanced for proper
mathematical equation.
interpretation of the
mathematical equation. An experiment is balanced when each factor has the same number of
experimental runs at both high and low levels.
An experiment is balanced
when each factor has the Summing the signs of the column contrast should yield a zero.
same number of
experimental runs at both Balance simplifies the math necessary to analyze the experiment
experiment.
high and low levels. – If you always use the designs MIN ITABTM provides, they will always be
balanced.
Summing the signs of the A B
column contrast should yield 1 - -
a zero. In this example, there 2 + -
are 2 minuses and 2 plusses.
3 - +
B l
Balance simplifies
i lifi th the math
th 4 + +
necessary to analyze the ∑ Xi 0 0
experiment.
MINITABTM creates balanced, orthogonal designs. If they aren’t changed, this isn’t a problem.
Orthogonal Design
An orthogonal design
allows each effect in An Orthogonal Design allows each effect in an experiment to be
an experiment to be p
measured independently, y theyy are vectors that are at 90 degrees
g to
measured each other.
independently, these If every interaction for all possible variable pair sums to zero, the
are vectors which are design is orthogonal.
at 90 degrees to each W ith an Orthogonal Design, if an interaction is found to be significant,
other. When every it is because of the data and not the experimental design.
interaction for all – If you always use the designs MIN ITABTM provides, they will always be
possible variable pair orthogonal and balanced.
sums to zero, the
A B C AB AC BC
design is orthogonal.
1 - - + + - -
2 + - - - - +
3 - + - - + -
4 + + + + + +
∑ XiX y = 0 0 0
In an empty
p y column, type
yp in
‘Yield’ where we will place the In an empty column, type in ‘Yield’ where we will place the experimental
results. Column C8 was selected in this example.
experimental results. Column
Do NOT edit, copy, paste or alter anything in the first 7 columns or
C8 was selected in this MINITABTM will not understand the worksheet.
example.
80
A F actor
A
B
N ame
Temp
C onc
Any significa nt effects w ill be
AC
plotted off the stra ight line a nd
large are indicated in red and
C S upplier
70
Percent
60
50
highlighted in red.
labeled. This method is referred 40
30
20 Pareto Chart of the Standardized Effects
to as the Daniels method in some 10
5 2.31
(response is Yield, Alpha = .05)
literature. 1
A
F actor N ame
A
B
Temp
C onc
0 10 20 30 40 50 60 70 C S upplier
Standardized Effect AC
BC
sta nda rdized effects
the selected alpha level. Any gra phica lly show s w hich
ABC
effects a re significa nt AB
Effect that is beyond the red line ba sed on the selected C
is considered significant. a lpha level. Any effect
0 10 20 30 40 50 60 70
tha t goes bey ond the red Standardized Effect
line is significa nt.
At this point, Temperature and
the interaction of Temperature
with supplier are the significant
Effects. In the Session W indow under the factorial fit, any effect that has a P-
value less than 0.05 (for an alpha of 0.05) is considered significant.
Look for the factorial fit
N otice that all three methods of determining what effects belong in
information. We interpret this
the final model fit agree.
based on the same way as we
Factorial Fit: Yield versus Temp, Conc, Supplier
have interpreted as we do any
other statistical test. Estimated Effects and Coefficients for Yield (coded units)
What does this tell us….there are Term Effect Coef SE Coef T P
We need to create some Sta t> DO E> Fa ctoria l>Fa ctoria l Plots
factor plots before evaluating Anytim e there is a significa nt
the residuals. Follow the intera ction, it is useful to plot.
Plot both “ M a in Effects Plot” a nd
MINITABTM path shown here.
here “ Intera ction Plot” in this ex a m ple.
ple
Mean of Yield
indicate they are not 50
25 45 5 15
slightly a nd still be
significant. Supplier insignifica nt.
70 Interaction Plot (data means) for Yield
65 5 15 A B
Residual
Residual Plots
Plots for
for YYield
ield
50
50 00
11 -2
-2
-2
-2 -1
-1 00 11 22 40
40 50
50 60
60 70
70 80
80
Standardized
StandardizedResidual
Residual Fitted
FittedValue
Value
Hist
Histogram
ogramof
of tthe
he Residuals
Residuals Residuals
ResidualsVersus
Versustthe
heOrder
Orderof
of tthe
he Dat
Dataa
22
44
esidual
esidual
33 11
Re
Frequency
yy
StandardizedRe
Frequency
Standardized
22 00
11 -1
-1
00 -2
-2
-1.5
-1.5 -1.0
-1.0 -0.5
-0.5 0.0
0.0 0.5
0.5 1.0
1.0 1.5
1.5 11 22 33 44 55 66 77 88 99 10
10 11
11 12
12 13
13 14
14 15
15 16
16
Standardized Obser vation OOrder
rder
StandardizedResidual
Residual Observation
The Residuals versus The Residuals versus variables are most important when deciding what level to
Variables are most set an insignifica nt factor.
important when A typical guideline is a difference of a factor of 3 in the spread of the Residuals
deciding what level to between the low and high levels of an insignificant input variable.
set an insignificant – In this case concentration was not significant, but we still need to make a decision
factor. on how to set it for the process. The low level for concentration has a smaller
spread of Residuals, but there is not a difference of 3:1. Other considerations for
setting the variable are cost and reducing cycle time.
A typical guideline is a
difference of a factor Residuals Versus Temp Residuals Versus Conc
(response is Yield) (response is Yield)
of 3 in the spread of 2
Spread of residuals
2
the Residuals
1 1
Standardized Residual
Standardized Residual
between the low and
high levels of an 0 0
insignificant input
-1 -1
variable. In this case
concentration was not -2
25 30 35 40 45
-2
5.0 7.5 10.0 12.5 15.0
need to make a
decision on how to set it for the process. The low level for concentration has a smaller spread of
Residuals, but there is not a difference of 3:1. Other considerations for setting the Variable are
cost and reducing cycle time.
The Response Optimizer in MINITABTM is a great tool to visually determine where to set the input
variables to achieve the desired output response. Play with it for a while and see what you get. The
more you play around with these thing the better your understanding will be of how it works.
Practical Solution:
Temp 45C
Concentration 5%
Supplier B
Center Points
As you can see in the A Center Point is an additional experimental run made at the physical center of
the design.
graphic there may be an – Center Points do not change the model to quadratic.
unknown hump in the – They allow a check for adequacy of linear model.
Response Curve, by The Center Point provides a check to see if it is valid to say that the output
response is linear through the center of the design space.
adding the Center Point it If a straight line connecting high and low levels passes through the center of the
allows us to calculate an design, the model is adequate to predict inside the design space.
– “Curvature” is the statistic used to interpret the adequacy of the Linear
additional statistic. If there Model.
is significant curvature in – If curvature is significant the P-value will be less than 0.05.
the model all we know is Do NOT predict outside the design space.
Linear
Linear.
Output Resp
In this example
p we will walk throughg the 11 stepp DOE methodologygy for
a panel cleaning machine using Center Points in the analysis. The
manufacturing firm is attempting to start up a new panel cleaning
machine and would like to getting it running quickly. They have
experience with this type of machine, but they do not have experience
with this particular model of equipment.
Na2S2O8 is Sodium
Persulfate; please 3 . Select the O utput (response) Va ria bles
use that any time • W idth of conductor is the only response.
you see that
notation. 4. Select the Input (independent) Va ria bles
• Dwell Time
• Temperature
• N a2 S2 O 8
• The experts believe that ambient temperature and humidity will have
no effect on the process. Monitors will be placed in the room to
record temperature and humidity.
You actually know the answer already since the sample size is the same as the previous example
since they were both 2 cubed designs. Look at your worksheet and find the Center Point runs.
Why are the Center Points uniformly distributed?
Why are
Wh
N otice the
Center
Center Points
Points not
a re uniform ly
random?
distributed
through the
design.
Center Points not only tell us something about how well the linear model works, but is also a
reality check for our data. By eyeballing the Center Point data as our experiment progressed we
can see if anything has effected our experiment that we were not expecting. If your Center Points
are dramatically different from each other, you’ve got a problem -- somewhere. They should be
fairly close in magnitude, at least within normal variation.
MIN ITABTM will place the Center Points randomly in the worksheet. The
next few slides will demonstrate how to move the Center Points so they
are uniformly distributed.
1. Create a 3 factor design with 3 Center Points and 2 replicates,
be sure to randomize the design
design.
Your designg should look different than the one in the illustration because we more likelyy than not have
a different random seed that generated the designs. It is possible that our designs are the same, but
trying to calculate the odds of that occurring is not worth the bother. You should have 19 rows in your
design, so if you do not, go back and fix it.
Sodium Persulfate,
99
Effect Type
Not Significant
95 Significant
80
B
C F actor
A
B
C
Name
Dw ell Time
Temp
Na2S 2O 8
60
50
5
BC
2.23
(response is Width, Alpha = .05)
F actor N ame
1 A D w ell Time
-10 -5 0 5 10 15 20 C B Temp
Standardized Effect C N a2S 2O 8
B
BC
Term
A
The significa nt effects a re
N a 2 S2 O 8 , Tem p, Dw ell AB
0 5 10 15 20
Standardized Effect
Notice that all three methods of determining what effects belong in the final
model fit agree.
When working with 2 level designs you will always have 1 degree of freedom for each effect
(including interactions) which is calculated as 2 levels minus 1 equals 1 degree of freedom. In the
ANOVA table for Main Effects we have 3 degrees of freedom for the 3 Main Effects placed in the
model There is one degree of freedom for the temperature Sodium Persulfate interaction
model. interaction.
The Residual error is broken into 2 sources. The 3 degrees of freedom for lack of fit are from the 3
interaction effects that were removed from the model because they were not significant in explaining
the variation of the data. The 10 degrees of freedom come from replication. The 8 runs from the
original design generated 8 degrees of freedom
freedom, in this case there were 2 replicates minus 1 equals 1
degree of freedom for each run in the design. Add to that 2 degrees of freedom from the Center
Points (3 Center Points minus 1 equals 2 degrees of freedom) and we have a total of 10 degrees of
freedom for pure error. Pure error can be defined as the failure of things treated alike to act alike
which are the replicates.
The SS or Sum
S off Squares
S calculations are simply an unscaled or unadjusted measure off
dispersion or spread of the data. Seq or Sequential Sum of Squares and Adj or Adjusted Sum of
Squares are the same for DOE analyses. (There may be differences in Regression Analysis).
Adj MS or Adjusted Mean Square takes the Sum of the Squares number and scales it using the
number of degrees of freedom for that calculation. Mean Squares are the equivalent of variance.
Here we use the F statistic. An F statistic is simply variance divided by variance. In the case of
DOE it is the Variance of an effect divided by the variance due to residual error. In this platform,
MINITABTM sums the sum of the squares for certain elements of the model to report in the ANOVA
table instead of keeping them separate. The F statistic with respect to the Main Effects is calculated
by taking 199.779 and dividing by 1.348 which equals 148.18. The associated P-value is 0.000
which is less than 0.05 so our conclusion is that the model is significant.
Notice in this example the curvature is not significant which means our assumption of linearity is
good. Also
good so tthe
e p value
a ue for
o lack
ac oof fitt is
s not
ot ssignificant.
g ca t Thatat means
ea s tthe
eeeffects
ects we
e removed
e o ed from
o tthe e
model really do not belong in the model. If there was significant lack of fit, that would indicate that
some of the effects that were removed from the model actually belong in the model.
The last to discuss here is the prediction equation. Please note here the coefficients for the
prediction equation are based on uncoded units. In other words, you can use this equation directly
in real units. Let’s do an example next.
Prediction Equation
Take a few minutes to study
Determine the predicted value when:
the equation above. It really
– Dwell time = 4.2 minutes
is simply “plug and chug”.
– Temp = 75C
– Sodium Persulfate = 2.0
Please note, we have taken
liberties with rounding
numbers! You won’t actually Simply insert these values into the equation and do the math.
have to do this by hand
because that is exactlyy what
the response optimizer does
in MINITABTM.
36
34
Persulfate interaction
of Width
32
Na2S2O8
Interaction Plot (data means) for Width
38
36
40 60 80 1.8 2.1 2.4
Dwell
response as long as
40
34
Time
4
5
Point Ty pe
C orner
C enter
Sodium Persulfate is held
Dwell T ime
30
concentration of Sodium
24
1.8 2.1 2.4
Temp Point Ty pe
40
40 C orner
33.245
33.245 38.395
38.395
80
80
35.020
35.020
Temp
Temp 36. 010
36.010 41. 000
41.000
2.4
2.4
Na2S2O8
N 2S2O8
Na2S2O8
23.025
23.025 25.895
25.895
40
40 1.8
1.8
44 66
Dwell
DwellTime
Time
Residual
StandardizedResidual
90
90 11
Percent
Percent
00
Standardized
50
50
-1
-1
10
10
11 -2
-2
-2
2
-2 -1
1
-1 00 11 22 20
20 25
25 30
30 35
35 40
40
Standar dized Residual
Standardized Residual Fitted
FittedValue
Value
Residual
6.0
StandardizedResidual
4.5 11
4.5
Frequency
Frequency
00
Standardized
3.0
3.0
1.5 -1
-1
1.5
0.0 -2
-2
0.0
-2
-2 -1
-1 00 11 22 22 44 66 88 10 10 1212 14 14 16
16 18
18
Standar dized Residual
Standardized Residual OObservation
bser vation OOrder
r der
1 1
Standardized Residual
Standardized Residual
0 0
As depicted here the
Residuals Versus
-1 -1
Factor Plots do NOT
-2
4.0 4.5 5.0 5.5 6.0
-2
40 50 60 70 80
show
h any diff
differences
Dwell Time Temp
in the variation of the
Residuals Versus Na2S2O8 data from the low to
(response is Width)
2 the high values.
1
Standardized Residual
-1
S
-2
1.8 1.9 2.0 2.1 2.2 2.3 2.4
Na2S2O8
9 . Dra w Pra ctica l Solutions Sta t>DO E> Fa ctoria l> Response O ptimizer
Here we will use the
Response Optimizer
to draw some
Practical
Conclusions. Play
with the Response
Optimizer and see
what you can do
remembering that the
original
i i l objective
bj ti was
to hit a target of 40
+/- 5 for the width.
Predicted output
Imagine if you were working with gold or platinum. What effect could that have on the bottom line?
Look at another
graphical tool you can There is another MINITABTM function that will show the complete
use in MINITABTM to solution set for a targeted values.
visualize the solution Stat>DOE>Factorial>Overlaid Contour Plot
As shown here we
generate 3 Overlaid Contour Plot of Width Overlaid Contour Plot of Width
a result of
45
Na2S2O8
Na2S2O8
point for dwell 2.10
Dw ell Tim e 2.10 Dw ell Tim e
time. The areas a t low a t m iddle
1.95
setting 1.95 setting
shown in white are
the solution set for 1.80
40 50 60 70 80
1.80
40 50 60 70 80
Notes
Improve Phase
Fractional Factorial Experiments
Now we will continue with the Improve Phase “Fractional Factorial Designing Experiments”.
Advanced
Advanced Process
Process Modeling:
Modeling:
MLR
MLR
Designing
Designing Experiments
Experiments
Experimental
Experimental Methods
Methods
Designs
Designs
Full
Full Factorial
Factorial Experiments
Experiments
Creation
Creation
Fractional
Fractional Factorial
Factorial Experiments
Experiments
Generators
Generators
Wrap
Wrap Up
Up &
& Action
Action Items
Items
Confounding
Confounding && Resolution
Resolution
Fractional Factorial Designs are a powerful sub-set of Factorial Designs. As the name implies, you
may expect they are some fraction of the original Factorial Designs – and you’d be correct. The
question is what fraction?
We’ve shown two 4 factor designs side by side so you can contrast the two designs. Notice the
Fractional Factorial Design requires only a fraction of the experimental runs to evaluate 4 input
factors In this case,
factors. case it is a half fraction
fraction. As with most things in life there is a price to be paid for
reducing the number of runs required which we will go through in detail in this module.
Fractional Factorial designs are also used to study Main Effects and 2-way interactions if the
experimenter and team has good process knowledge and can assume higher order interactions are
negligible. There is the cost in a nutshell. In exchange for reducing the overall experiment’s size you will
give up the ability to evaluate higher order interactions. It turns out this is a pretty good assumption in
many cases. We’ll talk about this more later.
Fractional Factorial designs are also used to reduce the time and cost of experiments because the
number of runs are lowered. As the number of factors increases, the number of runs required to run a
full 2k factorial experiment also increases (even without repeats or replicates) as you already know.
3 factors: requires 8 runs
4 factors: requires 16 runs
5 factors: requires 32 runs etc….
The number of runs required for a Fractional Factorial will depend on how many factors are included in
the design and how much fractioning can be tolerated based on the facts of the process
process.
Fractionals are also used as an initial experiment that can be augmented with another fraction to
reduce confounding and estimate factors of interest. We’ll define this as we advance through the
module.
How many runs if no repeats or replicates? Simply do the math. 2 to the 5 minus 1 is the same as
2 to the fourth which is 8 runs.
What Fractional Design is this? Since this design uses only half the number of runs as a Full
Factorial with 5 factors it is a half fraction.
Recall the 2x2x2 full 3-factor, 2-level Factorial Design. Suppose we needed to investigate
a fourth factor but we could N OT increase the number of runs because of time or cost.
g
Select the highest order interaction to represent
p the levels of the fourth factor. The ABC
interaction will determine the levels for factor D.
W hen we replace the ABC interaction with factor D, we say the ABC 3-way interaction
was aliased or confounded with D. This experiment maintains balance and orthogonality.
– The first experimental run in the first row indicates the experiment is executed with factor D at
the low level while running all the 3 other factors at the low level.
Factor D
A B C AxB AxC BxC AxBxC
-1
1 -1
1 -1
1 1 1 1 -1
1
1 -1 -1 -1 -1 1 1
-1 1 -1 -1 1 -1 1
1 1 -1 1 -1 -1 -1
-1 -1 1 1 -1 -1 1
1 -1 1 -1 1 -1 -1
-1 1 1 -1 -1 1 -1
1 1 1 1 1 1 1
Why is the design, shown as orange rows, called a “half” fraction? This is the design
just created on the previous slide. This is a half fraction since a full 2x2x2x2 factorial
would take 16 runs. With the half fraction we can estimate the effects of 4 factors in 8
runs. What is the cost? We lose the ability to study the higher order interaction
independently!
- A + - A +
Top line of previous slide
-
- C
+
B
-
+ C
+
- D +
Remember that D is confounded with the ABC interaction in this half-fractional
design.
Design Generators
Don’tt worry – MINITABTM will take care of this! THANK YOU MINITABTM!!!!
Don
This graph helps us visually draw the conclusion of the data that we already have. We have
highlighted in green two boxes and this can very simply be filled in by the data expressed by the
generator; A times B times C equals D.
Design
g Generator D = ABC
• Because of the Design Generator we can now fill out the D column
– For each row of D, multiply the values in the columns of A, B and
C together and create the column
• You may correctly suspect some 2-factor interactions are
confounded
• Create contrast columns for AD,
AD BD,
BD CD using a similar technique
used to create the column for D
A B C AB AC BC D AD BD CD
-1 -1 -1 1 1 1
1 -1 -1 -1 -1 1
-1 1 -1 -1 1 -1
1 1 -1 1 -1 -1
-1 -1 1 1 -1 -1
1 -1 1 -1 1 -1
-1 1 1 -1 -1 1
1 1 1 1 1 1
Notice after the design structure an alias structure is indicated. The line under the alias structure
showing A plus BCD means the A Main Effect is confounded with the 3 way interaction BCD. Also,
later we can see the AB 2 2-way
way interaction is confounded with the CD 2 2-way
way interaction meaning we
cannot distinguish if the interaction is statistically significant whether it is a result of the AB or CD
interaction or a combination.
So What is “Confounding”?
Experimental Resolution
k-p
2R
Remember R in the nomenclature referenced the Resolution.
This useful visual aid remembers definitions of the
Confounding designated by the Resolution.
Resolution IV
Next hold up four fingers
The Confounding is main effects with
three way interactions or…
Main Effects Three Way Interactions
k-p
2R
The visual aid is shown through Resolution V.
Resolution V
Hold up Five Fingers, One on one hand and
F
Four on the
th other.
th This
Thi illustrates
ill t t the th
Confounding of main effects with four way
Main Effects Four Way Interactions interactions or …
Example of a very useful Fractional Design often used for screening designs.
Run A B C D E
1 -1 -1 -1 -1 1
2 1 -1 -1 -1 -1
3 -1 1 -1 -1 -1
E
4 1 1 -1 -1 1
5 -1 -1 1 -1 -1
6 1 -1 1 -1 1
7 -1 1 1 -1 1
B
8 1 1 1 -1 -1
C
A 9 -1 -1 -1 1 -1
D 10 1 -1 -1 1 1
11 -1 1 -1 1 1
Pros Cons 12 1 1 -1 1 -1
13 -1 -1 1 1 1
5 factors (Main Effects) 16 trials to get 5 Main Effects 14 1 -1 1 1 -1
10 2-way interactions 2nd order interactions are
15 -1 1 1 1 -1
Main Effects only Confounded Confounded with 3rd order
with rare 4-way interactions 16 1 1 1 1 1
DOE Methodology
We have included a copy of the methodology here for you to use when following our practical
example for Fractional Factorials.
This is a two to the eighth minus four power design with a resolution four design
design. This design has
16 runs as you see in the graphic with all eight factors at two levels.
Take a look at what Confounding exists before you jump into analysis.
Pareto
ParetoChart
Chartof
ofthe
theEffects
Effects
(response
(responseisisY,
Y,Alpha
Alpha==.10)
.10)
0.26
0.26
EE FFactor
actor Name
N ame
AA AA
AC
AC BB BB
HH CC CC
BB DD DD
AF EE EE
AF FF FF
AE
AE GG GG
AD
AD HH HH
TTerm
Term
AA
AG
AGG
CC
AH
AH
AB
AB
GG
FF
DD
00 22 44 66 88 10
10 12
12 14
14
Effect
Effect
Lenth's
Lenth's PSE
PSE==0.129375
0.129375
S = 0.175232 R-Sq
R Sq = 99.98% R-Sq(adj)
R Sq(adj) = 99.96%
Analysis of Variance for Y (coded units)
Source DF Seq SS Adj SS Adj MS F P
Main Effects 4 921.55 921.545 230.386 7502.91 0.000
2-Way Interactions 3 331.20 331.198 110.399 3595.34 0.000
Residual Error 8 0.25 0.246 0.031
Total 15 1252.99
Residual
Residual Plots
Plots for
for YY
Normal
NormalProbability
Probability Plot
Plot Residuals
ResidualsVersus
Versusthe
theFitted
FittedValues
Values
99
99 NN 16
16
0.4
0.4
AD
AD 0.532
0.532
90
90 P-Value
P-Value 0.146
0.146 0.2
02
0.2
al
Percentt
Residua
Residual
Percent
50
50
0.0
0.0
10
10 -0.2
-0.2
11
-0.50
-0.50 -0.25
-0.25 0.00
0.00 0.25
0.25 0.50
0.50 00 10
10 20
20 30
30
Residual
Residual Fitted
FittedValue
Value
Histogram
Histogramof
of the
theResiduals
Residuals Residuals
ResidualsVersus
Versusthe
theOrder
Orderof
ofthe
theData
Data
44 0.4
0.4
33 0.2
ency
0.2
ncy
ual
al
Residua
Residu
Frequen
Freque
22
0.0
0.0
11
-0.2
-0.2
00
-0.3
-0.3 -0.2
-0.2 -0.1
-0.1 0.0
0.0 0.1
0.1 0.2
0.2 0.3
0.3 0.4
0.4
11 22 33 44 55 66 77 88 99 10
1011
11 12
1213
1314
14 15
1516
16
Residual Observation
ObservationOrder
Order
Residual
No, no unusual
observations here…
It ca n be difficult to optim ize the solutions a nd get the Pra ctica l Solution
desired.
Using Response O ptim izer w ithin M IN ITABTM helps us find the Pra ctica l
Solution of setting the fa ctors left in the m odel a ll a t the high level or + 1
We win, we win…!!
1 1 . Im plement Solutions
W ork with the Process Owners and develop the Control Plans
to sustain your success
Notes
Improve Phase
Wrap Up and Action Items
Congratulations on completing the training portion of the Improve Phase. Now comes the
exciting and challenging part…implementing what you have learned to real world projects.
• Listed below are the Improve Phase deliverables that each candidate
will present in a Power Point presentation at the beginning of the
Control Phase training.
• At this point you should all understand what is necessary to provide
these deliverables in your presentation.
– Team Members (Team Meeting Attendance)
– Primary Metric
– Secondary Metric(s)
– Experiment Justification
– Experiment Plan / Objective
– Experiment Results
– Project Plan
– Issues and Barriers
It’s your show!
Before beginning the Control Phase you should prepare a clear presentation that addresses each
topic shown here.
• Being tenacious
tenacious, courageous
Look for the potential roadblocks and plan to address them before they
become problems:
– Lack of data
– Data p presented is the best g
guess by
y functional managers
g
– Team members do not have the time to collect data
– Process participants do not participate in the analysis planning
– Lack of access to the process
Each phase will have roadblocks. Many will be similar throughout your project.
DMAIC Roadmap
Process Owner
Champion/
Estimate COPQ
Establish Team
Measure
The objective of the Improve Phase is simple – utilize advanced statistical methods to identify
contributing variables OR more appropriately optimize variables to create a desired output.
Improve Phase
Over 80% of projects will realize there
solutions in the Analyze Phase – Analysis Complete
Designed Experiments can be extremely
effective when used properly, it is Identify Few Vital X’s
• How much of the problem have you explained with these X’s?
X s?
These are questions that the participant should be able to answer in clear, understandable language
at the end of this phase.
W HAT W HO W HEN W HY W HY N O T HO W
Over the last decade of deploying Six Sigma it has been found that the parallel application of the
tools and techniques in a real project yields the maximum success for the rapid transfer of
knowledge. It is imperative that you complete this and submit your plan for action for review with
your mentors. Thanks and good luck!
You have now completed Improve Phase – Wrap Up and Action Items.
Notes
Improve Phase
Quiz
Now we will see what you have retained from the Improve Phase of the course. Please answer
these questions to the best of your ability without referencing the text. The answers are in the
Appendix. Please check your answers against the answers provided and review the sections in
the Improve Phase where your retention of the knowledge is less than you desire.
1 M
1. Multiple
lti l RRegressions
i are b
bestt used
d ffor?
?
A. Non-linear relationships between an X and a Y.
B. Uncertainty in the slope of the linear relationship between an X and a Y.
C. Relationships between Y and two or more X’s.
D. Replacing the use of a Designed Experiment.
2. Which relationships can be modeled with a Regression Equation? (check all that apply)
A. Simple Linear
B. Quadratic
C. Cubic
D. Multiple Linear
E. Logarithmic
3. Which statements are true about Multiple Regressions? (check all that apply)
A. Multiple Regressions are a form of experimentation.
B The
B. Th X’X’s are assumed d tto b
be iindependent
d d t off each
h other.
th
C. The X’s are assumed to not be correlated.
D. The residuals or errors are assumed to be Normally Distributed.
E. Interactions are NOT included in Multiple Linear Regressions.
F. R2 and the statistical confidence of the coefficients are impacted by the measurement
error of the inputs or X’s.
5. The results for experiments include the desire for problem solving, screening factors and
(check all that apply)
A. Physically model a process
B. Screening factors among possibilities
C. Achieving a robust design
D. Provide Regression Analysis
E. Understand the impact of an improved Measurement System
6. Which Experimental Design typically is most associated with the fewest number of input
variables or factors in the design?
A. Fractional Factorial Design
B. Full Factorial Design
C. Simple Linear Regression
D R
D. Response S Surface
f D
Design
i
7. The 11 step methodology recommended for performing a DOE has which item as the first
step?
A. Select the output response variable(s)
B. Select the Experimental Design
C. Select the input variables
D. Define the Practical Problem
8. How many experimental runs exist in a full factorial 2-level design for 5 factors with 2
replicates for the Corner Points and no Center Points?
A. 10
B. 16
C. 32
D. 34
E. 64
9. Which statements are true about Full Factorials? (check all that apply):
A. Full Factorials are used when 5 or fewer factors are involved.
B. Full Factorials are better for optimizing a process than Fractional Factorials.
C. Full Factorials are used instead of Fractional Factorials if interactions need to be fully
understood.
D. Full Factorials are used for screening factors if the Analyze Phase was unable to
narrow the critical factors sufficiently.
E. Full Factorials never have Center Points in the design.
10. Examples of the first step in the recommended 11 step methodology for a DOE include:
(check all that apply)
A. Consider the cost of a DOE.
B. The root cause for the defective product characteristic needs to be found.
C. The variation needs to be affected by the input factors.
D. The response time to calls needs to be reduced.
E. The DOE effect on the project timeline needs to be considered.
11. What is the best reason for not selecting too large of a difference among the factor
levels in the Experimental Design?
A. The process output must not change too much.
B. The process may show little change if curvature exists and the local maximum of the
process output is between the large differences of factor levels chosen.
C. The experimental factors have rarely been operating in such a wide range.
D The experiment must have Center Points if the factor levels are wide.
D. wide
12. Which statements are correct about Experimental Designs? (check all that apply):
A. An Experimental Design cannot be orthogonal if not balanced.
B. An Experimental Design can be a balanced design but not orthogonal although it is
encouraged to use only balanced and orthogonal designs.
C. The use of blocking can be used for accounting of the impact of Noise variables.
D. Center Points are not recommended unless the experimenter is attempting to
optimize the process.
E. A resolution IV design has only 4-way interactions confounded with Main Effects.