MSA Details Info
MSA Details Info
MSA Details Info
Measurement System Analysis (MSA) is a tool for analyzing the variation present in each
inspection, measurement, and test equipment type. It is the system used to assess the quality of the
measurement system.
A gage, in this context, is a tool for measurement. A gage could be simple, like calipers and rulers.
Or it could be a complex piece of machinery. It could even be a piece of software.
Looking at these two metrics helps us to understand variation in our measurements. When we
understand it, we can combat it.
Why is Gage Repeatability and Reproducibility Important?
Gage Repeatability and Reproducibility measure the amount of variability in measurements caused
by the measurement system itself. Then, it compares this variability with the total to determine the
actual variability of the measurement system. Gage R&R is very important when new workers are
assigned; new tools are used, or any significant process changes.
For example, imagine a situation where our performance metrics show a serious problem in our
manufacturing process. We spend a lot of time and money trying to fix it and improve the
performance of a process. But we’d have noticed serious measurement variations if we’d spent
some time looking at gage repeatability and reproducibility instead. The problem wasn’t in the
process at all; it was in the measurements. Checking this first would have saved time, money, and
stress.
Types of Gage Repeatability and Reproducibility Study
Based on the available data and data type, there are basically three types of Gage R&R available:
Select crossed-gage R&R when each operator measures each part, and it must have a balanced
design with random factors. It is used for non-destructive testing.
Select nested gage R&R when only one operator measures each part. It is used for destructive
testing. Since it is not crossed with other factors, it is called nested gage R&R. It must have
a balanced design with random factors.
Expanded Gage R&R
Select expanded gage R&R when we need to include more factors (maximum of eight) than
operator and part. Typically crossed and nested deal with only two factors (operator and part).
Design can be balanced or unbalanced.
There are basically three methods that exist to perform Gage R&R:
• Range method
• Average and range method
• Analysis of variance method
Range Method: The range method will provide a quick approximation of measurement variability
but does not compute the measurement system repeatability and reproducibility separately.
Average and Range method: The Average and Range method quantifies the measurement
system’s variability and provides repeatability, reproducibility, and part variation. Only crossed
Gage R&R can be performed with the Average and Range method.
Analysis of Variance method: It is the most widely used and accurate method for measurement
system repeatability and reproducibility. It also quantifies the variability of the interaction between
the operator and the parts. Gage R&R (crossed, nested, and expanded) can be done with the
ANOVA method.
Gage Repeatability and Reproducibility Using the Average and Range Method
The Average and Range method determines the total measurement system variability, which can
be separated into components like repeatability, reproducibility, and part variation. Furthermore,
this method requires multiple parts, operators, and trials. The Average and Range method is easy
to compute; however, the ANOVA method is more accurate than the Average and Range method.
Example of Gage R&R using Average and Range method in a Six Sigma project
Step 2: Record a lot of different measurements taken by various people on the same units using
the same gage. For each measurement, ensure that the unit, the person, and the gage are all
recorded.
For Operator A and Part x , the Range = Max – Min = 0.33 – 0.29 = 0.04
Now find the total mean range and difference in means (Xdiff)
EV = R̅*k1
The d2 value can be found in the table based on the subgroup size and the number of combinations
of parts and operators (g).
• d2 =2.080
• k1 =1/d2 = 1 /2.080 = 0.480
• EV= R̅ *k1= 0.0233 *0.480 = 0.0112
Step7: Find the Reproducibility– Appraiser Variation (AV)
The d2 value can be found in the table based on the number of parts and the number of
combinations of parts and operators (g)
• Number of parts =3
• Number of combinations of parts and operators (g) = 3 parts and 3 Operators = 3*3=9
• d2 =1.718
Then, interpret the results. According to the Automotive Industry Action Group (AIAG), below
are the guidelines for measurement system assessment using %GRR.
Since the Total Gage R&R is 1.12%, it is in the green zone. So, it is considered to be an acceptable
measurement system based on application and cost factors.
How to Measure Gage Repeatability and Reproducibility Using ANOVA Method
• t= number of technicians
• r= number of trials or replications
• p= number of parts
This provides the sum of squares by determining the squared deviations between the technician
average and the overall average.
It provides the sum of squares by determining the squared deviations between the part’s average
and the overall average.
It is the squared deviation of each individual result from the overall average.
Step 4: Compute Equipment within the sum of squares
It uses the deviation of all trials for a given part and given technician from the average for that part
and technician.
• σ2 Repeatability = MSEquipment
• σ2 TechnicianxPart = (MSTechnicianxPart – σ2 Repeatability)/ number of trials
• And, σ2 Part = (MSPart – MSTechnicianxPart)/ (number of trials * number of technicians)
• σ2 Technician = (MSTechnician – MSTechnicianxPart)/ (number of trials * number of parts)
Calculate the % Contribution Variance and interpret the results. Below are the criteria for
acceptance of Gage R&R.
Then, find the standard deviation and % study variance. Interpret the results. According to the
Automotive Industry Action Group (AIAG), below are the guidelines for the measurement system
assessment using % GRR.
What is the Number of Distinct Categories (NDC)
The number of distinct categories is a metric. In gage R&R, the goal is to identify the measurement
system’s ability to detect a difference in the measured characteristic. It represents the number of
non-overlapping confidence intervals that span the range of product variation.
Number of distinct categories = (Standard deviations for parts / standard deviation for gage) * √2
So, the number of categories depends on the ratio of the variability in the measuring parts and the
variability in the measurement system.
According to the Automotive Industry Action Group (AIAG), the number of distinct categories
should be greater than 5 for an adequate measuring system.
Example: A testing engineer selected 10 parts representing the expected range of process
variation. Three technicians measured the ten parts three times a part in random. Assess the
measurement system Gage R&R.
• t = number of technicians = 3
• r = number of trials or replications = 3
• p = number of parts = 10
For the 10 parts and 3 trials, the sum of deviations = 3*10*0.0033 =0.0999
Calculate the average of measurement for each part for all the trials for part 1:
(2.78+1.87+1.87+2.56+2.22+2.14+2.56+2.22+2.15)/9=2.263
Calculate the squared deviation of each part: squared deviations of each part and the overall
average.
For 3 trials and 3 technicians, the sum of the deviations = 3*3*12.9477 =116.5294
Calculate the squared deviation for each individual result from the overall average.
For the first part of trial 1: (2.78-3.066)2 = 0.082
Similarly, conduct for all the 90 trials and sum the squared deviation of 3 trials =
0.082+1.430+1.430+……..+1.111+0.034+0.389 =120.682
It uses the deviation of all trials for a given part and given technician from the average for that part
and technician.
Take the average of the first part of the first technician’s three trials = (2.78+1.87+1.87)/3 =2.173
Calculate the Squared Deviation Trial 1 for first part = (2.78-2.173)2 = 0.368
Similarly, calculate the squared deviation for all trials for each part.
According to the Automotive Industry Action Group (AIAG) measurement system assessment
using %GRR.
Since the Total Gage R&R is 18.71%, it is in the yellow zone. So it may be acceptable depending
on the application and cost factors, but the team needs to improve it further. Calculate the
number of distinct categories (NDC)
According to the Automotive Industry Action Group (AIAG), the number of distinct categories
should be greater than 5 for an adequate measuring system.
Number of distinct categories =(Standard deviations for parts / standard deviation for gage) * √2
= (1.9702 /0.2279) * √2 = 7
Gage Repeatability and Reproducibility ANOVA Excel Template
Gage Repeatability and Reproducibility using Minitab
Step2: Select Stat –> Quality Tools –> Gage Study –> Gage R&R (Crossed)
Select Part numbers, Operator, and Measurement data, and select the ANOVA method.
Under options: Enter process tolerance, the default alpha to remove interaction term
would be 0.25. click on ok.
Step 3: Interpretation of results (session window)
Now find the total mean range and difference in means (Xdiff)
EV = R̅*k1
The d2 value can be found in the table based on the subgroup size and the number of combinations
of parts and operators (g).
refer d2 table
• d2 =2.080
• k1 =1/d2 = 1 /2.080 = 0.480
• EV= R̅ *k1= 0.0233 *0.480 = 0.0112
Step7: Find the Reproducibility– Appraiser Variation (AV)
The d2 value can be found in the table based on the number of parts and the number of
combinations of parts and operators (g)
• Number of parts =3
• Number of combinations of parts and operators (g) = 3 parts and 3 Operators = 3*3=9
• d2 =1.718
• k2=1/d2 = 1 /1.718 = 0.5820
Then, interpret the results. According to the Automotive Industry Action Group (AIAG), below
are the guidelines for measurement system assessment using %GRR.
Since the Total Gage R&R is 1.12%, it is in the green zone. So, it is considered to be an acceptable
measurement system based on application and cost factors.
How to Measure Gage Repeatability and Reproducibility
Using ANOVA Method
• t= number of technicians
• r= number of trials or replications
• p= number of parts
Step 1: Calculate the technician sum of squares
This provides the sum of squares by determining the squared deviations between the technician
average and the overall average.
It provides the sum of squares by determining the squared deviations between the part’s average
and the overall average.
It is the squared deviation of each individual result from the overall average.
Step 4: Compute Equipment within the sum of squares
It uses the deviation of all trials for a given part and given technician from the average for that part
and technician.
• σ2 Repeatability = MSEquipment
• σ2 TechnicianxPart = (MSTechnicianxPart – σ2 Repeatability)/ number of trials
• And, σ2 Part = (MSPart – MSTechnicianxPart)/ (number of trials * number of technicians)
• σ2 Technician = (MSTechnician – MSTechnicianxPart)/ (number of trials * number of parts)
Then, find the standard deviation and % study variance. Interpret the results. According to the
Automotive Industry Action Group (AIAG), below are the guidelines for the measurement system
assessment using % GRR.
Number of distinct categories = (Standard deviations for parts / standard deviation for gage) * √2
So, the number of categories depends on the ratio of the variability in the measuring parts and the
variability in the measurement system.
According to the Automotive Industry Action Group (AIAG), the number of distinct categories
should be greater than 5 for an adequate measuring system.
• t = number of technicians = 3
• r = number of trials or replications = 3
• p = number of parts = 10
For the 10 parts and 3 trials, the sum of deviations = 3*10*0.0033 =0.0999
Calculate the average of measurement for each part for all the trials for part 1:
(2.78+1.87+1.87+2.56+2.22+2.14+2.56+2.22+2.15)/9=2.263
Calculate the squared deviation of each part: squared deviations of each part and the overall
average.
For 3 trials and 3 technicians, the sum of the deviations = 3*3*12.9477 =116.5294
Calculate the squared deviation for each individual result from the overall average.
It uses the deviation of all trials for a given part and given technician from the average for that
part and technician.
Take the average of the first part of the first technician’s three trials = (2.78+1.87+1.87)/3 =2.173
Calculate the Squared Deviation Trial 1 for first part = (2.78-2.173)2 = 0.368
Similarly, calculate the squared deviation for all trials for each part.
According to the Automotive Industry Action Group (AIAG) measurement system assessment
using %GRR.
Since the Total Gage R&R is 18.71%, it is in the yellow zone. So it may be acceptable
depending on the application and cost factors, but the team needs to improve it further.
Number of distinct categories =(Standard deviations for parts / standard deviation for gage) * √2
= (1.9702 /0.2279) * √2 = 7
Gage Repeatability and Reproducibility ANOVA Excel Template
Gage Repeatability and Reproducibility using Minitab
Select Part numbers, Operator, and Measurement data, and select the ANOVA method.
Under options: Enter process tolerance, the default alpha to remove interaction term would be
0.25. click on ok.
• First Graph- Components of Variation: It clearly shows too much variation is between
the part to part, but not due to Gage R&R.
• Second Graph- Measurement values by parts: Clearly indicate the variation between
the parts.
• Third Graph- R chart by the operator: All the values are within control limits.
• Fourth Graph – Measurement value by the operator: The difference between operators
is small.
• Fifth Graph – X bar chart by the operator: Most of the points are outside of control
limits. Hence, it indicates that variation is basically due to the parts.
• Sixth Graph – Operator * Parts Interaction: There is not much difference between the
operators, and also there is no interaction between the parts and the operator.
Gage R&R Definitions
Precision
Accuracy
Sensitivity
Reproducibility
Repeatability
Traceability
Step 2: Select three Operators and have them categorize each transaction (2 trials) without
knowing what the master readings are.
You will use these trials as a sample.
Step 3: Repeatability of the operator- count the number of times the operator readings
agree (between two trials). Divide the total agreed number by the total transactions to
obtain the percentage of agreement.
• In Excel, we can use the “IF” formula to check that both the trial data sets are agreed upon
(C5 and D5 cells). If both are agreed, use 1; otherwise, 0. For Example: =IF(C5=D5,1,0)
• Operator Jack: Out of 30 Transactions, 29 values are agreed upon between trial 1 and trial
2. So, repeatability of Jack =29/30 = 96.7%
Step 4: Compute each operator vs. Master readings
Similarly, compute for the other the operator’s repeatability and agreement with master readings.
Step 5: Compute reproducibility between operators
• In Excel, we can use the “IF” formula to check reproducibility between operators (C5, D5,
G5, H5, K5, and L5 cells). If all are agreed, use 1; otherwise, 0. For Example:
=IF(AND(C5=D5,C5=G5,C5=H5,C5=K5,C5=L5,1,0)
• Reproducibility: Out of 30 Transactions, 23 values are agreed upon between 3 operators.
So, the % Reproducibility =23/30 = 76.7%.
Step 6: Overall Effectiveness (All operators vs. Standard) – Compute the percentage of the
time that all the operator’s transactions are agreed upon among each other and with the
master transaction.
• In Excel, we can use the “IF” formula to check overall effectiveness (C5, D5, G5, H5,
K5, L5, and B5 cells). If all are agreed, use 1; otherwise, 0. For Example:
=IF(AND(B5=C5,B5=D5,B5=G5,B5=H5,B5=K5,B5=L5,1,0)
• Overall Effectiveness: Out of 30 Transactions, 23 values are agreed upon between 3
operators. So, the % Overall Effectiveness =23/30 = 76.7%
Step7: Conclusions
As per AIAG acceptance criteria of attribute data MSA:
SA will be failed as the overall efficiency is only 76.7%. MSA Should be greater than 90%. We
need to take the appropriate actions for improvement.
Attribute Gage R&R using Minitab