Special Internal Quality Control
Special Internal Quality Control
Special Internal Quality Control
1
Quality Control (QC)
Calibrator:
4
Internal Quality Control
Controls
• Different from kit calibrators
• Same control lot can be used across multiple reagent lots allowing long-term monitoring
of assay performance
5
Internal Quality Control
6
Comparing Results to the Appropriate Range
• Precision: Reproducibility
Low Accuracy,
High Precision
High Accuracy,
Low Precision
High Accuracy,
High Precision
Error
• Pre-Analytical Errors=40%
• Analytical Errors=20%
• Post-Analytical Errors=20%
Pre-Analytical Errors
• Before the specimen is run.
• Examples: Clerical, patient ID, specimen selection and
contamination, improper storage of reagents and specimen,
improper transport, etc.
• Testing errors
• Random or indeterminate
• Hard or impossible to trace
• Examples: Electricity surge, One-time events, etc
• Systematic or determinant
• Identifiable cause
• Examples: Specimen carryover, contaminated reagents, instrument
component malfunction, dirty electrodes, etc.
• Through Quality Control measures, such as always running controls,
the laboratory limits these errors.
Post-Analytical Errors
• After testing.
• Examples: Clerical, result reported on wrong patient, instrument to
host computer errors, etc.
• Variance =
In general the following are the rules observed for evaluating the control results:
(a) Both control (Normal and Abnormal levels) are within ± 2SD from the mean;
OR
(b) One control reads within ±2SD; the other between 2-3SD (once only).
(a) One control is greater than ±3SD from the mean or,
(b) Both controls are greater than ±2SD from the mean, or
(c) One control is between 2—3SD on two successive runs.
Quality Control
• 95% confidence limit (± 2 SD) - 95% of all the results in a
Gaussian distribution
How many points fall within 1SD?
• 12s
• A single control measurement exceeds two standard deviations
from the target mean
• Action – must consider other rule violations (trend, shift,
etc)
• This is a warning
22s Westgard Rule
• 22s
• Two consecutive control measurements exceed the same mean
plus 2S or the same mean minus 2S control limit.
• Action – Reject
R4s Westgard Rule
• R4s
• One control measurement in a group exceeds the mean plus 2S
and another exceeds the mean minus 2S.
• Action – Reject
41s Westgard Rule
• 41s
• Four consecutive control measurements exceed the same
mean plus 1S or the same mean minus 1S control limit.
• Action – Reject
If QC FAILS?
One Possible Plan of Action: (your lab may advise another)
1. Look at vial of control. If using the last drops—reconstitute or open new
vial.
2. If plenty of QC left in vial, mix well, repour, rerun. Most issues resolve by
now. However…
3. If the QC fails again, check the volumes and expiration dates of the
reagents. Change out if necessary.
4. Calibrate the instrument, run cleaning sequence, or perform maintenance
as needed.
5. Rerun control.
6. If controls fail repeatedly after multiple efforts, call technical support.
Use discretion keeping in mind that controls, calibrators, and reagents are
expensive.
References
https://www.who.int/medical_devices/diagnostics/WHO_EDL_2018.pdf
https://www.who.int/bulletin/volumes/95/9/16-187468/en/
32
Thank You
33
External Quality Control:
Samples provided by the agency are analyzed and the results sent
back by each participant.
36
Assuring the Quality of Test and Calibration
Results - ISO/IEC 17025 – 5.9
• This monitoring shall be planned and reviewed and may
include, but not be limited to, the following:
• regular use of certified reference materials and/or internal
quality control using secondary reference materials;
• participation in interlaboratory comparison or proficiency-
testing programmes;
• replicate tests or calibrations using the same or different
methods;
• retesting or recalibration of retained items;
• correlation of results for different characteristics of an
item.
37
Control Charts
• Powerful, easy-to-use technique for the control of
routine analyses
• ISO/IEC 17025 demands use wherever practicable
• It is hard to imagine quality management systems
in laboratories without control chart
38
History
• Introduced by Shewhart in 1931
• Originally for industrial manufacturing processes
• For suddenly occurring changes and for slow but
constant worsening of the quality
• Immediate interventions reduce the risk of
production of rejects and complaints from the
clients
39
Principle
• Take control samples during the process
• Measure a quality indicator
• Mark the measurement in a chart with warning and action
limits
concentration
target value
sample-# 1 2 3 4 5 6 7 8 9 10 1112 13 14 15 16 17 18
40
Control Charts in Analytical
Science
• Assign a target value
• Certified value of a RM/CRM (if available)
• Mean of often repeated measurements of the control
sample (in most cases)
41
Control Charts in Analytical
Science
• Warning / action limits
• If data are normally distributed
• 95.5% of the data are in µ ± 2σ
• 99.7% are in µ ± 3σ
• ± 2s is taken as warning limits
• x± 3s is taken as action limit
42
Action Limits
• There is a probability of only (100-99.7) 0.3 % that
a (correct) measurement is outside the action limits
(3 out of 1000 measurements)
• Therefore the process should be stopped
immediately and searched for errors
43
Warning Limits
• (100-95.5) 4.5% of the (correct) values are outside
the warning limits.
• This is not very unlikely.
• Therefore this is only for warning, no immediate
action required.
44
Calculation of Standard Deviation
• Measurements marked in the control chart are
between-batch
• Standard deviation should also be between-batch
• Estimation from a pre-period of about 20 working
days
• Repeatability STD too narrow limits
• Interlaboratory STD too wide limits
45
Limits Fitness for Purpose
• Action and warning limits have to be compatible
with the fitness-for-purpose demands
• No blind use
• Limits should be adjusted to fit-for purpose
requirements
46
Out-of-control Situation 1
• Suddenly deviating value, outside the action limits
concentration
target value
date
47
Out-of-control Situation 2
• 2 of 3 successive values outside the warning limits
concentration
target value
date
48
Out-of-control Situation 3
• 7 successive values on one side of the central line
Not so critical as 1 and 2
concentration
target value
date
49
Out-of-control Situation 4
• 7 successive increasing or decreasing values
Not so critical as 1 and 2
concentration
target value
date
50
Advantages of Graphical Display instead of
in a table
• Much faster
• More illustrative
• Clearer
51
Different Control Charts
X-chart
• Synonyms are X-control chart, mean control chart or
average control chart
• Original Shewhart-chart with single values
• Mainly for precision check
• For trueness control synthetic samples with known
content or RM/CRM samples may be analysed
• It is also possible to use calibration parameters
(slope, intercept) to check the plausibility
(constancy) of the calibration
52
Different Control Charts
Blank Value Chart
• Analysis of a sample, which can be assumed to not
contain the analyte (blank)
• Special form of the X-chart
• Information about
• The contamination of reagents
• The state of the analytical system
• Contamination from environment (molecular biology
laboratories)
• Enter direct measurements of signals, not
calculated values
53
Different Control Charts
Recovery Rate Chart - I
• Reflects influence of the sample matrix
• Principle:
• Analyse actual sample (unspiked)
• Spike this sample with a known amount of analyte (ΔX)
• Analyse again
• Recovery rate:
xspiked xunspiked
RR 100%
x
expected
54
Different Control Charts
Recovery Rate Chart - II
• Detects only proportional systematic errors
• Constant systematic errors remain undetected
• Spiked analyte might be bound differently to the
sample matrix better recovery rate for the spike
• Target value: around 100%
55
Different Control Charts
Range Chart
• Synonyms are R-chart or Precision chart.
• Absolute difference between the highest and lowest
value of multiple analyses
• Repeatability Precision check
• Control chart has only upper limits
concentration
target value
sample-# 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
56
Different Control Charts
Difference Chart - I
• Uses difference with its sign
• Analyse actual sample at the beginning of a series
• Analyse same sample at the end of the series
• Calculate difference (2nd value – 1st value)
• Mark in control chart with the sign
57
Different Control Charts
Difference Chart - II
• Target value: around 0
• Otherwise: drift in the analyses during the series
• Appropriate for repeatability precision and drift
check
58
Different Control Charts
Cusum Chart - I
• Highly sophisticated control chart
• Cusum = cumulative sum = sum of all differences
from one target value
• Target value is subtracted from every control
analyses and difference added to the sum of all
previous differences
59
Different Control Charts - Cusum Chart - II
T = 80 s = 2.5 90
2 79 -1 +1
3 80 0 +1
80
4 78 -2 -1 75
5 82 +2 +1
6 79 -1 0 70
7 80 0 0 0 2 4 6 8 10 12 14 16
8 79 -1 -1 30
9 78 -2 -3
10 80 0 -3 20
11 76 -4 -7 10
12 77 -3 -10
13 76 -4 -14
0
0 2 4 6 8 10 12 14 16
14 76 -4 -18 -10
15 75 -5 -23 -20
-30
60
Different Control Charts - Cusum Chart - III
• V-mask as indicator for out-of-control situation
30 30
20
in control 20
out of control
10 10
0 0
0 2 4 6 8 10 12 14 16 0 2 4 6 8 10 12 14 16
-10 -10
-20 -20
-30 -30
61
Different Control Charts
Cusum Chart - IV
• Advantages
• It indicates at what point the process went out of control
• The average run length is shorter
• Number of points that have to be plotted before a change in
the process mean is detected
• The size of a change in the process mean can be
estimated from the average slope
62
Different Control Charts
Target Control Charts - I
• In the contrary to classical control charts of the
Shewhart-type the target control charts operates with
fixed quality criterions and without statistically
evaluated values
• The limits for this type of control charts are given by
external prescribed and independent quality criterions
(fitness for purpose)
63
Different Control Charts
Target Control Charts - II
• All types of classical control chart (X-chart, blank value,
recovery, R-, R%-chart etc.) can be used as a target
control chart
• A target control chart is appropriate if:
• There is no normal distribution of the values from the control sample due
to persisting out of control situations (e.g. blank values)
• There are not enough data available for the statistical calculation of the
limits (rarely analysed parameters)
• There are external prescribed limits which have to be applied to ensure
the quality of analytical values
64
Different Control Charts
Target Control Charts - III
• The control samples for the target control charts are
the same as for the classical control charts
• The limits might be given by
• Requirements from legislation
• Standards of analytical methods and requirements for internal quality
control
• The (minimum) laboratory-specific precision and trueness of the
analytical value, which have to be ensured
• The evaluation of laboratory-internal known data of the same sample
type
65
Different Control Charts
Target Control Charts - IV
• Constructed with an upper and lower limit
• Pre-period is not necessary
• Out-of-control only, if the analytical value is higher or
lower than the respective limit
• Nevertheless trends in the analytical quality should be
identified and steps should be taken against them
66
Different Control Charts
Target Control Charts - V (example)
only two limits and one out-of-control situation
Control period
Ammonia RM (µmol/l) Date Value Comment / Out-of-control situation / Action
17 16.05.2003 12,61 Check WB/O v. 14.5./KB v. 15.5.
Values mean upper CL upper WL lower WL lower CL mean+1s mean-1s
20.05.2003 12,96 Check DB 1,2,6
16 21.05.2003 12,36 Check DB 10, 16, 19
22.05.2003 12,66 Check SH v. 21.5.03
27.05.2003 12,58 Check RB
15 11.06.2003 11,45 Check UW/O/KB v. 10.6
13.06.2003 12,28 Check UW/O/KB Wdh.
20.05.2003
21.05.2003
22.05.2003
27.05.2003
11.06.2003
13.06.2003
13.06.2003
16.06.2003
17.06.2003
18.06.2003
19.06.2003
24.06.2003
25.06.2003
26.06.2003
02.07.2003
08.07.2003
09.07.2003
10.07.2003
11.07.2003
15.07.2003
15.07.2003
16.07.2003
18.07.2003
67
EXCEL-Tool for Control Charts
ExcelKontrol 2.1
• X-/mean-charts
Blank value chart
Range chart with absolute ranges
Range chart with relative ranges
Recovery rate chart
Differences chart
68
Control Samples
• No control chart without control samples
• Requirements:
• Must be suitable for monitoring over a longer time period
• Should be representative for matrix and analyte conc.
• Concentration should be in the region of analytically
important values (limits!), if possible
• Amount must be sufficient for a longer time period
• Must be stable for several months
• No losses due to the container
• No changes due to taking subsamples
69
Control Samples
Standard Solutions
• To verify the calibration
• Control sample must be completely independent
from calibration solutions
• Influence of sample matrix cannot be detected
• Limited control for precision (no matrix effect)
• Very limited control for trueness
70
Control Samples
Blank Samples
• Samples which probably do not contain the analyte
• To detect errors due to
• Changes in reagents
• New batches of reagents
• Carryover errors
• Drift of apparatus parameters
• Blank value at the start and at the end allow
identification of some systematic trends
71
Control Samples
Real Samples
• Multiple analyses for range and differences charts
• If necessary separate charts for different matrices
• Rapid precision control
• No trueness check
72
Control Samples
Real Samples Spiked with Analyte
• For recovery rate control chart
• Detection of matrix influence
• If necessary separate charts for different matrices
• Substance for spiking must be representative for
the analyte in the sample (binding form!)
• Limited check for trueness
73
Control Samples
Synthetic Samples
• Synthetically mixed samples
• In very rare cases representative for real samples
• If this is possible precision and trueness check
74
Control Samples
Reference Materials
• CRM are ideal control samples, but
• Often too expensive or
• Not available
• In-house reference materials are a good alternative
• Can be checked regularly against a CRM
• If the value is well known good possibility for
trueness check
• Retained sample material from interlaboratory
tests
75
Which One?
• There are a lot of possibilities
• Which one is appropriate?
• How many are necessary?
76
Choice of Control Charts - I
• The more frequent a specific analysis is done the
more sense a control chart makes
• If the analyses are always done with the same
sample matrix, the sample preparation should be
included. If the sample matrix varies, the control
chart can be limited to the measurement only
77
Choice of Control Charts - II
• Some standards or decrees (authority decisions)
include obligatory measurement of control samples
or multiple measurements. Then it is only a
minimal additional effort to document these
measurements in control charts
• In some cases the daily calibration gives values
(slope and/or intercept) that can be integrated into
a control chart with little effort
78
Benefits of Using Control Charts
• A very powerful tool for internal quality control
• Changes in the quality of analyses can be detected
very rapidly
• Good possibility to demonstrate ones quality and
proficiency to clients and auditors
79
Definitions (1)
x x
x x
True x x x x
Value x x x
x x x
x
x
x
Systematic Error
x
x x x x x x x
True x
Value
Internal Quality Control Program for
Serological Testing
• Put up the IQC specimen for at least 20 or more assay runs and record
down the O.D./cut-off value or antibody titre (whichever is applicable).
• Calculate the mean and standard deviations (s.d.)
• Make a plot with the assay run on the x-axis, and O.D./cut-off or
antibody titre on the y axis.
• Draw the following lines across the y-axis: mean, -3, -2, -2, 1, 2, and 3
s.d.
• Plot the O.D./cut-off obtained for the IQC specimen for subsequent assay
runs
• Major events such as changes in the batch no. of the kit and instruments
used should be recorded on the chart.
Westgard rules
80
60
Antibody Units
+3 sd
40 +2 sd
+1 sd
20 Target value
-1 sd
0
-2 sd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
-3 sd
Assay Run
VZV IgG ELISA: Target Value = 49 U/ml
Warning rules
80
60
Antibody Units
+3 sd
40 +2 sd
+1 sd
20 Target value
-1 sd
0
-2 sd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
-3 sd
Assay Run
VZV IgG ELISA: Target Value = 49 U/ml
Westgard Rules: 10X
100
80
60
Antibody Units
+3 sd
40 +2 sd
+1 sd
20 Target value
-1 sd
0
-2 sd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
-3 sd
Assay Run
VZV IgG ELISA: Target Value = 49 U/ml
Follow-up action in the event of a violation
• Accept the test run in its entirety - this usually applies when
only a warning rule is violated.
• Reject the whole test run - this applies only when a
mandatory rule is violated.
• Enlarge the greyzone and thus re-test range for that particular
assay run - this option can be considered in the event of a
violation of either a warning or mandatory rule.
Accreditation of Pathology
Laboratories
• There is a movement towards the accreditation of medical testing
laboratories worldwide.
• Accreditation is an external audit of an applicant department’s
organization and quality assurance program.
• Examples of accreditation authorities include the CPA (College of
American Pathologists) in the U.S., CPA (Clinical Pathology
Accreditation) in the UK, NATA in Australia.
• ISO 15189 is used as the standard for all accreditation bodies in
order to provide uniformity of standards and cross-recognition.