Quality Control
Quality Control
Quality Control
Equipment
Information Management
Occurrence Management
Assessment
Process Improvement
Customer Service
Patient/Client Prep Sample Collection Reporting Data and Lab Management Safety Customer Service Personnel Competency Test Evaluations
Quality Control
Definitions Qualitative Quality Control Quantitative QC How to implement Selection and managing control materials Analysis of QC data Monitoring quality control data
4
of laboratory testing, and the accuracy and precision of results Routinely collect and analyze data from every test run or procedure Allows for immediate corrective action
Designing a QC Program
Establish written policies and procedures
Corrective action procedures Train all staff Design forms Assure complete documentation and review
Qualitative vs.Quantitative
Quantitative test
measures the amount of a substance present Qualitative test determines whether the substance being tested for is present or absent
Qualitative QC
Quality control is performed for both, system
is somewhat different Controls available Blood Bank/Serology/Micro RPR/TPHA Dipstick technology Pregnancy
contents concentration date prepared placed in service expiration date/shelf life preparer
9
Media Preparation
Record amount prepared Source Lot number Sterilization method Preparation date Preparer pH Expiration date
10
Microbiology QC
Check: Sterility Ability to support growth Selective or inhibitory characteristics of the medium Biochemical response Frequency Test QC organisms with each new batch or lot number Check for growth of fastidious organisms on media of choice incubate at time and temp recommended RECORD Results on Media QC form
11
Use gram positive and gram negative organisms to check stain daily Other : Check as used positive and negative reactions
12
Stock QC organisms
Organisms to be maintained must be
adequate to check all media and test systems. E. coli MacConkey, EMB, susceptibility tests Staphylococcus aureus Blood agar, Mannitol Salt, susceptibility tests Neisseria gonorrhoeae chocolate, MartinLewis
13
Detecting Errors
Many organisms have predictable
antimicrobial test results Staphylococcus spp. are usually susceptible to vancomycin Streptococcus pyogenes are always susceptible to penicillin Klebsiella pneumoniae are resistant to ampicillin
14
Sources of Error
If you encounter an unusual pattern
rule out error by checking identification of organisms repeat antimicrobial susceptibility test
Report if repeat testing yields same result, or refer
15
Select high quality controls Collect at least 20 control values over a period of 20-30 days for each level of control Perform statistical analysis Develop Levey-Jennings chart Monitor control values using the Levey-Jennings chart and/or Westgard rules Take immediate corrective action, if needed Record actions taken
17
(analyte) being measured Used to adjust instrument, kit, test system in order to standardize the assay Sometimes called a standard, although usually not a true standard This is not a control
18
Use 2 or three levels of controls Include with patient samples when performing a test Used to validate reliability of the test system
19
Values cover medical decision points Similar to the test specimen (matrix) Available in large quantity Stored in small aliquots Ideally, should last for at least 1 year Often use biological material, consider biohazardous
20
serum pool for one years testing May be frozen, freeze-dried, or chemically preserved Requires very accurate reconstitution if this step is necessary Always store as recommended by manufacturer
21
Sources of QC Samples
Appropriate diagnostic sample Obtained from:
22
Assayed
mean calculated by the manufacturer must verify in the laboratory Unassayed less expensive must perform data analysis Homemade or In-house pooled sera collected in the laboratory characterized preserved in small quantities for daily use
23
Low positive Between the cut off and positive control At a level where variability can be followed Generally ~2 times the cut off
25
stock sample diluent QC batch Method Validation Acceptance Criteria batch stability
26
Serial dilution of high positive stock sample Select suitable dilution Produce large batch Test stability Test batch variation Dispense, label, store
27
S/Co Ratio
Doubling Dilutions
29
Batch Production
Prepare positive sample
centrifuge heat inactivate Mix positive sample in diluent magnetic stirrer Bottle batch in numbered lots of suitable volume
30
Stability Testing
Assess the rate of deterioration
QC Sample Day 7 Storage -20c Day 14 Day 21 Day 28
4c
16-25C
31
Batch Validation
Dispense aliquots Test aliquots Confirm desired titre level
compare against target value Confirm minimal batch variation acceptable if CV <20% aim for <10%
32
Storage of QC Samples
Validated batch aliquoted into smaller user
store at -20oC in use vials stored at 4oC use 0.5 ml vial maximum of one week freeze-dried (requires accurate reconstitution) chemically preserved
33
34
Basic statistics skills Manual methods Graph paper Calculator Computer helpful Spreadsheet Important skills for laboratory personnel
36
over a 30 day period Calculate mean, standard deviation, coefficient of variation; determine target ranges Develop Levey-Jennings charts, plot results
37
38
Measurement of Variability
A certain amount of variability will naturally
occur when a control is tested repeatedly. Variability is affected by operator technique, environmental conditions, and the performance characteristics of the assay method. The goal is to differentiate between variability due to chance from that due to error.
39
central value or a central location There are several terms to describe that central location, or the central tendency of a set of data
40
41
Calculation of Mean
X +X +X (X ) =
1 2
... + X n
X = Mean X1 = First result X2 = Second result Xn = Last result in series n Total number of results
42
192 mg/dL 194 mg/dL 196 mg/dL 196 mg/dL 160 mg/dL 196 mg/dL
7. 200 mg/dL 8. 200 mg/dL 9. 202 mg/dL 10. 255 mg/dL 11. 204 mg/dL 12. 208 mg/dL 13. 212 mg/dL
43
Calculation of Mean
1) 192 mg/dL 2) 194 mg/dL 3) 196 mg/dL 4) 196 mg/dL 5) 196 mg/dL 6) 200 mg/dL 7) 200 mg/dL 8) 202 mg/dL 9) 204 mg/dL 10) 208 mg/dL 11) 212 mg/dL Sum = 2,200 mg/dL Mean = the calculated average of the values The sum of the values (X1 1 + X2 + X3 X11) divided 2 3 11 by the number (n) of observations The mean of these 11 observations is (2200 11) = 200 mg/dL
44
for each assay run Collect cutoff (CO) value for each run Calculate ratio of OD to CO (OD/CO) for each data point or observation This ratio standardizes data Use these ratio values to calculate the mean
45
Normal Distribution
All values are symmetrically distributed
around the mean Characteristic bell-shaped curve Assumed for all quality control statistics
46
Normal Distribution
Frequency
X
4.7
4.8
4.9
Mean
5.1
5.2
5.3
47
Normal Distribution
16 14 Mean 12 10 8 6 4 2 0 192 194 196 198 200 202 204 206 208 210 212
# o f O b s e rv a tio n s
48
indicative of the precision of the assay. The closeness of measurements to the true value is indicative of the accuracy of the assay. Quality Control is used to monitor both the precision and the accuracy of the assay in order to provide reliable results.
49
50
51
dispersion or variability of the data around the mean: Range Variance Standard Deviation Coefficient of Variation
52
Range
Range refers to the difference or spread
between the highest and lowest observations. It is the simplest measure of dispersion. It makes no assumption about the shape of the distribution or the central tendency of the data.
53
2) Calculation of Variance (S
(X X ) = mg 2 /dl 2 S = N 1
2 2
1
54
Calculation of Variance
Variance is a measure of variability about the
mean. It is calculated as the average squared deviation from the mean. the sum of the deviations from the mean, squared, divided by the number of observations (corrected for degrees of freedom)
55
Degrees of Freedom
Represents the number of independent
56
S=
(x x ) N 1
1
= mg/dl
variance
57
the variance it is the square root of the average squared deviation from the mean SD is commonly used (rather than the variance) since it has the same units as the mean and the original observations SD is the principle calculation used in the laboratory to measure dispersion of a group of values around a mean
58
X
Frequency 68.2% 95.5% 99.7%
-3s2s -1s Mean +1s +2s +3s
59
the limits of the acceptable range for a test When the QC measurement falls within that range, there is 95.5% confidence that the measurement is correct Only 4.5% of the time will a value fall outside of that range due to chance; more likely it will be due to error
60
variation (CV) is the standard deviation (SD) expressed as a percentage of the mean Ideally should be less than 5%
SD CV = x 100 mean
61
Monitoring QC Data
Monitoring QC Data
Use Levey-Jennings chart Plot control values each run, make decision
regarding acceptability of run Monitor over time to evaluate the precision and accuracy of repeated measurements Review charts at defined intervals, take necessary action, and document
63
Levey-Jennings Chart
A graphical method for displaying control
results and evaluating whether a procedure is in-control or out-of-control Control values are plotted versus time Lines are drawn from point to point to accent any trends, shifts, or random excursions
64
Levey-Jennings Chart
1 .2
-2 0 -2 0 -1 5 -1 5 -1 0 -1 0 -5
-5
-3SD -3SD
65
Record Time on X-Axis and the Control Values on Y-Axis Record Time on X-Axis and the Control Values on Y-Axis
115 110 105 100 95 90 85 80
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Plot Control Values for Each Run Plot Control Values for Each Run
Calculate the Mean and Standard Deviation; Calculate the Mean and Standard Deviation; Record the Mean and +/- 1,2 and 3 SD Control Limits Record the Mean and +/- 1,2 and 3 SD Control Limits
+3SD
Levey-Jennings Chart
115
100 Mean
-1SD -2SD -3SD
95 90 85 80
1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Day
68
Levey-Jennings Chart -
95 95 90 90 85 85 80 80 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Day
69
the mean (+/-2 SD) with little variation in the upward or downward direction Imprecision = large amount of scatter about the mean. Usually caused by errors in technique Inaccuracy = may see as a trend or a shift, usually caused by change in the testing process Random error = no pattern. Usually poor technique, malfunctioning equipment
70
71
should fall within 2SD Commonly applied when two levels of control are used Use in a sequential fashion
72
Westgard Rules
Multirule Quality Control Uses a combination of decision criteria or
73
Westgard Rules
74
warning rule One of two control results falls outside 2SD Alerts tech to possible problems Not cause for rejecting a run Must then evaluate the 13S rule
75
12S Rule = A warning to trigger careful inspection = A warning to trigger careful inspection 2S
of the control data of the control data
+3SD +2SD +1SD Mean -1SD -2SD -3SD
1 1
2 2
3 3
4 4
5 5
6 6
7 7
8 8
9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Day
76
of 3SD, rule is violated Run must be rejected If 13S not violated, check 22S
77
measurement exceeds the +3SD or -3SD control limit measurement exceeds the +3SD or -3SD control limit
+3SD +2SD +1SD Mean -1SD -2SD -3SD
13S Rule = Reject the run when a single control = Reject the run when a single control 3S
1 1
2 2
3 3
4 4
5 5
6 6
7 7
8 8
9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Day
78
level fall outside of 2SD in the same direction, or Both controls in the same run exceed 2SD Patient results cannot be reported Requires corrective action
79
22S Rule = Reject the run when 2 consecutive control = Reject the run when 2 consecutive control 2S
+3SD +2SD +1SD Mean -1SD -2SD -3SD
measurements exceed the same measurements exceed the same +2SD or -2SD control limit +2SD or -2SD control limit
1 1
2 2
3 3
4 4
5 5
6 6
7 7
8 8
9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Day
80
the other control exceeds the mean by +2SD The range between the two results will therefore exceed 4 SD Random error has occurred, test run must be rejected
81
measurement exceed the +2SD and the other measurement exceed the +2SD and the other exceeds the -2SD control limit exceeds the -2SD control limit
+3SD +2SD +1SD Mean -1SD -2SD -3SD
R4S Rule = Reject the run when 1 control = Reject the run when 1 control 4S
1 1
2 2
3 3
4 4
5 5
6 6
7 7
8 8
9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Day
82
control are outside 1SD, or Both levels of control have consecutive results that are outside 1SD
83
control are on one side of the mean, or Both levels of control have five consecutive results that are on the same side of the mean
84
10x Rule = Reject the run when 10 consecutive control = Reject the run when 10 consecutive control x
measurements fall on one side of the mean measurements fall on one side of the mean
+3SD +2SD +1SD Mean -1SD -2SD -3SD
Day
85
Westgard Multirule QC
86
Stop testing Identify and correct problem Repeat testing on patient samples and controls Do not report patient results until problem is solved and controls indicate proper performance
87
Policies and procedures for remedial action Troubleshooting Alternatives to run rejection
88
Summary
Why QC program?
89