AC7101.1 Rev G 2
AC7101.1 Rev G 2
AC7101.1 Rev G 2
G∆2
Issued 1993-05
161Thorn Hill Road
Warrendale, PA 15086-7527
AUDIT CRITERIA
Revised 28-JAN-2019
1. SCOPE
This Audit Criteria was developed by the Nadcap Materials Testing Laboratories Task Group
(MTLTG), for the evaluation of testing facilities for Nadcap Materials Testing Laboratories
Accreditation Program. While the criteria in this checklist may appear redundant with
ISO/IEC 17025 and/or 9100 audit criteria, the Task Group determined that its aerospace
auditors needed to assess compliance from the aerospace perspective. This Audit Criteria is
applicable to all laboratories. Supplemental checklists provide additional detailed criteria on
the specific test methods. Quality systems requirements for MTL Audits are covered in
Section 2 of this document.
The MTL Audit Handbook and the corresponding Handbook Supplements for each checklist
provide many details to ensure a successful audit experience. The Handbook and
Supplements should be used as companions to the Audit Criteria. The Handbook and
Supplements are located on www.eAuditNet.com under Resources → Documents → Audit
Criteria → Materials Testing Laboratories (AC7101/AC7006) → Handbooks & Guides.
Written customer requirements always take precedence over Nadcap audit criteria.
This section is for the use of auditors, as necessary, for notes during the audit. No NCRs will
be written against section 1.
Initial
SV1 – Reaccreditation
SV2 – Reaccreditation
PRI operating procedures provide that "This report is published by PRI to advance the state of technical, engineering, and quality
sciences. The use of this report is entirely voluntary, and its applicability and suitability for any particular use, including any patent
infringement arising there from, is the sole responsibility of the user."
PRI values your input. To provide feedback on this document, please contact the appropriate commodity staff engineer.
(Contact information is located at http://www.eauditnet.com under “Contact Us”.)
Copyright 2019 Performance Review Institute. All rights reserved.
t-frm-15 08-Oct-2019
Nadcap AC7101/1 Revision G∆2 - 2 -
Add Scope
Verification
Self/Internal Audit
AC7006
AC7101/1
AC7101/2
AC7101/3
AC7101/4
AC7101/5
AC7101/6
AC7101/7
AC7101/9
AC7101/11
AC7102/8
AC7109/5
AC7110/13
AC7110/13S
2. ACCREDITATION REQUIREMENTS
2.1.1.5 (INFO) The name and address of the facility matches that on the YES NO
certificate?
2.4 Self-Audit:
2.4.1 Did the Auditee upload a copy of their completed self-audit, and other YES NO
pre-audit documents as applicable, to eAuditNet at least 30 days prior
to the audit, utilizing the version of the checklist(s) applicable to this
audit?
2.4.2 For each question in the self-audit checklist, has the auditee identified YES NO
where the means of compliance or evidence of compliance may be
found. Evidence constitutes, for example, reference to a procedure,
checklist or the physical location of evidence.
Nadcap AC7101/1 Revision G∆2 - 5 -
2.4.3 Does the self-audit include Observation of Test as defined in OP 1114 YES NO
Appendix MTL?
The MTL TG requires documentation of at least one (1) Observation of
Test for each Test Code within the auditees’ scope of accreditation.
The self-audit shall include all audit criteria within the auditees’ scope
of accreditation.
2.6 INFORMATION FOR AUDITOR: A minimum of three job audits were YES NO
performed by the PRI auditor.
It is expected the PRI auditor will choose the Jobs to be included in the
review.
Note: Job Audits are not documented in the “Job Tracker” in eAuditNet.
2.6.1.4 Certificate and report unit conversions are in accordance with YES NO
documentation for the methods of data unit conversion, if applicable,
or different from test specification.
2.6.1.5 Certificate and report rounding methods are in accordance with YES NO
documentation for rounding method if not defined by / referenced by, or
different from test specification.
3. FACILITY (GENERAL)
3.1 Environmental conditions in the laboratory are in accordance with test YES NO
technical requirements such as to facilitate correct performance of the
tests and/or calibrations.
4.1 Procedures are used to ensure records are available within the YES NO
customer’s required time frame. If no requirement, a time frame shall
be defined by the laboratory.
4.2 A procedure is used to control records (technical data and test reports) YES NO
generated by the laboratory in compliance with customer requirements
including record retention policy.
4.3 Records (technical data) are maintained, traceable to each certification, YES NO
such that the laboratory could reproduce the test method or identify
incorrectly tested material.
4.5 Laboratory management defines responsibility for the review and YES NO
approval of test results, training and qualification of personnel, and
procedures.
5.1 The Q.A. function in the laboratory has stop-work/stop-ship authority. YES NO
5.4 The Q.A. function participates in the management (creation, revision, YES NO
implementation, etc.) of test procedures.
5.5 The Q.A. function has authority to require the implementation, YES NO
extension or modification of internal technical documents.
5.6 The Q.A. function oversees training and qualification of personnel. YES NO
6.4 Operators are trained to recognize proper operation of the equipment. YES NO
6.5 Operators are trained to recognize a properly executed analysis or test, YES NO
to distinguish between valid and invalid test data, and to justify
invalidating data.
7.3 Applicable quality assurance requirements specified in the contract are YES NO
transmitted to subcontractors.
8. PROCEDURE SYSTEM
8.1 Procedure(s) are used for calibration of all Measuring and Test YES NO
Equipment (M&TE) used for testing or producing results.
8.3 Procedures are used to ensure the use of ASTM E 29 for determination YES NO
of rounding conformance to specification requirements unless
otherwise stated in the certification or report.
8.4 Procedures define methods and test specifications used to perform YES NO NA
data unit of measure conversions.
8.5 Procedures are used to ensure all software programs and equipment YES NO NA
automation used to calculate results are validated, prior to initial use.
On legacy equipment a validation shall be defined in a lab procedure.
8.7 Procedures are used to ensure purchased equipment control software YES NO NA
has revision control and that only a validated revision is used for testing
and data analysis/compilation/reporting.
8.9 Procedures that are used for each test method reference the source of YES NO
the requirement. For example: specific industry standard(test
specification) or customer specification.
8.10 Procedures contain detail such that a test can be consistently YES NO
repeated.
8.11 Details required to reproduce non-standard tests are documented and YES NO NA
traceable to the test report/results.
9.1 Calibration
9.1.1 Calibration cycle extension: When calibration frequencies are changed, YES NO NA
procedures are used in accordance with NCSL (National Conference of
Standard Laboratories), recommended Practice 1, or other recognized
statistical review process to support the extended time interval. Any
calibration cycle extensions are in accordance with standard methods
or customer requirements.
9.1.2 Calibration: The laboratory uses a calibration schedule with frequencies YES NO
in accordance with manufacturers’ recommendations, AppendixF, or
the individual checklist requirements for all internal and external
calibrations performed on testing equipment. This schedule documents
duration between calibrations (frequency) and responsibility for
calibration (source).
9.1.3 Calibration: Procedures are used during calibration certificate review to YES NO
ensure the following:
•calibration certificates document the name and address of the agency
performing the calibration (if an external supplier is used).
• calibration suppliers approved by the laboratory’s quality
management system are used (if an external supplier is used).
•description(s) of equipment and operating range(s), including the
precision of the instrument, are documented on the calibration
certificate.
• primary standards or equipment are documented on the calibration
certificate and are traceable to a national standard.
• the calibration method is documented on the calibration certificate.
• the date of calibration is documented on the calibration certificate.
• the "as found" and "as left" conditions are documented on the
calibration certificate when the instrument was adjusted or repaired
during the course of calibration.
• the calibration personnel are documented on the calibration
certificate.
• the environmental conditions are documented on the calibration
certificate where required by standard/spec/customer.
9.1.4 Calibration: Calibration status is identified for each test machine or YES NO
associated laboratory equipment requiring calibration.
9.1.5 Calibration: Procedures are used to address the calibration and use of YES NO NA
“employee-owned” Measuring and Test Equipment (M&TE).
9.2 Maintenance
9.2.3 Maintenance: Procedures are used to identify equipment which is out YES NO
of service.
9.2.4 Maintenance: Procedures are used to assess the possible effect on YES NO
test values when maintenance is performed to address a malfunction of
calibrated equipment.
10.2 Transfer of work outside the laboratory for sub-contracted processes is YES NO
performed in accordance with procedures which ensure (1) traceability
of documents/records with test articles is maintained and (2)
verification that work performed was in accordance with purchase order
requirements.
11.1 Procedures are used to define and ensure retesting is performed in YES NO
accordance with material specification or customer requirements.
11.2 Procedures are used to ensure replacement tests are recorded and YES NO
cross-referenced with the original tests, including explanations where
applicable.
Note: Only a single replacement test is required in response to an
invalid test. See definitions in Audit Handbook.
11.3 Procedures are used to ensure records of invalid tests are reviewed YES NO
periodically for trends which could indicate test process deterioration.
The auditee shall define and document the period of review and what
constitutes a trend.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 11 -
11.4 Procedures are used to respond to defined criteria for test process YES NO
deterioration which required corrective action.
12.1 The certificate of test/test report meets the requirements of the YES NO NA
applicable test specification or/and customer requirements.
12.2 The certificate of test/test report includes the name and address of the YES NO
laboratory, and the location where the tests and/or calibrations were
executed, if different from the address of the laboratory.
12.3 The certificate of test/test report includes the name and address of the YES NO NA
customer.
12.4 The certificate of test/test report includes identification of the test article YES NO
and if provided identification and issue(s)/revision(s) of the material
specification(s) used for conformance disposition. (Example: Inco 718,
AMS5662 Rev H).
12.5 The certificate of test/test report identifies the testing specification or YES NO
procedure used, if not called out by the material specification. Non-
standard practices shall be documented.
12.6 The certificate of test/test report includes the numerical results of all YES NO
tests and inspections performed for which the material specification
establishes numerical requirements.
12.7 Test values on the certificate of test/test report are reported to the YES NO
number of digits according to the test method or material specification
resolution or other documented customer requirements. If there are
multiple requirements called out for comformance, the most stringent
resolution shall be reported.
12.8 The certificate of test/test report includes descriptions of the results YES NO NA
(e.g., conform/non-conform) of all tests for which the material
specification or customer specification/requirement does not establish
numerical requirements.
12.9 Any unusual observations are noted on the certificate of test/test report YES NO NA
(and identified as such, e.g. as “Observation”) in accordance with
customer requirement.
12.10 Test results for all specimens in the same set are included on the same YES NO
certificate of test/test report; that is, separate certificates of test/test
reports are not issued for conforming versus nonconforming material.
12.11 The certificate of test/test report includes appropriate description of test YES NO
specimens (quantity, form, and condition, etc), when applicable, and all
identification necessary to assure traceability of laboratory report to the
material supplier/customer records (e.g., sample number, heat
number, lot number, P.O. number).
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 12 -
12.12 The certificate of test/test report includes a statement that it shall not YES NO
be reproduced except in full without the written approval of the
laboratory.
12.13 The certificate of test/test report includes each page numbered "page YES NO
__ of__ ".
12.14 The certificate of test/test report includes unique identification traceable YES NO
to the laboratory identification system.
12.15 Procedures are used to address errors, corrections, and modifications YES NO
to certifications and test reports. Corrected or modified reports shall be
re-issued, and the lab shall have a method of identifying the change(s).
Manual/hand-written corrections to reports are not permitted.
12.16 The certificate of test/test report includes re-test values, and values YES NO
known to be nonconforming (i.e., when compared against mandatory
specification values), and they shall be clearly identified as such.
12.17 The certificate of test/test report includes documentation of all test YES NO
articles provided to the laboratory for testing. Example of test without
results: "Specimen 4A253: No Test - broke in grips”. Test values from
replaced specimens are not required to be reported.
12.18 The certificate of test/test report is traceable to the request to perform YES NO
work.
12.21 Computer generated certificates of test/test reports require either (a) YES NO
an actual or facsimile signature, or (b) a letter accompanying the
certificate, signed by the laboratory's representative attesting that the
laboratory is using a computerized system, the typed name on the
document is an authorized employee, and the laboratory is responsible
for the information it contains. If a laboratory uses computer-generated
certificates with an actual or facsimile signature, or typed name, the
system has security (password or other identity control) to ensure the
name on the document represents the individual who performed the
indicated function.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 13 -
12.23 Procedures are used to detect and correct transcription errors prior to YES NO
the release of the certificate/test report.
13.1.1 The internal round robin program meets the established requirements YES NO
as described in AC7101/1 Appendix D. If Gage R&R and/or SPC
and/or Calibration Method are used in lieu of IRR, these meet the
requirements as described in AC7101/1 Appendix D.
13.1.2 Internal round robin programs are in place to compare testing YES NO NA
equipment used for the same test/method, if required. (See AC7101/1
Appendix B for frequency and requirements). If Gage R&R and/or SPC
and/or Calibration Method are used in lieu of IRR, these meet the
requirements as described in AC7101/1 Appendix D.
13.1.3 Internal round robin programs are in place to compare testing YES NO NA
personnel performing the same test/method, if required. (See
AC7101/1 Appendix B for frequency and requirements). If Gage R&R
and/or SPC are used in lieu of IRR, these meet the requirements as
described in AC7101/1 Appendix D.
13.1.4 Participation in the internal round robin program meets the frequency YES NO
requirements for all test codes held by the laboratory as described in
AC7101/1 Appendix B. If Gage R&R and/or SPC and/or Calibration
Method are used in lieu of IRR, these meet the requirements as
described in AC7101/1 Appendix D.
13.1.5 Procedures are used to ensure participation in Internal Round Robin YES NO
Programs and/or Gage R&R and/or SPC and/or Calibration Method –
including analysis of the results against defined acceptance criteria.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 14 -
13.2.2 The laboratory used a Proficiency Testing provider in accordance with YES NO
AC7101/1 Appendix C.
13.3.1 Statistical analysis and correlation of the data are performed and YES NO
documented for both internal round robin testing (or Gage R&R, SPC
and/or Calibration when used in lieu of IRR) and proficiency testing, if
applicable. It is the host facility’s duty to provide a statistical
evaluation of the data in the final report, if applicable.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 15 -
A.1.2 Quality System Document: The laboratory has arrangements to ensure YES NO
that its management and personnel are free from any undue internal
and external commercial, financial, and other pressures and influences
that may adversely affect the quality of their work.
A.1.3 Quality System Document: The laboratory has policies and procedures YES NO
to avoid involvement in any activities that would diminish confidence in
its competence, impartiality, judgment or operational integrity.
A.1.4 Quality System Document: Written policy addressing errors in testing is YES NO
established through the Quality Systems Documentation.
A.1.5 Quality System Document: Procedures define the responsibility for YES NO
review and approval of test results, authorization of re-testing, and
preparation or approval of test procedures.
A.2 UNCERTAINTY
A.3.1 The laboratory is secure from unauthorized personnel. Access to and YES NO
use of areas affecting the quality of tests and/or calibrations shall be
controlled. The laboratory shall determine the extent of control based
on its particular circumstances.
A.4.1 Selection of Methods: When the customer does not specify the method YES NO
to be used, the laboratory shall select appropriate methods that have
been published either in international, regional, or national standards,
or by reputable technical organizations, or in relevant scientific texts or
journals, or as specified by the manufacturer of the equipment.
Laboratory-developed methods or methods adopted by the laboratory
may also be used if they are appropriate for the intended use and if
they are validated. The customer shall be informed as to the method
chosen. The laboratory shall confirm that it can properly operate
standard methods before introducing the tests and calibrations. If the
standard method changes, the confirmation shall be repeated.
A.4.2 Selection of Methods: The laboratory shall inform the customer when YES NO
the method proposed by the customer is considered inappropriate or
out of date.
A.5.1 When opinions and interpretations are included, the laboratory shall YES NO
document the basis upon which the opinions and interpretations have
been made. Opinions and interpretations shall be clearly marked as
such in a test report.
A.6 RECORDS
A.7.1 Procedures are used to control all test materials from the point of YES NO
entering the laboratory through the final disposition.
A.9 CALIBRATION
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 17 -
and segregated and controlled to prevent use for anything other than
calibration.
A.10 PROCEDURES
A.10.1 Procedures are used to ensure correct versions of the test procedures YES NO
are used at the time of testing and obsolete procedures/documents are
unavailable for use in testing.
A.10.2 Procedures are used for issue, change management, review and YES NO
approval of documents/procedures issued to personnel. Personnel
authorized for this activity are documented such that names and roles
and responsibilities are clear.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 18 -
¹Proficiency Testing programs to include all applicable alloy families (Ni, Co, Al, Ti, Fe, Cu and Mg) within 6 Years
Maximum .
²Proficiency Testing for the analysis of C, S, O, and N in Ni, Co, and Fe, in accordance with ASTM E1019, is considered a
single alloy family as the test method is the same.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 19 -
B.2.
Internal Round Internal Round
CODE TEST TYPE Robin Frequency Robin Frequency
for Operators for Equipment
AC7101/2 – Chemical Analysis¹
D Wet Chemistry Every 2 Years Every 2 Years
F Atomic Emission Spectroscopy
F1 Direct Current plasma (DCP) Every 2 Years Every 2 Years
Inductively Coupled Plasma
F2 Every 2 Years Every 2 Years
(ICP)
F3 Spark/Arc (OES) Every 2 Years Every 2 Years
F4 Glow Discharge (GD) Every 2 Years Every 2 Years
F5 High Temperature Hollow Cathode Every 2 Years Every 2 Years
G Combustion or Fusion
G1 Carbon Every 2 Years² Every 2 Years²
G2 Hydrogen Every 2 Years Every 2 Years
G3 Nitrogen Every 2 Years² Every 2 Years²
G4 Oxygen Every 2 Years² Every 2 Years²
G5 Sulfur Every 2 Years² Every 2 Years²
S X-Ray Fluorescence (XRF) Every 2 Years Every 2 Years
V Mass Spectroscopy Every 2 Years Every 2 Years
W Atomic Absorption
W1 Flame (AAS) Every 2 Years Every 2 Years
W2 Graphite Furnace (GFAA) Every 2 Years Every 2 Years
¹Internal Round Robin programs to include all applicable alloy families (Ni, Co, Al, Ti, Fe, Cu and Mg) within 6 Years
Maximum . Not applicable to C, S, O, and N.
²Internal Round Robin programs for the analysis of C, S, O, and N in Ni, Co, and Fe, in accordance with ASTM E1019, is
considered a single alloy family as the test method is the same.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 20 -
B.4.
Internal Round Internal Round
CODE TEST TYPE Robin Frequency Robin Frequency
for Operators for Equipment
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 21 -
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 22 -
B.6.
Internal Round Internal Round
CODE TEST TYPE Robin Frequency Robin Frequency
for Operators for Equipment
AC7101/5 – Hardness:
B.7.
CODE TEST TYPE Proficiency Testing Frequency
AC7101/5 – Hardness (Macro)
M1 Hardness (Brinell) Every 2 Years
M2 Hardness (Rockwell) Every 2 Years
M3 Hardness (Vickers) Every 2 Years
B.8.
Internal Round Internal Round
CODE TEST TYPE Robin Frequency Robin Frequency
for Operators for Equipment
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 23 -
¹For labs performing stress rupture PT on fasteners, time to fracture must be reported. A result of discontinued is not a
valid result to determine proficiency. Machined specimens may be used in lieu of fasteners under the same guidelines as
AC7101/3.
²Only one room temperature tensile PT is required. Separate participation is not required for axial or wedge.
³Yield, Reduction of Area, and percent Elongation required if reporting results required by customer is limited to ultimate
tensile strength for fasteners.
⁴If case depth utilized Microindentation hardness, separate PT for Microindentation hardness is not required.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 24 -
B.10.
Internal Round Internal Round
CODE TEST TYPE Robin Frequency Robin Frequency
for Operators for Equipment
AC7101/11 – Fastener Testing
15 Torque – Tension Every 2 Years Not Required
31 Torque – Locking, Torque-Out Every 2 Years Not Required
40L2 Metallography – Alloy Depletion Every 2 Years Not Required
40L3 Metallography – Oxidation / Corrosion Every 2 Years Not Required
40L7 Metallography – IGA / IGO Every 2 Years Not Required
Metallography –Alpha Case: Wrought
40L8 Every 2 Years Not Required
Titanium
Metallography – Decarburization /
40L10 Every 2 Years Not Required
Carburization
40L25 Metallography – Grain Size Every 2 Years Not Required
6-M2 Hardness – Rockwell Every 2 Years Every 2 Years
6-M3 Hardness – Vickers Every 2 Years Every 2 Years
6-L5 Hardness – Microindentation Hardness Every 2 Years⁴ Every 2 Years⁴
8-P Tensile Test – Proof Load (nuts / screws) Not Required Not Required
8-A Tensile Test – Axial Tensile Every 2 Years²³ Every 2 Years²³
8-W Tensile Test – Wedge Tensile Every 2 Years²³ Every 2 Years²³
18 Tensile Test – Elevated Temp.Tensile Every 2 Years² Every 2 Years²
10 Stress Rupture Every 2 Years¹ Every 2 Years¹
11 Fatigue Every 5 Years Not Required
13 Shear Strength – Double Shear Every 2 Years Every 2 Years
5 Stress Durability – External Threads Not Required Not Required
14 Stress Durability – Internal Threads Not Required Not Required
Q Corrosion – Salt Spray Not Required Not Required
QF Corrosion – Copper Sulfate Not Required Not Required
¹For labs performing IRR stress rupture tests on fasteners, time to fracture must be reported. A result of discontinued is
not a valid result to determine operator proficiency. If fastener specimens cannot be used for stress rupture IRR, then
machined specimens shall be utilized under the same guidelines as AC7101/3.
²If elevated temp tensile has been performed for IRR (and all operators are the same), equivalent room temperature
participation is not necessary.
³Yield, Reduction of Area, and percent Elongation not required if reporting results required by customer is limited to
ultimate tensile strength for fasteners.
⁴If case depth utilized Microindentation hardness, separate IRR for Microindentation hardness is not required.
AC7109/5 – Coating Evaluation Laboratory Practices: See AC7109/5 for PT/IRR requirements
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 25 -
Proficiency Testing is used to check the ability of a lab to perform a Test Method with a
defined protocol (common with other participating labs).
The statistical population shall contain a sufficient number of participants. Without this
requirement, there is an increased probability that the statistical methods used to compile
the report will be non-robust.
Nadcap specifies participation in PT for specific methods but not materials (with the
exception of chemistry where specific alloy analyses are required): whatever the material
chosen by the PT provider, if the capability of your equipment and/or specimen preparation
allows you to participate it shall be used, even if the specimen material or shape will not
exactly reflect your typical testing (mainly an issue for captive testing labs).
When not practical or feasible to use a provider from the PRI list of recognized providers
(found at www.eAuditNet.com, Resources → Documents → Public Documents → Task
Groups → Materials Testing Laboratories → Interlaboratory Proficiency Testing (IPT)
Information), three other options are available in this appendix.
Laboratories are responsible to ensure the provider they use conforms to the rules of this
appendix (listed below) at time of use.
Each Nadcap Subscriber specifies whether they require laboratories to go through Process
A or Process B when choosing PT providers. Which Subscribers require which Process is
given in the summary in Table C1. If the Subscriber is not listed, use Process A.
Process A (mandated by Airbus, MTU, Safran, Process B (Boeing, Eaton, Honeywell, Spirit,
Airbus Helicopter, Rolls Royce, Bombardier) Textron Aviation, Pratt and Whitney)
Carry out PTP using a recognized PTP provider as Any PTP program is OK, so long as rules laid down in
listed in Table C.2. or as updated on eAuditNet Appendix E are followed.
If this is not available, go to the following Options in
order of priority as detailed in Section C.2. above:
1. Option 1a: ISO 17043 (previously Guide 43)
accredited provider (e.g. delivered in audit
handbook or as updated on eAuditNet)
OR
Option 1b: ISO 17043 (previously Guide 43)
compliant (not accredited) provider following
8/10 of the “rules” listed in Appendix C Section
C.3.
2. Subscriber program
3. Supplier program with a plan to meet the
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 26 -
C.2.1. Process A:
Default: Carry out PTP using a recognised PTP provider as listed on eAuditNet or in Table
C.2. (in the Audit Handbook/Supplemental Guidance).
If the method to be tested is not available from a recognised PTP provider, use one of the
following options. Note that these are listed in order of priority. Option 1 shall be used if
available. If not, use Option 2. If Option 2 is not available, use Option 3.
Option 1 Option 1a: ISO 17043 (previously Guide 43) accredited provider (see Table C3 in the Audit
Handbook/Supplemental Guidance ).
Option 1b: ISO 17043 (previously Guide 43) compliant (not accredited) and following 8/10 of
the “rules” listed in Appendix C Section C.3.
The laboratory can participate in PT by other commercial providers if at least 8 of the “Rules
for acceptance of commercial proficiency testing providers” (listed in section C.3.) are
validated by the provider and verified by the laboratory.
The laboratory can use a Subscriber specific program only after PRI Staff Engineer and
Subscriber concur regarding confidentiality and method validation.
Option 3 Submit a plan to meet the intent of proficiency testing for Task Group approval. Supplier
shall retain an approved plan to meet this requirement. This supplier plan shall fulfill the
“rules” listed in Appendix C Section C.3.
C.2.2. Process B:
Unless specific Subscribers require otherwise, the Subscribers hold no preference for PT
provider, and any MTL approved (see Table C.2. or ISO 17043 (previously Guide 43)
accredited provider (see Table C.3.) is considered acceptable. (Table C.2. and C.3. located
in the Audit Handbook/Supplemental Guidance).
The Subscribers hold no preference for PT provider, and any MTL approved (see Table C.2.
and link below) or ISO 17043 (previously Guide 43) accredited provider (see Table C.3. in
audit Handbook and link below) is considered acceptable.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 27 -
TABLE C.2.: RECOGNIZED PROVIDERS OF PROFICIENCY TESTING PROGRAM at time of checklist publication
Analytical Reference Materials International, Inc. (ARMI) (LGC Chemical Analysis – Metal Alloys
STANDARDS)
Rocky Mountain Reference Materials, LLC Chemical Analysis – Metal Alloys
General: Any changes to the list will be posted on www.eAuditNet.com, Resources →Documents →Public Documents →
Task Groups → Materials Testing Laboratories → Interlaboratory Proficiency Testing (IPT) Information. Refer to eAuditNet
for contact information.
¹The PTP 5-year program guide provides additional visibility to the program so that labs can schedule their participation.
Some Nadcap Subscribers work directly with the host of the PTP and have input on proposed programs. If a common
need arises, a program can be developed. Subscribers are encouraged to provide feedback to the MTL Task Group PT
TAG by contacting the staff engineer so that interest in a specific new test method can be effectively collected. On
occasion, PTP does retain remaining material from previous programs, and these can be requested and performance
compared to existing statistics. Please contact the PTP provider directly.
ist of ISO 17043 (previously GUIDE 43) accredited PT providers at time of checklist publication are in the Audit Handbook.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 28 -
The *Full Process Provider, to be recognized by the MTLTG, shall be compliant with
Criterion 1 or Criterion 2
*Full Process Provider - A provider that supplies the sample in a condition to require
participating testing laboratory to utilize their entire process (e.g. sample preparation and
testing). (Not one that submits photographic sample for review only.)
Criterion 1: ISO 17043 (previously Guide 43) or ILAC G-13 Compliance and 3rd party
accreditation (such as ISO 9001, ISO/IEC 17025, and the scope of the accreditation
corresponding) and the following rules. OR
Criterion 2: ISO 17043 (previoulsy Guide 43) or ILAC G-13 Accreditation and the following
rules.
Rule 1 Materials and tests scope offered by the provider comply with our aeronautic requirements
(Standard used are listed in our referenced documentation).
Rule 2 Homogeneity study of material shall be explained and compliant with Rules 3 and 4:
Rule 3 20 specimens per sheet, tubes or batch is recommended for the homogeneity analyses.
Less than 10 specimens per sheet, tubes or batch analyses will not be accepted.
Rule 4 Risk analyses to exclude a participant because of an inhomogeneous material shall be less
than 5%.
Rule 5 The number of participants per test program shall be more than 30 to have a robust
statistical analyse (less than 10 not accepted (per ASTME2489)).
Rule 6 Time process between the beginning and the end of the program shall be less than 6
Months (Root cause analyses concern).
Rule 7 Time process between the final reporting of results and the data analysis report shall be less
than 3 months (Root cause analyses concern).
Rule 8 Numbers of specimens per test (sufficient number of specimens to ensure repeatability).
Rule 10 Report shall clearly state class identification of results and a graphical depiction of
population fit.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 29 -
D.0.1. INTENT
The aim of conducting internal round robins is to check the potential impact in variability
between equipment and/or operators on measurements for the same test code.
Intent is not to check the influence of the material, one material shall be chosen and be
homogenous to limit the impact on the statistics.
D.0.2. MEMBERSHIP
A coordinator of the Internal Round Robin program shall be assigned. It is the coordinator’s
responsibility to design the test method protocol, distribute testing materials, guide the
testing phase and construct a final report based on the data obtained.
D.0.3. PARTICIPANTS
All qualified operators or candidates for qualification must participate unless excluded in
Appendix B.
D.0.4. OPTIONS
Use one of the following options to fulfil the requirements for participation in an internal
round robin (IRR) program. There is no order of preference.
D.0.5. FREQUENCY
This option is best suited for captive labs with routine production testing. For independent
labs without routine measurements on consistent production material, it is recognized that
this option may be difficult to implement. One way to implement this for an independent lab
would be to obtain a sufficient number of samples from a homogenous material and
disperse these between regular lab jobs. This is particularly appropriate for testing which is
not destructive (hardness, some chemistry tests).
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 30 -
The SPC program shall be designed in such a way that operators are compared and
equipment is compared. Intervals at which data is to be analysed are to be defined by the
laboratory.
All equipment and operators shall be covered at least within the required time frame and for
chemistry, include all alloy families listed in appendix B.
The sampling frequency is determined by practical considerations, such as time and cost of
an observation, the process dynamics (how quickly the output responds to upsets), and
consequences of not reacting promptly to a process upset.
When using data from production material, compare operators or equipment using as similar
material as possible (e.g. same grade, same production route).The program shall be
designed using control charts and should be in accordance with one or more of the following
international standards:
Any of the ISO 7870 series of standards referenced in ISO 7870-1 Control charts: general
guidelines: It presents an overview of the basic principles and concepts and illustrates the
relationship among various control chart approaches to aid in the selection of the most
appropriate standard for given circumstances.
ISO 11462-1 Guidelines for implementation of statistical process control (SPC): it extends
the definition of process control to integrate the traditional definitions of statistical process
control, algorithmic process control, and model-based control methods. These are different
approaches with the same purpose of reducing variation in both products and processes.
ASTM E2587 Use of Control Charts in Statistical Process Control: it provides guidance for
the use of control charts in statistical process control programs, which improve process
quality through reducing variation and controlling the process to a target level or historical
average.
Note: The following standard may be used as guidance for statistical methods but is not
sufficient to design an SPC program on its own:
ISO 13528 Statistical methods for use in proficiency testing by interlaboratory
comparison: allowing guidance on statistical methods for analysing measurement.
Gage R&R is a robust statistical process used to establish repeatability and reproducibility
for operators and equipment, and is a good option for a large population.
A gage R&R study will tell operators if the measurement system is acceptable for its
intended use. The gage study also shows which part of the measurement system is
contributing the most to the variation of the measurements and helps operators/equipment
improvements to the system.
Measurement systems contain variation from three main sources: the products themselves
(taken into account by using homogeneous material), the operator taking the
measurements, and the equipment used to perform the measurement. The gage study
shows the contribution of each of these areas and checks whether the deviation generated
is acceptable.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 31 -
The Gage R&R Program should be designed in accordance with one or more of the
following international standards:
ASTM E 2782 Standard Guide for Measurement Systems Analysis (MSA): This guide
presents terminology, concepts, and selected methods and formulas useful for
measurement systems analysis.
D.3.1.1.A. Verified Material - Use a material that has been statistically evaluated with a known mean
value and standard deviation (Type 1) or a material accompanied with set upper and lower
limit values (Type II e.g. PTP material or standard hardness test block). Chemical reference
material upper and lower limits are defined by the laboratory’s process.
D.3.1.1.B. Unverified Material - Use a material with an unknown mean and sample standard deviation.
In this case, testing needs to be conducted to determine a reference distribution for the test
of interest (Type III).
D.3.1.1.1.A.b. For large volumes of material more tests may be necessary to adequately characterize
material variations present in the candidate stock. It is the labs responsibility to determine
adequate number of tests.
D.3.1.1.1.B.a. Conduct tests according to procedures that are used to fulfill the requirements set forth in
the test code of interest.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 32 -
D.3.1.1.1.C.b. To produce a robust data set, first perform an outlier test on test data. If an outlier is
identified, remove the test from the data set and run two (2) replacement tests. The
replacement test material should come from a location near the outlier sample’s original
location.
D.3.1.1.1.C.c. Calculate the mean (µ) and sample standard deviation (σ) on the robust test data set. So as
to define a reference distribution.
D.3.1.1.1.C.d. Establish the limits (fences) of the reference distribution by determining two (2) and three (3)
sample standard deviations values.
D.3.2.A. The allowed period for completion of the internal round robin will be two or five years
(defined by the calendar year) as listed under “frequency” in Appendix B. All Operators and
equipment must participate within the given timeframe.
The intention behind frequency of 2 or 5 years is to allow laboratories to share the cost and
equipment unavailability associated with round robin testing over multiple years, however if
the lab prefers to complete the round robin in less time than that available (e.g. all in year 1,
or spread over years 1, 3 and 5 for a five-year frequency), this is expressly permitted.
Examples of how to spread measurements over multiple years are given in the AC7101/1
Handbook Supplement.
D.3.2.B. Each subject piece of equipment or operator will perform a minimum of one (1) test.
D.3.2.C.a. If using a verified material with set upper and lower limit values (Type II), all values must fall
within the materials stated limits.
D.3.2.C.b. If using verified material with a known mean and standard deviation (Type I), establish the
limits (fences) of the reference distribution by determining two (2) and three (3) sample
standard deviations values. In this case proceed with qualification process described for
unverified material.
D.3.2.C.c. If using an unverified material for which a reference distribution has been determined,
qualification is established by comparing the test value to the reference sample standard
deviation limits (fences) according to the following conditions.
D.3.2.C.c.i. If the subject value falls within ± one (1) sample standard deviation, then the equipment or
operator is considered qualified.
D.3.2.C.c.ii. If the subject value falls within ± two (2) sample standard deviations but above ± one (1)
sample standard deviation (2s ≥ Value ≥ 1s) then a minimum of two (2) additional tests must
be run. If all three (3) tests are within two (2) sample standard deviation and the mean
absolute value of the Z Score of the variance (equation C) is within (1.6) sample standard
deviation, then the equipment or operator is considered qualified. If these conditions are not
met then the equipment or operator are considered non-qualified, the lab shall evaluate for
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 33 -
D.3.2.C.c.ii.1. To find mean absolute value of the Z Score of the variance, use the following equations:
D.3.2.C.c.iii. If the subject value falls outside of ± two (2) sample standard deviations then the equipment
or operator are considered non-qualified, the lab shall evaluate for possible causes of the
error.
D.3.2.C.c.iv. When equipment or operators are considered non-qualified, upon completion of the
laboratory evaluation the equipment or operators may be qualified by repeating the above
outlined procedure with satisfactory results.
D.3.3.A.a. This method is limited to equipment, (it would normally be applied to large numbers of
equipment).
D.3.3.A.a.ii. Based upon the equipment’s calibration results for the key characteristic or characteristics,
numerically order the calibration values (rank). Using the value ranked #1 as the “0%” and
the largest ranked value as “100%”, choose equipment at the 0%, 25%, 50%, 75%, and
100% levels. It is recognized that exact pieces of equipment may not be available and
alternative equipment within ± 5% of the level is acceptable.
D.3.3.B. Each subject piece of equipment will perform a minimum of three (3) tests.
D.3.3.C.a. If using a verified material with set upper and lower limit values, all values must fall within the
materials stated limits.
D.3.3.C.b. If using verified material with a known mean and standard deviation, establish the limits
(fences) of the reference distribution by determining two (2) and three (3) sample standard
deviations values. In this case proceed with qualification process described for unverified
material.
D.3.3.C.c. If using an unverified material for which a reference distribution has been determined,
qualification is established by comparing the test value to the reference sample standard
deviation limits (fences) according to the following conditions.
D.3.3.C.c.i. If all subject values fall within ± one (1) sample standard deviation, then the equipment is
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 34 -
considered qualified.
D.3.3.C.c.ii. If the subject value falls within ± two (2) sample standard deviations but above ± one (1)
sample standard deviation (2s ≥ Value ≥ 1s) then a minimum of two (2) additional tests must
be run. If all three (3) tests are within two (2) sample standard deviation and the mean
absolute value of the Z Score of the variance (equation C) is within (1.6) sample standard
deviation, then the equipment is considered qualified. If these conditions are not met then
the equipment is considered non-qualified, the lab shall evaluate for possible causes of the
error.
D.3.3.C.c.ii.1. To find mean absolute value of the Z Score of the variance use the following equations:
D.3.3.C.c.iii. If a subject value falls outside of ± two (2) sample standard deviations then the equipment is
considered non-qualified, the lab shall evaluate for possible causes of the error.
D.3.3.C.c.iv. When equipment is considered non-qualified, upon completion of the laboratory’s evaluation
the equipment may be qualified by following the above outlined procedure.
D.3.4.A. Data which has been generated during a qualification study that meets the above
qualification criteria may be combined with the original reference distribution population to
create a more robust reference distribution moving forward. (This may be done at the
discretion of the laboratory.)
D.3.5. Reporting
For IRR programs which last longer than one year, it is highly recommended that the
laboratory document results to date in an interim report at the end of each year.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 35 -
(A) Basic Design – The testing protocol should be designed such that the results obtained
from the chosen method can be classified easily to study the within – and between – facility
variability without the influence of secondary effects.
(B) Within facility variability, referred to as repeatability, concerns the variability between
independent testing results obtained within a single facility in the shortest practical period of
time by a single operator with a specific set of test apparatus using test specimens taken at
random from a single quantity of homogeneous material obtained or prepared for the study.
The single operator – single set of apparatus requirement means that given a particular step
in the measurement process, the same combination of operator and apparatus is used for
every test result (replicate) and on every material. Thus, one operator may prepare the test
specimens, a second operator measure the dimensions and a third operator may perform
the test.
(C) Timing Precision – “Shortest practical period of time” means that the test results, at least
for one material, are obtained in a time not less than in normal testing and not so long as to
permit significant changes in the test material, equipment or environment.
(D) Between facility variability, referred to as Reproducibility, deals with the variability
between single test results obtained in different facilities, each of which has applied the test
method to the test specimens taken at random from a single quantity of homogeneous
material obtained or prepared for the study.
(E) Data Classification – One form of classification suggested is a separate matrix table for
each property tested, in which the rows represent the facilities and the columns represent
the materials (or vice versa). Each cell, the intersection of a row with a column, contains the
test results made by a particular laboratory for a particular material. (For practicality reasons
regarding certain test methods, the terms material and property may be interchanged in this
paragraph).
(F) Test Method – The actual measurement process and the written description of the
process. A written draft of the test method shall be constructed that describes the test
procedure, identifies test conditions affecting the test results, and specifies the proper
degree of control of the test. The number of significant digits to be reported shall also be
designated and shall follow, as a minimum. The test method shall include any special
calibration procedure and the frequency of calibration required, if applicable.
(G) Global Instruction – The name, address, e-mail address, telephone and fax number of
the key person(s) coordinating and supervising the proficiency testing should be provided in
the protocol. The participating laboratories shall be instructed to contact the coordinator
when any questions arise as to the conduct of the proficiency testing.
(H) Test Identification – Clearly identify the test method, specifying any option(s) in
apparatus or procedure selected. Test units and test data sheets should be given for each
option.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 36 -
(I) Material Consistency – Each material selected shall be supplied by one source and made
to be as homogeneous as possible, prior to its subdivision into test specimens. The location
of every test specimen from the bulk material shall be traceable through a letter and/or
number designation indicated on each sample. In other words, a log or schematic of the
location referencing where each test specimen originated from the bulk material shall be
maintained. The samples shall be randomized before distribution and a record shall be
maintained of which facilities (EPT) or operators and equipment (IRR) are testing which
sample number(s).
(J) Calibration Procedures – Calibration procedures required before every test result should
be described in detail in the test method, if applicable.
(K) Specific Conditions Analyses – Characterize any special circumstances that must be
addressed in executing the repeatability conditions (e.g. the length of time between
obtaining the test results for the same material).
(L) Handling and Conditioning – Stipulate the required care, handling and conditioning of the
material(s) to be tested, if applicable. Describe the coding system used to identify the
material(s) to be tested.
(M) Host Facility Data Collection – The host laboratory or provider may provide data sheets
for recording the raw data as observed. Supply sheets on which test results can be
calculated or combined with the raw data sheet(s), if applicable. Request that all raw data be
sent as soon as the testing is completed, or at regular intervals for testing which extends
over several weeks.
(N) Data sheets should be provided so that each laboratory can record any special events
that arise during any phase of the testing. In addition to a ‘comments’ section, questions
pertinent to the test method may be asked to get a better idea of how the test was carried
out as long as the information is not proprietary. Any information that would ensure that the
laboratory complied with the requirements specified for the test method or that may be
needed to prepare for the final report should also be requested. The recorded comments will
serve as a valuable source of information both in handling outlying data and for improving
the test method for future proficiency testing. Obtain suggestions for future testing regarding
the test method and test materials.
(O) Replacement – The protocol must contain information about the availability of the
material(s) for replacement tests. It is recommended that the host laboratory prepare
enough of each material to supply 50% more than needed by the number of facilities
committed to the testing program. Instruct the facilities to notify the test coordinator
immediately whenever an error in test procedure occurs. It can then be determined whether
a new set of test specimens needs to be provided for a replacement test of the material(s).
(P) Final Report – A formal report shall be distributed by the host to all participants,
containing a description or summary of the test method, materials and the reported test
results from all participants, a summary of performance statistics and a description of the
statistical method used for the analysis of results. Testing sponsored by Nadcap-accredited
facilities should clearly state which Nadcap testing requirement(s) are met (e.g. This testing
fulfills Nadcap requirements for Stress Rupture in January of 2010). Participants shall be
identified by code to minimize the possibility of bias during data analysis. Each participant
shall be informed of its code assigned by the host to maintain confidentiality.
t-frm-15 04-Apr-2019
Nadcap AC7101/1 Revision G∆2 - 37 -
Micrometers/Verniers 6 Months
Oscilloscopes 1 Year
Note:Calibration cycles may be extended as defined by the NCSL (National Conference of Standards
Laboratories), Recommended Practice 1, or other recognized statistical review process to support the
extended time interval. Calibration frequencies defined by standard methods or supplier requirements
shall not be extended. Calibration extension shall be allowed only if documented historical data and
standard calibration practices substantiate the extension of calibration frequencies.
t-frm-15 04-Apr-2019