Data Integrity

Download as pdf or txt
Download as pdf or txt
You are on page 1of 71

Configuring Empower 3 for

Data Integrity and Regulatory Compliance

Arjan Timmerman

©2017 Waters Corporation COMPANY CONFIDENTIAL 1


Disclaimer

 This presentation is for informational purposes only and should not be


taken as advice regarding any particular course of action to be followed.
 Waters does not make any representations or warranties, express or
implied, to any party, regarding use of the information contained in this
presentation to make decisions regarding the implementation and
maintenance of effective quality control systems and quality assurance
testing programs, including but not limited to the applicable Good
Manufacturing Regulations that apply to the manufacture of regulated
products.

©2017 Waters Corporation COMPANY CONFIDENTIAL 2


Design your Process

 First …..design your ideal process


– Look at current User roles & responsibilities
– Look at current workflow processes
– Look for bottle necks 1
– Look at current calculations
o Eliminate non compliant spreadsheets 5 2
o Eliminate paper worksheets
o Eliminate hand calculations
 Ask for input from Users
 Use outside help to design a process
4 3
– Fresh pair of eyes
– Vendor support using previous experience in similar industry
– Employees with experience in previous employment

©2017 Waters Corporation COMPANY CONFIDENTIAL 3


Agenda – Empower Settings

 System Policies  Custom Calculations


 Default Strings (= Separate Demo)
 Roles and Responsibilities  Audit Trails
 User Privileges  Result Audit Viewer
 User Accounts  Electronic Signatures
 User Groups  Reporting
 Project Setup  Archiving & Securing Data
 Method Setup (= Separate Demo)

 Complete data

©2017 Waters Corporation COMPANY CONFIDENTIAL 4


Empower System Policies

 System Policies are labeled,


designating Waters recommendation
for policies that should be invoked for
– GxP_
– Electronic Records
– Electronic Signatures

 However it is the user interpretation


that is important!

©2017 Waters Corporation COMPANY CONFIDENTIAL 5


Empower System Policies

 System Policies are labeled,


designating Waters recommendation
for policies that should be invoked for
– GxP_
– Electronic Records
– Electronic Signatures

 However it is the user interpretation


that is important!

©2017 Waters Corporation COMPANY CONFIDENTIAL 6


Empower System Policies

 System Policies are labeled,


designating Waters recommendation
for policies that should be invoked for
– GxP_
– Electronic Records
– Electronic Signatures

 However it is the user interpretation


that is important!

©2017 Waters Corporation COMPANY CONFIDENTIAL 7


Empower System Policies

 System Policies are labeled,


designating Waters recommendation
for policies that should be invoked for
– GxP_
– Electronic Records
– Electronic Signatures

 However it is the user interpretation


that is important!

©2017 Waters Corporation COMPANY CONFIDENTIAL 8


Empower System Policies

 System Policies are labeled,


designating Waters recommendation
for policies that should be invoked for
– GxP_
– Electronic Records
– Electronic Signatures

 However it is the user interpretation


that is important!

©2017 Waters Corporation COMPANY CONFIDENTIAL 9


Empower System Policies

 System Policies are labeled,


designating Waters recommendation
for policies that should be invoked for
– GxP_
– Electronic Records
– Electronic Signatures

 However it is the user interpretation


that is important!

©2017 Waters Corporation COMPANY CONFIDENTIAL 10


Empower System Policies

 System Policies are labeled,


designating Waters recommendation
for policies that should be invoked for
– GxP_
– Electronic Records
– Electronic Signatures

 However it is the user interpretation


that is important!

©2017 Waters Corporation COMPANY CONFIDENTIAL 11


Default Strings

 Default Strings are key to using same comments and proper reasons WHY
 Reasons WHY for ~23 categories to be filled (2 categories are for Sign Off)

 It helps the user identify the reason WHY a change was proposed
 Reasons WHY are hard to write down!
– Remember the who, what and when is already capture by the system

©2017 Waters Corporation COMPANY CONFIDENTIAL 12


Roles / Responsibilities & Access
The process

System
Owner

Department
Analysts
Manager

Regulated
Company
Vendors /
Reviewers
Consultants

Quality IT

©2017 Waters Corporation COMPANY CONFIDENTIAL 13


Roles / Responsibilities & Access
User Types

 Use an overview
sheet to identify
the differences

©2017 Waters Corporation COMPANY CONFIDENTIAL 14


Roles / Responsibilities & Access
User Types

 Use an overview
sheet to identify
the differences

©2017 Waters Corporation COMPANY CONFIDENTIAL 15


Roles / Responsibilities & Access
User Types

 Use an overview
sheet to identify
the differences

©2017 Waters Corporation COMPANY CONFIDENTIAL 16


Roles / Responsibilities & Access
User Types

 Use an overview
sheet to identify
the differences

©2017 Waters Corporation COMPANY CONFIDENTIAL 17


Roles / Responsibilities & Access
User Groups

 Identify an additional level of


access and control to projects
and systems

©2017 Waters Corporation COMPANY CONFIDENTIAL 18


Roles / Responsibilities & Access
User Groups

 Identify an additional level of


access and control to projects
and systems

©2017 Waters Corporation COMPANY CONFIDENTIAL 19


Roles / Responsibilities & Access
User Groups

 Identify an additional level of


access and control to projects
and systems

©2017 Waters Corporation COMPANY CONFIDENTIAL 20


Roles / Responsibilities & Access
Unique User Accounts

©2017 Waters Corporation COMPANY CONFIDENTIAL 21


Project Management

 Empower Projects are folders used to organize chromatographic studies

 Establish Name Convention


– Customer Name, Site Name, Assay Name, Compound, System Name, Analyst
Name

 Determine how long an active Project will be available to receive new


samples
– Think also about the time for Processing and Reviewing the data after locking

 Decide what to do with inactive Projects

 Develop an archive schedule

©2017 Waters Corporation COMPANY CONFIDENTIAL 22


Key Questions when creating project structure

 What criteria is best to search for data?


– Examples are by date, lab, compound, batch, calculation type, project, shipment,
tanker, customer, lab book, analyst, system

 How many projects


– Monthly
– Quarterly
– Yearly

 How many samples would go into each project per month?

 Over what time period / which projects would you need to compare data –
stability projects ?

©2017 Waters Corporation COMPANY CONFIDENTIAL 23


Project Management & Access

 Use the Project Wizard to create new projects


– Based on a template project
– Based on previous months project
– Can only be created one by one

 Use the Clone project feature


– Copies project structure, methods and preferences
o Quicker and less room for error (what to select where)
– Can create multiple projects at once
– Need good templates
o Containing correct structure and methods with correct naming strategy

©2017 Waters Corporation COMPANY CONFIDENTIAL 24


Project Management & Access

©2017 Waters Corporation COMPANY CONFIDENTIAL 25


Project Management & Access

©2017 Waters Corporation COMPANY CONFIDENTIAL 26


Project Management & Access

 The privilege to lock and unlock channels are separate so control of when
results are reprocessed can be controlled.
 Different locks are possible

©2017 Waters Corporation COMPANY CONFIDENTIAL 27


Relationship
User – Group – Type – Project – System – Node

 Access Rights Explained


More than one User Type may - Management
be given to a User - Methods
- Data Acquisition

Contain
User Types Privileges

Are assigned to

Projects
Access to
Users as owner Systems

Nodes
Are part of

Access to
User Groups as users own type

More than one User may have access


to Project / System / Node.
User Groups may have Group Admin
©2017 Waters Corporation COMPANY CONFIDENTIAL 28
Methods

 Make sure the privileges for creating, adjusting and copying methods is set
properly

©2017 Waters Corporation COMPANY CONFIDENTIAL 29


All the data….. Is it complete?
Multiple Analysis

Data is
Result(3)
Result Reported
Sets
Sample Result(2)
Project A Set
Result Set Result(1)

 A well defined SOP for processing will help, but does that project show all
the data?
Data is not
Initial reported or
Project B Sample Set Result Set Result(1)
addressed

 Technical controls (project access and project/method creation) are


important
©2017 Waters Corporation COMPANY CONFIDENTIAL 30
All the data….. Is it complete?
Re-Analysis

Sample Set Result Sets Result(1)

Repeat
Result Sets Result(1)
Sample Set

 Outlining the process in an SOP can provide a clear UNDERSTANDING


for users, reviewers, and auditors WHY multiple analysis may be required
and HOW to document that process

©2017 Waters Corporation COMPANY CONFIDENTIAL 31


All the data….. Is it complete?
Multiple Processing

Result Set Result(1)

Sample Set
Result(2)
Result Set
Result(3)

 Outlining the process in a SOP provides a clear UNDERSTANDING for


users, reviewers, and auditor

 Data review is more effective with an outlined process and determine if there
is a problem
©2017 Waters Corporation COMPANY CONFIDENTIAL 32
Acquiring Samples SOP

 Test Injections: System Readiness checks


– Define ‘WHAT’ they are:
o Never Samples
o Possibly a standard
o An independent solution which mimics real samples

– Define ‘HOW’ they will be used:


o Never delete them
o How is it assessed visual check, calculations performed, reported or not
o How do you proceed when it doesn’t meet the criteria

– Define ‘WHEN’ they will be performed:


o Every run, when runs are not successive
o As part of the sample set, as individual injections

 System Suitability: As part of the Sample Set/Result Set


– If System Suitability fails… or “just” passes define the next steps
o should you continue the run, repeat from the beginning with justification

©2017 Waters Corporation COMPANY CONFIDENTIAL 33


Existence of Multiple Results / Channel

 FDA are being trained that multiple results indicate that users are trying to
reintegrate into acceptance.
 However, this conclusion can only be confirmed by looking at the actual
integration for each iteration
– Good documentation of “why” you reprocessed is essential
– Getting it right first time, all the time, is unrealistic
o If it data looks too good, it probably is

 Review of audit trails and all result versions are advised

 What is the “right” integration?


– SOPs and training should define this for each method

©2017 Waters Corporation COMPANY CONFIDENTIAL 34


Which Integration is better?

1.249
1.249
0.05 0.05

2.132
2.132
0.04 0.04

0.03 0.03

AU
AU

0.02 0.02

0.01 0.01

0.00 0.00

0.5 1.0 1.5 2.0 2.5 0.5 1.0 1.5 2.0 2.5
Minutes Minutes

©2017 Waters Corporation COMPANY CONFIDENTIAL 35


Which Integration is better?

1.249
1.249
0.05 0.05

2.132
2.132
0.04 0.04

0.03 0.03
Good Not Good

AU
AU

0.02 Integration 0.02 Integration

0.01 0.01

0.00 0.00

0.5 1.0 1.5 2.0 2.5 0.5 1.0 1.5 2.0 2.5
Minutes Minutes

©2017 Waters Corporation COMPANY CONFIDENTIAL 36


Which Integration is better?
Pass Fail

1.249
1.249
0.05 0.05

2.132
2.132
0.04 0.04

0.03 0.03
Good Not Good

AU
AU

0.02 Integration 0.02 Integration

0.01 0.01

0.00 0.00

0.5 1.0 1.5 2.0 2.5 0.5 1.0 1.5 2.0 2.5
Minutes Minutes

©2017 Waters Corporation COMPANY CONFIDENTIAL 37


Which Integration is better?
Pass Fail

1.249
1.249
0.05 0.05

2.132
2.132
0.04 0.04

0.03 0.03
Good Not Good

AU
AU

0.02 Integration 0.02 Integration

0.01 0.01

0.00 0.00

0.5 1.0 1.5 2.0 2.5 0.5 1.0 1.5 2.0 2.5
Minutes Minutes

Manual Processing Method

©2017 Waters Corporation COMPANY CONFIDENTIAL 38


Which Integration is better?
Fail Pass

1.249
1.249
0.05 0.05

2.132
2.132
0.04 0.04

0.03 0.03
Good Not Good

AU
AU

0.02 Integration 0.02 Integration

0.01 0.01

0.00 0.00

0.5 1.0 1.5 2.0 2.5 0.5 1.0 1.5 2.0 2.5
Minutes Minutes

Manual Processing Method

©2017 Waters Corporation COMPANY CONFIDENTIAL 39


Which Integration is better?
Fail Pass

1.249
1.249
0.05 0.05

2.132
2.132
0.04 0.04

0.03 0.03
Good Not Good

AU
AU

0.02 Integration 0.02 Integration

0.01 0.01

0.00 0.00

0.5 1.0 1.5 2.0 2.5 0.5 1.0 1.5 2.0 2.5
Minutes Minutes

Manual Processing Method

Manual integration isn’t always bad


Automated processing methods could easily be used
to manipulate integration
©2017 Waters Corporation COMPANY CONFIDENTIAL 40
Which Integration is better?
Pass Fail

1.249
1.249
0.05 0.05

2.132
2.132
0.04 0.04

0.03 0.03
Good Not Good

AU
AU

0.02 Integration 0.02 Integration

0.01 0.01

0.00 0.00

0.5 1.0 1.5 2.0 2.5 0.5 1.0 1.5 2.0 2.5
Minutes Minutes

Manual Processing Method

©2017 Waters Corporation COMPANY CONFIDENTIAL 41


Data Review SOP suggestions

 Should be performed on ELECTRONIC data in the application at least at


Peer Review level
– Not relying on paper / PDF or Empower reports entirely
 Define a Process
 Look at final results (summaries, averages, CofA)
– Work back through the data from final quantitation, to areas and integration to
Sample Set meta data to audit trails
 Specifically focus on suspect data
– Define a list of warning signs..
o Manual integration / multiple results / metadata changes
o Results that only just meet specification

©2017 Waters Corporation COMPANY CONFIDENTIAL 42


Custom Fields

 Build in functionality – 6 Fields, 6 Data Types


 Separate Demo on this

©2017 Waters Corporation COMPANY CONFIDENTIAL 43


The Automated Process
Chromatography to Calculations

©2017 Waters Corporation COMPANY CONFIDENTIAL 44


The Automated Process
Chromatography to Calculations

©2017 Waters Corporation COMPANY CONFIDENTIAL 45


Automated Calculations....
Dissolution

Integrity of your HPLC


dissolution testing
% Dissolved automatically
Combined
calculated software
Accounts for and
hardware
transfer solution
volume, replace OR
media etc
Q Factors assessed
SOFTWARE ALONE for
For online and offline Dissolution
calculations

©2017 Waters Corporation COMPANY CONFIDENTIAL 46


Automated Calculations....
Dissolution

Integrity of your HPLC


dissolution testing
% Dissolved automatically
Combined
calculated software
Accounts for and
hardware
transfer solution
volume, replace OR
media etc
Q Factors assessed
SOFTWARE ALONE for
For online and offline Dissolution
calculations

©2017 Waters Corporation COMPANY CONFIDENTIAL 47


Audit Trail

 Project Audit Trail


– Gives overview of all changes in a project
– Includes details of method / data deletion

 System Audit Trail


– shows changes to system objects and system policies
– details archive activity
– notes all changes to security (users, user types etc)
– documents all successful and unsuccessful logins
o you have a history of who was logged into the application at any time
o you have information about system break in attempts
o includes the client the login/login attempt occurred at

©2017 Waters Corporation COMPANY CONFIDENTIAL 48


Audit Trail – Project Set Up

©2017 Waters Corporation COMPANY CONFIDENTIAL 49


Reviewing Audit Trails – Why ?

 Why?
– To uncover possible cases of fraudulent behaviour
o Multiple processing data
o Altering metadata to make results pass
o Hiding or altering meta data on reports sent to QA
o Uncovering persistent suspicious behaviour around security of data
o Ensuring only authorised users have access to certain functionality
o Deletion of data
o Altering system policies /configuration / settings without change control
procedures

©2017 Waters Corporation COMPANY CONFIDENTIAL 50


Reviewing Audit Trails – How ?

 Review audit trails as part of data review SOP


– Find anomalies before batch release
– Focus of user behaviour that affect results
– Peer Review / Manager review / QA review?

 Periodic Review of overall Audit trails as separate SOP


– Looking for system level activity without correct documentation, change control,
testing or approval
o E.g. changing system policies, user access or deletion of data

 Biggest issue: Audit trails generally may often be more a log of all activity
(to comply) and are not always designed for easy review
– But it is expected that inspectors will look at the audit trails
– Adding Audit trails to reports is not practical or sufficient

©2017 Waters Corporation COMPANY CONFIDENTIAL 51


Empower Review Tool

©2017 Waters Corporation COMPANY CONFIDENTIAL 52


Audit Trail summary

System Project Result Signed off


Methods
Level level Sets Reports
Sample Set
System Audit Summary level Summary of
•History Chromatograms
Trail audit trail Results
•Compare
•Sample History

Archived
Calibration Created by
System Audit Instrument Curves Empower
Trail
•Audit trail
•Compare
•Acquisition Log
Individual Verify against
results e-data
Processing
•Audit trail
•Compare
What was
Manual results
approved

Display links in
All calculated
Review and peak values
Result Audit Viewer

©2017 Waters Corporation COMPANY CONFIDENTIAL 53


Audit Trail summary

System Project Result Signed off


Methods
Level level Sets Reports
Sample Set
System Audit Summary level Summary of
•History Chromatograms
Trail audit trail Results
•Compare
•Sample History

Archived
Calibration Created by
System Audit Instrument Curves Empower
Trail
•Audit trail
•Compare
•Acquisition Log
Individual Verify against
results e-data
Processing
•Audit trail
•Compare
What was
Manual results
approved
Display links in
Using View
As…. All calculated
peak values

©2017 Waters Corporation COMPANY CONFIDENTIAL 54


Audit Trail - Reviewing

 Audit trails tell us WHO did WHAT, WHEN and WHY (when defined by
the user comments)
 They have two primary purposes:
– Give a history to the data, to help decide if it can be trusted
– They should deter wrongdoing
o Without review, they are not a deterrent

 Review audit trails as part of data review process


– Find anomalies before batch release
– Focus on user behaviour that affect results
– Peer Review / Manager Review / QA Review
 Periodic Review of overall/system level audit trails
– Review system level activity
• Changes to system policies, user access, deletion of data
©2017 Waters Corporation COMPANY CONFIDENTIAL 55
Result Audit Viewer Tool

©2017 Waters Corporation COMPANY CONFIDENTIAL 56


Result Audit Viewer Tool

©2017 Waters Corporation COMPANY CONFIDENTIAL 57


Result Audit Viewer Tool

One Stop Solution:

• Project Audit Trails


• Method History and Differences
• Sample History
• Sample Set History
• Acquisition Log
• Injection Log

©2017 Waters Corporation COMPANY CONFIDENTIAL 58


Electronic Signatures in Empower

 Applied to Reports to mimic the paper based process


 SOP defined meaning for Sign Off 1 & Sign Off 2
 Set appropriate system policies
– Designed based on regulatory requirements & customer feedback

©2017 Waters Corporation COMPANY CONFIDENTIAL 59


Reports

 Make sure the privileges for creating and adjusting Reports is set properly
 Having everybody creating reports...
– What is shown on the report?
– Do you rely on these results?
– Are you using electronic signatures?
– Do you need to insert audit trails?

S02 = Problem calculating baseline noise, not enough baseline.

©2017 Waters Corporation COMPANY CONFIDENTIAL 61


Do you archive your Empower Data?

For now, only Questions!


But separate demo later.

©2017 Waters Corporation COMPANY CONFIDENTIAL 62


Do you Archive your Empower data?

 There is a difference between Backup and Archive!


– And you need to have both

 Backup might be arranged by IT department


– Do you regularly check your backups for recovery?
– Do you have a disaster recovery plan?
– Is this process validated?
– Is your backup taking a long time?

 Guidance on Backup
– EU and PIC/S Annex 11 describe in: Section 7 Data Storage
– MHRA guidance describes: in Data Retention section, Backup
– FDA guidance describes: in Question 1 (a)
– WHO guidance describes: in Annex 5 Retention of Original Records
©2017 Waters Corporation COMPANY CONFIDENTIAL 63
Do you Archive your Empower data?

 What about Archive?


– Do you Archive the Empower Data? And System Audit trail?
– How? Who? When? Where (location)?
– Is this process audit trailed?
– Do you keep indexes?
– If so, do you check restore when you upgrade the software?
– Do you delete your data when needed (data retention)?
– Is all described in your SOP’s?

 Guidance on Archive
– EU and PIC/S Annex 11 describe in: Section 17 Archiving
– MHRA guidance describes: in Data Retention section, Archive
– FDA guidance describes: in Question 1 (a), a bit cryptic
– WHO guidance describes: in Annex 5 Retention of Original Records

©2017 Waters Corporation COMPANY CONFIDENTIAL www.waters.com/waters/library.htm?cid=511436&lid=134872580 64


Empower 3
Compliance for an FDA audit

 Inspectors want to see that you have implemented the controls that
Empower provides for you
– Unique Usernames for audit trails
– Default strings for reasons WHY you change objects
– Password expiry and history
– Limited access to delete objects in the database
– Audit Trail review
 Outside Empower procedures are as important
– Training
– Daily Backup of data & Long Term Archiving
– SOPs for Acquisition, Review, Reporting etc.
 Validation of the entire system, including software to demonstrate
“ fit for intended use” based on a clear URS is a key aspect
– Including a clear Change Control procedure

©2017 Waters Corporation COMPANY CONFIDENTIAL 65


Summary
DO review data and audit trails
DO perform and record training
DO use a change control process
DO create Standard Operating Procedures
DO select compliance-ready systems
DO train users and prepare your response for
multiple analyses
multiple results
review of ALL data including Audit Trails

DON’T share accounts or passwords


DON’T provide delete privileges to users
DON’T disable the audit trails
DON’T hide or exclude data
DON’T forget to backup your data

©2017 Waters Corporation COMPANY CONFIDENTIAL 66


Comment Library for the Empower Default Strings
These are examples (Check if they apply to you)
All Methods

for initial creation

for switching back to a previous version of saved method

for use in other project

Component Names

RRT x.yz

Product 1 (remark: this can be a real product name)

Product 2 (remark: this can be a real product name)

Product 3 (remark: this can be a real product name)

Product 4 (remark: this can be a real product name)

Custom Fields

for initial creation

for wrong formula used

for change in translation definition

Deletion Comments (remember, deletion is a privilege…)

for deletion after archiving

for deletion after incorrect creation

Instrument Methods

for adjusting after method change

for incorrect creation of method


Manual Results

for correct integration of peak

for correct identification of peak

for addition of peak

for removal of peak

Method Sets

for adjusting after method change

for incorrect creation of method

Plot Scaling

for correct scaling to show in the report

Processing Methods

for restricting access after review, to prevent user intervention

for shifting retention times of components

for setting correct integration parameters

for addition of unknown components

for adjusting after processing method change

for incorrect creation of method

for addition of information after custom field change

for initial creation according to analytical instruction

for addition of unknown component after integration

for typo in component name


Projects

for initial creation

for setting correct access

for correct project settings

for typo in project name

for additional tablespace to process data

Reporting Methods

for showing correct report information

for adjusting to correctly report the data

Result Signoff 1 Meanings

Submitted: Data ready for Review

Reviewed: Data rejected for Incompleteness *

Reviewed: Data rejected for none optimized integration *

Reviewed: Data is ready for Approval *

(* legitimate reason to go to Sign Off 2)

Result Signoff 2 Meanings

Approved: Data rejected because of Sign Off 1 rejection

Approved: Data rejected for Incompleteness

Approved: Data rejected for none optimized integration

Approved: Data is Approved

Results

for initial saving of the results

for saving results with correct settings


Sample Acquisition

for initial injection of the samples

for injection of the pre-condition injection(s)

Sample Information

for initial creation

for correction of the sample information

for wrongly introduced values

Sample Set Methods

for adjusting samples settings in the sample set method

for adjusting information in the sample set method setting

Sample Set (SS) Method Templates

for adjusting sample settings in the sample set method template

for adjusting information the sample set method template

System Audit Trails

for deletion after archiving (following SOP xyz)

System Policies

for adjusting the policies (following SOP xyz)

for adjusting the policies (following Change Control xyz)

Systems

for initial creation

for addition of modules

for removal after decommissioning

User Groups

for initial creation

for correct access of users in the groups


User Types

for initial creation

for adjustment after change (following Change Control xyz)

Users

for initial creation

for change of full name of user

for re-activation after password lock

for removal, user left department

for removal, incorrect username

You might also like