Peter Jenks, Paul Boother, Annette Marshall
The proper validation of an analytical instrument is a topic that has long concerned me. Laboratories accredited to ISO/IEC 17025 put much effort into validating a method, but the starting point is that the analytical system is working properly because it has been calibrated using a CRM.
In the GMP world of the pharmaceutical industry Instrument Qualification is part of the quality culture. Machines are checked, in some cases on a time basis, in other cases if anything at all has been changed, such as a column or pump part.
ISO/IEC 17025 is presently under revision and it seems that one of the changes will be to introduce a requirement for instrument qualification, in addition to method validation.
In exploring the differences between the ISO 17025 world and the GMP word, at least as far as this subject is concerned, I talked at length with Paul Boother, Operations Manager at Jaytee Biosciences Ltd. Jaytee know quite a lot about instrument validation. Paul and his colleague Annette Marshall put together a poster with me that was presented at the BERM 14 Conference held in October 2015 in the USA. I’ll be putting together a report on the Conference shortly and posting it on the Spectroscopy Europe Web Site.
Back to Instrument Qualification
It is now accepted universally, at least by readers of this column, that reliable analytical measurement underpins the chemical industry; whether in pharmaceutical manufacture, food safety or paint composition, the need to ensure product quality and safety is paramount.
Irrespective of the use of a Quality Standard, such as GMP or ISO 17025, failure to ensure valid analytical results can have massive impacts on an organisation and its reputation for product quality.
So reliable measurement is the basis for all analytical techniques. As mentioned above, analysts spend a vast amount of time validating methods, running system suitability tests and performing QC and PT checks in order to demonstrate the validity of their results. All this work is based on the rationale that the instrument must be working correctly because all of the calibration, validation and QC checks have been done.
But what if the instrument itself was slightly faulty?
The truth is that many methods are developed within ISO/IEC Accredited Laboratories using an instrument or instrument system which has never been qualified as working correctly since the time it was first installed in the laboratory, perhaps 5 years ago. Yes, a service engineer comes in once a year, but most service contracts only include a cursory check by the engineer after the annual service, not a full qualification against specification.
It is worth comparing the requirements of ISO/IEC 17025 and GMP
The Pharmaceutical industry requires a regime of regular instrument qualification this combined with change control ensures that the equipment is “fit for purpose”. But ISO/IEC 17025 (2005) only requires the equipment is checked or calibrated before use. The fundamental difference is “fitness for purpose”.
How can this be proven? Let’s take a specific example. A well proven HPLC system suffers a pump failure and the pump is replaced. At the same time a new column is fitted. So how can the user be sure that the instrument is still working, not just properly, but as it was previously? Any change in instrument performance may well bias the validated method running on the instrument.
This flow diagram makes it clear that the procedure isn’t quick, or simple.
Another, common situation is that ongoing QA results are out of specification, typically the results have drifted outside the acceptable +/-2SD range. It is all too easy to assume the problem is a standard, a reagent of the column when it may be something more fundamental. How can this be checked?
This flow diagram make things clear:
A machine that is working out of specification will frequently bias, in a reproducible way, a result. This figure makes it clear.
The graph demonstrates the impact of an unqualified instrument on the reported impurity level in a product: a simple wavelength fault is causing an impurity to be reported at a level far lower that the true amount. Wavelength faults will allow a standard to be quantified but because of the fault the standard has not been quantified at maximum absorbance sensitivity is reduced. The result is that an impurity is not reported. Normal downstream rarely detects subtle errors of this type.
The risk is that data will be generated, but is not of usable quality. In USP Monograph <1058>,on Analytical Instrument Qualification the concept of a Data Quality Triangle (DQT) is introduced.
The DQT clearly shows that Instrument Qualification is the foundation for all analytical data, as in all “triangle” models the lowest layer must be complete before the next layer is started.
Yet ISO/IEC 17025- 2005 requires all methods should be suitable and validated without demanding Instrument Qualification. So when ISO 17025 is implemented in the context of cGMP regulations all equipment MUST undergo a regular Performance Qualification (PQ). But outside the cGMP arena no such PQ is mandated.
Instrument qualification should always be based on the intended use of the instrument or “purpose”. This is part of the design qualification phase, which should be (but usually isn’t) carried prior to the installation of the equipment.
Defining the purpose is vital for instrument qualification; there are countless examples of attempts to develop methods which exceed the capability if the instrument. One such example is expecting repeatability of less than 1% when the 15 year old instrument is only capable of less than 2%.
The term “not fit for purpose” is frequently used in laboratories the world over. This expression usually means is that it has not performed as the analyst expected. The questions that should reasonably be asked are how was the purpose defined and how has that been assessed?
Once the purpose has been established the Installation Qualification (IQ) phase should be conducted followed by the Operational Qualification (OQ) phase. IQ is where the non- variable requirements of the “purpose” are reviewed; for example has the instrument got the desired sample capacity? The OQ phase demonstrates that the instrument will operate as expected; e.g. no errors appear when the instrument is turned on.
Upon completion of the IQ/OQ phase the Performance Qualification (PQ) phase begins. This is where the instrument is qualified to ensure that it meets the requirements of the analysis being carried out in the laboratory. i.e. running a CRM with certified wavelengths to prove that the instrument’s wavelength is sufficiently accurate for the analysis that will be conducted.
The benefit of using a CRM is that it provides instant traceability to the laboratory.
There are three basic rules:
- Qualification should always be based on simplicity!
- If complex chemistry is used to validate a complex instrumentation then any failure could be due to multiple factors and the true cause hidden….!
- By simplifying the chemistry within the qualification process it is easy to see which failures are due to the instrumentation and which are from the method.
Unfortunately there are relatively few CRMs designed to qualify instruments, many Laboratory Managers see no need and produce their own, after all they are simple solutions, or are they? No, they are not. In increasingly accreditation auditors look to see that in house CRMs are produced so that they generally achieve the same quality level as a commercially produced CRM. Following ISO Guide 34, which is the “standard” for the production of CRMs, is complex and labour intensive as the list below makes clear.
- Chemicals and solvents required and validated
- Methods to be developed
- ISO Guide 34 Quality System to be maintained
- Homogeneity to be assessed
- Stability to be assessed
- Traceable links to international standards or NMI’s to be established
- Equipment require to verify correct preparation
- Review by Quality inspectors
As well as the time spent producing a CRM the opportunity cost cannot be ignored. Essentially it is the value of the work that could have been done, and charged out by staff instead of preparing the “simple standard?”
My advice is that unless a CRM isn’t available then buy one! There are a number of reputable and fully accredited UK and European suppliers.
 Guidance for Industry, investigating Out-of-Specification (OOS) test results for Pharmaceutical Production – U.S. Department of Health and Human Services Food and Drug Administration Center for Drug Evaluation and Research, October 2006
 EN ISO/IEC 17025:2005
 USP 38, NF 33 <1058> Analytical Instrument Qualification
Authors: Paul Boother & Annette Marshall can be contacted at www.jaytee.com