Yvonne Moores , Executive Vice President, Operations, Quanticate Ltd. 03.06.15
Patient safety narratives are a key element in clinical study reporting, and are required for all phases of clinical studies, whether these trials are conducted in healthy volunteers or in patients with the disease or condition that is being studied. This article reviews requirements for drafting, reviewing and tracking these narratives, and offers best practices for improving overall efficiency and compliance, particularly when the narratives are outsourced to a clinical research organization (CRO).
ICH Guidance on Clinical Study Reports
A patient safety narrative should provide a full and clinically relevant, chronological account of the progression of an event experienced during or immediately following a clinical study.
As Per ICH E3 guidelines, a patient safety narrative should describe:
Such narratives are required for describing each clinically significant adverse event, and certainly any serious adverse event or events that led to patient death.
Format and Location for Narratives
Guidance is less specific on where to place and how to format the narratives. Depending on the total number of narratives required, they can be placed either in the text of the CSR or in Section 14.3.3: Narratives of Deaths, Other Serious and Certain Other Significant Adverse Events.
Although no cut-off is specified, if there are five or fewer narratives, they can usually be reported directly in the CSR text, although this depends on the therapeutic area involved, the complexity of reporting, relevant course of events, and flow of information in the CSR. When you are uncertain where to put them, narratives should be prepared as separate documents and compiled in Section 14.3.3 during CSR publishing.
Plan Ahead: Identify the Number of Narratives Early in the Process
Since the number of patient safety narratives determines the narrative format used for the CSR, and will have an impact on the timing of production (ie, whether prior to or following clinical database lock), it is critical to determine how many narratives will be needed early in the planning process.
If patient safety narratives are written from draft data before the clinical database is locked down, updates will be required based on final data. This approach can consume more time than preparing all narratives after database lock, but is more feasible for projects where a large number of narratives are required to be drafted in a short span (e.g., for a regulatory submission).
Good communication is essential for projects that will include a large number of patient safety narratives. There should be a good understanding of requirements by all parties, and agreement of the scope and main principles prior to project start.
Checking, and Rechecking the Source Data
Medical writers use various sources of information when preparing patient safety narratives, including:
This is particularly important with CIOMS forms, which are updated on an ongoing basis during a clinical study. A medical writer is well placed to assess the impact of any discrepancies and provide feedback to a sponsor, thereby assisting with the data cleaning process.
Using a Template for Narratives
When significant numbers of narratives are required, a template can be useful for defining overall structure and content, and obtaining approval from all stakeholders prior to initiation of work. In the template, consideration should be given to a number of factors, including order of information, sentence structure, date format, relevance of specific medical history and concomitant medications, use of trade or generic names for medications, and whether normal ranges should be included for some or all laboratory test results.
A comprehensive template should be flexible enough to suit sponsor requirements while maintaining consistency. However, care should be taken to ensure that all writers who are involved in preparing the narratives understand the template’s limitations, and feel empowered to deviate from it as data require for transparent reporting.
Generally, the following steps should be used to generate the narratives:
Ensuring Consistency
When preparing a large number of documents for a single purpose, including patient safety narratives, it is essential that consistency be maintained. A large project will require the involvement of several medical writers. A CRO project lead should be assigned to act as a single point of contact to work closely with the sponsor and other stakeholders. In addition to managing communication and delivery, he or she should act as a peer reviewer, ensuring consistency of reporting across all narratives, reviewing as if he or she were part of the sponsor study team.
During a large project, it is not unusual for the scope of work and content of narratives to evolve over time, particularly where narratives are prepared on an ongoing basis. For example, it may become apparent from events reported during an ongoing study that specific endpoints (e.g., liver function test results) are more important than considered originally. An effective single point of contact will be able to work with the sponsor to ensure that the process specifications are adapted quickly, and will disseminate the relevant information to the writing team in a timely manner, through meetings and the use of study specific documents.
Where it is necessary to update narratives already prepared and possibly reviewed, this person will again work with the Sponsor to identify a solution that integrates updates into the overall narrative development process in the most effective and expeditious way.
Tracking
The majority of Phase II-IV studies have a large number of patients meeting pre-agreed patient safety narrative criteria. Excellent project management skills are essential for tracking such projects, since a large number of narratives are written by several writers, particularly later in a project where the delivery of newly drafted narratives overlaps with the return of clinical review comments and QC checking, and finalization of narratives at the end of the process.
The importance of careful management should not be underestimated; ensuring accuracy and consistency across a large number of narratives is a challenging and time consuming task.
Tracking is critical in projects involving a large number of patient safety narratives. Microsoft Excel spreadsheets can be used as an excellent tracking tool for managing high volumes of narratives, and it is particularly useful if all stakeholders are able to adapt their processes, if necessary, to share the same documents. In practice, this may not be possible, particularly where a CRO, for example, records confidential information, such as time spent per narrative, for budgetary purposes.
Delivery
Whatever the size of the project, it is beneficial to deliver patient safety narratives in batches with pre-agreed units/numbers for sponsor review. The batch size will depend on the total number of narratives to be prepared, data availability, completion timelines, number of writers working on the project and reviewer availability, and should take into account any ramp up time required.
Experience shows that it is preferable to deliver a small number of patient safety narratives, for instance, five to 10 depending on complexity, prepared by one writer, usually the project lead, for Sponsor review in the first instance. This allows for fine tuning of the content, presentation and process prior to implementing preparation on a larger scale. Restricting the number of people involved early in the process allows for faster resolution of any issues such that a streamlined process can be agreed quickly and minimizes confusion when rolled out to the larger team. By working in this way, duplication of efforts can be kept to a minimum, which is beneficial to all parties. The in-house team can subsequently be trained on the agreed Sponsor requirements.
When sending the narratives for review, it is advisable for the CRO project lead to clearly state the timeframe within which all review comments should be returned, thereby minimizing unnecessary delays, and to request that comments from all reviewers be provided in a consolidated manner.
Future Directions
CIOMS Forms
It is becoming more common for sponsors to consider including direct links to CIOMS forms from CSR appendices instead of including individual patient safety narratives. This approach should be used with caution.
CIOMS forms are completed by an Investigator in the country in which the study is being conducted; sometimes, with English not his or her fist language. These forms are updated frequently as key information becomes available, which makes data repetitive and unwieldy. One patient may have several CIOMS forms for separate events, which cross reference one another. A medical writer can spend several hours distilling the most relevant and up-to-date information from such forms in order to prepare a narrative that is succinct, accurate and readable for a single patient.
Since the purpose of a patient safety narrative is to present a full and clinically relevant, chronological account of the progression of an event or events, a regulatory reviewer may not take kindly to having to derive a clear account from one or more lengthy CIOMS report(s).
Furthermore, the Note for Guidance on the Inclusion of Appendices to Clinical Study Reports in Marketing Authorisation Applications, specifies that in Appendix 16.3 of the CSR, CIOMS reports (or equivalent) and CRFs should be available on request. Since CIOMS forms should be made available as required and are not mandated, it may be considered less acceptable for them to be linked routinely to the CSR in place of patient safety narratives.
Automation of Patient Safety Narrative Preparation
Another development in clinical study reporting is the automation of patient safety narrative preparation using programming and statistical support to prepare output directly from SAS datasets. Several case studies and papers are publicly available that document the benefits of such an approach (which include increased standardization, reduced preparation time and reduced cost).
With time invested at the start of an individual project or program of work to define the fields to be presented, the benefits are real, particularly for patient safety narratives for significant non- serious adverse events that are judged to be of special interest.
However, there are limitations to this approach, which should be considered at the outset:
Individual Case Safety Reports
It is important to avoid confusion between patient safety narratives and Individual Case Safety Reports (ICSRs). ICSRs are a core component of pharmacovigilance (PV) services and drug safety, and differ from patient safety narratives in a number of respects.
A patient safety narrative in, or appended to, a CSR describes all relevant events for a single patient, with relevant background information as detailed above. An ICSR concerns one patient, one or more identifiable reporter(s), one or more suspected adverse reaction(s) that are clinically and temporally associated, and one or more suspected medicinal product(s).
In the context of a clinical trial, an individual case is the information provided by a primary source to describe a serious adverse event related or unrelated to the administration of one or more investigational medicinal products to an individual patient at a particular point of time. The event reported should be the diagnosis. If a diagnosis has not been made at that time, the case may contain several signs and symptoms instead and, therefore, more than one reported event.
ICSRs prepared post-marketing can differ from this in that several event terms may be reported in a single case; these events should be temporally or clinically associated and they will be ordered according to clinical relevance for the product, i.e., a serious unexpected event would be designated the ‘primary event’ for reporting purposes, whereas non-serious or expected events would be ranked lower within the case. Furthermore, in post-marketing ICSRs, all spontaneous reported events are considered related to the medicinal product unless specified otherwise by the reporter, whereas in a clinical setting the Investigator makes his or her interpretation as to causality.
The regulations pertaining to ICSRs are both complex and precise and dictate that reports be presented in a standardized format. This can prove to be challenging, particularly for smaller companies involved in drug development and they often outsource this work to CROs, which can provide an end-to-end PV service on their behalf.
References
ICH Guidance on Clinical Study Reports
A patient safety narrative should provide a full and clinically relevant, chronological account of the progression of an event experienced during or immediately following a clinical study.
As Per ICH E3 guidelines, a patient safety narrative should describe:
- the nature, intensity and outcome of the event;
- the clinical course leading to the event;
- an indication of timing relevant to study drug administration;
- relevant laboratory measures;
- action taken with the study drug (and timing) in relation to the event;
- treatment or intervention;
- post mortem findings (if applicable); and
- investigator’s and sponsor’s (if appropriate) opinion on causality.
- patient identifier;
- age and sex of patient; general clinical condition of patient, if appropriate;
- disease being treated (if this is the same for all patients, this information is not required) with duration of current episode of illness;
- relevant concomitant/previous illnesses with details of occurrence/duration;
- relevant concomitant/previous medication with details of dosage; and
- test drug administered, including dose, if this varied among patients, and length of time administered.
Such narratives are required for describing each clinically significant adverse event, and certainly any serious adverse event or events that led to patient death.
Format and Location for Narratives
Guidance is less specific on where to place and how to format the narratives. Depending on the total number of narratives required, they can be placed either in the text of the CSR or in Section 14.3.3: Narratives of Deaths, Other Serious and Certain Other Significant Adverse Events.
Although no cut-off is specified, if there are five or fewer narratives, they can usually be reported directly in the CSR text, although this depends on the therapeutic area involved, the complexity of reporting, relevant course of events, and flow of information in the CSR. When you are uncertain where to put them, narratives should be prepared as separate documents and compiled in Section 14.3.3 during CSR publishing.
Plan Ahead: Identify the Number of Narratives Early in the Process
Since the number of patient safety narratives determines the narrative format used for the CSR, and will have an impact on the timing of production (ie, whether prior to or following clinical database lock), it is critical to determine how many narratives will be needed early in the planning process.
If patient safety narratives are written from draft data before the clinical database is locked down, updates will be required based on final data. This approach can consume more time than preparing all narratives after database lock, but is more feasible for projects where a large number of narratives are required to be drafted in a short span (e.g., for a regulatory submission).
Good communication is essential for projects that will include a large number of patient safety narratives. There should be a good understanding of requirements by all parties, and agreement of the scope and main principles prior to project start.
Checking, and Rechecking the Source Data
Medical writers use various sources of information when preparing patient safety narratives, including:
- Council for International Organisations of Medical Sciences (CIOMS) forms;
- Case Report Forms (CRFs);
- MedWatch forms;
- Data Clarification Forms (DCFs); and
- Clinical database listings.
This is particularly important with CIOMS forms, which are updated on an ongoing basis during a clinical study. A medical writer is well placed to assess the impact of any discrepancies and provide feedback to a sponsor, thereby assisting with the data cleaning process.
Using a Template for Narratives
When significant numbers of narratives are required, a template can be useful for defining overall structure and content, and obtaining approval from all stakeholders prior to initiation of work. In the template, consideration should be given to a number of factors, including order of information, sentence structure, date format, relevance of specific medical history and concomitant medications, use of trade or generic names for medications, and whether normal ranges should be included for some or all laboratory test results.
A comprehensive template should be flexible enough to suit sponsor requirements while maintaining consistency. However, care should be taken to ensure that all writers who are involved in preparing the narratives understand the template’s limitations, and feel empowered to deviate from it as data require for transparent reporting.
Generally, the following steps should be used to generate the narratives:
- The medical writer should prepare the first draft narrative based on patient/subject data;
- The draft narrative should undergo scientific and editorial peer review by the CRO project lead, to ensure accuracy, completeness and consistency with requirements and across documents;
- The sponsor, or a company designated by the sponsor, should perform a clinical review of the draft narrative. The CRO can provide this service as necessary;
- Following clinical review, the medical writer should revise the draft. If he or she disagrees with clinical review comments, for example, where requested amendments conflict with the evidence, where changes would introduce inconsistencies between narratives, or where review comments are unclear, these should be discussed with the Sponsor or designate, as appropriate, and responses retained on file;
- The revised draft should then undergo quality control (QC) review, based on final patient/subject data. Given the often large number of narratives required for individual studies, it is recommended that a single QC review be performed towards the end of the process, rather than QC review of the first draft and final deliverable;
- At this point, the medical writer should revise the document based on QC review findings. Where significant findings are identified during QC review, these should be discussed with the Sponsor and clinical reviewer, as appropriate, and further updates should be checked for consistency and accuracy; and
- The final step would be final review and approval.
Ensuring Consistency
When preparing a large number of documents for a single purpose, including patient safety narratives, it is essential that consistency be maintained. A large project will require the involvement of several medical writers. A CRO project lead should be assigned to act as a single point of contact to work closely with the sponsor and other stakeholders. In addition to managing communication and delivery, he or she should act as a peer reviewer, ensuring consistency of reporting across all narratives, reviewing as if he or she were part of the sponsor study team.
During a large project, it is not unusual for the scope of work and content of narratives to evolve over time, particularly where narratives are prepared on an ongoing basis. For example, it may become apparent from events reported during an ongoing study that specific endpoints (e.g., liver function test results) are more important than considered originally. An effective single point of contact will be able to work with the sponsor to ensure that the process specifications are adapted quickly, and will disseminate the relevant information to the writing team in a timely manner, through meetings and the use of study specific documents.
Where it is necessary to update narratives already prepared and possibly reviewed, this person will again work with the Sponsor to identify a solution that integrates updates into the overall narrative development process in the most effective and expeditious way.
Tracking
The majority of Phase II-IV studies have a large number of patients meeting pre-agreed patient safety narrative criteria. Excellent project management skills are essential for tracking such projects, since a large number of narratives are written by several writers, particularly later in a project where the delivery of newly drafted narratives overlaps with the return of clinical review comments and QC checking, and finalization of narratives at the end of the process.
The importance of careful management should not be underestimated; ensuring accuracy and consistency across a large number of narratives is a challenging and time consuming task.
Tracking is critical in projects involving a large number of patient safety narratives. Microsoft Excel spreadsheets can be used as an excellent tracking tool for managing high volumes of narratives, and it is particularly useful if all stakeholders are able to adapt their processes, if necessary, to share the same documents. In practice, this may not be possible, particularly where a CRO, for example, records confidential information, such as time spent per narrative, for budgetary purposes.
Delivery
Whatever the size of the project, it is beneficial to deliver patient safety narratives in batches with pre-agreed units/numbers for sponsor review. The batch size will depend on the total number of narratives to be prepared, data availability, completion timelines, number of writers working on the project and reviewer availability, and should take into account any ramp up time required.
Experience shows that it is preferable to deliver a small number of patient safety narratives, for instance, five to 10 depending on complexity, prepared by one writer, usually the project lead, for Sponsor review in the first instance. This allows for fine tuning of the content, presentation and process prior to implementing preparation on a larger scale. Restricting the number of people involved early in the process allows for faster resolution of any issues such that a streamlined process can be agreed quickly and minimizes confusion when rolled out to the larger team. By working in this way, duplication of efforts can be kept to a minimum, which is beneficial to all parties. The in-house team can subsequently be trained on the agreed Sponsor requirements.
When sending the narratives for review, it is advisable for the CRO project lead to clearly state the timeframe within which all review comments should be returned, thereby minimizing unnecessary delays, and to request that comments from all reviewers be provided in a consolidated manner.
Future Directions
CIOMS Forms
It is becoming more common for sponsors to consider including direct links to CIOMS forms from CSR appendices instead of including individual patient safety narratives. This approach should be used with caution.
CIOMS forms are completed by an Investigator in the country in which the study is being conducted; sometimes, with English not his or her fist language. These forms are updated frequently as key information becomes available, which makes data repetitive and unwieldy. One patient may have several CIOMS forms for separate events, which cross reference one another. A medical writer can spend several hours distilling the most relevant and up-to-date information from such forms in order to prepare a narrative that is succinct, accurate and readable for a single patient.
Since the purpose of a patient safety narrative is to present a full and clinically relevant, chronological account of the progression of an event or events, a regulatory reviewer may not take kindly to having to derive a clear account from one or more lengthy CIOMS report(s).
Furthermore, the Note for Guidance on the Inclusion of Appendices to Clinical Study Reports in Marketing Authorisation Applications, specifies that in Appendix 16.3 of the CSR, CIOMS reports (or equivalent) and CRFs should be available on request. Since CIOMS forms should be made available as required and are not mandated, it may be considered less acceptable for them to be linked routinely to the CSR in place of patient safety narratives.
Automation of Patient Safety Narrative Preparation
Another development in clinical study reporting is the automation of patient safety narrative preparation using programming and statistical support to prepare output directly from SAS datasets. Several case studies and papers are publicly available that document the benefits of such an approach (which include increased standardization, reduced preparation time and reduced cost).
With time invested at the start of an individual project or program of work to define the fields to be presented, the benefits are real, particularly for patient safety narratives for significant non- serious adverse events that are judged to be of special interest.
However, there are limitations to this approach, which should be considered at the outset:
- Serious adverse events. Since data relating to serious adverse events are obtained directly from other sources such as CIOMS forms, routine automation of reporting is generally not practicable. However, such narratives can be partially automated with information such as demographics, study treatments, event details (onset and resolution dates, severity, relationship to study drug, etc.), prior medications, ongoing medications at event onset, and medications started during an event, output as routine. Such information is useful to the Medical Writer and can save a significant amount of time when drafting a narrative.
- Timing. As detailed above, the timing of narrative preparation is a key decision at the start of the reporting process. When following an automated process, there is little benefit to starting prior to database lock as any changes made during medical writer review will be lost when the narratives are re-run from clean data. If timings are such that increased efficiencies are required, this approach may be followed as long as the programmed outputs based on clean and draft data are compared, preferably via an automated process, with changes flagged to the medical writer for inclusion late in the narrative writing process, but ideally prior to sponsor review.
Individual Case Safety Reports
It is important to avoid confusion between patient safety narratives and Individual Case Safety Reports (ICSRs). ICSRs are a core component of pharmacovigilance (PV) services and drug safety, and differ from patient safety narratives in a number of respects.
A patient safety narrative in, or appended to, a CSR describes all relevant events for a single patient, with relevant background information as detailed above. An ICSR concerns one patient, one or more identifiable reporter(s), one or more suspected adverse reaction(s) that are clinically and temporally associated, and one or more suspected medicinal product(s).
In the context of a clinical trial, an individual case is the information provided by a primary source to describe a serious adverse event related or unrelated to the administration of one or more investigational medicinal products to an individual patient at a particular point of time. The event reported should be the diagnosis. If a diagnosis has not been made at that time, the case may contain several signs and symptoms instead and, therefore, more than one reported event.
ICSRs prepared post-marketing can differ from this in that several event terms may be reported in a single case; these events should be temporally or clinically associated and they will be ordered according to clinical relevance for the product, i.e., a serious unexpected event would be designated the ‘primary event’ for reporting purposes, whereas non-serious or expected events would be ranked lower within the case. Furthermore, in post-marketing ICSRs, all spontaneous reported events are considered related to the medicinal product unless specified otherwise by the reporter, whereas in a clinical setting the Investigator makes his or her interpretation as to causality.
The regulations pertaining to ICSRs are both complex and precise and dictate that reports be presented in a standardized format. This can prove to be challenging, particularly for smaller companies involved in drug development and they often outsource this work to CROs, which can provide an end-to-end PV service on their behalf.
References
- International Conference on Harmonisation. July 1996. Topic E3 Structure and Content of Clinical Study Reports.
- EMEA (now EMA; European Medicines Agency). December 2004. Note for Guidance on the Inclusion of Appendices to Clinical Study Reports in Marketing Authorisation Applications.
- Volume 9A of The Rules Governing Medicinal Products in the European Union – Guidelines on Pharmacovigilance for Medicinal Products for Human Use. 2011. Part II [ONLINE] Available at: http://ec.europa.eu/health/files/eudralex/vol-9/pdf/vol9a_09-2008_en.pdf. [Accessed 29 January 2014].
- Volume 9A of The Rules Governing Medicinal Products in the European Union – Guidelines on Pharmacovigilance for Medicinal Products for Human Use. 2011. Annex 1.2. [ONLINE] Available at: http://ec.europa.eu/health/files/eudralex/vol-9/pdf/vol9a_09-2008_en.pdf. [Accessed 29 January 2014].