[Federal Register Volume 61, Number 138 (Wednesday, July 17, 1996)]
[Notices]
[Pages 37320-37343]
From the Federal Register Online via the Government Publishing Office [www.gpo.gov]
[FR Doc No: 96-18000]



[[Page 37319]]


_______________________________________________________________________

Part II





Department of Health and Human Services





_______________________________________________________________________



Food and Drug Administration



_______________________________________________________________________



International Conference on Harmonisation; Guideline on Structure and 
Content of Clinical Study Reports; Availability; Notice

Federal Register / Vol. 61, No. 138 / Wednesday, July 17, 1996 / 
Notices

[[Page 37320]]



DEPARTMENT OF HEALTH AND HUMAN SERVICES

Food and Drug Administration
[Docket No. 95D-0218]


International Conference on Harmonisation; Guideline on Structure 
and Content of Clinical Study Reports; Availability

AGENCY: Food and Drug Administration, HHS.

ACTION: Notice.

-----------------------------------------------------------------------

SUMMARY: The Food and Drug Administration is publishing a guideline 
entitled ``Structure and Content of Clinical Study Reports.'' The 
guideline was prepared under the auspices of the International 
Conference on Harmonisation of Technical Requirements for Registration 
of Pharmaceuticals for Human Use (ICH). The guideline is intended to 
facilitate the compilation of a single worldwide core clinical study 
report acceptable to all regulatory authorities.

DATES: Effective July 17, 1996. Submit written comments at any time.

ADDRESSES: Submit written comments on the guideline to the Dockets 
Management Branch (HFA-305), Food and Drug Administration, 12420 
Parklawn Dr., rm. 1-23, Rockville, MD 20857. Copies of the guideline 
are available from the Division of Communications Management (HFD-210), 
Center for Drug Evaluation and Research, Food and Drug Administration, 
7500 Standish Pl., Rockville, MD 20855, 301-594-1012. An electronic 
version of this guideline is also available via Internet by connecting 
to the CDER file transfer protocol (FTP) server (CDVS2.CDER.FDA.GOV).

FOR FURTHER INFORMATION CONTACT: 
    Regarding the guideline: Robert Temple, Center for Drug Evaluation 
and Research (HFD-100), Food and Drug Administration, 5600 Fishers 
Lane, Rockville, MD 20857, 301-594-6758.
    Regarding ICH: Janet Showalter, Office of Health Affairs (HFY-1), 
Food and Drug Administration, 5600 Fishers Lane, Rockville, MD 20857, 
301-443-1382.

SUPPLEMENTARY INFORMATION: In recent years, many important initiatives 
have been undertaken by regulatory authorities and industry 
associations to promote international harmonization of regulatory 
requirements. FDA has participated in many meetings designed to enhance 
harmonization and is committed to seeking scientifically based 
harmonized technical procedures for pharmaceutical development. One of 
the goals of harmonization is to identify and then reduce differences 
in technical requirements for drug development among regulatory 
agencies.
    ICH was organized to provide an opportunity for tripartite 
harmonization initiatives to be developed with input from both 
regulatory and industry representatives. FDA also seeks input from 
consumer representatives and others. ICH is concerned with 
harmonization of technical requirements for the registration of 
pharmaceutical products among three regions: The European Union, Japan, 
and the United States. The six ICH sponsors are: The European 
Commission, the European Federation of Pharmaceutical Industries 
Associations, the Japanese Ministry of Health and Welfare, the Japanese 
Pharmaceutical Manufacturers Association, the Centers for Drug 
Evaluation and Research and Biologics Evaluation and Research, FDA, and 
the Pharmaceutical Research and Manufacturers of America. The ICH 
Secretariat, which coordinates the preparation of documentation, is 
provided by the International Federation of Pharmaceutical 
Manufacturers Associations (IFPMA).
    The ICH Steering Committee includes representatives from each of 
the ICH sponsors and the IFPMA, as well as observers from the World 
Health Organization, the Canadian Health Protection Branch, and the 
European Free Trade Area.
    In the Federal Register of August 23, 1995 (60 FR 43910), FDA 
published a draft tripartite guideline entitled ``Structure and Content 
of Clinical Study Reports.'' The notice gave interested persons an 
opportunity to submit comments by October 10, 1995.
    After consideration of the comments received and revisions to the 
guideline, a final draft of the guideline was submitted to the ICH 
Steering Committee and endorsed by the three participating regulatory 
agencies at the ICH meeting held on November 29, 1995.
    The guideline is intended to facilitate the compilation of a single 
worldwide core clinical study report acceptable to all regulatory 
authorities. The clinical study report described in this guideline is 
an integrated full report of an individual study of any therapeutic, 
prophylactic, or diagnostic agent conducted in patients. Certain 
information is contained in appendices, including the protocol, 
listings of investigators and their qualifications, trial material 
information, technical statistical documentation, related publications, 
patient data listings, case report forms, and documentation of 
statistical methods. These appendices should be prepared by sponsors, 
but may be submitted as part of an initial submission, or on request, 
at the discretion of the regulatory authority. The material in the 
appendices should be provided in submissions to the Food and Drug 
Administration unless specific agreements are reached with reviewing 
divisions/offices to retain particular appendices.
    The guideline is intended to assist sponsors in the development of 
a report that is complete, free from ambiguity, well organized, and 
easy to review. It is intended to replace one section of an existing 
FDA guideline, specifically, Section III of the Guideline for the 
Format and Content of the Clinical and Statistical Sections of New Drug 
Applications.
    In the past, guidelines have generally been issued under 
Sec. 10.90(b) (21 CFR 10.90(b)), which provides for the use of 
guidelines to state procedures or standards of general applicability 
that are not legal requirements but are acceptable to FDA. The agency 
is now in the process of revising Sec. 10.90(b). Although this 
guideline does not create or confer any rights for or on any person and 
does not operate to bind FDA, it does represent the agency's current 
thinking on structure and content of clinical study reports.
    As with all of FDA's guidelines, the public is encouraged to submit 
written comments with new data or other new information pertinent to 
this guideline. The comments in the docket will be periodically 
reviewed, and, where appropriate, the guideline will be amended. The 
public will be notified of any such amendments through a notice in the 
Federal Register.
    Interested persons may, at any time, submit written comments on the 
guideline to the Dockets Management Branch (address above). Two copies 
of any comments are to be submitted, except that individuals may submit 
one copy. Comments are to be identified with the docket number found in 
brackets in the heading of this document. The guideline and received 
comments may be seen in the office above between 9 a.m. and 4 p.m., 
Monday through Friday.
    The text of the guideline follows:

Structure and Content of Clinical Study Reports Table of Contents

Introduction to the Guideline

1. Title Page
2. Synopsis

[[Page 37321]]

3. Table of Contents for the Individual Clinical Study Report
4. List of Abbreviations and Definition of Terms
5. Ethics
5.1- Independent Ethics Committee (IEC) or Institutional Review 
Board (IRB)
5.2- Ethical Conduct of the Study
5.3- Patient Information and Consent
6. Investigators and Study Administrative Structure
7. Introduction
8. Study Objectives
9. Investigational Plan
9.1- Overall Study Design and Plan--Description
9.2- Discussion of Study Design, including the Choice of Control 
Groups
9.3 Selection of Study Population
9.3.1 Inclusion Criteria
9.3.2 Exclusion Criteria
9.3.3 Removal of Patients from Therapy or Assessment
9.4 Treatments
9.4.1 Treatments Administered
9.4.2 Identity of Investigational Product(s)
9.4.3 Method of Assigning Patients to Treatment Groups
9.4.4 Selection of Doses in the Study
9.4.5 Selection and Timing of Dose for Each Patient
9.4.6 Blinding
9.4.7 Prior and Concomitant Therapy
9.4.8 Treatment Compliance
9.5- Efficacy and Safety Variables
9.5.1 Efficacy and Safety Measurements Assessed and Flow Chart
9.5.2 Appropriateness of Measurements
9.5.3 Primary Efficacy Variable(s)
9.5.4 Drug Concentration Measurements
9.6 Data Quality Assurance
9.7- Statistical Methods Planned in the Protocol and Determination 
of Sample Size
9.7.1 Statistical and Analytical Plans
9.7.2 Determination of Sample Size
9.8- Changes in the Conduct of the Study or Planned Analyses
10. Study Patients
10.1 Disposition of Patients
10.2 Protocol Deviations
11.- Efficacy Evaluation
11.1 Data Sets Analyzed
11.2 Demographic and Other Baseline Characteristics
11.3 Measurements of Treatment Compliance
11.4 Efficacy Results and Tabulations of Individual Patient Data
11.4.1 Analysis of Efficacy
11.4.2 Statistical/Analytical Issues
11.4.2.1 Adjustments for Covariates
11.4.2.2 Handling of Dropouts or Missing Data
114.2.3 Interim Analyses and Data Monitoring
11.4.2.4 Multiple Studies
11.4.2.5 Multiple Comparisons/Multiplicity
11.4.2.6 Use of an ``Efficacy Subset'' of Patients
11.4.2.7 Active-Control Studies Intended to Show Equivalence
11.4.2.8 Examination of Subgroups
11.4.3 Tabulation of Individual Response Data
11.4.4 Drug Dose, Drug Concentration, and Relationships to Response
11.4.5 Drug-Drug and Drug-Disease Interactions
11.4.6 By-Patient Displays
11.4.7 Efficacy Conclusions
12.- Safety Evaluation
12.1 Extent of Exposure
12.2 Adverse Events (AE's)
12.2.1 Brief Summary of Adverse Events
12.2.2 Display of Adverse Events
12.2.3 Analysis of Adverse Events
12.2.4 Listing of Adverse Events by Patient
12.3 Deaths, Other Serious Adverse Events, and Other Significant 
Adverse Events
12.3.1 Listings of Deaths, Other Serious Adverse Events, and Other 
Significant Adverse Events
12.3.1.1 Deaths
12.3.1.2 Other Serious Adverse Events
12.3.1.3 Other Significant Adverse Events
12.3.2 Narratives of Deaths, Other Serious Adverse Events, and 
Certain Other Significant Adverse Events
12.3.3 Analysis and Discussion of Deaths, Other Serious Adverse 
Events, and Other Significant Adverse Events
12.4 Clinical Laboratory Evaluation
12.4.1 Listing of Individual Laboratory Measurements by Patient 
(16.2.8) and Each Abnormal Laboratory Value (14.3.4)
12.4.2 Evaluation of Each Laboratory Parameter
12.4.2.1 Laboratory Values Over Time
12.4.2.2 Individual Patient Changes
12.4.2.3 Individual Clinically Significant Abnormalities
12.5 Vital Signs, Physical Findings, and Other Observations Related 
to Safety
12.6 Safety Conclusions
13. Discussion and Overall Conclusions
14.- Tables, Figures and Graphs Referred To But Not Included in the 
Text
14.1 Demographic Data
14.2 Efficacy Data
14.3 Safety Data
14.3.1 Displays of Adverse Events
14.3.2 Listings of Deaths, Other Serious and Significant Adverse 
Events
14.3.3 Narratives of Deaths, Other Serious and Certain Other 
Significant Adverse Events
14.3.4 Abnormal Laboratory Value Listing (each patient)
15.- Reference List
16.- Appendices
16.1 Study Information
16.1.1 Protocol and protocol amendments
16.1.2 Sample case report form (unique pages only)
16.1.3 List of EIC's or IRB's (plus the name of the committee Chair 
if required by the regulatory authority) - Representative written 
information for patient and sample consent forms
16.1.4 List and description of investigators and other important 
participants in the study, including brief (1 page) CVS or 
equivalent summaries of training and experience relevant to the 
performance of the clinical study
16.1.5 Signatures of principal or coordinating investigator(s) or 
sponsor's responsible medical officer depending on the regulatory 
authority's requirement
16.1.6 Listing of patients receiving test drug(s)/investigational 
products from specific batches where more than one batch was used
16.1.7 Randomization scheme and codes (patient identification and 
treatment assigned)
16.1.8 Audit certificates (if available)
16.1.9 Documentation of statistical methods
16.1.10 Documentation of inter-laboratory standardization methods 
and quality assurance procedures if used
16.1.11 Publications based on the study
16.1.12 Important publications referenced in the report
16.2 Patient Data Listings
16.2.1 Discontinued patients
16.2.2 Protocol deviations
16.2.3 Patients excluded from the efficacy analysis
16.2.4 Demographic data
16.2.5 Compliance and/or drug concentration data (if available)
16.2.6 Individual efficacy response data
16.2.7 Adverse event listings (each patient)
16.2.8 Listing of individual laboratory measurements by patient when 
required by regulatory authorities
16.3 Case Report Forms
16.3.1 CRF's for deaths, other serious adverse events and 
withdrawals for AE
16.3.2 Other CRF's submitted
16.4 Individual Patient Data Listings (U.S. Archival Listings)
Annex I Synopsis (Example)
Annex II Principal or Coordinating Investigator(s) or Sponsor's 
responsible medical officer (Example)
Annex IIIa Study Design and Schedule of Assessments (Example)
Annex IIIb Study Design and Schedule of Assessments (Example)
Annex IVa Disposition of patients (Example)
Annex IVb Disposition of patients (Example)
Annex V Listing of patients Who Discontinued Therapy (Example)
Annex VI Listing of Patients and Observations Excluded from Efficacy 
Analysis (Example)
Annex VII Number of Patients Excluded from Efficacy Analysis 
(Example)
Annex VIII Guidance for Section 11.4.2 - Statistical/Analytical 
Issues and Appendix 16.1.9

I. Introduction

    The objective of this guideline is to facilitate the compilation 
of a single core clinical study report acceptable to all regulatory 
authorities of the ICH regions. The regulatory authority-specific 
additions will consist of modules to be considered as appendices, 
available upon request according to regional regulatory 
requirements.
    The clinical study report described in this guideline is an 
``integrated'' full report of an individual study of any 
therapeutic, prophylactic, or diagnostic agent (referred to herein 
as drug or treatment) conducted in patients. The clinical and 
statistical description, presentations, and analyses are integrated 
into a single report, incorporating tables and figures into the main 
text of the report or at the end of the text, with appendices 
containing such information as the protocol, sample case report 
forms, investigator-related information, information related to the 
test drugs/investigational products including active control/
comparators, technical statistical documentation, related 
publications, patient data listings, and technical statistical 
details such as derivations, computations, analyses,

[[Page 37322]]

and computer output. The integrated full report of a study should 
not be derived by simply joining a separate clinical and statistical 
report. Although this guideline is mainly aimed at efficacy and 
safety trials, the basic principles and structure described can be 
applied to other kinds of trials, such as clinical pharmacology 
studies. Depending on the nature and importance of such studies, a 
less detailed report might be appropriate.
    The guideline is intended to assist sponsors in the development 
of a report that is complete, free from ambiguity, well organized, 
and easy to review. The report should provide a clear explanation of 
how the critical design features of the study were chosen and enough 
information on the plan, methods, and conduct of the study so that 
there is no ambiguity in how the study was carried out. The report 
with its appendices should also provide enough individual patient 
data, including the demographic and baseline data, and details of 
analytical methods, to allow replication of the critical analyses 
when authorities wish to do so. It is also particularly important 
that all analyses, tables, and figures carry, in text or as part of 
the table, clear identification of the set of patients from which 
they were generated.
    Depending on the regulatory authority's review policy, 
abbreviated reports using summarized data or with some sections 
deleted may be acceptable for uncontrolled studies or other studies 
not designed to establish efficacy, for seriously flawed or aborted 
studies, or for controlled studies that examine conditions clearly 
unrelated to those for which a claim is made. A controlled safety 
study, however, should be reported in full. If an abbreviated report 
is provided, a full description of safety aspects should be included 
in all cases. If an abbreviated report is submitted, there should be 
enough detail of design and results to allow the regulatory 
authority to determine whether a full report is needed. If there is 
any question regarding whether the reports are needed, it may be 
useful to consult the regulatory authority.
    In presenting the detailed description of how the study was 
carried out, it may be possible simply to restate the description in 
the initial protocol. Often, however, it is possible to present the 
methodology of the study more concisely in a separate document. In 
each section describing the design and conduct of the study, it is 
particularly important to clarify features of the study that are not 
well-described in the protocol and identify ways in which the study 
as conducted differed from the protocol, and to discuss the 
statistical methods and analyses used to account for these 
deviations from the planned protocol.
    The full integrated report of the individual study should 
include the most detailed discussion of individual adverse events or 
laboratory abnormalities, but these should usually be reexamined as 
part of an overall safety analysis of all available data in any 
application.
    The report should describe demographic and other potentially 
predictive characteristics of the study population and, where the 
study is large enough to permit this, present data for demographic 
(e.g., age, sex, race, weight) and other (e.g., renal or hepatic 
function) subgroups so that possible differences in efficacy or 
safety can be identified. Usually, however, subgroup responses 
should be examined in the larger data base used in the overall 
analysis.
    The data listings requested as part of the report (usually in an 
appendix) are those needed to support critical analyses. Data 
listings that are part of the report should be readily usable by the 
reviewer. Thus, although it may be desirable to include many 
variables in a single listing to limit size, this should not be at 
the expense of clarity. An excess of data should not be allowed to 
lead to, for example, overuse of symbols instead of words or easily 
understood abbreviations, or to too-small displays. In this case, it 
is preferable to produce several listings.
    Data should be presented in the report at different levels of 
detail: Overall summary figures and tables for important 
demographic, efficacy, and safety variables may be placed in the 
text to illustrate important points; other summary figures, tables, 
and listings for demographic, efficacy, and safety variables should 
be provided in section 14; individual patient data for specified 
groups of patients should be provided as listings in Appendix 16.2; 
and all individual patient data (archival listings requested only in 
the United States) should be provided in Appendix 16.4.
    In any table, figure, or data listing, estimated or derived 
values, if used, should be identified in a conspicuous fashion. 
Detailed explanations should be provided as to how such values were 
estimated or derived and what underlying assumptions were made.
    The guidance provided below is detailed and is intended to 
notify the applicant of virtually all of the information that should 
routinely be provided so that postsubmission requests for further 
data clarification and analyses can be reduced as much as possible. 
Nonetheless, specific requirements for data presentation and/or 
analysis may depend on specific situations, may evolve over time, 
may vary from drug class to drug class, may differ among regions, 
and cannot be described in general terms. It is, therefore, 
important to refer to specific clinical guidelines and to discuss 
data presentation and analyses with the reviewing authority, 
whenever possible. Detailed written guidance on statistical 
approaches is available from some authorities.
    Each report should consider all of the topics described (unless 
clearly not relevant) although the specific sequence and grouping of 
topics may be changed if alternatives are more logical for a 
particular study. Some data in the appendices are specific 
requirements of individual regulatory authorities and should be 
submitted as appropriate. The numbering should then be adapted 
accordingly.
    In the case of very large trials, some of the provisions of this 
guideline may be impractical or inappropriate. When planning and 
when reporting such trials, contact with regulatory authorities to 
discuss an appropriate report format is encouraged.
    The provisions of this guideline should be used in conjunction 
with other ICH guidelines.

Structure and Content of Clinical Study Reports

1. Title Page

    The title page should contain the following information:
    - Study title.
    - Name of test drug/investigational product.
    - Indication studied.
    - If not apparent from the title, a brief (one to two sentences) 
description giving design (parallel, cross-over, blinding, 
randomized) comparison (placebo, active, dose/response), duration, 
dose, and patient population.
    - Name of the sponsor.
    - Protocol identification (code or number).
    - Development phase of study.
    - Study initiation date (first patient enrolled, or any other 
verifiable definition).
    - Date of early study termination, if any.
    - Study completion date (last patient completed).
    - Name and affiliation of principal or coordinating 
investigator(s) or sponsor's responsible medical officer.
    - Name of company/sponsor signatory (the person responsible for 
the study report within the company/sponsor). The name, telephone 
number, and fax number of the company/sponsor contact persons for 
questions arising during review of the study report should be 
indicated on this page or in the letter of application.
    - Statement indicating whether the study was performed in 
compliance with good clinical practice (GCP), including the 
archiving of essential documents.
    - Date of the report (identify any earlier reports from the same 
study by title and date).

2. Synopsis

    A brief synopsis (usually limited to three pages) that 
summarizes the study should be provided (see Annex I of the 
guideline for an example of a synopsis format used in Europe). The 
synopsis should include numerical data to illustrate results, not 
just text or p-values.

3. Table of Contents for the Individual Clinical Study Report

    The table of contents should include:
    - The page number or other locating information of each section, 
including summary tables, figures, and graphs.
    - A list and the locations of appendices, tabulations, and any 
case report forms provided.

4. List of Abbreviations and Definitions of Terms

    A list of the abbreviations, and lists and definitions of 
specialized or unusual terms or measurement units used in the report 
should be provided. Abbreviated terms should be spelled out and the 
abbreviation indicated in parentheses at first appearance in the 
text.

5. Ethics

5.1 Independent Ethics Committee (IEC) or Institutional Review Board 
(IRB)
    It should be confirmed that the study and any amendments were 
reviewed by an IEC or IRB. A list of all IEC's or IRB's consulted 
should be given in Appendix 16.1.3 and, if required by the 
regulatory authority, the

[[Page 37323]]

name of the committee Chair should be provided.
5.2 Ethical Conduct of the Study
    It should be confirmed that the study was conducted in 
accordance with the ethical principles that have their origins in 
the Declaration of Helsinki.
5.3 Patient Information and Consent
    How and when informed consent was obtained in relation to 
patient enrollment (e.g., at allocation, prescreening) should be 
described.
    Representative written information for the patient (if any) and 
a sample of the patient consent form used should be provided in 
Appendix 16.1.3.

6. Investigators and Study Administrative Structure

    The administrative structure of the study (e.g., principal 
investigator, coordinating investigator, steering committee, 
administration, monitoring and evaluation committees, institutions, 
statistician, central laboratory facilities, contract research 
organization (C.R.O.), clinical trial supply management) should be 
described briefly in the body of the report.
    There should be provided in Appendix 16.1.4 a list of the 
investigators with their affiliations, their role in the study, and 
their qualifications (curriculum vitae or equivalent). A similar 
list for other persons whose participation materially affected the 
conduct of the study should also be provided in Appendix 16.1.4. In 
the case of large trials with many investigators, the above 
information may be abbreviated to consist of general statements of 
qualifications for persons carrying out particular roles in the 
study with only the name, degree, and institutional affiliation and 
roles of each investigator or other participant.
    The listing should include:
    (a) Investigators.
    (b) Any other person carrying out observations of primary or 
other major efficacy variables, such as a nurse, physician's 
assistant, clinical psychologist, clinical pharmacist, or house 
staff physician. It is not necessary to include in this list a 
person with only an occasional role, e.g., an on-call physician who 
dealt with a possible adverse effect or a temporary substitute for 
any of the above.
    (c) The author(s) of the report, including the responsible 
biostatistician(s).
    Where signatures of the principal or coordinating investigators 
are required by regulatory authorities, these should be included in 
Appendix 16.1.5 (see Annex II for a sample form). Where these are 
not required, the signature of the sponsor's responsible medical 
officer should be provided in Appendix 16.1.5.

7. Introduction

    The introduction should contain a brief statement (maximum: one 
page) placing the study in the context of the development of the 
test drug/investigational product, relating the critical features of 
the study (e.g., rationale and aims, target population, treatment, 
duration, primary endpoints) to that development. Any guidelines 
that were followed in the development of the protocol or any other 
agreements/meetings between the sponsor/company and regulatory 
authorities that are relevant to the particular study should be 
identified or described.

8. Study Objectives

    A statement describing the overall purpose(s) of the study 
should be provided.

9. Investigational Plan

9.1 Overall Study Design and Plan: Description
    The overall study plan and design (configuration) of the study 
(e.g., parallel, cross-over) should be described briefly but 
clearly, using charts and diagrams as needed. If other studies used 
a very similar protocol, it may be useful to note this and describe 
any important differences. The actual protocol and any changes 
should be included as Appendix 16.1.1 and a sample case report form 
(unique pages only; i.e., it is not necessary to include identical 
pages from forms for different evaluations or visits) as Appendix 
16.1.2. If any of the information in this section comes from sources 
other than the protocol, these should be identified.
    The information provided should include:
    - Treatments studied (specific drugs, doses, and procedures).
    - Patient population studied and the number of patients to be 
included.
    - Level and method of blinding/masking (e.g., open, double-
blind, single-blind, blinded evaluators, and unblinded patients and/
or investigators).
    - Kind of control(s) (e.g., placebo, no treatment, active drug, 
dose-response, historical) and study configuration (parallel, cross-
over).
    - Method of assignment to treatment (randomization, 
stratification).
    - Sequence and duration of all study periods, including 
prerandomization and post-treatment periods, therapy withdrawal 
periods, and single and double-blind treatment periods. When 
patients were randomized should be specified. It is usually helpful 
to display the design graphically with a flow chart that includes 
timing of assessments (see Annexes IIIa and IIIb for an example).
    - Any safety, data monitoring, or special steering or evaluation 
committees.
    - Any interim analyses.
9.2 Discussion of Study Design, Including the Choice of Control 
Groups
    The specific control chosen and the study design used should be 
discussed, as necessary. Examples of design issues meriting 
discussion follow.
    Generally, the control (comparison) groups that are recognized 
are placebo concurrent control, no treatment concurrent control, 
active treatment concurrent control, dose comparison concurrent 
control, and historical control. In addition to the type of control, 
other critical design features that may need discussion are use of a 
cross-over design and selection of patients with particular prior 
history, such as response or nonresponse to a specific drug or 
member of a drug class. If randomization was not used, it is 
important to explain how other techniques, if any, guarded against 
systematic selection bias.
    Known or potential problems associated with the study design or 
control group chosen should be discussed in light of the specific 
disease and therapies being studied. For a cross-over design, for 
example, there should be consideration, among other things, of the 
likelihood of spontaneous change in the disease and of carry-over 
effects of treatment during the study.
    If efficacy was to be demonstrated by showing equivalence, i.e., 
the absence of a specified degree of inferiority of the new 
treatment compared to an established treatment, problems associated 
with such study designs should be addressed. Specifically, there 
should be provided a basis for considering the study capable of 
distinguishing active from inactive therapy. Support may be provided 
by an analysis of previous studies similar to the present study with 
respect to important design characteristics (e.g., patient 
selection, study endpoints, duration, dose of active control, 
concomitant therapy) showing a consistent ability to demonstrate 
superiority of the active control to placebo. How to assess the 
ability of the present study to distinguish effective from 
ineffective therapy should also be discussed. For example, it may be 
possible to identify a treatment response (based on past studies) 
that would clearly distinguish between the treated population and an 
untreated group. Such a response could be the change of a measure 
from baseline or some other specified outcome like healing rate or 
survival rate. Attainment of such a response would support the 
expectation that the study could have distinguished the active drug 
from an inactive drug. There should also be a discussion of the 
degree of inferiority of the therapy (often referred to as the delta 
value) the study was intended to show was not exceeded.
    The limitations of historical controls are well known (e.g., 
difficulty of assuring comparability of treated groups, inability to 
blind investigators to treatment, change in therapy/disease, 
difference due to placebo effect) and deserve particular attention.
    Other specific features of the design may also deserve 
discussion, including presence or absence of washout periods and the 
duration of the treatment period, especially for a chronic illness. 
The rationale for dose and dose-interval selection should be 
explained, if it is not obvious. For example, once daily dosing with 
a short half-life drug whose effect is closely related in time to 
blood level is not usually effective; if the study design uses such 
dosing, this should be explained, e.g., by pointing to 
pharmacodynamic evidence that effect is prolonged compared to blood 
levels. The procedures used to seek evidence of ``escape'' from drug 
effect at the end of the dose-interval, such as measurements of 
effect just before dosing, should be described. Similarly, in a 
parallel design dose-response study, the choice of doses should be 
explained.
9.3 Selection of Study Population
9.3.1 Inclusion Criteria
    The patient population and the selection criteria used to enter 
the patients into the study should be described, and the suitability 
of the population for the purposes of the study discussed. Specific 
diagnostic criteria used, as well as specific disease requirements

[[Page 37324]]

(e.g., disease of a particular severity or duration, results of a 
particular test or rating scale(s) or physical examination, 
particular features of clinical history, such as failure or success 
on prior therapy, or other potential prognostic factors and any age, 
sex, or ethnic factors) should be presented.
    Screening criteria and any additional criteria for randomization 
or entry into the test drug/investigational product treatment part 
of the trial should be described. If there is reason to believe that 
there were additional entry criteria, not defined in the protocol, 
the implications of these should be discussed. For example, some 
investigators may have excluded or entered into other studies 
patients who were particularly ill or who had particular baseline 
characteristics.
9.3.2 Exclusion Criteria
    The criteria for exclusion at entry into the study should be 
specified and the rationale provided (e.g., safety concerns, 
administrative reasons, or lack of suitability for the trial). The 
impact of exclusions on the generalizability of the study should be 
discussed in section 13 of the study report or in an overview of 
safety and efficacy.
9.3.3 Removal of Patients From Therapy or Assessment
    The predetermined reasons for removing patients from therapy or 
assessment observation, if any, should be described, as should the 
nature and duration of any planned followup observations in those 
patients.
9.4 Treatments
9.4.1 Treatments Administered
    The precise treatments or diagnostic agents to be administered 
in each arm of the study, and for each period of the study, should 
be described including route and mode of administration, dose, and 
dosage schedule.
9.4.2 Identity of Investigational Products(s)
    In the text of the report, a brief description of the test 
drug(s)/investigational product(s) (formulation, strength, batch 
number(s)) should be given. If more than one batch of test drug/
investigational product was used, patients receiving each batch 
should be identified in Appendix 16.1.6.
    The source of placebos and active control/comparator product(s) 
should be provided. Any modification of comparator product(s) from 
their usual commercial state should be noted, and the steps taken to 
assure that their bioavailability was unaltered should be described.
    For long-duration trials of investigational products with 
limited shelf-lives or incomplete stability data, the logistics of 
resupply of the materials should be described. Any use of test 
materials past their expiry date should be noted, and patients 
receiving them identified. If there were specific storage 
requirements, these should also be described.
9.4.3 Method of Assigning Patients to Treatment Groups
    The specific methods used to assign patients to treatment 
groups, e.g., centralized allocation, allocation within sites, 
adaptive allocation (that is, assignment on the basis of earlier 
assignment or outcome) should be described in the text of the 
report, including any stratification or blocking procedures. Any 
unusual features should be explained.
    A detailed description of the randomization method, including 
how it was executed, should be given in Appendix 16.1.7 with 
references cited if necessary. A table exhibiting the randomization 
codes, patient identifier, and treatment assigned should also be 
presented in the Appendix. For a multicenter study, the information 
should be given by center. The method of generating random numbers 
should be explained.
    For a historically controlled trial, it is important to explain 
how the particular control was selected and what other historical 
experiences were examined, if any, and how their results compared to 
the control used.
9.4.4 Selection of Doses in the Study
    The doses or dose ranges used in the study should be given for 
all treatments and the basis for choosing them described (e.g., 
prior experience in humans, animal data).
9.4.5 Selection and Timing of Dose for Each Patient
    Procedures for selecting each patient's dose of test drug/ 
investigational product and active control/comparator should be 
described. These procedures can vary from simple random assignment 
to a selected fixed drug/dose regimen, to use of a specified 
titration procedure, or to more elaborate response-determined 
selection procedures, e.g., where dose is titrated upward at 
intervals until intolerance or some specified endpoint is achieved. 
Procedures for back-titration, if any, should also be described.
    The timing (time of day, interval) of dosing and the relation of 
dosing to meals should be described and, if timing was not 
specified, this should be noted.
    Any specific instructions to patients about when or how to take 
the dose(s) should be described.
9.4.6 Blinding
    A description of the specific procedures used to carry out 
blinding should be provided (e.g., how bottles were labeled, use of 
labels that reveal blind-breakage, sealed code list/envelopes, 
double dummy techniques), including the circumstances in which the 
blind would be broken for an individual or for all patients (e.g., 
for serious adverse events), the procedures used to do this, and who 
had access to patient codes. If the study allowed for some 
investigators to remain unblinded (e.g., to allow them to adjust 
medication), the means of shielding other investigators should be 
explained. Measures taken to ensure that test drug/investigational 
product and placebo were indistinguishable and evidence that they 
were indistinguishable should be described, as should the 
appearance, shape, smell, and taste of the test material. Measures 
to prevent unblinding by laboratory measurements, if used, should be 
described. If there was a data monitoring committee with access to 
unblinded data, procedures to ensure maintenance of overall study 
blinding should be described. The procedure used to maintain the 
blinding when interim analyses were performed should also be 
explained.
    If blinding was considered unnecessary to reduce bias for some 
or all of the observations, this should be explained; e.g., use of a 
random-zero sphygmomanometer eliminates possible observer bias in 
reading blood pressure and Holter tapes are often read by automated 
systems that are presumably immune to observer bias. If blinding was 
considered desirable but not feasible, the reasons and implications 
should be discussed. Sometimes blinding is attempted but is known to 
be imperfect because of obvious drug effects in at least some 
patients (dry mouth, bradycardia, fever, injection site reactions, 
changes in laboratory data). Such problems or potential problems 
should be identified and, if there were any attempts to assess the 
magnitude of the problem or manage it (e.g., by having endpoint 
measurements carried out by people shielded from information that 
might reveal treatment assignment), they should be described.
9.4.7 Prior and Concomitant Therapy
    Which drugs or procedures were allowed before and during the 
study, whether and how their use was recorded, and any other 
specific rules and procedures related to permitted or prohibited 
concomitant therapy should be described. How allowed concomitant 
therapy might affect the outcome due either to drug-drug interaction 
or to direct effects on the study endpoints should be discussed, and 
how the independent effects of concomitant and study therapies could 
be ascertained should be explained.
9.4.8 Treatment Compliance
    The measures taken to ensure and document treatment compliance 
should be described, e.g., drug accountability, diary cards, blood, 
urine or other body fluid drug level measurements, or medication 
event monitoring.
9.5 Efficacy and Safety Variables
9.5.1 Efficacy and Safety Measurements Assessed and Flow Chart
    The specific efficacy and safety variables to be assessed and 
laboratory tests to be conducted, their schedule (days of study, 
time of day, relation to meals, and the timing of critical measures 
in relation to test drug administration, e.g., just prior to next 
dose, 2 hours after dose), the methods for measuring them, and the 
persons responsible for the measurements should be described. If 
there were changes in personnel carrying out critical measurements, 
these should be reported.
    It is usually helpful to display graphically in a flow chart 
(see Annex III of the guideline) the frequency and timing of 
efficacy and safety measurements; visit numbers and times should be 
shown, or, alternatively, times alone can be used (visit numbers 
alone are more difficult to interpret). Any specific instructions 
(e.g., guidance or use of a diary) to the patients should also be 
noted.
    Any definitions used to characterize outcome (e.g., criteria for 
determining occurrence of acute myocardial infarction, designation 
of the location of the infarction, characterization of a stroke as 
thrombotic or hemorrhagic, distinction between TIA and stroke, 
assignment of cause of death) should be explained in full. Any 
techniques used to standardize or compare results of laboratory 
tests or other clinical measurements (e.g., ECG, chest X-ray) should 
also be described.

[[Page 37325]]

This is particularly important in multicenter studies.
    If anyone other than the investigator was responsible for 
evaluation of clinical outcomes (e.g., the sponsor or an external 
committee to review X-rays or ECG's or to determine whether the 
patient had a stroke, acute infarction, or sudden death), the person 
or group should be identified. The procedures used, including means 
of maintaining blindness and centralizing readings and measurements, 
should be described fully.
    The means of obtaining adverse event data should be described 
(volunteered, checklist, or questioning), as should any specific 
rating scale(s) used and any specifically planned followup 
procedures for adverse events or any planned rechallenge procedure.
    Any rating of adverse events by the investigator, sponsor, or 
external group (e.g., rating by severity or likelihood of drug 
causation) should be described. The criteria for such ratings, if 
any, should be given and the parties responsible for the ratings 
should be clearly identified. If efficacy or safety was to be 
assessed in terms of categorical ratings or numerical scores, the 
criteria used for point assignment should be provided (e.g., 
definitions of point scores). For multicenter studies, how methods 
were standardized should be indicated.
9.5.2 Appropriateness of Measurements
    If any of the efficacy or safety assessments was not standard, 
i.e., widely used and generally recognized as reliable, accurate, 
and relevant (able to discriminate between effective and ineffective 
agents), its reliability, accuracy, and relevance should be 
documented. It may be helpful to describe alternatives considered 
but rejected.
    If a surrogate endpoint (a laboratory measurement or physical 
measurement or sign that is not a direct measure of clinical 
benefit) was used as a study endpoint, this should be justified, 
e.g., by reference to clinical data, publications, guidelines, or 
previous actions by regulatory authorities.
9.5.3 Primary Efficacy Variable(s)
    The primary measurements and endpoints used to determine 
efficacy should be clearly specified. Although the critical efficacy 
measurements may seem obvious, when there are multiple variables or 
when variables are measured repeatedly, the protocol should identify 
the primary ones with an explanation of why they were chosen, or 
designate the pattern of significant findings or other method of 
combining information that would be interpreted as supporting 
efficacy.
    If the protocol did not identify the primary variables, the 
study report should explain how these critical variables were 
selected (e.g., by reference to publications, guidelines, or 
previous actions by regulatory authorities) and when they were 
identified (i.e., before or after the study was completed and 
unblinded). If an efficacy threshold was defined in the protocol, 
this should be described.
9.5.4 Drug Concentration Measurements
    Any drug concentrations to be measured and the sample collection 
times and periods in relation to the timing of drug administration 
should be described. Any relation of drug administration and 
sampling to ingestion of food, posture, and the possible effects of 
concomitant medication/alcohol/ caffeine/nicotine should also be 
addressed. The biological sample measured, the handling of samples 
and the method of measurement used should be described, referring to 
published and/or internal assay validation documentation for 
methodological details. Where other factors are believed important 
in assessing pharmacokinetics (e.g., soluble circulating receptors, 
renal or hepatic function), the timing and plans to measure these 
factors should also be specified.
9.6 Data Quality Assurance
    The quality assurance and quality control systems implemented to 
assure the quality of the data should be described in brief. If none 
were used, this should be stated. Documentation of inter-laboratory 
standardization methods and quality assurance procedures, if used, 
should be provided under Appendix 16.1.10.
    Any steps taken at the investigation site or centrally to ensure 
the use of standard terminology and the collection of accurate, 
consistent, complete, and reliable data, such as training sessions, 
monitoring of investigators by sponsor personnel, instruction 
manuals, data verification, cross-checking, use of a central 
laboratory for certain tests, centralized ECG reading, or data 
audits, should be described. It should be noted whether investigator 
meetings or other steps were taken to prepare investigators and 
standardize performance.
    If the sponsor used an independent internal or external auditing 
procedure, it should be mentioned here and described in Appendix 
16.1.8; audit certificates, if available, should be provided in the 
same appendix.
9.7 Statistical Methods Planned in the Protocol and Determination of 
Sample Size
9.7.1 Statistical and Analytical Plans
    The statistical analyses planned in the protocol and any changes 
made before outcome results were available should be described. In 
this section, emphasis should be on which analyses, comparisons, and 
statistical tests were planned, not on which ones were actually 
used. If critical measurements were made more than once, the 
particular measurements (e.g., average of several measurements over 
the entire study, values at particular times, values only from study 
completers, or last on-therapy value) planned as the basis for 
comparison of test drug/investigational product and control should 
be specified. Similarly, if more than one analytical approach is 
plausible, e.g., changes from baseline response, slope analysis, 
life-table analysis, the planned approach should be identified. 
Also, whether the primary analysis is to include adjustment for 
covariates should be specified.
    If there were any planned reasons for excluding from analysis 
patients for whom data are available, these should be described. If 
there were any subgroups whose results were to be examined 
separately, these should be identified. If categorical responses 
(global scales, severity scores, responses of a certain size) were 
to be used in analyzing responses, they should be clearly defined.
    Planned monitoring of the results of the study should be 
described. If there was a data monitoring committee, either within 
or outside the sponsor's control, its composition and operating 
procedures should be described and procedures to maintain study 
blinding should be given. The frequency and nature of any planned 
interim analysis, any specified circumstances in which the study 
would be terminated, and any statistical adjustments to be employed 
because of interim analyses should be described.
9.7.2 Determination of Sample Size
    The planned sample size and the basis for it, such as 
statistical considerations or practical limitations, should be 
provided. Methods for sample size calculation should be given 
together with their derivations or source of reference. Estimates 
used in the calculations should be given, and explanations should be 
provided as to how they were obtained. For a study intended to show 
a difference between treatments, the difference the study is 
designed to detect should be specified. For a positive control study 
intended to show that a new therapy is at least as effective as the 
standard therapy, the sample size determination should specify the 
difference between treatments that would be considered unacceptably 
large and, therefore, the difference the study is designed to be 
able to exclude.
9.8 Changes in the Conduct of the Study or Planned Analyses
    Any change in the conduct of the study or planned analyses 
(e.g., dropping a treatment group, changing the entry criteria or 
drug dosages, adjusting the sample size) instituted after the start 
of the study should be described. The time(s) and reason(s) for the 
change(s), the procedure used to decide on the change(s), the 
person(s) or group(s) responsible for the change(s) and the nature 
and content of the data available (and to whom they were available) 
when the change was made should also be described, whether the 
change was documented as a formal protocol amendment or not. 
Personnel changes need not be included. Any possible implications of 
the change(s) for the interpretation of the study should be 
discussed briefly in this section and more fully in other 
appropriate sections of the report. In every section of the report, 
a clear distinction between conditions (procedures) planned in the 
protocol and amendments or additions should be made. In general, 
changes in planned analyses made prior to breaking the blind have 
limited implications for study interpretation. It is therefore 
particularly critical that the timing of changes relative to blind 
breaking and availability of outcome results be well characterized.

10. Study Patients

10.1 Disposition of Patients
    There should be a clear accounting of all patients who entered 
the study, using figures or tables in the text of the report. The 
numbers of patients who were randomized and who entered and 
completed each phase of the study (or each week/month of the study) 
should be provided, as well as the reasons for all postrandomization 
discontinuations, grouped by treatment and by major reason (e.g., 
lost to followup,

[[Page 37326]]

adverse event, poor compliance). It may also be relevant to provide 
the number of patients screened for inclusion and a breakdown of the 
reasons for excluding patients during screening, if this could help 
clarify the appropriate patient population for eventual drug use. A 
flow chart is often helpful (see Annexes IVa and IVb for examples). 
Whether patients are followed for the duration of the study, even if 
drug is discontinued, should be made clear.
    In Appendix 16.2.1, there should also be a listing of all 
patients discontinued from the study after enrollment, broken down 
by center and treatment group, giving a patient identifier, the 
specific reason for discontinuation, the treatment (drug and dose), 
cumulative dose (where appropriate), and the duration of treatment 
before discontinuation. Whether or not the blind for the patient was 
broken at the time of discontinuation should be noted. It may also 
be useful to include other information, such as critical demographic 
data (e.g., age, sex, race), concomitant medication, and the major 
response variable(s) at termination. See Annex V for an example of 
such a listing.
10.2 Protocol Deviations
    All important deviations related to study inclusion or exclusion 
criteria, conduct of the trial, patient managements or patient 
assessment should be described.
    In the body of the text, protocol deviations should be 
appropriately summarized by center and grouped into different 
categories, such as:
    - Those who entered the study even though they did not satisfy 
the entry criteria.
    - Those who developed withdrawal criteria during the study but 
were not withdrawn.
    - Those who received the wrong treatment or incorrect dose.
    - Those who received an excluded concomitant treatment.
    In Appendix 16.2.2, individual patients with these protocol 
deviations should be listed, broken down by center for multicenter 
studies.

11. Efficacy Evaluation

11.1 Data Sets Analyzed
    Exactly which patients were included in each efficacy analysis 
should be precisely defined, e.g., all patients receiving any test 
drugs/investigational products, all patients with any efficacy 
observation or with a certain minimum number of observations, only 
patients completing the trial, all patients with an observation 
during a particular time window, or only patients with a specified 
degree of compliance. It should be clear, if not defined in the 
study protocol, when (relative to study unblinding) and how 
inclusion/exclusion criteria for the data sets analyzed were 
developed. Generally, even if the applicant's proposed primary 
analysis is based on a reduced subset of the patients with data, 
there should also be, for any trial intended to establish efficacy, 
an additional analysis using all randomized (or otherwise entered) 
patients with any on-treatment data.
    There should be a tabular listing of all patients, visits, and 
observations excluded from the efficacy analysis provided in 
Appendix 16.2.3 (see Annex VI for an example). The reasons for 
exclusions should also be analyzed for the whole treatment group 
over time (see Annex VII for an example).
11.2 Demographic and Other Baseline Characteristics
    Group data for the critical demographic and baseline 
characteristics of the patients, as well as other factors arising 
during the study that could affect response, should be presented in 
this section and comparability of the treatment groups for all 
relevant characteristics should be displayed by use of tables or 
graphs in section 14.1. The data for the patient sample included in 
the ``all patients with data'' analysis should be given first. This 
may be followed by data on other groups used in principal analyses, 
such as the ``per-protocol'' analysis or other analyses, e.g., 
groups defined by compliance, concomitant disease/therapy, or 
demographic/baseline characteristics. When such groups are used, 
data for the complementary excluded group should also be shown. In a 
multicenter study, where appropriate, comparability should be 
assessed by center, and centers should be compared.
    A diagram showing the relationship between the entire sample and 
any other analysis groups should be provided.
    The critical variables will depend on the specific nature of the 
disease and on the protocol but will usually include:
     Demographic variables:
    - Age
    - Sex
    - Race
     Disease factors:
    - Specific entry criteria (if not uniform), duration, stage and 
severity of disease, and other clinical classifications and 
subgroupings in common usage or of known prognostic significance.
    - Baseline values for critical clinical measurements carried out 
during the study or identified as important indicators of prognosis 
or response to therapy.
    - Concomitant illness at trial initiation, such as renal 
disease, diabetes, heart failure.
    - Relevant previous illness.
    - Relevant previous treatment for illness treated in the study.
    - Concomitant treatment maintained, even if the dose was changed 
during the study, including oral contraceptive and hormone 
replacement therapy; treatments stopped at entry into the study 
period (or changed at study initiation).
     Other factors that might affect response to therapy 
(e.g., weight, renin status, antibody levels, metabolic status).
     Other possibly relevant variables (e.g., smoking, 
alcohol intake, special diets) and, for women, menstrual status and 
date of last menstrual period, if pertinent for the study.
    In addition to tables and graphs giving group data for these 
baseline variables, relevant individual patient demographic and 
baseline data, including laboratory values, and all concomitant 
medication for all individual patients randomized (broken down by 
treatment and by center for multicenter studies) should be presented 
in by-patient tabular listings in Appendix 16.2.4. Although some 
regulatory authorities will require all baseline data to be 
presented elsewhere in tabular listings, the Appendix to the study 
report should be limited to only the most relevant data, generally 
the variables listed above.
11.3 Measurements of Treatment Compliance
    Any measurements of compliance of individual patients with the 
treatment regimen under study and drug concentrations in body fluids 
should be summarized, analyzed by treatment group and time interval, 
and tabulated in Appendix 16.2.5.
11.4 Efficacy Results and Tabulations of Individual Patient Data
11.4.1 Analysis of Efficacy
    Treatment groups should be compared for all critical measures of 
efficacy (primary and secondary endpoints; any pharmacodynamic 
endpoints studied), as well as benefit/risk assessment(s) in each 
patient where these are utilized. In general, the results of all 
analyses contemplated in the protocol and an analysis including all 
patients with on-study data should be performed in studies intended 
to establish efficacy. The analysis should show the size (point 
estimate) of the difference between the treatments, the associated 
confidence interval, and, where utilized, the results of hypothesis 
testing.
    Analyses based on continuous variables (e.g., mean blood 
pressure or depression scale score) and categorical responses (e.g., 
cure of an infection) can be equally valid; ordinarily both should 
be presented if both were planned and are available. If categories 
are newly created (i.e., not in the statistical plan) the basis for 
them should be explained. Even if one variable receives primary 
attention (e.g., in a blood pressure study, supine blood pressure at 
week ``x''), other reasonable measures (e.g., standing blood 
pressure and blood pressures at other particular times) should be 
assessed, at least briefly. In addition, the time course of response 
should be described, if possible. For a multicenter study, where 
appropriate, data display and analysis of individual centers should 
be included for critical variables to give a clear picture of the 
results at each site, especially the larger sites.
    If any critical measurements or assessments of efficacy or 
safety outcomes were made by more than one party (e.g., both the 
investigator and an expert committee may offer an opinion on whether 
a patient had an acute infarction), overall differences between the 
ratings should be shown, and each patient having disparate 
assessments should be identified. The assessments used should be 
clear in all analyses.
    In many cases, efficacy and safety endpoints are difficult to 
distinguish (e.g., deaths in a fatal disease study). Many of the 
principles addressed below should be adopted for critical safety 
measures as well.
11.4.2 Statistical/Analytical Issues
    The statistical analysis used should be described for clinical 
and statistical reviewers in the text of the report, with detailed 
documentation of statistical methods (see Annex IX) presented in 
Appendix 16.1.9. Important features of the analysis, including the 
particular methods used, adjustments made for demographic or 
baseline measurements or concomitant therapy, handling of dropouts 
and missing data, adjustments for multiple comparisons, special 
analyses of multicenter studies, and

[[Page 37327]]

adjustments for interim analyses, should be discussed. Any changes 
in the analysis made after blind-breaking should be identified.
    In addition to the general discussion, the following specific 
issues should be addressed (unless not applicable):
11.4.2.1 Adjustments for Covariates
    Selection of, and adjustments for, demographic or baseline 
measurements, concomitant therapy, or any other covariates or 
prognostic factors should be explained in the report, and methods of 
adjustment, results of analyses, and supportive information (e.g., 
ANCOVA or Cox regression output) should be included in the detailed 
documentation of statistical methods. If the covariates or methods 
used in these analyses differed from those planned in the protocol, 
the differences should be explained and, where possible and 
relevant, the results of planned analyses should also be presented. 
Although not part of the individual study report, comparisons of 
covariate adjustments and prognostic factors across individual 
studies may be an informative analysis in a summary of clinical 
efficacy data.
11.4.2.2 Handling of Dropouts or Missing Data
    There are several factors that may affect dropout rates. These 
include the duration of the study, the nature of the disease, the 
efficacy and toxicity of the drug under study, and other factors 
that are not therapy-related. Ignoring the patients who dropped out 
of the study and drawing conclusions based only on patients who 
completed the study can be misleading. A large number of dropouts, 
however, even if included in an analysis, may introduce bias, 
particularly if there are more early dropouts in one treatment group 
or the reasons for dropping out are treatment or outcome related. 
Although the effects of early dropouts, and sometimes even the 
direction of bias, can be difficult to determine, possible effects 
should be explored as fully as possible. It may be helpful to 
examine the observed cases at various times or, if dropouts were 
very frequent, to concentrate on analyses at times when most of the 
patients were still under observation and when the full effect of 
the drug was realized. It may also be helpful to examine modeling 
approaches to the evaluation of such incomplete data sets.
    The results of a clinical trial should be assessed not only for 
the subset of patients who completed the study, but also for the 
entire patient population as randomized or at least for all those 
with any on-study measurements. Several factors should be considered 
and compared for the treatment groups in analyzing the effects of 
dropouts: The reasons for the dropouts, the time to dropout, and the 
proportion of dropouts among treatment groups at various time 
points.
    Procedures for dealing with missing data, e.g., use of estimated 
or derived data, should be described. Detailed explanation should be 
provided as to how such estimations or derivations were done and 
what underlying assumptions were made.
11.4.2.3 Interim Analyses and Data Monitoring
    The process of examining and analyzing data accumulating in a 
clinical trial, either formally or informally, can introduce bias 
and/or increase type I error. Therefore, all interim analyses, 
formal or informal, preplanned or ad hoc, by any study participant, 
sponsor staff member, or data monitoring group should be described 
in full, even if the treatment groups were not identified. The need 
for statistical adjustment because of such analyses should be 
addressed. Any operating instructions or procedures used for such 
analyses should be described. The minutes of meetings of any data 
monitoring group and any data reports reviewed at those meetings, 
particularly a meeting that led to a change in the protocol or early 
termination of the study, may be helpful and should be provided in 
Appendix 16.1.9. Data monitoring without code-breaking should also 
be described, even if this kind of monitoring is considered to cause 
no increase in type I error.
11.4.2.4 Multicenter Studies
    A multicenter study is a single study under a common protocol, 
involving several centers (e.g., clinics, practices, hospitals) 
where the data collected are intended to be analyzed as a whole (as 
opposed to a post-hoc decision to combine data or results from 
separate studies). Individual center results should be presented, 
however, where appropriate, e.g., when the centers have sufficient 
numbers of patients to make such analysis potentially valuable, the 
possibility of qualitative or quantitative treatment-by-center 
interaction should be explored. Any extreme or opposite results 
among centers should be noted and discussed, considering such 
possibilities as differences in study conduct, patient 
characteristics, or clinical settings. Treatment comparison should 
include analyses that allow for center differences with respect to 
response. If appropriate, demographic, baseline, and postbaseline 
data, as well as efficacy data, should be presented by center, even 
though the combined analysis is the primary one.
11.4.2.5 Multiple Comparisons/Multiplicity
    False/positive findings increase in number as the number of 
significance tests (number of comparisons) performed increases. If 
there was more than one primary endpoint (outcome variable) or more 
than one analysis of particular endpoint, or if there were multiple 
treatment groups or subsets of the patient population being 
examined, the statistical analysis should reflect awareness of this 
and either explain the statistical adjustment used for type I error 
criteria or give reasons why it was considered unnecessary.
11.4.2.6 Use of an ``Efficacy Subset'' of Patients
    Particular attention should be devoted to the effects of 
dropping patients with available data from analyses because of poor 
compliance, missed visits, ineligibility, or any other reason. As 
noted above, an analysis using all available data should be carried 
out for all studies intended to establish efficacy, even if it is 
not the analysis proposed as the primary analysis by the applicant. 
In general, it is advantageous to demonstrate robustness of the 
principal trial conclusions with respect to alternative choices of 
patient populations for analysis. Any substantial differences 
resulting from the choice of patient population for analysis should 
be the subject of explicit discussion.
11.4.2.7 Active-Control Studies Intended to Show Equivalence
    If an active control study is intended to show equivalence 
(i.e., lack of a difference greater than a specified size) between 
the test drug/investigational product and the active control/
comparator, the analysis should show the confidence interval for the 
comparison between the two agents for critical endpoints and the 
relation of that interval to the prespecified degree of inferiority 
that would be considered unacceptable. (See section 9.2 for 
important considerations when using the active control equivalence 
design.)
11.4.2.8 Examination of Subgroups
    If the size of the study permits, important demographic or 
baseline value-defined subgroups should be examined for unusually 
large or small responses and the results presented, e.g., comparison 
of effects by age, sex, or race; by severity or prognostic groups; 
and by history of prior treatment with a drug of the same class. If 
these analyses were not carried out because the study was too small, 
it should be noted. These analyses are not intended to ``salvage'' 
an otherwise nonsupportive study but may suggest hypotheses worth 
examining in other studies or be helpful in refining labeling 
information, patient selection, or dose selection. Where there is a 
prior hypothesis of a differential effect in a particular subgroup, 
this hypothesis and its assessment should be part of the planned 
statistical analysis.
11.4.3 Tabulation of Individual Response Data
    In addition to tables and graphs representing group data, 
individual response data and other relevant study information should 
be presented in tables. Some regulatory authorities may require all 
individual data in archival case report tabulations. What needs to 
be included in the report will vary from study to study and from one 
drug class to another, and the applicant must decide, if possible 
after consultation with the regulatory authority, what to include in 
an Appendix to the study report. The study report should indicate 
what material is included as an Appendix, what is in the more 
extensive archival case report tabulations, if required by the 
regulatory authority, and what is available on request.
    For a controlled study in which critical efficacy measurements 
or assessments (e.g., blood or urine cultures, pulmonary function 
tests, angina frequency, or global evaluations) are repeated at 
intervals, the data listings accompanying the report should include, 
for each patient, a patient identifier, all measured or observed 
values of critical measurements, including baseline measurements, 
with notation of the time during the study (e.g., days on therapy 
and time of day, if relevant) when the measurements were made, the 
drug/dose at the time (if useful, given as milligram per kilogram 
(mg/kg)), any measurements of compliance, and any concomitant 
medications at the time of, or close to the time of, measurement or 
assessment. If, aside from repeated assessments, the study included 
some overall responder versus

[[Page 37328]]

nonresponder evaluation(s) (bacteriologic cure or failure), it 
should also be included. In addition to critical measurements, the 
tabulation should note whether the patient was included in the 
efficacy evaluation (and which evaluation, if more than one), 
provide patient compliance information, if collected, and a 
reference to the location of the case report form, if included. 
Critical baseline information such as age, sex, and weight; disease 
being treated (if more than one in study); and disease stage or 
severity is also helpful. The baseline values for critical 
measurements would ordinarily be included as zero time values for 
each efficacy measurement.
    The tabulation described should usually be included in Appendix 
16.2.6 of the study report, rather than in the more extensive case 
report tabulations required by some regulatory authorities, because 
it represents the basic efficacy data supporting summary tables. 
Such a thorough tabulation can be unwieldy for review purposes, 
however, and it is expected that more targeted displays will be 
developed as well. For example, if there are many measurements 
reported, tabulations of the most critical measurements for each 
patient (e.g., the blood pressure value at certain visits might be 
more important than others) will be useful in providing an overview 
of each individual's results in a study, with each patient's 
response summarized on a single line or small number of lines.
11.4.4 Drug Dose, Drug Concentration, and Relationships to Response
    When the dose in each patient can vary, the actual doses 
received by patients should be shown and individual patient's doses 
should be tabulated. Although studies not designed as dose-response 
studies may have limited ability to contribute dose-response 
information, the available data should be examined for whatever 
information they can yield. In examining the dose response, it may 
be helpful to calculate dose as mg/kg body weight or milligram per 
square meter (mg/m2) body surface.
    Drug concentration information, if available, should also be 
tabulated (Appendix 16.2.5), analyzed in pharmacokinetic terms, and, 
if possible, related to response.
    Further guidance on the design and analysis of studies exploring 
dose-response or concentration response can be found in the ICH 
Guideline entitled ``Dose-Response Information to Support Drug 
Registration.''
11.4.5 Drug-Drug and Drug-Disease Interactions
    Any apparent relationship between response and concomitant 
therapy and between response and past and/or concurrent illness 
should be described.
11.4.6 By-Patient Displays
    While individual patient data ordinarily can be displayed in 
tabular listings, it has on occasion been helpful to construct 
individual patient profiles in other formats, such as graphic 
displays. These might, for example, show the value of a particular 
parameter(s) over time, the drug dose over the same period, and the 
times of particular events (e.g., an adverse event or change in 
concomitant therapy). Where group mean data represent the principal 
analyses, this kind of ``case report extract'' may offer little 
advantage; it may be helpful, however, if overall evaluation of 
individual responses is a critical part of the analysis.
11.4.7 Efficacy Conclusions
    The important conclusions concerning efficacy should be 
concisely described, considering primary and secondary endpoints, 
prespecified and alternative statistical approaches, and results of 
exploratory analyses.

12. Safety Evaluation

    Analysis of safety-related data can be considered at three 
levels. First, the extent of exposure (dose, duration, number of 
patients) should be examined to determine the degree to which safety 
can be assessed from the study. Second, the more common adverse 
events and laboratory test changes should be identified, classified 
in some reasonable way, compared for treatment groups, and analyzed, 
as appropriate, for factors that may affect the frequency of adverse 
reactions/events, such as time dependence, relation to demographic 
characteristics, relation to dose or drug concentration. Finally, 
serious adverse events and other significant adverse events should 
be identified, usually by close examination of patients who left the 
study prematurely because of an adverse event, whether or not 
identified as drug related, or who died.
    The ICH Guideline entitled ``Clinical Safety Data Management: 
Definitions and Standards for Expedited Reporting'' defines serious 
adverse events as follows: ``A serious adverse event (experience) or 
reaction is any untoward medical occurrence that at any dose: 
results in death, is life-threatening, requires inpatient 
hospitalization or prolongation of existing hospitalization, results 
in persistent or significant disability/incapacity, or is a 
congenital anomaly/birth defect.''
    For the purpose of this guideline, ``other significant adverse 
events'' are marked hematological and other laboratory abnormalities 
and any adverse events that led to an intervention, including 
withdrawal of drug treatment, dose reduction, or significant 
additional concomitant therapy.
    In the following sections, three kinds of analysis and display 
are called for:
    (1) Summarized data, often using tables and graphical 
presentations presented in the main body of the report;
    (2) Listings of individual patient data; and
    (3) Narrative statements of events of particular interest.
    In all tabulations and analyses, events associated with both 
test drug and control treatment should be displayed.
12.1 Extent of Exposure
    The extent of exposure to test drugs/investigational products 
(and to active control and placebo) should be characterized 
according to the number of patients exposed, the duration of 
exposure, and the dose to which they were exposed.
     Duration: Duration of exposure to any dose can be 
expressed as a median or mean, but it is also helpful to describe 
the number of patients exposed for specified periods of time, such 
as for 1 day or less, 2 days to 1 week, more than 1 week to 1 month, 
more than 1 month to 6 months. The numbers exposed to test drug(s)/
investigational product(s) for the various durations should also be 
broken down into age, sex, and racial subgroups, and any other 
pertinent subgroups, such as groups defined by disease (if more than 
one is represented), disease severity, or concurrent illness.
     Dose: The mean or median dose used and the number of 
patients exposed to specified daily dose levels should be given; the 
daily dose levels used could be the maximum dose for each patient, 
the dose with longest exposure for each patient, or the mean daily 
dose. It is often useful to provide combined dose-duration 
information, such as the numbers exposed for a given duration (e.g., 
at least 1 month) to the most common dose, the highest dose, or the 
maximum recommended dose. In some cases, cumulative dose might be 
pertinent. Dosage may be given as the actual daily dose or on a mg/
kg or mg/m2 basis, as appropriate. The number of patients 
exposed to various doses should be broken down into age, sex, 
racial, and any other pertinent subgroups.
     Drug concentration: If available, drug concentration 
data (e.g., concentration at the time of an event, maximum plasma 
concentration, area under curve) may be helpful in individual 
patients for correlation with adverse events or changes in 
laboratory variables. (Appendix 16.2.5.)
    It is assumed that all patients entered into treatment who 
received at least one dose of the treatment are included in the 
safety analysis; if not, an explanation should be provided.
12.2 Adverse Events
12.2.1 Brief Summary of Adverse Events
    The overall adverse event experience in the study should be 
described in a brief narrative, supported by the following more 
detailed tabulations and analyses. In these tabulations and 
analyses, events associated with both the test drug and control 
treatment should be displayed.12.2.2 Display of Adverse Events
    All adverse events occurring after initiation of study 
treatments (including events likely to be related to the underlying 
disease or likely to represent concomitant illness, unless there is 
a prior agreement with the regulatory authority to consider 
specified events as disease related) should be displayed in summary 
tables (section 14.3.1). The tables should include changes in vital 
signs and any laboratory changes that were considered serious 
adverse events or other significant adverse events.
    In most cases, it will also be useful to identify in such tables 
``treatment emergent signs and symptoms'' (TESS: events not seen at 
baseline and events that worsened even if present at baseline).
    The tables should list each adverse event, the number of 
patients in each treatment group in whom the event occurred, and the 
rate of occurrence. When treatments are cyclical, e.g., cancer 
chemotherapy, it may also be helpful to list results separately for 
each cycle. Adverse events should be grouped by body system. Each 
event may then be divided into defined severity categories (e.g., 
mild, moderate, severe) if these were used. The tables may also 
divide

[[Page 37329]]

the adverse events into those considered at least possibly related 
to drug use and those considered not related, or use another 
causality scheme (e.g., unrelated or possibly, probably, or 
definitely related). Even when such a causality assessment is used, 
the tables should include all adverse events, whether or not 
considered drug related, including events thought to represent 
intercurrent illnesses. Subsequent analyses of the study or of the 
overall safety data base may help to distinguish between adverse 
events that are, or are not, considered drug related. So that it is 
possible to analyze and evaluate the data in these tables, it is 
important to identify each patient having each adverse event. An 
example of such a tabular presentation is shown below.

                ADVERSE EVENTS: NUMBER OBSERVED AND RATE,               
                      WITH PATIENT IDENTIFICATIONS                      
                                                                        
         Treatment Group X                                  N=50        
------------------------------------------------------------------------
               Mild        Moderate       Severe         Total     Total
         ---------------------------------------------------------------
          Related1  NR1  Related   NR  Related   NR  Related   NR   R+NR
------------------------------------------------------------------------
Body                                                                    
 System                                                                 
 A                                                                      
Event 1   6(12%)    2(4  3(6%)    1(2  3(6%)    1(2  12(24%)  4(8       
                     %)            %)            %)            %)       
                                                                        
                                                                        
                                                                        
          N112      N21  N31      N41  N51      N61                     
                                                                        
                                                                        
          N12       N22  N32           N52                              
                                                                        
                                                                        
          N13            N33           N53                              
                                                                        
                                                                        
          N14                                                           
                                                                        
                                                                        
          N15                                                           
                                                                        
                                                                        
          N16                                                           
                                                                        
                                                                        
                                                                        
                                                                        
                                                                        
Event 2                                                                 
                                                                        
                                                                        
------------------------------------------------------------------------
\1\NR = not related; related could be expanded, e.g., as definite,      
  probable, possible.                                                   
\2\Patient identification number.                                       

    In addition to these complete tables provided in section 14.3.1, 
an additional summary table comparing treatment and control groups, 
without the patient identifying numbers and limited to relatively 
common adverse events (e.g., those in at least 1 percent of the 
treated group), should be provided in the body of the report.
    In presenting adverse events, it is important both to display 
the original terms used by the investigator and to attempt to group 
related events (i.e., events that probably represent the same 
phenomenon), so that the true occurrence rate is not obscured. One 
way to do this is with a standard adverse reaction/events 
dictionary.
12.2.3 Analysis of Adverse Events
    The basic display of adverse event rates described in section 
12.2.2 (and located in section 14.3.1) of the report should be used 
to compare rates in treatment and control groups. For this analysis, 
it may be helpful to combine the event severity categories and the 
causality categories, leading to a simpler side-by-side comparison 
of treatment groups. In addition, although this is usually best done 
in an integrated analysis of safety, if study size and design 
permit, it may be useful to examine the more common adverse events 
that seem to be drug related for relationship to dosage and mg/kg or 
mg/m2 dose; dose regimen; duration of treatment; total dose; 
demographic characteristics such as age, sex, race; other baseline 
features such as renal status, efficacy outcomes, and drug 
concentration. It may also be useful to examine time of onset and 
duration of adverse events. A variety of additional analyses may be 
suggested by the study results or by the pharmacology of the test 
drug/investigational product.
    It is not intended that every adverse event be subjected to 
rigorous statistical evaluation. It may be apparent from initial 
display and inspection of the data that a significant relation to 
demographic or other baseline features is not present. If the 
studies are small and if the number of events is relatively small, 
it may be sufficient to limit analyses to a comparison of treatment 
and control.
    Under certain circumstances, life table or similar analyses may 
be more informative than reporting of crude adverse event rates. 
When treatments are cyclical, e.g., cancer chemotherapy, it may also 
be helpful to analyze results separately for each cycle.
12.2.4 Listing of Adverse Events by Patient
    All adverse events for each patient, including the same event on 
several occasions, should be listed in Appendix 16.2.7, giving both 
preferred term and the original term used by the investigator. The 
listing should be by investigator and by treatment group and should 
include:
    - Patient identifier.
    - Age, race, sex, weight (height, if relevant).
    - Location of case report forms, if provided.
    - The adverse event (preferred term, reported term).
    - Duration of the adverse event.
    - Severity (e.g., mild, moderate, severe).
    - Seriousness (serious/nonserious).
    - Action taken (none, dose reduced, treatment stopped, specific 
treatment instituted, and so forth).
    - Outcome (e.g., CIOMS format).
    - Causality assessment (e.g., related/not related). How this was 
determined should be described in the table or elsewhere.
    - Date of onset or date of clinic visit at which the event was 
discovered.
    - Timing of onset of the adverse event in relation to the last 
dose of the test drug/investigational product (when applicable).
    - Study treatment at the time of event or the most recent study 
treatment taken.
    - Test drug/investigational product dose in absolute amount, mg/
kg or mg/m2, at time of event.
    - Drug concentration (if known).
    - Duration of test drug/investigational product treatment.
    - Concomitant treatment during study.
    Any abbreviations and codes should be clearly explained at the 
beginning of the listing or, preferably, on each page.
12.3 Deaths, Other Serious Adverse Events, and Other Significant 
Adverse Events
    Deaths, other serious adverse events, and other significant 
adverse events deserve special attention.
12.3.1 Listing of Deaths, Other Serious Adverse Events, and Other 
Significant Adverse Events
    Listings, containing the same information as called for in 
section 12.2.4, should be provided for the following events.
12.3.1.1 Deaths
    All deaths during the study, including the post-treatment 
followup period, and deaths that resulted from a process that began 
during the study, should be listed by patient in section 14.3.2.
12.3.1.2 Other Serious Adverse Events
    All serious adverse events (other than death but including the 
serious adverse events temporally associated with or preceding the 
deaths) should be listed in section 14.3.2. The listing should 
include laboratory abnormalities, abnormal vital signs, and abnormal 
physical observations that were considered serious adverse events.
12.3.1.3 Other Significant Adverse Events

[[Page 37330]]

    Marked hematological and other laboratory abnormalities (other 
than those meeting the definition of serious) and any events that 
led to an intervention, including withdrawal of test drug/
investigational product treatment, dose reduction, or significant 
additional concomitant therapy, other than those reported as serious 
adverse events, should be listed in section 14.3.2.
12.3.2 Narratives of Deaths, Other Serious Adverse Events, and 
Certain Other Significant Adverse Events
    There should be a brief narrative describing each death, other 
serious adverse event, and other significant adverse event that is 
judged to be of special interest because of clinical importance. 
These narratives can be placed either in the text of the report or 
in section 14.3.3, depending on their number. Events that were 
clearly unrelated to the test drug/investigational product may be 
omitted or described very briefly. In general, the narrative should 
describe the following: The nature and intensity of event; the 
clinical course leading up to event, with an indication of timing 
relevant to test drug/investigational product administration; 
relevant laboratory measurements; whether the drug was stopped, and 
when; countermeasures; post-mortem findings; investigator's opinion 
on causality and sponsor's opinion on causality, if appropriate.
    In addition, the following information should be included:
    - Patient identifier.
    - Age and sex of patient; general clinical condition of patient, 
if appropriate.
    - Disease being treated (this is not required if it is the same 
for all patients) with duration (of current episode) of illness.
    - Relevant concomitant/previous illnesses with details of 
occurrence/ duration.
    - Relevant concomitant/previous medication with details of 
dosage.
    - Test drug/investigational product administered; drug dose, if 
this varied among patients; and length of time administered.
12.3.3 Analysis and Discussion of Deaths, Other Serious Adverse 
Events, and Other Significant Adverse Events
    The significance of the deaths, other serious adverse events, 
and other significant adverse events leading to withdrawal, dose 
reduction, or institution of concomitant therapy should be assessed 
with respect to the safety of the test drug/investigational product. 
Particular attention should be paid to whether any of these events 
may represent a previously unsuspected important adverse effect of 
the test drug/investigational product. For serious adverse events 
that appear of particular importance, it maybe useful to use life 
table or similar analyses to show their relation to time on test 
drug/investigational product and to assess their risk over time.
12.4 Clinical Laboratory Evaluation
12.4.1 Listing of Individual Laboratory Measurements by Patient 
(Appendix 16.2.8) and Each Abnormal Laboratory Value (section 
14.3.4)
    When required by regulatory authorities, the results of all 
safety-related laboratory tests should be available in tabular 
listings, using a display similar to the following, where each row 
represents a patient visit at which a laboratory study was done, 
with patients grouped by investigator (if more than one) and 
treatment group, and columns include critical demographic data, drug 
dose data, and the results of the laboratory tests. Because not all 
tests can be displayed in a single table, they should be grouped 
logically (e.g., hematological tests, liver chemistries, 
electrolytes, urinalysis). Abnormal values should be identified, 
e.g., by underlining or bracketing. These listings should be 
submitted as part of the registration/marketing application, when 
this is required, or may be available on request.

List of Laboratory Measurement

                                                                                                                
----------------------------------------------------------------------------------------------------------------
                                                                                          Laboratory Tests      
----------------------------------------------------------------------------------------------------------------
            Patient                Time     Age     Sex    Race    Weight    Dose    SGOT    SGPT     AP     X  
----------------------------------------------------------------------------------------------------------------
#1        .....................  T0       70      M       W       70 kg     400 mg  V1 Vn = value of particular test
    For all regulatory authorities, there should be a by-patient 
listing of all abnormal laboratory values in section 14.3.4, using 
the format described above. For laboratory abnormalities of special 
interest (abnormal laboratory values of potential clinical 
importance), it may also be useful to provide additional data, such 
as normal values before and after the abnormal value, and values of 
related laboratory tests. In some cases, it may be desirable to 
exclude certain abnormal values from further analysis. For example, 
single, nonreplicated, small abnormalities of some tests (e.g., uric 
acid or electrolytes) or occasional low values of some tests (e.g., 
transaminase, alkaline phosphatase, or BUN) can probably be defined 
as clinically insignificant and excluded. Any such decisions should 
be clearly explained, however, and the complete list of values 
provided (or available to authorities on request) should identify 
every abnormal value.
12.4.2 Evaluation of Each Laboratory Parameter
    The necessary evaluation of laboratory values will in part be 
determined by the results seen, but, in general, the following 
analyses should be provided. For each analysis, comparison of the 
treatment and control groups should be carried out, as appropriate 
and compatible with study size. In addition, normal laboratory 
ranges should be given for each analysis.
12.4.2.1 Laboratory Values Over Time
    For each parameter at each time over the course of the study 
(e.g., at each visit) the following should be described: The group 
mean or median values, the range of values, and the number of 
patients with abnormal values or with abnormal values that are of a 
certain size (e.g., twice the upper limit of normal or five times 
the upper limit; choices should be explained). Graphs may be used.
12.4.2.2 Individual Patient Changes
    An analysis of individual patient changes by treatment group 
should be given. A variety of approaches may be used, including:
    I. ``Shift tables'' - These tables show the number of patients 
who are low, normal, or high at baseline and at selected time 
intervals.
    II. Tables showing the number or fraction of patients who had a 
change in parameter of a predetermined size at selected time 
intervals. For example, for BUN, it might be decided that a change 
of more than 10 mg/dL BUN should be noted. For this parameter, the 
number of patients having a smaller or greater change would be shown 
for one or more visits, usually grouping patients separately 
depending on baseline BUN (normal or elevated). The possible 
advantage of this display, compared to the usual shift table, is 
that changes of a certain size are noted, even if the final value is 
not abnormal.
    III. A graph comparing the initial value and the on-treatment 
values of a laboratory measurement for each patient by locating the 
point defined by the initial value on the abscissa and a subsequent 
value on the ordinate. If no changes occur, the point representing 
each patient will be located on the 45 deg. line. A general shift to 
higher values will show a clustering of points above the 45 deg. 
line. As this display usually shows only a single time point for a 
single treatment, interpretation requires a time series of these 
plots for treatment and control groups. Alternatively, the display 
could show baseline and most extreme on-treatment value. These 
displays identify outliers

[[Page 37331]]

readily (it is useful to include patient identifiers for the 
outliers).
12.4.2.3 Individual Clinically Significant Abnormalities
    Clinically significant changes (defined by the applicant) should 
be discussed. A narrative of each patient whose laboratory 
abnormality was considered a serious adverse event and, in certain 
cases, considered an ``other significant adverse event,'' should be 
provided under section 12.3.2 or 14.3.3. When toxicity grading 
scales are used (e.g., WHO, NCI), changes graded as severe should be 
discussed regardless of seriousness. An analysis of the clinically 
significant changes, together with a recapitulation of 
discontinuations due to laboratory measurements, should be provided 
for each parameter. The significance of the changes and likely 
relation to the treatment should be assessed, e.g., by analysis of 
such features as relationship to dose, relationship to drug 
concentration, disappearance on continued therapy, positive 
dechallenge, positive rechallenge, and the nature of concomitant 
therapy.
12.5 Vital Signs, Physical Findings, and Other Observations Related 
to Safety
    Vital signs, other physical findings, and other observations 
related to safety should be analyzed and presented in a way similar 
to laboratory variables. If there is evidence of a drug effect, any 
dose-response or drug-concentration-response relationship or 
relationship to patient variables (e.g., disease, demographics, 
concomitant therapy) should be identified and the clinical relevance 
of the observation described. Particular attention should be given 
to changes not evaluated as efficacy variables and to those 
considered to be adverse events.
12.6 Safety Conclusions
    The overall safety evaluation of the test drug(s)/
investigational product(s) should be reviewed, with particular 
attention to events resulting in changes of dose or need for 
concomitant medication, serious adverse events, events resulting in 
withdrawal, and deaths. Any patients or patient groups at increased 
risk should be identified and particular attention should be paid to 
potentially vulnerable patients who may be present in small numbers, 
e.g., children, pregnant women, frail elderly, people with marked 
abnormalities of drug metabolism or excretion. The implication of 
the safety evaluation for the possible uses of the drug should be 
described.

13. Discussion and Overall Conclusions

    The efficacy and safety results of the study and the 
relationship of risks and benefits should be briefly summarized and 
discussed, referring to the tables, figures, and sections above as 
needed. The presentation should not simply repeat the description of 
results nor introduce new results.
    The discussion and conclusions should clearly identify any new 
or unexpected findings, comment on their significance, and discuss 
any potential problems such as inconsistencies between related 
measures. The clinical relevance and importance of the results 
should also be discussed in the light of other existing data. Any 
specific benefits or special precautions required for individual 
subjects or at-risk groups and any implications for the conduct of 
future studies should be identified. Alternatively, such discussions 
may be reserved for summaries of safety and efficacy referring to 
the entire dossier (integrated summaries).

14. Tables, Figures, and Graphs Referred to but not Included in the 
Text

    Figures should be used to visually summarize the important 
results, or to clarify results that are not easily understood from 
tables.
    Important demographic, efficacy, and safety data should be 
presented in summary figures or tables in the text of the report. 
However, if these become obtrusive because of size or number they 
should be presented here, cross-referenced to the text, along with 
supportive, or additional, figures, tables, or listings.
    The following information may be presented in this section of 
the core clinical study report:
14.1 Demographic Data Summary figures and tables.
14.2 Efficacy Data Summary figures and tables.
14.3 Safety Data Summary figures and tables.
14.3.1 Displays of Adverse Events
14.3.2 Listings of Deaths, Other Serious and Significant Adverse 
Events
14.3.3 Narratives of Deaths, Other Serious and Certain Other 
Significant Adverse Events
14.3.4 Abnormal Laboratory Value Listing (each patient)

15. Reference List

    A list of articles from the literature pertinent to the 
evaluation of the study should be provided. Copies of important 
publications should be attached in an Appendix (Appendices 16.1.11 
and 16.1.12). References should be given in accordance with the 
internationally accepted standards of the 1979 Vancouver Declaration 
on ``Uniform Requirements for Manuscripts Submitted to Biomedical 
Journals'' or the system used in ``Chemical Abstracts.''

16. Appendices

    This section should be prefaced by a full list of all Appendices 
available for the study report. Where permitted by the regulatory 
authority, some of the following Appendices need not be submitted 
with the report but need to be provided only on request.
    The applicant should therefore clearly indicate those Appendices 
that are submitted with the report.
    N.B.: In order to have Appendices available on request, they 
should be finalized by the time of filing of the submission.
16.1 Study Information
16.1.1 Protocol and protocol amendments.
16.1.2 Sample case report form (unique pages only).
16.1.3 List of IEC's or IRB's (plus the name of the committee chair 
if required by the regulatory authority) and representative written 
information for patient and sample consent forms.
16.1.4 List and description of investigators and other important 
participants in the study, including brief (one page) CV's or 
equivalent summaries of training and experience relevant to the 
performance of the clinical study.
16.1.5 Signatures of principal or coordinating investigator(s) or 
sponsor's responsible medical officer, depending on the regulatory 
authority's requirement.
16.1.6 Listing of patients receiving test drug(s)/investigational 
product(s) from specific batches, where more than one batch was 
used.
16.1.7 Randomization scheme and codes (patient identification and 
treatment assigned).
16.1.8 Audit certificates (if available).
16.1.9 Documentation of statistical methods.
16.1.10 Documentation of inter-laboratory standardization methods 
and quality assurance procedures if used.
16.1.11 Publications based on the study.
16.1.12 Important publications referenced in the report.
16.2 Patient Data Listings
16.2.1 Discontinued patients.
16.2.2 Protocol deviations.
16.2.3 Patients excluded from the efficacy analysis.
16.2.4 Demographic data.
16.2.5 Compliance and/or drug concentration data (if available).
16.2.6 Individual efficacy response data.
16.2.7 Adverse event listings (each patient).
16.2.8 Listing of individual laboratory measurements by patient, 
when required by regulatory authorities.
16.3 Case Report Forms (CRF's)
16.3.1 CRF's for deaths, other serious adverse events, and 
withdrawals for adverse events.
16.3.2 Other CRF's submitted.
16.4 Individual Patient Data Listings (U.S. Archival Listings)
BILLING CODE 4160-01-F

[[Page 37332]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.000



[[Page 37333]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.001



[[Page 37334]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.002



[[Page 37335]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.003



[[Page 37336]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.004



[[Page 37337]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.005



[[Page 37338]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.006



[[Page 37339]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.007



[[Page 37340]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.008



[[Page 37341]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.009



[[Page 37342]]

[GRAPHIC] [TIFF OMITTED] TN17JY96.010



BILLING CODE 4160-01-C

[[Page 37343]]

ANNEX VIII

Guidance for Section 11.4.2--Statistical/Analytical Issues and Appendix 
16.1.9

A. Statistical Considerations

    Details of the statistical analysis performed on each primary 
efficacy variable should be presented in Appendix 16.1.9. Details 
reported should include at least the following information:
    (a) The statistical model underlying the analysis. This should 
be presented precisely and completely, using references if 
necessary.
    (b) A statement of the clinical claim tested in precise 
statistical terms, e.g., in terms of null and alternative 
hypotheses.
    (c) The statistical methods applied to estimate effects, 
construct confidence intervals, etc. Literature references should be 
included where appropriate.
    (d) The assumptions underlying the statistical methods. It 
should be shown, insofar as statistically reasonable, that the data 
satisfy crucial assumptions, especially when necessary to confirm 
the validity of an inference. When extensive statistical analyses 
have been performed by the applicant, it is essential to consider 
the extent to which the analyses were planned prior to the 
availability of data and, if they were not, how bias was avoided in 
choosing the particular analysis used as a basis for conclusions. 
This is particularly important in the case of any subgroup analyses, 
because if such analyses are not preplanned they will ordinarily not 
provide an adequate basis for definitive conclusions.
    (i) In the event data transformation was performed, a rationale 
for the choice of data transformation along with interpretation of 
the estimates of treatment effects based on transformed data should 
be provided.
    (ii) A discussion of the appropriateness of the choice of 
statistical procedure and the validity of statistical conclusions 
will guide the regulatory authority's statistical reviewer in 
determining whether reanalysis of data is needed.
    (e) The test statistic, the sampling distribution of the test 
statistic under the null hypothesis, the value of the test 
statistic, significance level (i.e., p-value), and intermediate 
summary data, in a format that enables the regulatory authority's 
statistical reviewer to verify the results of the analysis quickly 
and easily. The p-values should be designated as one or two tailed. 
The rationale for using a one-tailed test should be provided.
    For example, the documentation of a two-sample t-test should 
consist of the value of the t-statistic, the associated degrees of 
freedom, the p-value, the two sample sizes, mean and variance for 
each of the samples, and the pooled estimate of variance. The 
documentation of multicenter studies analyzed by analysis of 
variance techniques should include, at a minimum, an analysis of 
variance table with terms for centers, treatments, their 
interaction, error, and total. For crossover designs, the 
documentation should include information regarding sequences, 
patients within sequences, baselines at the start of each period, 
washouts and length of washouts, dropouts during each period, 
treatments, periods, treatment by period interaction, error, and 
total. For each source of variation, aside from the total, the table 
should contain the degrees of freedom, the sum of squares, the mean 
square, the appropriate F-test, the p-value, and the expected mean 
square.
    Intermediate summary data should display the demographic data 
and response data, averaged or otherwise summarized, for each 
center-by-treatment combination (or other design characteristic such 
as sequence) at each observation time.

B. Format and Specifications for Submission of Data Requested by 
Regulatory Authority's Statistical Reviewers

    In the report of each controlled clinical study, there should be 
data listings (tabulations) of patient data utilized by the sponsor 
for statistical analyses and tables supporting conclusions and major 
findings. These data listings are necessary for the regulatory 
authority's statistical review, and the sponsor may be asked to 
supply these patient data listings in a computer-readable form.

    Dated: July 3, 1996.
William B. Schultz,
Deputy Commissioner for Policy.
[FR Doc. 96-18000 Filed 7-16-96; 8:45 am]
BILLING CODE 4160-01-F