Methodology Overview

Methodology Overview
 The Academy of Nutrition and Dietetics (Academy) is a leader in the process of Evidence Analysis

One reason for this is, in part, the combination of the rigor and transparency of our process. Our goal is not only to be as thorough as possible, but to make each step in our process completely clear.

The idea behind this is that, by using our process, other individuals and organizations could use our process and come to the same conclusions.

Recognition of the Academy's Evidence Analysis Process

At the Academy, we are convinced that our rigorous process of evidence analysis is simply the best there is. But don't take our word for it. Consider the following:

  • Academy's Evidence Analysis process was recognized by JCAHO as exemplary of bringing the best research to practice
  • Academy's Evidence Analysis process was adapted by the FDA to assess the type of qualified health claim that can be put on food labels
  • Academy's Research and Strategic Business Development staff has trained staff and task force members for USDA, DHHS, and FDA.
 Steps in the Academy Evidence Analysis Process

The table below offers a brief overview of the steps in our process. For a more detailed, step-by-step description of our Evidence Analysis process, see our Evidence Analysis Manual.

Step in the Evidence Analysis Process

Brief Description

 

Step 1 

Formulate the Question

 

Specify a question in a defined area of practice; or state a tentative conclusion or recommendation that is being considered. Include the patient type and special needs of the target population involved, the alternatives under consideration, and the outcomes of interest.

Step 2 

Gather and Classify Evidence Reports

Conduct a systematic search of the literature to find evidence related to the question, gather studies and reports, and classify them by type of evidence. Classes differentiate primary reports of new data according to study design, and distinguish them from reports that are a systematic review and synthesis of primary reports. 

(Classes used by Academy are A, B, C, D, M, R, and X.)

Step 3 

Critically Appraise Each Report

Review each report for relevance to the question and critique for scientific validity. Abstract key information from the research article and report it on the online worksheet.  Answer the questions in the quality criteria checklist and assign a code to indicate the quality of the study.

(Academy uses the symbols:  +, -, Ø, NA to designate positive, negative, neutral, or not assessed).

Step 4 

Summarize Evidence in an narrative form and an overview table. 

Combine findings from all reports into a narrative evidence summary and/or an overview table that summarizes the relevant information from each article worksheet and allows for comparisons across articles. 

Step 5 

Develop a conclusion statement and Grade the Strength of Evidence Supporting the Conclusion.

Arrive at a concise conclusion statement (the answer to the question).  Take into account the synthesis of all relevant studies and reports, their class, and their quality ratings. Assign a grade to indicate the overall strength or weakness of evidence informing the conclusion statement. 

Academy uses Grades I, II, and III, for strong, fair, and weak; Grade IV designates expert opinion only; and Grade V indicates not assignable (because there is no evidence that directly supports or refutes the question).

For more detail, please go to the "Evidence Analysis Process" tab on the EAL.