EE: Number of Measurements (2005)

Citation:
 
Study Design:
Class:
- Click here for explanation of classification scheme.
Quality Rating:
Research Purpose:
  1. Evaluate the consistency of measurements in adult, healthy volunteers taken over a three-day period using a mouthpiece or nose clips, face mask and ventilated canopy
  2. To systematically evaluate the reactivity of the testing procedure and whether this reactivity varies as a function of the collection system used
  3. To determine the degree of reliability of a single measurement of varying duration using a mouthpiece, face mask and canopy data collection system.
Inclusion Criteria:
  1. Understand and give written consent
  2. Healthy (screened for respiratory disorders, medication usage known to affect metabolic rates and any medical condition thought to be associated with metallic rate—diabetes, eating disorders
  3. Adult volunteers
  4. Females
  5. Non-smoking
  6. Weight falling between the 25th and 75th percentile norms.
Exclusion Criteria:
  1. Refusal to consent
  2. Not meeting inclusion criteria
  3. Diseases in subjects that were excluded: Diabetes, eating disorders
  4. Medications excluded: those known to affect metabolic rates
  5. Smokers
  6. Overweight or underweight.
Description of Study Protocol:

Recruitment

Subjects recruited through newspaper advertisements

Design

Time series

Blinding used

Not applicable

Intervention

Not applicable

Statistical Analysis

  • 3 (system) X 3 (time) X 2 (first five minutes vs. 40 subsequent minutes) repeated measures analysis of variance to evaluate possible reactivity and differences between systems and across time
  • Intraclass correlation coefficients (ICC) calculated to determine reliability
    • One-way analysis of variance to calculate both the within-subject and between-subject variances
    • ICC then computed as the ratio of these variance components
    • ICCs were computed for each collection method on 10-, 20- and 40-minute blocks following the five-minute adaptation period
    • An ICC of 0.70 is considered an acceptable level of reliability.
Data Collection Summary:

Timing of Measurements

Data were collected on each subject for 50 consecutive minutes a day over three consecutive days at the same time of day. 

Dependent variables/outcomes

  • Reactivity of testing procedures
  • Differences between collection systems
  • Reliability of a single metabolic measurement of varying duration using different collection systems.

Independent variables/measures

Indirect calorimetry using three different collection systems:

  • IC type: Subjects stratified randomly and assigned (based on baseline predicted resting energy expenditures) to one of three collection methods:
    • Mouthpiece or nose clips
    • Face mask
    • Ventilated canopy
  • Equipment of calibration: Yes prior to each test; in addition leakage carefully controlled in all three collection systems; throughout testing subjects were monitored to insure leakage had not occurred
  • Coefficient of variation using std gases: Yes
  • Rest before measure: Five minutes prior to testing
  • Measurement length: 50 consecutive minutes a day for three consecutive days at the same time of day with the same collection system assigned to
  • Steady state: Not discussed
  • Fasting length: Abstain from food and caffeinated beverages for five hours prior to testing
  • Exercise restrictions: Instructed to avoid any strenuous, aerobic-type physical activity for at least five hours prior to testing
  • Room temp: Thermally neutral
  • Number of measures within the measurement period: Intraclass correlation coefficients (ICCs) were computed for each collection method on 10-, 20- and 40-minute blocks following the five-minute adaptation period (not eliminated)
  • Were some measures eliminated? No
  • Were a set of measurements averaged? REE across the three days were averaged to evaluate whether REE measurements in the first five minutes were different than in the subsequent 40-minute period
  • Training of measurer? Not mentioned
  • Subject training of measuring process? Yes; while resting before testing (five minutes)
  • Monitored heart rate? Not discussed
  • Body temperature? Not discussed
  • Medications administered? Not discussed.

 

Description of Actual Data Sample:
  • Initial N: N=30
  • Attrition (final N):  N=30 non-smoking adult females
  • Age:  Not reported
  • Ethnicity:  Not reported
  • Other relevant demographics: Not reported
  • Anthropometrics:  Not reported (inclusion criteria: Between 25th and 75th percentile for weight)
  • Location: Memphis State University and University of Tennessee, Memphis, TN.
Summary of Results:
  • Results indicated no significant effects for collection procedure, day or interactions between method and day
  • There were no significant differences between methods on the first five minutes or between methods on the last 40 minutes
  • However, all three methods had significantly elevated REE measurements (reactivity) in the first five minutes of testing compared with the subsequent 40 minutes (see below)
    • There was a significant two-way interaction between method and reactivity (P=0.023).

Collection Method* Mean REE(kcal per day) ±SD

  1. Mouthpiece
    • First five minutes=1,521.71±270.86
    • 40 minutes=1,250.86±135.68
    • P<0.001                                                                                                  
    • Reduction=270.86kcal per day
  2. Face mask       
    • First five minutes=1,509.67±171.85
    • 40 minutes=1,337.82±182.85
    • P<0.05
    • Reduction=171.85kcal per day
  3. Canopy           
    • First five minutes=1,674.97±379.01
    • 40 minutes=1,295.96±162.97
    • P<0.000
    • Reduction=379.01kcal per day.

*mean REE=average REE over three-day measurement period

The face mask had the least drop in resting energy expenditure.

ICCs For Collection Method

  1. Mouthpiece/nose clips
    • 10-minutes=0.75
    • 20-minutes=0.62
    • 40-minutes=0.40
  2. Face mask
    • 10-minutes=0.43
    • 20-minutes=0.60
    • 40-minutes=0.79
  3. Canopy
    • 10-minutes=0.44
    • 20-minutes=0.75
    • 40-minutes=0.79.
  • As indicated above, the mouthpiece shows acceptable reliability (>0.7) for the 10-minute period, but the reliability progressively decreased as the measurement duration increased
  • The face mask show poor reliability for the 10-minutes, an increase in reliability with a 20-minute measurement and strong reliability with a 40-minute measurement length
  • For the canopy, the 10-minute period showed poor reliability, but both the 20- and 40-minute measurement periods were strongly reliable.

 

Author Conclusion:
  • The results of the current study indicate that there are no significant REE differences between data collected with mouthpiece or nose clips, a face mask or a canopy collection system. Additionally, there were no differences between systems over time.
  • However, across all three days of measurement, the first five minutes of data collection on all three systems were more reactive (i.e., significantly higher) than the subsequent 40 minutes of assessment. Reliability analyses indicated that following a five-minute adjustment period, acceptable reliability coefficients were obtained after 20 minutes of continuous data collection in the ventilated canopy and after 40 minutes with the face mask. Reliability coefficients with the mouthpiece and nose clips steadily decreased as the length of the testing session increased.
  • The finding that the first five minutes of data collection were significantly higher than the subsequent 40 minutes despite the fact that the subjects rested prior to assessment and the procedure was explained to them prior to initiation, confirms earlier observations which indicated a need to acclimate to the testing procedure once the collection system was attached and also indicated that values obtained during the first five minutes were likely to be unstable and unrepresentative regardless of the method used. Thus, it is recommended that a five-minute acclimation period following attachment of the collection system be conducted in all clinical and research studies.
  • Results also indicated that reliability of both the face mask and the canopy increased as test length increased. In contrast, the data collected with the mouthpiece or nose clips method indicated that as test duration increased, reliability decreased. This is likely due to increasing discomfort on the part of the subject with the mouthpiece and nose clips as test length increased (acceptable reliability obtained after 10-minutes). Given that most clinical and research metabolic evaluations require relatively longer test durations, it is recommended that either a face mask or canopy be used for testing sessions lasting longer than 10 minutes.
  • Whereas the canopy system achieved acceptable levels of reproducibility following a 20-minute test, it appears that both the face mask and canopy are reliable collection methods during longer tests (40 minutes)
  • On balance, the feature of reliability, comfort and non-obtrusiveness my make the canopy system a more advantageous method for measuring REE in research and clinical applications
  • In summary, it appears that both the face mask and canopy data collection systems yield reproducible metabolic data, provided that acclimation to the procedure be conducted.
Funding Source:
Government: NHLBI, State of Tennessee
Reviewer Comments:

Strengths

Good description of three metabolic collection systems; the calibration and evaluation of leakage throughout the testing sessions.

 

Limitations

  • Limited generalizability; sample consisted of healthy females and generalizability to males and other populations is not known
  • Sample was restricted to non-obese and nonsmokers
  • Role of factors such as smoking, obesity (?)
  • Data on age, height, weight, ethnicity not reported (potential confounders?)
  • Measurements made after five-hour fast rather than more standard 12-hour fast, and had not participated in physical activity for only five hours; number of hours may not have been consistent across groups (accounted for by testing conducted at same time each day?)

 

 

Quality Criteria Checklist: Primary Research
Relevance Questions
  1. Would implementing the studied intervention or procedure (if found successful) result in improved outcomes for the patients/clients/population group? (Not Applicable for some epidemiological studies) Yes
  2. Did the authors study an outcome (dependent variable) or topic that the patients/clients/population group would care about? Yes
  3. Is the focus of the intervention or procedure (independent variable) or topic of study a common issue of concern to dieteticspractice? Yes
  4. Is the intervention or procedure feasible? (NA for some epidemiological studies) Yes
 
Validity Questions
1. Was the research question clearly stated? Yes
  1.1. Was (were) the specific intervention(s) or procedure(s) [independent variable(s)] identified? Yes
  1.2. Was (were) the outcome(s) [dependent variable(s)] clearly indicated? Yes
  1.3. Were the target population and setting specified? Yes
2. Was the selection of study subjects/patients free from bias? ???
  2.1. Were inclusion/exclusion criteria specified (e.g., risk, point in disease progression, diagnostic or prognosis criteria), and with sufficient detail and without omitting criteria critical to the study? Yes
  2.2. Were criteria applied equally to all study groups? Yes
  2.3. Were health, demographics, and other characteristics of subjects described? ???
  2.4. Were the subjects/patients a representative sample of the relevant population? ???
3. Were study groups comparable? ???
  3.1. Was the method of assigning subjects/patients to groups described and unbiased? (Method of randomization identified if RCT) ???
  3.2. Were distribution of disease status, prognostic factors, and other factors (e.g., demographics) similar across study groups at baseline? ???
  3.3. Were concurrent controls or comparisons used? (Concurrent preferred over historical control or comparison groups.) Yes
  3.4. If cohort study or cross-sectional study, were groups comparable on important confounding factors and/or were preexisting differences accounted for by using appropriate adjustments in statistical analysis? N/A
  3.5. If case control study, were potential confounding factors comparable for cases and controls? (If case series or trial with subjects serving as own control, this criterion is not applicable.) N/A
  3.6. If diagnostic test, was there an independent blind comparison with an appropriate reference standard (e.g., "gold standard")? N/A
4. Was method of handling withdrawals described? N/A
  4.1. Were follow-up methods described and the same for all groups? N/A
  4.2. Was the number, characteristics of withdrawals (i.e., dropouts, lost to follow up, attrition rate) and/or response rate (cross-sectional studies) described for each group? (Follow up goal for a strong study is 80%.) N/A
  4.3. Were all enrolled subjects/patients (in the original sample) accounted for? N/A
  4.4. Were reasons for withdrawals similar across groups? N/A
  4.5. If diagnostic test, was decision to perform reference test not dependent on results of test under study? N/A
5. Was blinding used to prevent introduction of bias? No
  5.1. In intervention study, were subjects, clinicians/practitioners, and investigators blinded to treatment group, as appropriate? N/A
  5.2. Were data collectors blinded for outcomes assessment? (If outcome is measured using an objective test, such as a lab value, this criterion is assumed to be met.) N/A
  5.3. In cohort study or cross-sectional study, were measurements of outcomes and risk factors blinded? N/A
  5.4. In case control study, was case definition explicit and case ascertainment not influenced by exposure status? N/A
  5.5. In diagnostic study, were test results blinded to patient history and other test results? N/A
6. Were intervention/therapeutic regimens/exposure factor or procedure and any comparison(s) described in detail? Were interveningfactors described? Yes
  6.1. In RCT or other intervention trial, were protocols described for all regimens studied? N/A
  6.2. In observational study, were interventions, study settings, and clinicians/provider described? Yes
  6.3. Was the intensity and duration of the intervention or exposure factor sufficient to produce a meaningful effect? Yes
  6.4. Was the amount of exposure and, if relevant, subject/patient compliance measured? Yes
  6.5. Were co-interventions (e.g., ancillary treatments, other therapies) described? Yes
  6.6. Were extra or unplanned treatments described? N/A
  6.7. Was the information for 6.4, 6.5, and 6.6 assessed the same way for all groups? N/A
  6.8. In diagnostic study, were details of test administration and replication sufficient? N/A
7. Were outcomes clearly defined and the measurements valid and reliable? Yes
  7.1. Were primary and secondary endpoints described and relevant to the question? Yes
  7.2. Were nutrition measures appropriate to question and outcomes of concern? Yes
  7.3. Was the period of follow-up long enough for important outcome(s) to occur? Yes
  7.4. Were the observations and measurements based on standard, valid, and reliable data collection instruments/tests/procedures? Yes
  7.5. Was the measurement of effect at an appropriate level of precision? Yes
  7.6. Were other factors accounted for (measured) that could affect outcomes? N/A
  7.7. Were the measurements conducted consistently across groups? Yes
8. Was the statistical analysis appropriate for the study design and type of outcome indicators? Yes
  8.1. Were statistical analyses adequately described and the results reported appropriately? Yes
  8.2. Were correct statistical tests used and assumptions of test not violated? Yes
  8.3. Were statistics reported with levels of significance and/or confidence intervals? Yes
  8.4. Was "intent to treat" analysis of outcomes done (and as appropriate, was there an analysis of outcomes for those maximally exposed or a dose-response analysis)? N/A
  8.5. Were adequate adjustments made for effects of confounding factors that might have affected the outcomes (e.g., multivariate analyses)? No
  8.6. Was clinical significance as well as statistical significance reported? Yes
  8.7. If negative findings, was a power calculation reported to address type 2 error? N/A
9. Are conclusions supported by results with biases and limitations taken into consideration? Yes
  9.1. Is there a discussion of findings? Yes
  9.2. Are biases and study limitations identified and discussed? Yes
10. Is bias due to study's funding or sponsorship unlikely? Yes
  10.1. Were sources of funding and investigators' affiliations described? Yes
  10.2. Was the study free from apparent conflict of interest? Yes