UWL: Screening and Assessment Methods (2009)

Citation:
 
Study Design:
Class:
- Click here for explanation of classification scheme.
Quality Rating:
Research Purpose:

To develop a nutrition screening tool for use with older South Africans.

Inclusion Criteria:
  • Free-living and frail/institutionalized black South Africans
  • Black men and women age 60 years and older.
Exclusion Criteria:

None specifically mentioned.

Description of Study Protocol:

Recruitment

Community-dwelling subjects were recruited from church groups, luncheon clubs and community health center facilities. Frail subjects were recruited from state-subsidized homes for the aged, day-care centers for the elderly or from lists of applicants applying for entry into category three homes.

Design

Cross-sectional validation study.

Statistical Analysis

  • Sample size of 300 subjects was calculated for 80% power and an alpha error of 5%, with an expected attrition rate of at least 15%
  • Six-step systematic approach was used to determine the most appropriate items to classify nutritional status in this population for the new screening tool.
Data Collection Summary:

Timing of Measurements

Trained fieldworkers administered a 24-hour recall and the Mini Nutritional Assessment (MNA) screening tool, and completed anthropometric measurements and physical function tests in participants' homes.

Dependent Variables

  • MNA and short-form MNA were used as the gold standard
  • DETERMINE nutrition screening checklist
  • Novel screening tool was developed using six-step systematic approach: correspondence analysis, identification of key questions, determination of internal consistency, correlational analyses with objective measures, determination of reference cut-off values for categories of nutritional risk and determination of sensitivity and specificity.

Independent Variables

  • Cognitive function assessed using validated version of the Six-Item Cognitive Impairment Test
  • Biochemical indicators included serum albumin, hemoglobin, ferritin, vitamin B12, red blood cell folate, cholesterol and vitamin C
  • Food security was assessed using a modified version of the 15-item Hunger and Food Security Assessment scale
  • Self-reported health status was assessed using a five-scale item
  • Self-perceived health status
  • Ability to perform activities of daily living (ADLs) assessed using the six-item Katz ADL questionnaire and the 10-item Barthel ADL questionnaire
  • Anthropometric measurements: standing height, weight, body mass index (BMI), calf circumference, mid-thigh circumference, and triceps and biceps skinfold thicknesses
  • Physical function tests: handgrip strength, static and dynamic balance, functional reach, chair rise, get-up-and-go test and an eight-foot walk.
Description of Actual Data Sample:

Initial N: 300 elderly subjects recruited

Attrition (final N): 285 subjects (232 women, 53 men)

Age: Mean age, 71.5±8.0 years

Ethnicity: All subjects were black

Other relevant demographics: 15% were institutionalized, 85% were community-dwelling

Location: Cape Town, South Africa.

 

Summary of Results:

 

Variables

BMI<17 (moderately underweight) BMI<18.5 (underweight)

BMI>25 (overweight)

BMI>30 (obese)

MUAC, Men (cm)

22.9 <23.9 >28.1 >31.4

MUAC, Women (cm)

22.9

<23.9

>28.4

>31.8

Other Findings

The mean MNA score for both men (22.3±3.6, range 14 to 29) and women (23.0±3.3, range 10 to 29) was in the "at risk of malnutrition" category.

5% of subjects were classified as malnourished (MNA<17).

50.4% were in the "at risk" classification of nutritional status, whereas 44.4% were in the well-nourished category (MNA>24).

Good associations were found between mid-upper arm circumference (MUAC) and BMI (r=0.86 in women and r=0.89 in men, P<0.0001).

Dietary intakes of energy, protein and vitamin C tended to be higher in the better-nourished subjects, and vitamin A intake was almost three times lower (P<0.05) in the malnourished subjects compared with their peers.

The new screening tool includes nine separate concepts, comprising a total of 14 questions, as well as measurement of MUAC.

The new tool score was positively associated with level of independence in either basic activities of daily living (r=0.472) or the more complex instrumental activities of daily living (r=0.233).

A three-category scoring system of nutritional risk was developed and shown to significantly characterize subjects according to physical function tests, level of independence and cognitive function.

The new tool has good sensitivity (87.5%) and specificity (95.0%) compared with the MNA scoring system. It has a very high negative predictive value (99.5%), which means that the tool is unlikely to falsely classify subjects as well-nourished/at risk when they are in fact malnourished. 

Author Conclusion:

A proposed new, simplified screening tool has been shown to have content-, construct- and criterion-related validity (at least against the MNA tool) and the individual items have been shown to have good internal consistency. The MUAC measurement may be used as a proxy for BMI in this population, and reference cut-off values have been identified. The inclusion of a standardized set of short questions will allow comparison between elderly populations from different countries in Africa, and identify (within-country) sectors of the elderly population most in need of nutritional intervention.

Funding Source:
Government: Behavioral and Social Research Program of the US National Institute on Aging
Not-for-profit
Minimum Data Set (MDS) Project of the World Health Organization
Other non-profit:
Reviewer Comments:

Authors note that use of MUAC in the final screening tool was due to the fact that conventional BMI may not be appropriate for identifying poor nutritional status in elderly people because of changes in body composition and kyphosis. Authors note that an inherent methodological problem in the current study is that the new screening tool has been developed and validated in the same population.

Quality Criteria Checklist: Primary Research
Relevance Questions
  1. Would implementing the studied intervention or procedure (if found successful) result in improved outcomes for the patients/clients/population group? (Not Applicable for some epidemiological studies) Yes
  1. Would implementing the studied intervention or procedure (if found successful) result in improved outcomes for the patients/clients/population group? (Not Applicable for some epidemiological studies) Yes
  2. Did the authors study an outcome (dependent variable) or topic that the patients/clients/population group would care about? Yes
  2. Did the authors study an outcome (dependent variable) or topic that the patients/clients/population group would care about? Yes
  3. Is the focus of the intervention or procedure (independent variable) or topic of study a common issue of concern to dieteticspractice? Yes
  3. Is the focus of the intervention or procedure (independent variable) or topic of study a common issue of concern to dieteticspractice? Yes
  4. Is the intervention or procedure feasible? (NA for some epidemiological studies) Yes
  4. Is the intervention or procedure feasible? (NA for some epidemiological studies) Yes
 
Validity Questions
  1. Was the research question clearly stated? Yes
1. Was the research question clearly stated? Yes
  1.1. Was (were) the specific intervention(s) or procedure(s) [independent variable(s)] identified? Yes
  1.1. Was (were) the specific intervention(s) or procedure(s) [independent variable(s)] identified? Yes
  1.2. Was (were) the outcome(s) [dependent variable(s)] clearly indicated? Yes
  1.2. Was (were) the outcome(s) [dependent variable(s)] clearly indicated? Yes
  1.3. Were the target population and setting specified? Yes
  1.3. Were the target population and setting specified? Yes
  2. Was the selection of study subjects/patients free from bias? Yes
2. Was the selection of study subjects/patients free from bias? Yes
  2.1. Were inclusion/exclusion criteria specified (e.g., risk, point in disease progression, diagnostic or prognosis criteria), and with sufficient detail and without omitting criteria critical to the study? Yes
  2.1. Were inclusion/exclusion criteria specified (e.g., risk, point in disease progression, diagnostic or prognosis criteria), and with sufficient detail and without omitting criteria critical to the study? Yes
  2.2. Were criteria applied equally to all study groups? N/A
  2.2. Were criteria applied equally to all study groups? N/A
  2.3. Were health, demographics, and other characteristics of subjects described? Yes
  2.3. Were health, demographics, and other characteristics of subjects described? Yes
  2.4. Were the subjects/patients a representative sample of the relevant population? Yes
  2.4. Were the subjects/patients a representative sample of the relevant population? Yes
  3. Were study groups comparable? N/A
3. Were study groups comparable? N/A
  3.1. Was the method of assigning subjects/patients to groups described and unbiased? (Method of randomization identified if RCT) N/A
  3.1. Was the method of assigning subjects/patients to groups described and unbiased? (Method of randomization identified if RCT) N/A
  3.2. Were distribution of disease status, prognostic factors, and other factors (e.g., demographics) similar across study groups at baseline? N/A
  3.2. Were distribution of disease status, prognostic factors, and other factors (e.g., demographics) similar across study groups at baseline? N/A
  3.3. Were concurrent controls or comparisons used? (Concurrent preferred over historical control or comparison groups.) N/A
  3.3. Were concurrent controls or comparisons used? (Concurrent preferred over historical control or comparison groups.) N/A
  3.4. If cohort study or cross-sectional study, were groups comparable on important confounding factors and/or were preexisting differences accounted for by using appropriate adjustments in statistical analysis? N/A
  3.4. If cohort study or cross-sectional study, were groups comparable on important confounding factors and/or were preexisting differences accounted for by using appropriate adjustments in statistical analysis? N/A
  3.5. If case control study, were potential confounding factors comparable for cases and controls? (If case series or trial with subjects serving as own control, this criterion is not applicable.) N/A
  3.5. If case control study, were potential confounding factors comparable for cases and controls? (If case series or trial with subjects serving as own control, this criterion is not applicable.) N/A
  3.6. If diagnostic test, was there an independent blind comparison with an appropriate reference standard (e.g., "gold standard")? N/A
  3.6. If diagnostic test, was there an independent blind comparison with an appropriate reference standard (e.g., "gold standard")? N/A
  4. Was method of handling withdrawals described? ???
4. Was method of handling withdrawals described? ???
  4.1. Were follow-up methods described and the same for all groups? ???
  4.1. Were follow-up methods described and the same for all groups? ???
  4.2. Was the number, characteristics of withdrawals (i.e., dropouts, lost to follow up, attrition rate) and/or response rate (cross-sectional studies) described for each group? (Follow up goal for a strong study is 80%.) ???
  4.2. Was the number, characteristics of withdrawals (i.e., dropouts, lost to follow up, attrition rate) and/or response rate (cross-sectional studies) described for each group? (Follow up goal for a strong study is 80%.) ???
  4.3. Were all enrolled subjects/patients (in the original sample) accounted for? ???
  4.3. Were all enrolled subjects/patients (in the original sample) accounted for? ???
  4.4. Were reasons for withdrawals similar across groups? N/A
  4.4. Were reasons for withdrawals similar across groups? N/A
  4.5. If diagnostic test, was decision to perform reference test not dependent on results of test under study? N/A
  4.5. If diagnostic test, was decision to perform reference test not dependent on results of test under study? N/A
  5. Was blinding used to prevent introduction of bias? N/A
5. Was blinding used to prevent introduction of bias? N/A
  5.1. In intervention study, were subjects, clinicians/practitioners, and investigators blinded to treatment group, as appropriate? N/A
  5.1. In intervention study, were subjects, clinicians/practitioners, and investigators blinded to treatment group, as appropriate? N/A
  5.2. Were data collectors blinded for outcomes assessment? (If outcome is measured using an objective test, such as a lab value, this criterion is assumed to be met.) N/A
  5.2. Were data collectors blinded for outcomes assessment? (If outcome is measured using an objective test, such as a lab value, this criterion is assumed to be met.) N/A
  5.3. In cohort study or cross-sectional study, were measurements of outcomes and risk factors blinded? N/A
  5.3. In cohort study or cross-sectional study, were measurements of outcomes and risk factors blinded? N/A
  5.4. In case control study, was case definition explicit and case ascertainment not influenced by exposure status? N/A
  5.4. In case control study, was case definition explicit and case ascertainment not influenced by exposure status? N/A
  5.5. In diagnostic study, were test results blinded to patient history and other test results? N/A
  5.5. In diagnostic study, were test results blinded to patient history and other test results? N/A
  6. Were intervention/therapeutic regimens/exposure factor or procedure and any comparison(s) described in detail? Were interveningfactors described? Yes
6. Were intervention/therapeutic regimens/exposure factor or procedure and any comparison(s) described in detail? Were interveningfactors described? Yes
  6.1. In RCT or other intervention trial, were protocols described for all regimens studied? N/A
  6.1. In RCT or other intervention trial, were protocols described for all regimens studied? N/A
  6.2. In observational study, were interventions, study settings, and clinicians/provider described? Yes
  6.2. In observational study, were interventions, study settings, and clinicians/provider described? Yes
  6.3. Was the intensity and duration of the intervention or exposure factor sufficient to produce a meaningful effect? N/A
  6.3. Was the intensity and duration of the intervention or exposure factor sufficient to produce a meaningful effect? N/A
  6.4. Was the amount of exposure and, if relevant, subject/patient compliance measured? N/A
  6.4. Was the amount of exposure and, if relevant, subject/patient compliance measured? N/A
  6.5. Were co-interventions (e.g., ancillary treatments, other therapies) described? N/A
  6.5. Were co-interventions (e.g., ancillary treatments, other therapies) described? N/A
  6.6. Were extra or unplanned treatments described? N/A
  6.6. Were extra or unplanned treatments described? N/A
  6.7. Was the information for 6.4, 6.5, and 6.6 assessed the same way for all groups? N/A
  6.7. Was the information for 6.4, 6.5, and 6.6 assessed the same way for all groups? N/A
  6.8. In diagnostic study, were details of test administration and replication sufficient? N/A
  6.8. In diagnostic study, were details of test administration and replication sufficient? N/A
  7. Were outcomes clearly defined and the measurements valid and reliable? Yes
7. Were outcomes clearly defined and the measurements valid and reliable? Yes
  7.1. Were primary and secondary endpoints described and relevant to the question? N/A
  7.1. Were primary and secondary endpoints described and relevant to the question? N/A
  7.2. Were nutrition measures appropriate to question and outcomes of concern? Yes
  7.2. Were nutrition measures appropriate to question and outcomes of concern? Yes
  7.3. Was the period of follow-up long enough for important outcome(s) to occur? N/A
  7.3. Was the period of follow-up long enough for important outcome(s) to occur? N/A
  7.4. Were the observations and measurements based on standard, valid, and reliable data collection instruments/tests/procedures? Yes
  7.4. Were the observations and measurements based on standard, valid, and reliable data collection instruments/tests/procedures? Yes
  7.5. Was the measurement of effect at an appropriate level of precision? Yes
  7.5. Was the measurement of effect at an appropriate level of precision? Yes
  7.6. Were other factors accounted for (measured) that could affect outcomes? Yes
  7.6. Were other factors accounted for (measured) that could affect outcomes? Yes
  7.7. Were the measurements conducted consistently across groups? N/A
  7.7. Were the measurements conducted consistently across groups? N/A
  8. Was the statistical analysis appropriate for the study design and type of outcome indicators? Yes
8. Was the statistical analysis appropriate for the study design and type of outcome indicators? Yes
  8.1. Were statistical analyses adequately described and the results reported appropriately? Yes
  8.1. Were statistical analyses adequately described and the results reported appropriately? Yes
  8.2. Were correct statistical tests used and assumptions of test not violated? Yes
  8.2. Were correct statistical tests used and assumptions of test not violated? Yes
  8.3. Were statistics reported with levels of significance and/or confidence intervals? Yes
  8.3. Were statistics reported with levels of significance and/or confidence intervals? Yes
  8.4. Was "intent to treat" analysis of outcomes done (and as appropriate, was there an analysis of outcomes for those maximally exposed or a dose-response analysis)? N/A
  8.4. Was "intent to treat" analysis of outcomes done (and as appropriate, was there an analysis of outcomes for those maximally exposed or a dose-response analysis)? N/A
  8.5. Were adequate adjustments made for effects of confounding factors that might have affected the outcomes (e.g., multivariate analyses)? N/A
  8.5. Were adequate adjustments made for effects of confounding factors that might have affected the outcomes (e.g., multivariate analyses)? N/A
  8.6. Was clinical significance as well as statistical significance reported? Yes
  8.6. Was clinical significance as well as statistical significance reported? Yes
  8.7. If negative findings, was a power calculation reported to address type 2 error? N/A
  8.7. If negative findings, was a power calculation reported to address type 2 error? N/A
  9. Are conclusions supported by results with biases and limitations taken into consideration? Yes
9. Are conclusions supported by results with biases and limitations taken into consideration? Yes
  9.1. Is there a discussion of findings? Yes
  9.1. Is there a discussion of findings? Yes
  9.2. Are biases and study limitations identified and discussed? Yes
  9.2. Are biases and study limitations identified and discussed? Yes
  10. Is bias due to study's funding or sponsorship unlikely? Yes
10. Is bias due to study's funding or sponsorship unlikely? Yes
  10.1. Were sources of funding and investigators' affiliations described? Yes
  10.1. Were sources of funding and investigators' affiliations described? Yes
  10.2. Was the study free from apparent conflict of interest? Yes
  10.2. Was the study free from apparent conflict of interest? Yes