MHFS: Food Safety (2012-2013)

Citation:
 
Study Design:
Class:
- Click here for explanation of classification scheme.
Quality Rating:
Research Purpose:

To determine baseline food safety practices as part of the development of a questionnaire to evaluate a food safety education program.

Inclusion Criteria:

All female adult Women, Infant and Children (WIC) Program recipients and female guardians of pediatric clients (usually the mother or grandmother) who were able to read and speak English.

Exclusion Criteria:

Those who could not read and speak English.

Description of Study Protocol:

Recruitment

  • All subjects were recruited form one of the Miami-Dade County Health Department WIC clinics
  • Recruitment occurred once during every time period that the clinic served clients
  • Consenting clients were enrolled until the quota for the given time period was reached
  • The quota for the time period was weighted on the basis of the typical census for that time period
  • After clients completed the survey, they were given a thank- you gift of $10 for their time. 

Design

  • Cross-sectional study using a survey designed to capture five constructs of food safety behaviors with the first four from the Partnership for Food Safety Education's Fight BAC! campaign. These behaviors include clean, separate, cook, chill and avoid unsafe foods during pregnancy.
  • Two studies were conducted to determine the psychometric characteristics of the adapted survey so that it could be used in the evaluation of the food safety education program.
Statistical Analysis
  • A univariate analysis of variance and a multivariate analysis of variance were performed on each of nine participant characteristics
  • The univariate analysis was performed on a total score across all questionnaire items, with each of the nine participant characteristics of interest as the fixed effect
  • This was followed by a multivariate analysis of variance on each of the same nine participant characteristic items as a fixed effect with the family of dependent measures being each of the four construct scores (clean, separate, cook and chill, for a total of four dependent measures in the multivariate analysis)
  • The multivariate analysis provided a view of the participant character tics on the joint and four individual food safety constructs that was contained in the total score.
  • A type one error rate was set at P≤0.05 for each participant characteristic, assuming that there was an independent hypothesis for each participant characteristic
  • To describe the size effects found in the analysis, a partial square (η2) was obtained for each statistical test of a fixed effect
  • Following the recommendation of Cohen, a value of η2≥0.03 was considered non-trivial, representing an effect equivalent to 3% or more of the variance attributed to the statistical test represented by the F1-statistic. 
Data Collection Summary:

Timing of Measurements

Consenting women completed the survey in April 2005.

Dependent Variables

Food practice safety score based on 23-item self-administered survey:

  • Clean construct
  • Separate construct
  • Cook construct
  • Chill construct
  • Food eaten during the past month by pregnant participants.

Independent Variables

Pregnant women and mothers in the Women, Infants and Children (WIC) Program in Miami, Florida.

Control Variables

  • Age group
  • Education
  • Race/ethnicity
  • Country of birth
  • Employment status
  • Number of children
  • Diarrhea among household members in the past month
  • Household member at risk for food-borne illnesses, excluding young age or pregnancy.
Description of Actual Data Sample:
  • Initial N: 342 eligible clients
  • Attrition (final N):  299 consented to participate
  • Age: 
Age 18 to 24 39.8%
Age 25 to 34 45.2%
Age 35 or older 15%
  • Ethnicity:
Non-Hispanic, non-Haitian black 64.4%
Hispanic 27.1%
Haitian 5.8%
Non-Hispanic white/Other 2.7%
  • Other relevant demographics:
    • 64.8% were born in the United States
    • 34% were full-time homemakers or unemployed
    • 5.9% had no children and were WIC clients on the basis of their pregnancy
  • Location: Miami-Dade County, Florida, US.

 

Summary of Results:

Key Findings

Food Safety Behaviors

  • In general, a high percentage of participants reported "almost always" or "always" following good practices in the clean and separate constructs, although the frequency of "always" or "almost always" washing hands after changing diapers was significantly lower (83.6%) than the frequency of "always" or "almost always" washing hands after using the toilet (93%) (P<0.001)
  • Also, a small percentage of participants (12.6%) reported not properly cleaning cutting boards after contact with raw meat
  • In the cook construct, however, safe practices were less common, particularly regarding thermometer use
  • Only one-fourth of the participants reported using a cooking thermometer "almost always" or "always" for cooking whole chicken or turkeys (23.4%) or other large pieces of meat (22.3%). 24.4% reported owning a thermometer.
  • 24.7% reported usually eating undercooked eggs. Usually eating pink or undercooked meat was, however, rare (3.5%). 
  • Safe practices in the chill construct were not practiced among a sizable proportion of participants
  • About one third (32.2%) of the participants reported usually leaving food out for more than two hours.
  • Few (17.3%) reported refrigerating large amounts of leftovers in shallow containers
  •  Importantly, 10.8% reported leaving formula or bottled breast milk outside of the refrigerator for more than two hours "most of the time", "almost always" or "always" and 61.8% reported thawing foods on the countertop or in the sink in standing water
  • 62 pregnant women participated in the survey. More than one half (51.6%) reported eating hot dogs or deli meats without first reheating sometimes or more frequently since becoming pregnant and 35.5% reported eating soft cheeses and blue-veined cheeses sometimes or more frequently since becoming pregnant. Both of these practices carry a risk of acquiring listeriosis. 

Factors Associated With Behaviors

  • There were no statistically significant multivariate effects for any of the major demographic variables except for educational level. However, the effect size for educational levels was in the trivial range (η2=0.024).
  • The univariate effects on the sum of the chill items for educational level and for race and ethnicity characteristics were significant although the effects were quite small (η2=0.033 for education and η2=0.041 for race and ethnicity)
  • Chill scores were directly related to the amount of education (ie, the lower the education level, the lower the chill score). The following were the lowest mean scores:
Black non-Hispanic, non-Haitian group 85.9%
Haitian group 88.1%
Hispanic group 89.4%
Others

93.6%

  • In a post-hoc contrast between pairs of groups, the only pair to show statistically significant differences was between the non-Hispanic, non-Haitian black group and the Hispanic group, with a mean difference in chill scores of 3.5 (P<0.01)
  • The statistical test for a multivariate effect across the dependent measures clearly indicated that there was a significant difference by pregnancy status, F(4, 283)=6.62, P<0.001, with a moderate-to-large value of η2 (0.086)
  • There was a statistically lower average total score for those who were pregnant, F(1, 286)=13.69, P<0.001, although the effect size was small, η2=0.0446
  • The size of effect was stronger for the sum of the clean items, F(1,286)=24.02, with a moderate effect size of η2=(0.077)
  • The multivariate test for the number of children was significant, F(12, 744)=3.47, P<0.001, with a small effect of η2 (0.047), with all of the other scores, except for the chill items having effect sizes of η2 ranging from small (0.028) for the cook items to moderate (0.073) for clean items
  • There was an even stronger effect size (0.088) for the total score, with F(3, 284)=9.13, P<0.001. The women who were pregnant with their first child had the lowest scores on all dimensions.
  • For the variable diarrhea among a household member, there were statistically significant but small effect sizes for the multivariate analysis and for the clean items [F(4, 277)=3.84, P=0.005 and η2=0.053 and F(1,280)=8.72, P=0.003) and η2=0.03, respectively]
  • Those with a history of diarrhea among household members during the past month had lower clean scores.

Other Findings

Psychometric Characteristics of the Survey Instrument

The item distribution of the revised survey were less skewed and sufficiently spread out to increase the potential for detecting change in behavior as a function of training. Moreover, the confirmatory factor analysis fit indices improved with a chi-square per df=1.457, a confirmatory fit index=0.969, a Tucker-Lewis index=960, a root mean square error of approximation=.039 (90% CI; 0.025 to 0.052) and a probability that the root mean square error of approximation 90% CI covered the value of 0.05 to 0.92.

The measure of inter-item reliability within each factor was estimated by the standardized Cronbach's alpha:

  • The standardized Cronbach's alpha coefficients for the six clean items were 0.828 and 0.753 for the four separate items
  • The cook items consisted of two subsets that, taken together, had a standardized Cronbach coefficient of 0.751
  • The lowest standardized Cronbach's co-efficient was for the seven chill items at 0.389
  • Upon further analysis, it appeared that the chill item about how frequently food was left out for "no more than two hours" may not have been understood by the participants
  • An additional confirmatory factor analysis was conducted without the question, but there was no improvement in the parameters.
Author Conclusion:
  • This study provided at least three important findings:
    • Client's food safety practices were most problematic in the cook and chill constructs. Using a cooking thermometer, refrigerating foods within two hours and thawing foods safely were the practices least commonly reported
    • Being pregnant for the first time was the factor most commonly associated with suboptimal practices
    • Among pregnant participants, the consumption of foods that could expose women to listeriosis was common
  • The findings from this study should be considered in the development of food safety education programs in similar populations. However, it should be noted that good personal hygiene behaviors can prevent illnesses that have a particularly high incidence and cost and thus should not be excluded from food safety education curricula. The relatively high prevalence of some suboptimal food safety practices is of particular concern because these WIC clients are either highly susceptible to food-borne illnesses themselves, if pregnant or they prepare food for their highly susceptible infants and young children. Especially worrisome is the high percentage of pregnant women who reported the consumption of foods that put them at risk of listeriosis. Importantly, it was found that women who were pregnant with their first child had the poorest food safely practice scores. It would be important to attempt to duplicate this finding in other populations.
  • The WIC program is in a good position to provide food safety education because it serves people who are highly susceptible to food-borne illnesses, including pregnant women, infants and young children and has regular contact with its clients. Although all women in the WIC program could benefit from food safety education, these findings indicate that women during their first pregnancy should be especially targeted.
Funding Source:
Government: National Integrated Food Safety Initiative of the Cooperative State Research, Education, and Extension Service of the U.S. Department of Agriculture
Reviewer Comments:

The authors note the following limitations:

  • The food safety practices were self-reported and no actual practices were observed. Studies that compare reported with observed food-handling practices indicate that people tend to over-report their performance of good food safely.
  • Although refusal rates were low, those who refused may have been particularly unconcerned with food safety and have had worse practices than those who participated
  • Because of these first two limitations, it is likely that the prevalence of inadequate food safety practices found in this study underestimates the true prevalence
  • There were inconsistencies in the responses between the two questions about cooking eggs and between the two questions about how promptly foods were chilled
  • Although the participants represented the clinic population well regarding race and ethnicity, they did not necessarily represent those of other WIC clinics in the area, Florida or the United States. Thus, the results may not be applicable to other populations, particularly those serving a smaller number of minority clients.
  • This study assessed only self-reported practices and did not assess knowledge or attitudes; thus, it is not possible to determine if specific unsafe practices were due to knowledge deficits, attitudinal issues or specific barriers.
Quality Criteria Checklist: Primary Research
Relevance Questions
  1. Would implementing the studied intervention or procedure (if found successful) result in improved outcomes for the patients/clients/population group? (Not Applicable for some epidemiological studies) Yes
  2. Did the authors study an outcome (dependent variable) or topic that the patients/clients/population group would care about? Yes
  3. Is the focus of the intervention or procedure (independent variable) or topic of study a common issue of concern to dieteticspractice? Yes
  4. Is the intervention or procedure feasible? (NA for some epidemiological studies) Yes
 
Validity Questions
1. Was the research question clearly stated? Yes
  1.1. Was (were) the specific intervention(s) or procedure(s) [independent variable(s)] identified? Yes
  1.2. Was (were) the outcome(s) [dependent variable(s)] clearly indicated? Yes
  1.3. Were the target population and setting specified? Yes
2. Was the selection of study subjects/patients free from bias? No
  2.1. Were inclusion/exclusion criteria specified (e.g., risk, point in disease progression, diagnostic or prognosis criteria), and with sufficient detail and without omitting criteria critical to the study? Yes
  2.2. Were criteria applied equally to all study groups? Yes
  2.3. Were health, demographics, and other characteristics of subjects described? Yes
  2.4. Were the subjects/patients a representative sample of the relevant population? No
3. Were study groups comparable? Yes
  3.1. Was the method of assigning subjects/patients to groups described and unbiased? (Method of randomization identified if RCT) Yes
  3.2. Were distribution of disease status, prognostic factors, and other factors (e.g., demographics) similar across study groups at baseline? Yes
  3.3. Were concurrent controls or comparisons used? (Concurrent preferred over historical control or comparison groups.) Yes
  3.4. If cohort study or cross-sectional study, were groups comparable on important confounding factors and/or were preexisting differences accounted for by using appropriate adjustments in statistical analysis? Yes
  3.5. If case control study, were potential confounding factors comparable for cases and controls? (If case series or trial with subjects serving as own control, this criterion is not applicable.) Yes
  3.6. If diagnostic test, was there an independent blind comparison with an appropriate reference standard (e.g., "gold standard")? N/A
4. Was method of handling withdrawals described? Yes
  4.1. Were follow-up methods described and the same for all groups? N/A
  4.2. Was the number, characteristics of withdrawals (i.e., dropouts, lost to follow up, attrition rate) and/or response rate (cross-sectional studies) described for each group? (Follow up goal for a strong study is 80%.) N/A
  4.3. Were all enrolled subjects/patients (in the original sample) accounted for? Yes
  4.4. Were reasons for withdrawals similar across groups? N/A
  4.5. If diagnostic test, was decision to perform reference test not dependent on results of test under study? N/A
5. Was blinding used to prevent introduction of bias? N/A
  5.1. In intervention study, were subjects, clinicians/practitioners, and investigators blinded to treatment group, as appropriate? N/A
  5.2. Were data collectors blinded for outcomes assessment? (If outcome is measured using an objective test, such as a lab value, this criterion is assumed to be met.) N/A
  5.3. In cohort study or cross-sectional study, were measurements of outcomes and risk factors blinded? N/A
  5.4. In case control study, was case definition explicit and case ascertainment not influenced by exposure status? N/A
  5.5. In diagnostic study, were test results blinded to patient history and other test results? N/A
6. Were intervention/therapeutic regimens/exposure factor or procedure and any comparison(s) described in detail? Were interveningfactors described? Yes
  6.1. In RCT or other intervention trial, were protocols described for all regimens studied? N/A
  6.2. In observational study, were interventions, study settings, and clinicians/provider described? Yes
  6.3. Was the intensity and duration of the intervention or exposure factor sufficient to produce a meaningful effect? N/A
  6.4. Was the amount of exposure and, if relevant, subject/patient compliance measured? N/A
  6.5. Were co-interventions (e.g., ancillary treatments, other therapies) described? N/A
  6.6. Were extra or unplanned treatments described? N/A
  6.7. Was the information for 6.4, 6.5, and 6.6 assessed the same way for all groups? Yes
  6.8. In diagnostic study, were details of test administration and replication sufficient? N/A
7. Were outcomes clearly defined and the measurements valid and reliable? Yes
  7.1. Were primary and secondary endpoints described and relevant to the question? Yes
  7.2. Were nutrition measures appropriate to question and outcomes of concern? Yes
  7.3. Was the period of follow-up long enough for important outcome(s) to occur? Yes
  7.4. Were the observations and measurements based on standard, valid, and reliable data collection instruments/tests/procedures? Yes
  7.5. Was the measurement of effect at an appropriate level of precision? Yes
  7.6. Were other factors accounted for (measured) that could affect outcomes? Yes
  7.7. Were the measurements conducted consistently across groups? Yes
8. Was the statistical analysis appropriate for the study design and type of outcome indicators? Yes
  8.1. Were statistical analyses adequately described and the results reported appropriately? Yes
  8.2. Were correct statistical tests used and assumptions of test not violated? Yes
  8.3. Were statistics reported with levels of significance and/or confidence intervals? Yes
  8.4. Was "intent to treat" analysis of outcomes done (and as appropriate, was there an analysis of outcomes for those maximally exposed or a dose-response analysis)? N/A
  8.5. Were adequate adjustments made for effects of confounding factors that might have affected the outcomes (e.g., multivariate analyses)? Yes
  8.6. Was clinical significance as well as statistical significance reported? Yes
  8.7. If negative findings, was a power calculation reported to address type 2 error? N/A
9. Are conclusions supported by results with biases and limitations taken into consideration? Yes
  9.1. Is there a discussion of findings? Yes
  9.2. Are biases and study limitations identified and discussed? Yes
10. Is bias due to study's funding or sponsorship unlikely? Yes
  10.1. Were sources of funding and investigators' affiliations described? Yes
  10.2. Was the study free from apparent conflict of interest? Yes