Abstract
Citation
Hoehner CM, Budd EL, Marx CM, Dodson EA, Brownson RC. Development and reliability testing of the Worksite and Energy Balance Survey. J Public Health Manag Pract 2013 May-Jun;19(3 Suppl 1):S105-13.
Abstract
CONTEXT: Worksites represent important venues for health promotion. Development of psychometrically sound measures of worksite environments and policy supports for physical activity and healthy eating are needed for use in public health research and practice. OBJECTIVE: Assess the test-retest reliability of the Worksite and Energy Balance Survey (WEBS), a self-report instrument for assessing perceptions of worksite supports for physical activity and healthy eating. DESIGN: The WEBS included items adapted from existing surveys or new items on the basis of a review of the literature and expert review. Cognitive interviews among 12 individuals were used to test the clarity of items and further refine the instrument. A targeted random-digit-dial telephone survey was administered on 2 occasions to assess test-retest reliability (mean days between time periods = 8; minimum = 5; maximum = 14). SETTING: Five Missouri census tracts that varied by racial-ethnic composition and walkability. PARTICIPANTS: Respondents included 104 employed adults (67% white, 64% women, mean age = 48.6 years). Sixty-three percent were employed at worksites with less than 100 employees, approximately one-third supervised other people, and the majority worked a regular daytime shift (75%). MAIN OUTCOME MEASURES: Test-retest reliability was assessed using Spearman correlations for continuous variables, Cohen's κ statistics for nonordinal categorical variables, and 1-way random intraclass correlation coefficients for ordinal categorical variables. RESULTS: Test-retest coefficients ranged from 0.41 to 0.97, with 80% of items having reliability coefficients of more than 0.6. Items that assessed participation in or use of worksite programs/facilities tended to have lower reliability. Reliability of some items varied by gender, obesity status, and worksite size. Test-retest reliability and internal consistency for the 5 scales ranged from 0.84 to 0.94 and 0.63 to 0.84, respectively. CONCLUSIONS: The WEBS items and scales exhibited sound test-retest reliability and may be useful for research and surveillance. Further evaluation is needed to document the validity of the WEBS and associations with energy balance outcomes.
Full Text
The full text is available at https://dx.doi.org/10.1097/PHH.0b013e3182849f21
At A Glance
Food Environment Variables
| # | Type of Environment/Institution |
|---|---|
| - | Full Service Restaurant |
| - | Limited Service/Fast Food Restaurant |
| 104 | Neighborhood |
| 104 | Worksites |
| Measure | objective | perceived |
|---|---|---|
| Availability/Access | ✔ | ✘ |
| Food Quality | ✔ | ✘ |
| Labeling/Point of Purchase Info | ✔ | ✘ |
| Marketing/Advertising/Promotion | ✔ | ✘ |
| Policy/Practice | ✘ | ✔ |
| Food Group/Type of Food |
|---|
| Fruits and vegetables |
| Low-fat dairy |
| Whole grains |
| Low-fat foods other than dairy |
Physical Activity Environment Variables
| # | Type of Environment/Location |
|---|---|
| - | Transportation Infrastructure |
| # | Scale |
|---|---|
| - | Equipment |
| - | Trail/path/corridor |
| Measure | objective | perceived |
|---|---|---|
| Policy | ✘ | ✔ |
| Street Connectivity | ✘ | ✔ |
| Crime/Safety | ✘ | ✔ |
| Cycling Infrastructure | ✘ | ✔ |
| Facility Access/Availablity/Proximity | ✘ | ✔ |
| Pedestrian Infrastructure | ✘ | ✔ |
Domain(s)
Food Environment
Physical Activity Environment
Measure Type
Questionnaire
Measure Availability
Measure included in article
Number of Items
84 Reported
Study location
Metro/Urban
St. Louis, Kansas City, Missouri, USA
Languages
English
Information about Development of Measure
The Worksite and Environment Balance Survey (WEBS) was developed following a literature review of existing instruments in which items were classified by worksite domains relevant for physical activity and healthy eating. In addition, items were identified that captured important contextual information about worksite and occupational characteristics as well as behaviors occurring during work hours.The survey was reviewed by six external researchers and two practitioners with expertise in physical activity, diet, worksite wellness, and health promotion. The survey also underwent cognitive response testing.
Study Design
Study Participants
Age
Adults
Sex
Female
Male
Race/Ethnicity
Hispanic
White
Black/African American
Predominantly Low-income/Low-SES
No
Sample Size
104
Study Design
Design Type
Validation/Reliability
Health Outcomes Assessed
None
Obesity Measures
Not applicable
BMI Measured or Self-reported
Not applicable
Covariates
Social influence (e.g., parent modeling)
Data Reported on Race/Ethnicity
Quantitative data on study sample
Data Reported on SES
Quantitative data on study sample
SES-related Variables
Income
Education
How To Use
Administration
Who Administered
Researcher-administered
How Administered
Phone
Time Required
Not reported
Training Required
Not reported
Instructions on Use
Instructions on instrument use included in article
Data Analysis
Data Collection/Analysis Costs
Not reported
Data Collection/Protocol
Participants were sampled from Missouri regions within race, ethnicity and walkability strata used in the larger SHOW-ME study. Participants completed the Worksite and Environment Balance survey at two time points approximately eight days apart.
Instructions on Data Analysis
Instructions on analysis included in article
Validity (0)
There are no validity tests reported for this measure.
Reliability (2)
| Type of reliability | Construct/subscale assessed | Test/statistic used | Result |
|---|---|---|---|
| Test-retest | Worksite and Environment Balance Survey scales | lntra-class correlation coefficients (ICC) | ICC = 0.84 to 0.93 |
| Internal Consistency | Worksite and Environment Balance Survey scales | Cronbach's alpha | Alpha = 0.63 to 0.84 |