Daily sampling frequency and sampling duration affect reliability of person-level estimates of physical activity outcomes: Optimizing Ecological Momentary Assessment studies of physical activities

Abstract

Studies on the interrelationship between physical activity (PA) behaviors and EMA-assessed constructs should use measures with high reliability of both the EMA-assessed constructs and the time-matched accelerometry-assessed PA behavior. The aim of this paper is to evaluate how the reliability of accelerometry-assessed PA outcomes is affected by different EMA sampling schemes. Emulating relevant sampling schemes in EMA studies, multiple random samples of real-world accelerometer data (measured via activPAL worn for ∼7 days) were drawn that varied in the number of daily samples (3, 5, and 7 daily samples) and in the duration of each sample (5 min, 60 min, and 120 min), totaling 9 sampling schemes. The reliability of the resulting PA outcomes was estimated by correlating weekly aggregates of the sampled data with the true parameter values (weekly aggregates of all data). A total of 4231 days were analyzed from 619 participants (mean age 45 ± 16 years; 73.3 % female; 72.7 % Non-Hispanic White). At the lowest sampling duration (5 min), none of the sampling schemes reached the threshold for acceptable reliability (reliabilities ranged from 0.20 to 0.67). Using 120 min sample duration resulted in reliable person-level PA estimates (ranges 0.77 to 0.97) except for the time spent in sedentary behavior (rel = 0.68), and for minimum (rel = 0.66), and maximum (rel = 0.63) PA intensity. These three PA outcomes consistently yielded lower levels of reliability across all sampling schemes. Holding constant the total time covered in a day, sampling schemes that used more frequent samples with shorter duration resulted in greater reliability compared to sampling schemes that used less frequent samples with longer duration. Overall, the results are consistent with sampling theory - reliability increased as more time was covered. However, our results also suggested interactive effects of reliability based on sampling frequency, duration, and PA outcome. Researchers should be aware that the reliability of accelerometer-derived PA outcomes can vary depending on the sampling design of EMA studies.

Keywords: Accelerometry; Ecological Momentary Assessment; Physical activity; Reliability.