Just out in the Journal of Medical Internet Research, our mixed-methods process evaluation of the "Strengthen Your Ankle" neuromuscular training program. The current evaluation is a part of a randomised controlled trial that examined both the short- and long-term effectiveness of the program delivered through an App. Although it was shown previously that the program, available both in a printed booklet and as a mobile app, is able to effectively reduce the number of recurrent ankle sprains, participants' compliance with the program is an ongoing challenge.
This process evaluation explored participants' opinions regarding both the methods of delivery, using the RE-AIM (Reach Effectiveness Adoption Implementation Maintenance) Framework to identify barriers and challenges to program compliance. Although Reach, Effectiveness, and Adaptation were the focus of a previous study, this paper focuses on the implementation and maintenance phases. Semistructured interviews and online questionnaires were analyzed using qualitative content analysis. Fisher exact, chi-square, and t tests assessed between-group differences in quantitative survey responses. Interviews were assessed by thematic analysis to identify key themes.
While there were no significant differences in the perceived simplicity, usefulness, and liking of the exercise during the 8 weeks of the neuromuscular training program, semistructured interviews showed that participants agreed that an app would be of additional benefits over a booklet. After the 12-month follow-up, when asked how they evaluated the overall use of the app or the booklet, the users of the app gave a mean score of 7.7 (SD 0.99) versus a mean score 7.1 (SD 1.23) for the users of the booklet. This difference in mean score was significant (P=.006).
We concluded that, although both the app and booklet showed a high user satisfaction, the users of the app were significantly more satisfied. Semistructured questionnaires allowed users to address issues they would like to improve in future updates. Including a possibility for feedback and postponement of exercises, an explanation of the use of specific exercises and possibly music were identified as features that might further improve the contentment of the program, probably leading to increased compliance.
The full article can be accessed here (open access)
van Reijen M, Asscheman M, Vriend II, et al. Users' Perspectives, Opportunities, and Barriers of the Strengthen Your Ankle App for Evidence-Based Ankle Sprain Prevention: Mixed-Methods Process Evaluation for a Randomized Controlled Trial. JMIR Rehabil Assist Technol 2018;5:e13. doi:10.2196/rehab.8638