Evaluating the usability of an interactive, bi-lingual, touchscreen-enabled breastfeeding educational programme: application of Nielson’s heuristics

Ashish Joshi, Douglas M Puricelli Perin, Chioma Amadi, Kate Trout

Abstract


Background: Usability challenges have to be met in an interactive computer program development and should meet all users’ needs.

Objective: The study purpose was to conduct heuristic evaluation of an interactive, bilingual touch screen enabled breastfeeding educational program for Hispanic women living in rural settings.

Methods: Two usability experts used Nielsen’s heuristics while reviewing the user interface in May 2013 using principles of Nielson’s Heuristics. Nielson’s heuristics are a set of usability engineering principles developed to identify issues in user interface design and involves analysis of the interface. The heuristic evaluations were carried out in the interface, program sections, and interactive educational modules. A total of 271 screens were evaluated and included: interface (n=5), program sections (n=223) and educational content (n=43).

Results: A total of 97 violations were identified and were mostly related to interface (8violations/5screens) and program components (89violations/266screens). The most common violations reported were recognition rather than recall (62%, n=60), consistency and standards (14%, n=14), and match between the system and real world (9%, n= 9). Majority of the violations had minor usability issues (73%, n=71). The only catastrophic violation reported was due to the visibility of system status in the assessment modules.

Conclusion: The results demonstrated that the system was more consistent with Nielsen’s usability heuristics.

 


Keywords


breastfeeding, educational programme, heuristics, human–computer interaction

Full Text:

PDF HTML

References


World Health Organization. Global Strategy for Infant and Young Child Feeding. World Health Organization, 2003.

Gartner LM, Morton J, Lawrence RA, Naylor AJ, O’Hare D, Schanler RJ et al. Breastfeeding and the use of human milk. Pediatrics 2005;115:496–506. http://dx.doi.org/10.1542/ peds.2004-2491. PMid:15687461.

United States Department of Health and Human Services. Maternal, Infant and Child Health. MICH-21. http://healthypeople.gov/2020/topicsobjectives2020/overview.aspx?topicid=26. Accessed 31 March 2013.

Centers for Disease Control and Prevention. Breastfeeding Report Card 2011. Atlanta, GA: Division of Nutrition, Physical Activity, and Obesity, 2011. http://www.cdc.gov/breastfeeding/pdf/2011breastfeedingreportcard.pdf. Accessed 21 January 2013.

Wilhelm SL, Rodehorst TK, Stepans MBF, Hertzog M and Berens C. Influence of intention and self-efficacy levels on duration of breastfeeding for Midwest rural mothers. Applied Nursing Research 2008; 21(3):123–30. http://dx.doi.org/10.1016/j.apnr.2006.10.005. PMid:18684405.

Jaspers MW. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. International Journal of Medical Informatics 2009; 78:340–53. http://dx.doi.org/10.1016/j.ijmedinf.2008.10.002. PMid:19046928.

Jones R, Pearson J, McGregor S, Cawsey AJ, Barret A, Craig N et al. Randomized trial of personalized computer based information for cancer patients. BMJ, 1999;319:1241–7.

Kreuter M, Farrell D, Olevitch L and Brennan L. Tailoring Health Messages. Customizing Communication with Computer Technology. London: Lawrence Earlbaum Associates, 2000. http://dx.doi.org/10.1136/bmj.319.7219.1241. PMid:10550090; PMCid:PMC28275

Kreuter MW and Wray RJ. Tailored and targeted health communication: strategies for enhancing information relevance. American Journal of Health Behavior 2003;27:S227–32.

Fogg BJ, Grudin J, Nielsen J and Card S. Persuasive Technology: Using Computers to Change What We Think and Do. Science & Technology Books, 2002.

Kientz, Julie A et al Heuristic evaluation of persuasive health technologies. Proceedings of the 1st ACM International Health Informatics Symposium, 2010, ACM.

Williams P, Nicholas D, Huntington P, and McLean F. Surfing for health: user evaluation of a health information website. Part one: background and literature review. Health Information & Libraries Journal 2002;19(2):98–108. http://dx.doi.org/10.1046/j.1471-1842.2002.00374_2.x. PMid:12389607.

Nielsen J. Heuristic evaluation. Nielsen J and Mack RL (Eds.) Usability Inspection Methods. New York, NY: John Wiley & Sons, 1994, pp. 25–62.

Nielsen J. Usability Engineering. San Diego, CA: Academic Press, 1993.

Turner-Bowker, Diane M et al Heuristic evaluation and usability testing of a computerized patient-reported outcomes survey for headache sufferers. Telemedicine and e-Health 2011;17:40–5. http://dx.doi.org/10.1089/tmj.2010.0114. PMid:21214341; PMCid:PMC3064878.

Joshi A, Arora M, Dai L, Price K, Vizer L and Sears A. Usability of a patient education and motivation tool using heuristic evaluation. Journal of Medical Internet Research 2009;11:e47.

Yen PY and Bakken S. Review of health information technology usability study methodologies. Journal of American Medical Informatics Association 2012;19:413–22. http://dx.doi.org/10.1136/amiajnl-2010-000020. PMid:21828224; PMCid:PMC3341772.

Nielsen J. How to conduct a heuristic evaluation. On the World Wide Web (1994).

Miller GA. The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological Review 1956;63(2):81–97. doi: 10.1037/h0043158. http://dx.doi.org/10.1037/h0043158.

Duffy T and Jonassen DH. Constructivism and the Technology of Instruction: A Conversation. Hillsdale, N.J: Lawrence Erlbaum Associates Publishers, 1992.

Spiro R. The Library of the University of Illinois-Urbana Champaign. 1988. [2013-10-29]. Cognitive flexibility theory: advanced knowledge acquisition in ill-structured domains. https://www.ideals.illinois.edu/bitstream/handle/2142/18011/ctrstreadtechrepv01988i00441_opt.pdf?sequence=1. Accessed 12 February 2013.

Sweller J. Online library Wiley. 1988. Cognitive load during problem solving: effects on learning http://onlinelibrary.wiley.com/store/10.1207/s15516709cog1202_4/asset/s15516709cog1202_4.pdf?v=1&t=hnd7f8uy&s=fe685a8b2c5fb070c8097c15693a7fa1d29a1f92. Accessed 12 February 2013.

Boeree C. Personality theories. 1998. [2013-10-21]. B.F. Skinner. http://webspace.ship.edu/cgboer/skinner.html. Accessed 12 February 2013.

McDonald EM, Solomon B, Shields W, Serwint JR, Jacobsen H, Weaver NL et al. Evaluation of kiosk-based tailoring to promote household safety behaviors in an urban pediatric primary care practice. Patient Education and Counseling. 2005;58(2):168–81.

Petty RT and Cacioppo JT. Attitudes and Persuasion: Classic and Contemporary Approaches. Dubuque, Iowa:W. C. Brown, 1981.

Anderson I, Maitland J, Sherwood S et al. Shakra: tracking and sharing daily activity levels with unaugmented mobile phones. Mobile networks and applications 2007;12(2–3):185–9. http://dx.doi.org/10.1007/s11036-007-0011-7.

Consolvo S, Everitt KM, Smith I and Landay JA. Design requirements for technologies that encourage physical activity. Proceedings of CHI, 2006, ACM, pp. 457–66.

Consolvo S, Klasnja P, McDonald DW et al. Flowers or a robot army?: encouraging awareness and activity with personal, mobile displays. Proceedings of the 10th International conference on Ubiquitous computing, 2008, ACM, pp. 54–63.

Lin JL, Mamykina L, Lindtner S, Delajoux G and Strub HB. Fish ‘n’ steps: encouraging physical activity with an interactive computer game. Proceedings of Ubicomp, 2006, Springer, pp. 261–78.

King AC, Ahn DK, Oliveira BM, Atienza AA, Castro CM and Gardner CD. Promoting physical activity through hand-held computer technology. American Journal of Preventive Medicine 2008;34(2):138–42. http://dx.doi.org/10.1016/j.amepre.2007.09.025. PMid:18201644; PMCid:PMC2715220.

Wieland LS, Falzon L, Sciamanna CN, Trudeau KJ, Brodney S, Schwartz JE et al. Interactive computer-based interventions for weight loss or weight maintenance in overweight or obese people. Cochrane Database of Systematic Reviews 2012;8: CD007675.

Denning T, Andrew A, Chaudhri R et al. BALANCE: towards a usable pervasive wellness application with accurate activity inference. Proceedings of the 10th Workshop on Mobile Computing Systems & Applications 2009, ACM, pp. 1–6.

Gasser R, Brodbeck D, Degen M, Luthinger J, Wyss R and Reichlin S. Persuasiveness of a mobile lifestyle coaching application using social facilitation. Proceedings of the 1st International Conference on Persuasive Technology, 2006, Springer Verlag, pp. 27–38.

Lee G, Tsai C, Grisworld WG, Raab F and Patrick K. PmEB: a mobile phone application for monitoring caloric balance. CHI ’06 extended abstracts on Human Factors in computing systems 2006, ACM, pp. 1013–8.

Devries KM, Kenward MG and Free CJ. Preventing smoking relapse using text messages: analysis of data from the txt2stop trial. Nicotine & Tobacco Research 2013;15(1):77–82. http://dx.doi.org/10.1093/ntr/nts086. PMid:22523120.

Michie S, Brown J, Geraghty AW, Miller S, Yardley L, Gardner B et al. Development of StopAdvisor: a theory-based interactive internet-based smoking cessation intervention. Translational Behavioral Medicine 2012;2(3):263–75. http://dx.doi.org/10.1007/s13142-012-0135-6. PMid:24073123; PMCid:PMC3717907.

Morris M, Kathawala Q, Leen TK et al. Mobile therapy: case study evaluations of a cell phone application for emotional self awareness. Journal of Medical Internet Research 2010;12(2):e10.

Yen PY and Bakken S. Review of health information technology usability study methodologies. Journal of American Medical Informatics Association 2012;19(3):413–22. http://dx.doi.org/10.1136/amiajnl-2010-000020. PMid:21828224; PMCid:PMC3341772.

Minshall S. A review of health care information system usability and safety. Studies in Health Technology and Informatics 2013;183:151–6. PMid:23388273.

Segall N, Saville JG, L’Engle P, Carlson B, Wright MC, Schulman K et al. Usability evaluation of a personal health record. Proceedings of the AMIA Annual Symposium, 2011, pp. 1233–42.

Nielsen J. Usability Engineering. Boston: Academic Press, 1993.

Tang Z, Johnson TR, Tindall RD and Zhang J. Applying heuristic evaluation to improve the usability of a telemedicine system. Telemedicine Journal and E-Health 2006;12(1):24–34. http://dx.doi.org/10.1089/tmj.2006.12.24. PMid:16478410.

Joshi A, Arora M, Dai L, Price K, Vizer L and Sears A. Usability of a patient education and motivation tool using heuristic evaluation. Journal of Medical Internet Research 2009;11(4):e47. http://dx.doi.org/10.2196/jmir.1244. PMid:19897458; PMCid:PMC2802560.

Jaspers MWM. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. International Journal of Medical Informatics 2009;78(5):340–53. http://dx.doi.org/10.1016/j.ijmedinf.2008.10.002. PMid:19046928.

Joshi A, Lichenstein R, King J, Arora M and Khan S. Evaluation of a computer-based patient education and motivation tool on knowledge, attitudes, and practice towards influenza vaccination. IEJHE 2009;12:1–15.

Smith MK. The Encyclopedia of Informal Education. 2003. Learning Theory. Available from: http://www.infed.org/biblio/b-learn.htm. Accessed 26 Oct 2009.

Jezierski J. Learnativity.com. 2003. Learning Styles. Available from: http://www.learnativity.com/learningstyles.html. Accessed 30 Oct 2009.

Russell SS. An overview of adult learning processes. Urologic Nursing 2006;26(5):349–52, 370. PMid:17078322.

Shneiderman B. Designing the User Interface: Strategies for Effective Human–Computer Interaction. Reading, MA: Addison–Wesley, 1998. PMid:9929185; PMCid:PMC2232192.

Jeffries R, Miller JR, Wharton C and Uyeda K. User interface evaluation in the real world: a comparison of four techniques. Proceedings of the 1991 CHI Conference on Human Factors in Computing Systems, 1991, New Orleans, LA: ACM, pp. 119–24.

Nielsen J. Finding usability problems through heuristic evaluaion. Proceedings of the 1992 SIGCHI Conference on Human Factors in Computing Systems,1992, Monterey, CA: ACM, pp. 373–80.

Hertzum M and Jacobsen NE. The evaluator effect: a chilling fact about usability evaluation methods. International Journal Human–Computer Interacttion 2001;13:421–43. http://dx.doi.org/10.1207/S15327590IJHC1304_05.

Tang Z, Johnson TR, Tindall RD and Zhang J. Applying heuristic evaluation to improve the usability of a telemedicine system. Telemedicine Journal and E-Health 2006;12(1):24–34. http://dx.doi.org/10.1089/tmj.2006.12.24. PMid:16478410.




DOI: http://dx.doi.org/10.14236/jhi.v22i2.71

Refbacks

  • There are currently no refbacks.


This is an open access journal, which means that all content is freely available without charge to the user or their institution. Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles in this journal starting from Volume 21 without asking prior permission from the publisher or the author. This is in accordance with the BOAI definition of open accessFor permission regarding papers published in previous volumes, please contact us.

Privacy statement: The names and email addresses entered in this journal site will be used exclusively for the stated purposes of this journal and will not be made available for any other purpose or to any other party.

Online ISSN 2058-4563 - Print ISSN 2058-4555. Published by BCS, The Chartered Institute for IT