Computerised decision support systems for healthcare professionals: an interpretative review

Kathrin Cresswell, Azeem Majeed, David W Bates, Aziz Sheikh


Purpose Computerised decision support systems are designed to support clinicians in making decisions and thereby enhance the quality and safety of care. We aimed to undertake an interpretative review of the empirical evidence on computerised decision support systems, their contexts of use, and summarise evidence on the effectiveness of these tools and insights into how these can be successfully implemented and adopted.

Methods We systematically searched the empirical literature to identify systematic literature reviews on computerised decision support applications and their impact on the quality and safety of healthcare delivery over a 13-year period (1997–2010). The databases searched included: MEDLINE, EMBASE, The Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects, The Cochrane Central Register of Controlled Trials, The Cochrane Methodology Register, The Health Technology Assessment Database, and The National Health Service (NHS) Economic Evaluation Database. To be eligible for inclusion, systematic reviews needed to address computerised decision support systems, and at least one of the following: impact on safety; quality; or organisational, implementation or adoption considerations.

Results Our searches yielded 121 systematic reviews relating to eHealth, of which we identified 41 as investigating computerised decision support systems. These indicated that, whilst there was a lack of investigating potential risks, such tools can result in improvements in practitioner performance in the promotion of preventive care and guideline adherence, particularly if specific information is available in real time and systems are effectively integrated into clinical workflows. However, the evidence regarding impact on patient outcomes was less clear-cut with reviews finding either no, inconsistent or modest benefits.

Conclusions Whilst the potential of clinical decision support systems in improving, in particular, practitioner performance is considerable, such technology may also introduce new risks resulting not only from technical challenges (such as data inaccuracies) but also from disruption of clinical workflows. Moving forward, there is a need for system development, procurement and implementation to be characterised by a user ‘pull’ and then tailor systems to the needs of users.


adoption; clinical decision support systems; implementation

Full Text:



Coiera E. Guide to Health Informatics. London: Hodder Arnold, 2003.

National Electronic Decision Support Taskforce (NEDST). Electronic Decision Support for Australia's Health Sector. Canberra: Australian Government Department of Health and Ageing, 2003.

Wyatt J and Spiegelhalter D. Field trials of medical decision-aids: potential problems and solutions. Proceedings of the Annual Symposium on Computer Applications in Medical Care 1991;3–7. PMCid:PMC2247484

Shortliffe EH. Computer programs to support clinical decision making. Journal of the American Medical Association 1987;258:61–6. PMid:3586293

Sheikh A, McLean S, Cresswell K et al. The Impact of eHealth on the Quality and Safety of Healthcare. An updated systematic overview and synthesis of the literature. Edinburgh: The University of Edinburgh, 2011. Scottish Intercollegiate Guidelines Network (SIGN) methodology filters. (accessed 23/01/12).

Shepperd S, Lewin S, Straus S et al. Can we systematically review studies that evaluate complex interventions? PLoS Medicine 2009; 6: e1000086. PMid:19668360 PMCid:PMC2717209

World Health Organization RegionalOffice for Europe. Health Evidence Network (HEN), Geneva: WHO, 2007. Heselmans A, Van de Velde S, Donceel P, Aertgeerts B and Ramaekers D. Effectiveness of electronic guideline-based implementation systems in ambulatory care settings – a systematic review. Implement Science 2009;4. PMid:19203373 PMCid:PMC2644665

Garg AX, Adhikari NKJ, McDonald H et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes. Journal of the Americal Medical Association 2005;293:1223–38. PMid:15755945

Georgiou A, Williamson M, Westbrook JI and Ray S. The impact of computerised physician order entry systems on pathology services: a systematic review. International Journal of Medical Informatics 2007;76:514–29. PMid:16567121

Jamal A, McKenzie K and Clark M. The impact of health information technology on the quality of medical and health care: a systematic review. Health Information Management Journal 2009;38:26–37. PMid:19875852

Mador RL and Shaw NT. The impact of a Critical Care Information System (CCIS) on time spent charting and in direct patient care by staff in the ICU: a review of the literature. International Journal of Medical Informatics 2009;78:435–45. PMid:19261544

Main C, Moxham T, Wyatt JC, Kay J, Anderson R and Stein K. Computerised decision support systems in order communication for diagnostic, screening or monitoring test ordering: systematic reviews of the effects and cost-effectiveness of systems. Health Technology Assessment 2010;14:1–227. PMid:21034668

Balas EA, Krishna S, Kretschmer RA, Cheek TR, Lobach DF and Boren SA. Computerized knowledge management in diabetes care. Medical Care 2004;42.

Bryan C and Boren SA. The use and effectiveness of electronic clinical decision support tools in the ambulatory/primary care setting: a systematic review of the literature. Informatics in Primary Care 2008;16:79–91. PMid:18713524

Damiani G, Pinnarelli L, Colosimo SC et al. The effectiveness of computerized clinical guidelines in the process of care: a systematic review. BMC Health Service Research 2010;10:2. PMid:20047686 PMCid:PMC2837004

Delpierre C, Cuzin L, Fillaux J, Alvarez M, Massip P and Lang T. A systematic review of computer-based patient record systems and quality of care: more randomized clinical trials or a broader approach? International Journal of Quality in Health Care 2004;16:407–16. PMid:15375102

Dexheimer JW, Talbot TR, Sanders DL, Rosenbloom ST and Aronsky D. Prompting clinicians about preventive care measures: a systematic review of randomized controlled trials. Journal of the American Medical Informatics Association 2005;15:311–20. PMid:18308989 PMCid:PMC2410011

Jerant AF and Hill DB. Does the use of electronic medical records improve surrogate patient outcomes in outpatient settings? Journal of Family Practice 2000;49:349–57. PMid:10778842

Kaplan B. Evaluating informatics applications – clinical decision support systems literature review. International Journal of Medical Informatics 2001;64:15–37.

Kawamoto K, Houlihan CA, Balas EA and Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. British Medical Journal 2005;330:765. PMid:15767266 PMCid:PMC555881

Lisboa PJ and Taktak AF. The use of artificial neural networks in decision support in cancer: a systematic review. Neural Networks 2006;19:408–15. PMid:16483741

Montgomery AA and Fahey T. A systematic review of the use of computers in the management of hypertension. Journal of Epidemiology and Community Health 1998;52:520–5. PMid:9876364 PMCid:PMC1756753

Randell R, Mitchell N, Dowding D, Cullum N and Thompson C. Effects of computerized decision support systems on nursing performance and patient outcomes: a systematic review. Journal of Health Service Research and Policy 2007;12:242–9. PMid:17925077

Rosado B, Menzies S, Harbauer A et al. Accuracy of computer diagnosis of melanoma: a quantitative metaanalysis. Archives of Dermatology 2003;139:361–7. PMid:12622631

Shekelle P and Goldzweig C. Costs and Benefits of Health Information Technology: an updated systematic review. London: The Health Foundation, 2009.

Shiffman RN, Liaw Y, Brandt CA and Corb GJ. Computer-based guideline implementation systems: a systematic review of functionality and effectiveness. Journal of the American Medical Informatics Association 1999;6:104–14. PMid:10094063 PMCid:PMC61349

Shojania KG, Jennings A, Mayhew A, Ramsay C, Eccles M and Grimshaw J. Effect of point-of-care computer reminders on physician behaviour: a systematic review. Canadian Medical Association Journal 2010;182:E216–25. PMid:20212028 PMCid:PMC2842864

Sintchenko V, Magrabi F, Tipper S. Are we measuring the right end-points? Variables that affect the impact of computerised decision support on patient outcomes: a systematic review. Medical Informatics and the Internet in Medicine 2007;32:225–40. PMid:17701828

Smith MY, DePue JD and Rini C. Computerized decision support systems for chronic pain management in primary care. Pain Medicine 2007;8:S155–66.

Tan K, Dear PR and Newell SJ. Clinical decision support systems for neonatal care (Cochrane Review). The Cochrane Library, 2005;CD004211. Durieux P, Trinquart L, Colombet I et al. Computerized advice on drug dosage to improve prescribing practice (Cochrane Review). The Cochrane Library, 2008;CD002894.

Ammenwerth E, Schnell-Inderst P, Machan C and Siebert U. The effect of electronic prescribing on medication errors and adverse drug events: a systematic review. Journal of the American Medical Informatics Association 2008;15(5):585–600. PMid:18579832 PMCid:PMC2528040

Bassi J, Lau F and Bardal S. Use of information technology in medication reconciliation: a scoping review. Annals of Pharmacotherapy 2010;44:885–97. PMid:20371752

Chatellier G, Colombet I and Degoulet P. An overview of the effect of computer-assisted management of anticoagulant therapy on the quality of anticoagulation. International Journal of Medical Informatics 1998;49:311–20.

Eslami S, de Keizer NF and Abu-Hanna A. The impact of computerized physician medication order entry in hospitalized patients – a systematic review. International Journal of Medical Informatics 2008;77:365–76. PMid:18023611

Eslami S, Abu-Hanna A, de Jonge E and de Keizer NF. Tight glycemic control and computerized decision support systems: a systematic review. Intensive Care Medicine 2009;35:1505–17. PMid:19562322 PMCid:PMC2726914

Fitzmaurice DA, Hobbs FD, Delaney BC, Wilson S and McManus R. Review of computerized decision support Strom BL, Schinnar R, Aberra F et al. Unintended effects of a computerized physician order entry nearly hard-stop alert to prevent a drug interaction: a randomized controlled trial. Archives of Internal Medicine 2010;170:1578–83.

Berner ES, Kasiraman RK, Yu F, Ray MN and Houston TK. Data quality in the outpatient setting: impact on clinical decision support systems. AMIA Annual Symposium Proceedings 2005;41–5. PMid:16778998 PMCid:PMC1560426

Van der Sijs H, Aarts J, Vulto A and Berg M. Overriding of drug safety alerts in computerized physician order entry. Journal of the American Medical Informatics Association 2003;13:138–47. PMid:16357358 PMCid:PMC1447540

Smith R. Strategies for coping with information overload. British Medical Journal 2010;341.

Shah NR, Seger AC, Seger DL et al. Improving acceptance of computerized prescribing alerts in ambulatory care. Journal of the American Medical Informatics Association 2006;13:5–11. PMid:16221941 PMCid:PMC1380196

Zachariah M, Phansalkar S, Seidling HM et al. Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems – I-MeDeSA. Journal of the American Medical Informatics Association 2011;Suppl1:i62–72. PMid:21946241 PMCid:PMC3241174

Eslami S, Abu-Hanna A, de Keizer NF and de Jonge E. Errors associated with applying decision support by suggesting default doses for aminoglycosides. Drug Safety 2006;29:803–9. PMid:16944965

Del Beccaro MA, Jeffries HE, Eisenberg MA and Harry ED. Computerized provider order entry implementation: no association with increased mortality rates in an intensive care unit. Pediatrics 2006;118;290. PMid:16818577

Beuscart-Zephir MC, Anceaux F, Crinquette V and Renard JM. Integrating users' activity modeling in the design and assessment of hospital electronic patient records: the example of anesthesia. International Journal of Medical Informatics 2001;64:157–71.

Cresswell K and Sheikh A. The NHS Care Record Service (NHS CRS): recommendations from the literature on successful implementation and adoption. Informatics in Primary Care 2009;17:153–60. PMid:20074427

Moen A. A nursing perspective to design and implementation of electronic patient record systems. Journal of Biomedical Informatics 2003;36:375–8. PMid:14643733

Pare G, Sicotte C, Jaana M and Girouard D. Prioritizing the risk factors influencing the success of clinical information system projects. A Delphi study in Canada. Methods of Information in Medicine 2008;47:251–9. PMid:18473092

Rose J, Jones M and Truex D. Socio-theoretic accounts of IS: the problem of agency. Scandinavian Journal of Information Systems 2005;17:133–52.

Sicotte C, Pare G, Moreault M-P and Paccioni A. A risk assessment of two interorganizational clinical information systems. Journal of the American Medical Informatics Association 2006;13:557–66. PMid:16799130 PMCid:PMC1561789

Kesselheim A, Cresswell K, Bates DW, Phansalkar S and Sheikh A. Clinical decision support for medication safety and the risk of litigation. Health Affairs 2011;30(12):2310–17. PMid:22147858

Fox J and Thomson R. Clinical decision support systems: a discussion of quality, safety and legal liability issues. Proceedings of theAMIA Symposium 2002;265–9. PMid:12463828 PMCid:PMC2244432

Marewski JN and Gigerenzer G. Heuristic decision making in medicine. Dialogues in Clinical Neuroscience 2012;14:77–89. PMid:22577307 PMCid:PMC3341653

The Cochrane Collaboration.: (accessed 22/07/2012).

Greenhalgh T, Stramer K, Bratan T, Byrne E, Mohammad Y and Russell J. Introduction of shared electronic records: multi-site case study using diffusion of innovation theory. British Medical Journal 2008;337:a1786.

Johnson CM and Turley JP. The significance of cognitive modeling in building healthcare interfaces. International Journal of Medical Informatics 2006;75:163–72. PMid:16085454

Puffer MJ, Ferguson JA, Wright BC et al. Partnering with clinical providers to enhance the efficiency of an EMR. Journal of Healthcare Information Management 2007;21:24–32. PMid:17299922

Majeed A, Car J and Sheikh A. Accuracy and completeness of electronic patient records in primary care. Family Practice 2008;25:213–14. PMid:18694896

Health Data Management. Nuance Gets a Contract, Partnership with UPMC. (accessed 21/10/2011).

Cresswell KM, Bates DW, Phansalkar S and Sheikh A. Opportunities and challenges in creating an international centralised knowledge base for clinical decision support systems in ePrescribing. BMJ Quality and Safety 2011;20:625–30. PMid:21606472

Wright A, Bates DW, Middleton B et al. Creating and sharing clinical decision support content with Web 2.0: issues and examples. Journal of Biomedical Informatics 2009;42:334–46. PMid:18935982

Sittig DF, Wright A, Simonaitis L et al. The state of the art in clinical knowledge management: an inventory of tools and techniques. International Journal of Medical Informatics 2010;79:44–57. PMid:19828364 PMCid:PMC2895508

Avery AJ, Savelyich BS, Sheikh A, Morris CJ, Bowler I and Teasdale S. Improving general practice computer systems for patient safety: qualitative study of key stakeholders. Quality and Safety in Health Care 2007;16:28–33. PMid:17301200 PMCid:PMC2464931

Gable J. An overview of the legal liabilities facing manufacturers of medical information systems. Qunnipiac Health Law 2001;5:127–51.

Souza NM, Sebaldt RJ, Mackay JA et al. Computerized clinical decision support systems for primary preventive care: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implementation Science 2011;6:87. PMid:21824381 PMCid:PMC3173370

Sahota N, Lloyd R, Ramakrishna A et al. Computerized clinical decision support systems for acute care management: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implementation Science 2011;6:91. PMid:21824385 PMCid:PMC3169487

Roshanov PS, Misra S, Gerstein HC et al. Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review. Implementation Science 2011;6:92. PMid:21824386 PMCid:PMC3170626

Nieuwlaat R, Connolly SJ, Mackay JA et al. Computerized clinical decision support systems for therapeutic drug monitoring and dosing: a decision maker-researcher partnership systematic review. Implementation Science 2011;6:90. PMid:21824384 PMCid:PMC3170236

Hemens BJ, Holbrook A, Tonkin M et al. Computerized clinical decision support systems for drug prescribing and management: a decision-maker-researcher partnership systematic review. Implementation Science 2011;6:89. PMid:21824383 PMCid:PMC3179735

Roshanov PS, You JJ, Dhaliwal J et al. Can computerized clinical decision support systems improve practitioners' diagnostic test ordering behavior? A decision-maker-researcher partnership systematic review. Implementation Science 2011;6:88. PMid:21824382 PMCid:PMC3174115

Purcell GP. What makes a good clinical decision support system. British Medical Journal 2005;330:740–1. PMid:15802700 PMCid:PMC555864

Handler JA, Feied CF, Coonan K et al. Computerized physician order entry and online decision support. Academic Emergency Medicine 2004;11:1135–41. PMid:15528576



  • There are currently no refbacks.

This is an open access journal, which means that all content is freely available without charge to the user or their institution. Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles in this journal starting from Volume 21 without asking prior permission from the publisher or the author. This is in accordance with the BOAI definition of open accessFor permission regarding papers published in previous volumes, please contact us.

Privacy statement: The names and email addresses entered in this journal site will be used exclusively for the stated purposes of this journal and will not be made available for any other purpose or to any other party.

Online ISSN 2058-4563 - Print ISSN 2058-4555. Published by BCS, The Chartered Institute for IT