Author: Rajesh Chatha, Ben Clarke, Aidan Mcivor, Thomas Frost, Benjamin Earle-Wight, Stuart Hamilton / Editor: Rajesh Chatha, Robert Hirst / Codes: NeuP8, SLO1, SLO10 / Published: 27/05/2021

At TERN Education we want to help you consider the evidence base behind your practice. We produce monthly virtual journal club modules on RCEMLearning. These give you the opportunity to critically consider your practice and earn a certificate which demonstrates the new curricular requirement to be engaged in critical appraisal activity. This month we are trialling some practice single best answer (SBA) questions to help get you acclimatised to the new examination formats. When you’ve finished, click the link to the forum to discuss this month’s paper with colleagues around the country.

Interested in writing a module? We are looking to recruit regional teams to write future modules. Email us at


  1. Adams, ST, Leveson SH. Clinical prediction rules. BMJ. 2012; 344: d8312. doi:10.1136/bmj.d8312
  2. Stiell, IG, Bennett C. Implementation of clinical decision rules in the emergency department. Academic Emergency Medicine. 2007; 14(11): 955-9. doi:10.1197/j.aem.2007.06.039
  3. Phillips, B. Clinical decision rules: how to build them. Archives of Disease in Childhood. 2010; 95(3): 83-7. doi:10.1136/adc.2009.174441
  4. Wells PS, Anderson DR, Rodger M, Ginsberg JS, Kearon C, Gent M et al., Derivation of a simple clinical model to categorize patients probability of pulmonary embolism: increasing the models utility with the SimpliRED D-dimer. Thromb Haemost. 2000; 83(3): 416-20.
  5. Gibson N, Sohne M, Kruip M, Tick L, Gerdes V, Bossuyt P et al., Further validation and simplification of the Wells clinical decision rule in pulmonary embolism. Thromb Haemost. 2008; 99(1): 229-34. doi: 10.1160/TH07-05-0321
  6. Kline J, Mitchell A, Kabrhel C, Richman P, Courtney D. Clinical criteria to prevent unnecessary diagnostic testing in emergency department patients with suspected pulmonary embolism. Journal of Thrombosis and Haemostasis. 2004; 2(8): 1247-55. doi:10.1111/j.1538-7836.2004.00790.x
  7. Shen, J, Chen H, Chen J, Xing J, Gu P, Zhu B. Comparison of the Wells score with the revised Geneva score for assessing suspected pulmonary embolism: a systematic review and meta-analysis. Journal of Thrombosis and Thrombolysis. 2016; 41(3): 482-92. doi:10.1007/s11239-015-1250-2
  8. Writing Group for the Christopher Study Investigators*. Effectiveness of Managing Suspected Pulmonary Embolism Using an Algorithm Combining Clinical Probability, D-Dimer Testing, and Computed Tomography. JAMA. 2006; 295(2): 172–179. doi:10.1001/jama.295.2.172
  9. Centor RM, Witherspoon JM, Dalton HP, Brody CE, Link K. The diagnosis of strep throat in adults in the emergency room. Medical Decision Making. 1981; 1(3): 239-46. doi: 10.1177/0272989X8100100304
  10. McIsaac WJ, White D, Tannenbuam D, Low DE. A clinical score to reduce unnecessary antibiotic use in patients with sore throat. CMAJ. 1998; 158(1): 75-83.
  11. National Institute of Clinical Excellence (NICE). (2018). Sore throat (acute): antimicrobial prescribing. [NICE guideline NG84]. [Accessed 20th May 2021].
  12. Willis B, Coomar D, Baragilly M. Comparison of Centor and McIsaac scores in primary care: a meta-analysis over multiple thresholds. British Journal of General Practice. 2020; 70(693): e245-254.
  13. Malley M, Driver K, Costelloe M, Monaghan I, Jefferson L, Poole L. To prescribe or not to prescribe for paediatric sore throat: a retrospective cohort study comparing clinician-led antibiotic prescriptions to FeverPAIN and Centor scoring in a tertiary paediatric emergency department and a national review of practice. EMJ. 2021; emermed-2020-210786. doi:10.1136/emermed-2020-210786
  14. Perry JJ, Stiell IG, Sivilotti MLA, Bullard MJ, Hohl CM, Sutherland J, et al., Clinical Decision Rules to Rule Out Subarachnoid Hemorrhage for Acute Headache. JAMA. 2013 Sep 25;310(12):1248.
  15. Perry J, Stiell I, Sivilotti M, Lee S, Eisenhauer M, Symington C, et al., High-risk clinical characteristics for subarachnoid haemorrhage in patients with acute headache: prospective cohort study. BMJ. 2010; 341: c5204. 
  16. Perry J, Sivilotti M, Sutherland J, Hohl C, Emond M, Calder C. Validation of the Ottawa Subarachnoid Hemorrhage Rule in patients with acute headache. CMAJ. 2017; 189(45): E1379-E1385. doi:10.1503/cmaj.170072
  17. Perry J, Sivilotti M, Emond M, Hohl C, Khan M, Lesiuk H et al., Prospective Implementation of the Ottawa Subarachnoid Hemorrhage Rule and 6-Hour Computed Tomography Rule.Stroke. 2020; 51(2): 424-430. doi:10.1161/strokeaha.119.026969
  18. Bellolio M, Hess E, Gilani W, VanDyck T, Ostby S, Schwarz J et al., External validation of the Ottawa subarachnoid hemorrhage clinical decision rule in patients with acute headache. Am J Emerg Med. 2015; 33(2): 244-9. doi:10.1016/j.ajem.2014.11.049
  19. Hirst R. 2020. Subarachnoid Haemorrhage in the Emergency Department (SHED). [Aaccessed 20th May 2021].
  20. Perry J, Sivilotti M, Emond M, Stiell I, Stotts G, Lee J et al., Prospective validation of Canadian TIA Score and comparison with ABCD2 and ABCD2i for subsequent stroke risk after transient ischaemic attack: multicentre prospective cohort study. BMJ. 2021; 372: n453. 4 Feb. 2021, doi:10.1136/bmj.n453
  21. StatsDirect. Validity (Internal, External, Construct) (2020). [accessed 20th May 2021].
  22. Sedgwick P. External and internal validity in clinical trials. BMJ. 2012; 344: e1004.
  23. Cook NR. Quantifying the added value of new biomarkers: how and how not. Diagnostic and Prognostic Research. 2018; 2:14.
  24. Mandrekar JN. Receiver Operating Characteristic Curve in Diagnostic Test Assessment. Journal of Thoracic Oncology. 2010; 5(9): 1315-16
  25. NICE. (2019). Stroke and transient ischaemic attack in over 16s: diagnosis and initial management. [accessed 20th May 2021].
  26. Nazerian P, Mueller C, Soeiro A, Leidel B, Salvadeo S, Giachino F et al., Diagnostic Accuracy of the Aortic Dissection Detection Risk Score Plus D-Dimer for Acute Aortic Syndromes: The ADvISED Prospective Multicenter Study. Circulation. 2018; 137(3): 250-258. doi:10.1161/circulationaha.117.029457
  27. Gottlieb M, Manchanda S, Patel K. What Is the Accuracy of the Aortic Dissection Detection Risk Score? Annals of Emergency Medicine. 2020; 76(5): e113-e115. doi:10.1016/j.annemergmed.2020.04.005
  28. Think Aorta. (2021). Think Aorta – Aortic Dissection Campaign. [Accessed 23rd May 2021].
  29. Blatchford O, Murray WR, Blatchford M. A risk score to predict need for treatment for upper-gastrointestinal haemorrhage. Lancet. 2000; 356(9238): 1318-21. doi: 10.1016/S0140-6736(00)02816-6
  30. Rockall TA, Logan RF, Devlin HB, Northfield TC. Risk assessment after acute upper gastrointestinal haemorrhage. Gut. 1996; 38(3): 316-21. doi: 10.1136/gut.38.3.316
  31. NICE. (2016). Acute upper gastrointestinal bleeding in over 16s: management. [Accessed 20th May 2021].
  32. Stanley AJ, Laine L, Dalton HR, Ngu JH, Schultz M, Abazi R et al., Comparison of risk scoring systems for patients presenting with upper gastrointestinal bleeding: international multicentre prospective study. BMJ. 2017; 356: i6432 doi:10.1136/bmj.i6432
  33. Stiell I, Wells G, Vandemheen K, Clement C, Lesiuk H, De Maio V et al., The Canadian C-spine rule for radiography in alert and stable trauma patients. JAMA. 2001; 286(15): 1841-8. doi:10.1001/jama.286.15.1841
  34. Hoffman JR, Mower WR, Wolfson AB, Todd KH, Zucker MI. Validity of a set of clinical criteria to rule out injury to the cervical spine in patients with blunt trauma. National Emergency X-Radiography Utilization Study Group. N Engl J Med. 2000; 343(2): 94-9. doi: 10.1056/NEJM200007133430203
  35. Stiell I, Clement C, McKnight R, Brison R, Schull M, Rowe B et al., The Canadian C-spine rule versus the NEXUS low-risk criteria in patients with trauma. N Engl J Med. 2003; 349(26): 2510-8. doi:10.1056/NEJMoa031375
  36. Paykin G, O’Reilly G, Ackland H, Mitra B. The NEXUS criteria are insufficient to exclude cervical spine fractures in older blunt trauma patients. Injury. 2017; 48(5): 1020-1024. doi:10.1016/j.injury.2017.02.013
  37. Six AJ, Backus BE, Kelder JC. Chest pain in the emergency room: value of the HEART score. Neth Heart J. 2008; 16(6): 191–6. doi: 10.1007/bf03086144
  38. Mahler S, Riley R, Hiestand B, Russell G, Hoekstra J, Lefebvre C et al., The HEART Pathway randomized trial: identifying emergency department patients with acute chest pain for early discharge. Circulation Cardiovascular quality and Outcomes. 2015; 8(2): 195-203. doi:10.1161/circoutcomes.114.001384
  39. Antman EM, Cohen M, Bernink PJ, McCabe CH, et al., The TIMI risk score for unstable angina/non-ST elevation MI: A method for prognostication and therapeutic decision making. JAMA. 2000; 284(7): 835-42. doi: 10.1001/jama.284.7.835
  40. Eagle KA, Lim MJ, Dabbous OH, et al., A Validated Prediction Model for All Forms of Acute Coronary Syndrome: Estimating the Risk of 6-Month Post-discharge Death in an International Registry. JAMA. 2004; 291(22): 2727–33. doi:10.1001/jama.291.22.2727
  41. Than M, Flaws D, Sanders S, Doust J, Glasziou P, Kline J, et al., Development and validation of the Emergency Department Assessment of Chest pain Score and 2h accelerated diagnostic protocol. Emerg Med Australas. 2014; 26(1): 34-44. doi: 10.1111/1742-6723.12164
  42. Laureano-Phillips J, Robinson R, Aryal S, Blair S, Wilson D, Boyd K, Schrader C et al., HEART Score Risk Stratification of Low-Risk Chest Pain Patients in the Emergency Department: A Systematic Review and Meta-Analysis. Annals of Emergency Medicine. 2019; 74(2): 187-203. doi:10.1016/j.annemergmed.2018.12.010
  43. Poldervaart JM, Langedijk M, Backus B, Dekker I, Six A, Doevendans P et al., Comparison of the GRACE, HEART and TIMI score to predict major adverse cardiac events in chest pain patients at the emergency department. International Journal of Cardiology. 2017; 227: 656-661. doi:10.1016/j.ijcard.2016.10.080
  44. Nilsson T, Johannesson E, Forberg J, Mokhtari A, Ekelund U. Diagnostic accuracy of the HEART Pathway and EDACS-ADP when combined with a 0-hour/1-hour hs-cTnT protocol for assessment of acute chest pain patients. Emergency Medicine Journal. 2021; emermed-2020-210833. doi:10.1136/emermed-2020-210833
  45. Flaws D, Than M, Scheuermeyer FX, Christenson J, Boychuk B, Greenslade J et al., External validation of the emergency department assessment of chest pain score accelerated diagnostic pathway (EDACS-ADP). Emergency Medicine Journal. 2016; 33(9): 618-625. doi: 10.1136/emermed-2015-205028
  46. Chapman A, Hesse K, Andrews J, Lee K, Anand A, Shah A et al., High-Sensitivity Cardiac Troponin I and Clinical Risk Scores in Patients With Suspected Acute Coronary Syndrome. Circulation. 2018 138(16): 1654-1665. doi:10.1161/circulationaha.118.036426
  47. Torralba F, Navarro A, Castellanos-de la Hoz J, Ortiz C, Botero A, Alarcón F et al., HEART, TIMI, and GRACE Scores for Prediction of 30-Day Major Adverse Cardiovascular Events in the Era of High-Sensitivity Troponin. Arquivos Brasileiros de Cardiologia. 2020; 114(5): 795-802. doi:10.36660/abc.20190206
  48. Royal College of Emergency Medicine. (2017). James Lind Alliance Priority Setting Partnership. [accessed 20th May 2021].  
  49. Stiell IG, Greenberg GH, McKnight RD, Nair RC, McDowell I, Worthington JR. A study to develop clinical decision rules for the use of radiography in acute ankle injuries. Ann Emerg Med. 1992; 21(4): 384-90. doi: 10.1016/s0196-0644(05)82656-3
  50. Bachmann LM, Kolb E, Koller MT, Steurer J, Riet GT. Accuracy of Ottawa ankle rules to exclude fractures of the ankle and mid-foot: systematic review. BMJ 2003; 326:417. doi:10.1136/bmj.326.7386.417
  51. Stiell IG, Greenberg GH, Wells GA, McKnight RD, Cwinn AA, Cacciotti T, et al., Derivation of a decision rule for the use of radiography in acute knee injuries. Ann Emerg Med. 1995; 26(4): 405-13. doi: 10.1016/s0196-0644(95)70106-0
  52. Seaberg DC, Jackson R. Clinical decision rule for knee radiographs. Am J Emerg Med. 1994; 12(5): 541-3. doi: 10.1016/0735-6757(94)90274-7
  53. Sims J, Chau M, Davies J. Diagnostic accuracy of the Ottawa Knee Rule in adult acute knee injuries: a systematic review and meta-analysis. European Radiology. 2020; 30(8): 4438-4446. doi:10.1007/s00330-020-06804-x
  54. Patrick B. BET 1: Predicting the need for knee radiography in the emergency department: Ottawa or Pittsburgh rule? Emergency Medicine Journal 2012; 29: 77-78
  55. Cheung T, Tank Y, Breederveld R, Tuinebreijer W, Lange-de Kler E, Derksen R. Diagnostic accuracy and reproducibility of the Ottawa Knee Rule vs the Pittsburgh Decision Rule. Am J Emerg Med. 2013; 31(4): 641-5. doi:10.1016/j.ajem.2012.11.003