Family Practice Advance Access originally published online on May 16, 2005
Family Practice 2005 22(4):465-469; doi:10.1093/fampra/cmi029
Electronic primary care guidelines with links to Cochrane reviewsEBM Guidelines
a The Finnish Medical Society Duodecim, Kalevankatu 11, 00100 Helsinki, b Mehiläinen Health Services, Annankatu 3436 A, 00100 Helsinki and c The Centre for Pharmacotherapy Development, Mannerheimintie 170, 00300 Helsinki, Finland
Correspondence to Helena Varonen, Kuninkaantie 4, 02400 Kirkkonummi, Finland; Email: helena.varonen{at}duodecim.fi
Received 22 June 2004; Accepted 27 January 2005.
Varonen H, Jousimaa J, Helin-Salmivaara A and Kunnamo I. Electronic primary care guidelines with links to Cochrane reviews EBM Guidelines. Family Practice 2005; 22: 465469.
| Abstract |
|---|
|
|
|---|
In Finland, guidelines have been used in primary care since the late 1980s to bridge the gap between research evidence and practice. From the very beginning, the electronic format has been the primary source for EBM Guidelines (EBMG). Although also published on CD and in print, the guidelines are currently mostly used via the Internet. Keeping more than 1000 guidelines up to date is a great challenge to the editorial group, and several methods are used to guarantee the quality. The Cochrane Library has become the most important source of information for the guideline producers and all Cochrane reviews relevant to GPs are summarized and linked to the guidelines. In this article we present our experience of producing the electronic guidelines for GPs, the methodology used, and data on the clinical use of these guidelines and their Cochrane links. We also discuss the barriers and facilitators to our process and present ideas for future development.
Keywords. Clinical decision support, evidence chain, evidence summary, practice guidelines, systematic reviews.
| Introduction |
|---|
|
|
|---|
GPs need to update their knowledge in a wide variety of clinical problems to be able to offer their patients the best available care. Clinical practice guidelines have been introduced to bridge the gap between research and practice. The practice guidelines can be defined as an attempt to distil a large body of medical expertise into a convenient, readily usable format.1 There is evidence that guidelines are effective in changing the process and outcome of care,24 provided that the implementation of guidelines into daily practice is successful.5,6
Systematic reviews are the best available source of evidence for guidelines. The largest and most frequently updated collection of systematic reviews is maintained by the Cochrane Collaboration.7 In Finland, guidelines for GPs have been produced since the late 1980s and electronic format was chosen because it is more user friendly and easier to update than most print sources. The producers of EBM Guidelines (EBMG) have followed the development of the Cochrane Collaboration and worked in close cooperation with the Cochrane Library.
The aim of this paper is to describe the Finnish experience of electronic guidelines and especially the role of Cochrane reviews in this work. The first section covers the methods and resources of the guideline authoring process. The second section describes user perspectives of our guidelines based on effectiveness studies and logbook files. In addition we discuss the barriers and facilitators to our process and present ideas for future development.
| Methods |
|---|
|
|
|---|
History and background
The idea of EBM Guidelines emerged in 1987 from the apparent need for an evidence-based data source relating to the diagnosis and treatment of the wide range of diseases and conditions encountered by the GP.8 Dr Ilkka Kunnamo set up the editorial process in 1988 with the help of the Finnish Medical Society Duodecim, the scientific society of Finnish physicians. The first experimental version comprising twenty short guidelines on various topics was published in 1989. Since then, the collection of guidelines has grown steadily and comprises currently more than 1000 guidelines. In the year 2000 we translated the guidelines into English and since then we have updated the Finnish and English versions simultaneously.
Editorial process
The members of the editorial team are experienced physicians, most of whom have clinical research background, and training in the critical appraisal of medical literature. The team meets twice a month and works in close cooperation with about 20 specialist coordinators and 300 authors. Although the editors draw from the expertise of specialists, the guidelines are intended to be used for unselected patients in general practice and outpatient departments. The key sources of evidence in EBMG are presented in Table 1.
|
The guidelines have two approaches: the symptom-oriented guidelines take up a variety of symptoms encountered by GPs; and the disease-specific guidelines include both common and rare health problems. The epidemiology of various conditions has been taken into account, and the diagnostic strategies have been adapted to general practice, keeping cost-effectiveness in mind.
Updating
Since the first electronic version was published in 1989, the contents of the source database have been updated regularly and we use several methods to guarantee the quality (Table 2). Over the years the guidelines have been reviewed extensively and even rewritten several times to include mounting evidence from systematic reviews and clinical studies, comments by external referees, and feedback from clinicians who use the database in their daily practice. Clinical questions from the users and editors serve as an important starting point for the revising. The guidelines are updated jointly by the editors of EBMG and by the authors and specialist coordinators. All amendments in the text are marked in red for the benefit of the user.
|
At present, the articles in EBMG are circulated to a group of external referees from both English speaking and other countries. The editors continuously review the contents of the most important English language general medical journals (New England Journal of Medicine, Lancet, JAMA, BMJ), and the contents of a number of other journals are checked regularly.
Cochrane reviews and other sources of evidence
The editors of EBMG have followed the development of Cochrane Collaboration from its beginning and cooperated closely with the publishers of the Cochrane Library, first with Update Software, and from 2003 with John Wiley & Sons Ltd. The main sources of evidence for the guidelines, i.e. the Cochrane reviews and DARE abstracts, are evaluated as they are published, and if they bear relevance to topics in EBM Guidelines they are abstracted as evidence summaries.
The recommendations in the guidelines are checked whenever new information is added to the evidence summaries, and if necessary, the recommendations are amended accordingly. All evidence cannot be linked directly to recommendations in the guidelines. Statements describing such evidence are collected under the subheading Related evidence. During editing and the peer review process some statements from the Related evidence sections are included in the guidelines.
Evidence summaries
The special feature of EBM Guidelines are concise summaries of scientific evidence that are attached to the individual guidelines. These summaries are based on Cochrane reviews and DARE abstracts in the Cochrane Library, on other systematic reviews and EBM sources (Table 1). A link is made from the evidence summary to the Cochrane review, and the full-text review is included on the CD-ROM and Internet database.
Evidence summaries begin with a heading, followed by a letter code for the grade of evidence (Table 3). A statement to which the evidence code refers is given below the heading. This statement is followed by a short description of original research or systematic reviews. If the evidence summary is based on a Cochrane review, the full-text review is added to the guideline. An evidence chain is formed: the physician can move from the guideline to the evidence summary and to the Cochrane review.
|
Grading the evidence
The strength of evidence is determined and is coded from A to D, with A presenting the highest quality research evidence and D the lowest (Table 4). The production of evidence summaries has been developed together with Current Care, the national guidelines program in Finland that is also hosted by Duodecim, following the methods of other guidelines producers.9,10
|
The GRADE Working Group has developed a common approach to grading the quality of evidence and strength of recommendations in health care.11 This approach is adopted in EBMG, although we only grade the strength of evidence, and not, as many guidelines do, the strength of recommendations.
| Clinical use of the guidelines and Cochrane links |
|---|
|
|
|---|
Clinical use of EBMG
During the 1990's the Finnish version of EBMG became recognised nationally. Either the CD version or the Internet version is used in practically all Finnish primary health care centres. The health centres and districts subscribe to Duodecim's health portal that covers EBMG and most of the resources for the editorial work comes from the subscriptions. The 1000 core guidelines have been published in book format every two years, and more than 30 000 handbooks have been sold since 1992.
The use of EBMG has been studied.12 It has been shown that electronic guidelines can be retrieved rapidly enough to be used during primary care consultations, which is when they are most likely to influence treatment decisions.13 The users of guidelines reported finding the information they sought in over 85% of cases. Less experienced young physicians searched guidelines that dealt with common health problems while more experienced physicians searched information on rare but important conditions.
Logbook data of the use of EBMG, evidence summaries and Cochrane reviews
We monitor the log file recordings of used search terms and opened guidelines to meet the needs of the users. According to the log files, in October 2004, the guidelines in the Finnish version of EBMG were opened more than 150 000 times per month. There are approximately 17 500 practicing physicians in Finland of whom 4000 are GPs. The GPs that use EBMG consult it, on average, three times per day.12
According to the log files, the largest number of searches are done on common primary care problems. The most used search terms in the first three months of 2004 include diabetes, asthma, hypertension, gout, UTI (urinary tract infection), diarrhea, fracture, anemia, chicken pox and migraine. The articles most often opened are listed in Table 5.
|
The evidence summaries have been placed in a separate database since June 2003. They are used to a lesser extent than guidelines but their use is steadily increasing (Fig. 1). In Finland, the Cochrane Library is provided to physicians by the same health portal as EBMG. We have monitored the physician use of the Cochrane Library in Finland since June 2003 and the use is increasing (Fig. 1).
|
| Discussion |
|---|
|
|
|---|
The logbook data proves that electronic guidelines are used by GPs in Finland probably more frequently than anywhere else in the world. According to user surveys the major reasons for this are that the guidelines cover a wide spectrum of problems, give practical advice, are easy to use and frequently updated. Easy and quick access are considered key elements for the usability of guidelines.14 The decision to link the guidelines to systematic reviews has guaranteed the quality of evidence and Cochrane reviews have become well known in our country because of the links and evidence summaries in EBMG.
Electronic information sources are more user friendly than print formats and are a suitable way to keep abreast of developments in medicine.15 The choice of electronic publishing format at the very beginning of the process was crucial for the editing of the Finnish guidelines. Physicians have problems with finding printed guidelines when needed,16 and the acceptance of guidelines via CDs and the Internet is high.17 The introduction of electronic guidelines was facilitated by the fact electronic patient records have been widely used since the 1980s.
There have been certain barriers and difficulties to producing this large collection of guidelines. Finland is a small linguistic area and writing guidelines for only approximately 4000 GPs is economically onerous. The financial and collective support from the well respected Medical Society Duodecim has guaranteed the continuity of the work. Other facilitators include the high level of information technology in Finland and the uniform clinical culture, resulting from well-standardized medical education.
The editorial process has been built on enthusiasm and well-defined visions. The editors have mostly been practicing physicians with clear ideas of the information needs in clinical practice. There guideline collection is comprehensive enough to guarantee that relevant information is found at most searches, and that the guidelines give answers to specific questions, which is considered essential for the implementation of guidelines.18
We plan to index the evidence summaries on the basis of patient groups and diagnoses, interventions, and outcomes, so that each of these could be searched separately or in combinations in specific search fields. This will make the evidence summary database searchable for specific patient problems. The structuring of evidence summaries aims at facilitated or semi-automated updating from structured sources of evidence (such as the Cochrane Library), as well as flagging of new evidence from original studies.
Our vision of the ideal process of bridging the gap between research and practice is presented in Figure 2. We have started to build a decision support database that contains guidelines in computer-readable format. Reminders are created by a decision support engine, prompted by data from the electronic patient record. The reminders are backed by the whole evidence chain, from guidelines to evidence summaries and further to Cochrane reviews.
|
The log files show that electronic guidelines are frequently used in Finland and that the reading rate of evidence summaries and Cochrane reviews is increasing. Whether this is accompanied by changes in clinical practice remains to be studied in further randomized controlled trials.
| Declaration |
|---|
|
|
|---|
Funding: None.
Ethical approval: n/a.
Conflicts of interest: All authors are editors of EBMG.
| References |
|---|
|
|
|---|
1 Cook DJ, Greengold NL, Ellrodt AG, Weingarten SR. The relation between systematic reviews and practice guidelines. Ann Int Med 1997; 127: 210216.
2 Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Guidelines in professions allied to medicine. Cochrane Database Syst Rev 2000; 2: CD000349.
3 Grimshaw J, Russell I. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet 1993; 342: 13171322.[CrossRef][Web of Science][Medline]
4 Grimshaw J, Freemantle N, Wallace S, Russell I, Hurwitz B, Watt I et al. Developing and implementing clinical practice guidelines. Qual Health Care 1995; 4: 5564.
5 Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet 2003; 362: 12251230.[CrossRef][Web of Science][Medline]
6 Cranney M, Warren E, Barton S, Gardner K, Walley T. Why do GPs not implement evidence-based guidelines? A descriptive study. Fam Pract 2001; 18: 359363.
7 Jadad AR, Cook DJ, Jones A, Klassen TP, Tugwell P, Moher M et al. Methodology and reports of systematic reviews and meta-analyses: a comparison of Cochrane reviews with articles published in paper-based journals. J Am Med Assoc 1998; 280: 278280.
8 Jousimaa J, Kunnamo I. PDRDa computer-based primary care decision support system. Med Inform 1993; 18: 103112.
9 Harris RP, Helfand M, Woolf SH, Lohr KN, Mulrow CD, Teutsch SM et al. Current methods of the US Preventive Services Task Force: a review of the process. Am J Prev Med 2001; 20(3 Suppl): 2135.[Web of Science][Medline]
10 Scottish Intercollegiate Guidelines network (SIGN). Forming guideline recommendations. In A Guideline Developers' Handbook. SIGN Publication No. 50; 2001.
11 GRADE Working Group. Grading quality of evidence and strength of recommendations. Br Med J 2004; 328: 14901498.
12 Jousimaa J. The clinical use of computerised primary care guidelines [Doctoral dissertation]. Kuopio: University of Kuopio; 2001.
13 Jousimaa J, Kunnamo I, Makela M. Physicians' patterns of using a computerized collection of guidelines for primary care. Int J Tech Ass in HC 1998; 14: 484493.
14 Butzlaff M, Vollmar H, Floer B, Koneczny N, Isfort J, Lange S. Learning with computerized guidelines in general practice?: A randomized controlled trial. Fam Pract 2004; 21: 183188.
15 Gillespie LD, Gillespie WJ. Finding current evidence: search strategies and common databases. Clin Orthop 2003; 413: 133145.
16 Varonen H, Makela M. Practice guidelines in Finland: availability and quality. Qual Health Care 1997; 6: 7579.
17 Jeannot JG, Scherer F, Pittet V, Burnand B, Vader JP. Use of the World Wide Web to implement clinical practice guidelines: a feasibility study. J Med Internet Res 2003; 5: e12.[Medline]
18 Michie S, Johnston M. Changing clinical behaviour by making guidelines specific. Br Med J 2004; 328: 343345.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
H. Varonen, T. Kortteisto, M. Kaila, and for the EBMeDS Study Group What may help or hinder the implementation of computerized decision support systems (CDSSs): a focus group study with physicians Fam. Pract., June 1, 2008; 25(3): 162 - 167. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||


