Skip Navigation


Family Practice Advance Access originally published online on May 16, 2005
Family Practice 2005 22(4):465-469; doi:10.1093/fampra/cmi029
This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
22/4/465    most recent
cmi029v1
Right arrow E-letters: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when E-letters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Varonen, H.
Right arrow Articles by Kunnamo, I.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Varonen, H.
Right arrow Articles by Kunnamo, I.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© The Author (2005). Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oupjournals.org

Electronic primary care guidelines with links to Cochrane reviews—EBM Guidelines

Helena Varonena, Jukkapekka Jousimaab, Arja Helin-Salmivaarac and Ilkka Kunnamoa

a The Finnish Medical Society Duodecim, Kalevankatu 11, 00100 Helsinki, b Mehiläinen Health Services, Annankatu 34–36 A, 00100 Helsinki and c The Centre for Pharmacotherapy Development, Mannerheimintie 170, 00300 Helsinki, Finland

Correspondence to Helena Varonen, Kuninkaantie 4, 02400 Kirkkonummi, Finland; Email: helena.varonen{at}duodecim.fi

Received 22 June 2004; Accepted 27 January 2005.

Varonen H, Jousimaa J, Helin-Salmivaara A and Kunnamo I. Electronic primary care guidelines with links to Cochrane reviews — EBM Guidelines. Family Practice 2005; 22: 465–469.


    Abstract
 Top
 Abstract
 Introduction
 Methods
 Clinical use of the...
 Discussion
 Declaration
 References
 
In Finland, guidelines have been used in primary care since the late 1980s to bridge the gap between research evidence and practice. From the very beginning, the electronic format has been the primary source for EBM Guidelines (EBMG). Although also published on CD and in print, the guidelines are currently mostly used via the Internet. Keeping more than 1000 guidelines up to date is a great challenge to the editorial group, and several methods are used to guarantee the quality. The Cochrane Library has become the most important source of information for the guideline producers and all Cochrane reviews relevant to GPs are summarized and linked to the guidelines. In this article we present our experience of producing the electronic guidelines for GPs, the methodology used, and data on the clinical use of these guidelines and their Cochrane links. We also discuss the barriers and facilitators to our process and present ideas for future development.

Keywords. Clinical decision support, evidence chain, evidence summary, practice guidelines, systematic reviews.


    Introduction
 Top
 Abstract
 Introduction
 Methods
 Clinical use of the...
 Discussion
 Declaration
 References
 
GPs need to update their knowledge in a wide variety of clinical problems to be able to offer their patients the best available care. Clinical practice guidelines have been introduced to bridge the gap between research and practice. The practice guidelines can be defined as an attempt to distil a large body of medical expertise into a convenient, readily usable format.1 There is evidence that guidelines are effective in changing the process and outcome of care,24 provided that the implementation of guidelines into daily practice is successful.5,6

Systematic reviews are the best available source of evidence for guidelines. The largest and most frequently updated collection of systematic reviews is maintained by the Cochrane Collaboration.7 In Finland, guidelines for GPs have been produced since the late 1980s and electronic format was chosen because it is more user friendly and easier to update than most print sources. The producers of EBM Guidelines (EBMG) have followed the development of the Cochrane Collaboration and worked in close cooperation with the Cochrane Library.

The aim of this paper is to describe the Finnish experience of electronic guidelines and especially the role of Cochrane reviews in this work. The first section covers the methods and resources of the guideline authoring process. The second section describes user perspectives of our guidelines based on effectiveness studies and logbook files. In addition we discuss the barriers and facilitators to our process and present ideas for future development.


    Methods
 Top
 Abstract
 Introduction
 Methods
 Clinical use of the...
 Discussion
 Declaration
 References
 
History and background
The idea of EBM Guidelines emerged in 1987 from the apparent need for an evidence-based data source relating to the diagnosis and treatment of the wide range of diseases and conditions encountered by the GP.8 Dr Ilkka Kunnamo set up the editorial process in 1988 with the help of the Finnish Medical Society Duodecim, the scientific society of Finnish physicians. The first experimental version comprising twenty short guidelines on various topics was published in 1989. Since then, the collection of guidelines has grown steadily and comprises currently more than 1000 guidelines. In the year 2000 we translated the guidelines into English and since then we have updated the Finnish and English versions simultaneously.

Editorial process
The members of the editorial team are experienced physicians, most of whom have clinical research background, and training in the critical appraisal of medical literature. The team meets twice a month and works in close cooperation with about 20 specialist coordinators and 300 authors. Although the editors draw from the expertise of specialists, the guidelines are intended to be used for unselected patients in general practice and outpatient departments. The key sources of evidence in EBMG are presented in Table 1.


View this table:
[in this window]
[in a new window]
 
TABLE 1 Key sources of evidence that are summarized and linked to EBMG

 
The guidelines have two approaches: the symptom-oriented guidelines take up a variety of symptoms encountered by GPs; and the disease-specific guidelines include both common and rare health problems. The epidemiology of various conditions has been taken into account, and the diagnostic strategies have been adapted to general practice, keeping cost-effectiveness in mind.

Updating
Since the first electronic version was published in 1989, the contents of the source database have been updated regularly and we use several methods to guarantee the quality (Table 2). Over the years the guidelines have been reviewed extensively and even rewritten several times to include mounting evidence from systematic reviews and clinical studies, comments by external referees, and feedback from clinicians who use the database in their daily practice. Clinical questions from the users and editors serve as an important starting point for the revising. The guidelines are updated jointly by the editors of EBMG and by the authors and specialist coordinators. All amendments in the text are marked in red for the benefit of the user.


View this table:
[in this window]
[in a new window]
 
TABLE 2 The methods to guarantee the quality of EBM guidelines

 
At present, the articles in EBMG are circulated to a group of external referees from both English speaking and other countries. The editors continuously review the contents of the most important English language general medical journals (New England Journal of Medicine, Lancet, JAMA, BMJ), and the contents of a number of other journals are checked regularly.

Cochrane reviews and other sources of evidence
The editors of EBMG have followed the development of Cochrane Collaboration from its beginning and cooperated closely with the publishers of the Cochrane Library, first with Update Software, and from 2003 with John Wiley & Sons Ltd. The main sources of evidence for the guidelines, i.e. the Cochrane reviews and DARE abstracts, are evaluated as they are published, and if they bear relevance to topics in EBM Guidelines they are abstracted as evidence summaries.

The recommendations in the guidelines are checked whenever new information is added to the evidence summaries, and if necessary, the recommendations are amended accordingly. All evidence cannot be linked directly to recommendations in the guidelines. Statements describing such evidence are collected under the subheading Related evidence. During editing and the peer review process some statements from the ‘Related evidence’ sections are included in the guidelines.

Evidence summaries
The special feature of EBM Guidelines are concise summaries of scientific evidence that are attached to the individual guidelines. These summaries are based on Cochrane reviews and DARE abstracts in the Cochrane Library, on other systematic reviews and EBM sources (Table 1). A link is made from the evidence summary to the Cochrane review, and the full-text review is included on the CD-ROM and Internet database.

Evidence summaries begin with a heading, followed by a letter code for the grade of evidence (Table 3). A statement to which the evidence code refers is given below the heading. This statement is followed by a short description of original research or systematic reviews. If the evidence summary is based on a Cochrane review, the full-text review is added to the guideline. An ‘evidence chain’ is formed: the physician can move from the guideline to the evidence summary and to the Cochrane review.


View this table:
[in this window]
[in a new window]
 
TABLE 3 Example of an EBMG evidence summary

 
Grading the evidence
The strength of evidence is determined and is coded from A to D, with A presenting the highest quality research evidence and D the lowest (Table 4). The production of evidence summaries has been developed together with Current Care, the national guidelines program in Finland that is also hosted by Duodecim, following the methods of other guidelines producers.9,10


View this table:
[in this window]
[in a new window]
 
TABLE 4 Classification of the level of evidence

 
The GRADE Working Group has developed a common approach to grading the quality of evidence and strength of recommendations in health care.11 This approach is adopted in EBMG, although we only grade the strength of evidence, and not, as many guidelines do, the strength of recommendations.


    Clinical use of the guidelines and Cochrane links
 Top
 Abstract
 Introduction
 Methods
 Clinical use of the...
 Discussion
 Declaration
 References
 
Clinical use of EBMG
During the 1990's the Finnish version of EBMG became recognised nationally. Either the CD version or the Internet version is used in practically all Finnish primary health care centres. The health centres and districts subscribe to Duodecim's health portal that covers EBMG and most of the resources for the editorial work comes from the subscriptions. The 1000 core guidelines have been published in book format every two years, and more than 30 000 handbooks have been sold since 1992.

The use of EBMG has been studied.12 It has been shown that electronic guidelines can be retrieved rapidly enough to be used during primary care consultations, which is when they are most likely to influence treatment decisions.13 The users of guidelines reported finding the information they sought in over 85% of cases. Less experienced young physicians searched guidelines that dealt with common health problems while more experienced physicians searched information on rare but important conditions.

Logbook data of the use of EBMG, evidence summaries and Cochrane reviews
We monitor the log file recordings of used search terms and opened guidelines to meet the needs of the users. According to the log files, in October 2004, the guidelines in the Finnish version of EBMG were opened more than 150 000 times per month. There are approximately 17 500 practicing physicians in Finland of whom 4000 are GPs. The GPs that use EBMG consult it, on average, three times per day.12

According to the log files, the largest number of searches are done on common primary care problems. The most used search terms in the first three months of 2004 include diabetes, asthma, hypertension, gout, UTI (urinary tract infection), diarrhea, fracture, anemia, chicken pox and migraine. The articles most often opened are listed in Table 5.


View this table:
[in this window]
[in a new window]
 
TABLE 5 The most popular opened articles in the Finnish version of EBMG from 1.1.2004 to 31.10.2004

 
The evidence summaries have been placed in a separate database since June 2003. They are used to a lesser extent than guidelines but their use is steadily increasing (Fig. 1). In Finland, the Cochrane Library is provided to physicians by the same health portal as EBMG. We have monitored the physician use of the Cochrane Library in Finland since June 2003 and the use is increasing (Fig. 1).



View larger version (39K):
[in this window]
[in a new window]
 
FIGURE 1 Number of evidence summaries and Cochrane reviews opened monthly via Internet in Finland from June 2003 to October 2004

 

    Discussion
 Top
 Abstract
 Introduction
 Methods
 Clinical use of the...
 Discussion
 Declaration
 References
 
The logbook data proves that electronic guidelines are used by GPs in Finland probably more frequently than anywhere else in the world. According to user surveys the major reasons for this are that the guidelines cover a wide spectrum of problems, give practical advice, are easy to use and frequently updated. Easy and quick access are considered key elements for the usability of guidelines.14 The decision to link the guidelines to systematic reviews has guaranteed the quality of evidence and Cochrane reviews have become well known in our country because of the links and evidence summaries in EBMG.

Electronic information sources are more user friendly than print formats and are a suitable way to keep abreast of developments in medicine.15 The choice of electronic publishing format at the very beginning of the process was crucial for the editing of the Finnish guidelines. Physicians have problems with finding printed guidelines when needed,16 and the acceptance of guidelines via CDs and the Internet is high.17 The introduction of electronic guidelines was facilitated by the fact electronic patient records have been widely used since the 1980s.

There have been certain barriers and difficulties to producing this large collection of guidelines. Finland is a small linguistic area and writing guidelines for only approximately 4000 GPs is economically onerous. The financial and collective support from the well respected Medical Society Duodecim has guaranteed the continuity of the work. Other facilitators include the high level of information technology in Finland and the uniform clinical culture, resulting from well-standardized medical education.

The editorial process has been built on enthusiasm and well-defined visions. The editors have mostly been practicing physicians with clear ideas of the information needs in clinical practice. There guideline collection is comprehensive enough to guarantee that relevant information is found at most searches, and that the guidelines give answers to specific questions, which is considered essential for the implementation of guidelines.18

We plan to index the evidence summaries on the basis of patient groups and diagnoses, interventions, and outcomes, so that each of these could be searched separately or in combinations in specific search fields. This will make the evidence summary database searchable for specific patient problems. The structuring of evidence summaries aims at facilitated or semi-automated updating from structured sources of evidence (such as the Cochrane Library), as well as flagging of new evidence from original studies.

Our vision of the ideal process of bridging the gap between research and practice is presented in Figure 2. We have started to build a decision support database that contains guidelines in computer-readable format. Reminders are created by a decision support engine, prompted by data from the electronic patient record. The reminders are backed by the whole evidence chain, from guidelines to evidence summaries and further to Cochrane reviews.



View larger version (14K):
[in this window]
[in a new window]
 
FIGURE 2 Pathways from research to clinical practice

 
The log files show that electronic guidelines are frequently used in Finland and that the reading rate of evidence summaries and Cochrane reviews is increasing. Whether this is accompanied by changes in clinical practice remains to be studied in further randomized controlled trials.


    Declaration
 Top
 Abstract
 Introduction
 Methods
 Clinical use of the...
 Discussion
 Declaration
 References
 
Funding: None.

Ethical approval: n/a.

Conflicts of interest: All authors are editors of EBMG.


    References
 Top
 Abstract
 Introduction
 Methods
 Clinical use of the...
 Discussion
 Declaration
 References
 
1 Cook DJ, Greengold NL, Ellrodt AG, Weingarten SR. The relation between systematic reviews and practice guidelines. Ann Int Med 1997; 127: 210–216.[Abstract/Free Full Text]

2 Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Guidelines in professions allied to medicine. Cochrane Database Syst Rev 2000; 2: CD000349.

3 Grimshaw J, Russell I. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet 1993; 342: 1317–1322.[CrossRef][Web of Science][Medline]

4 Grimshaw J, Freemantle N, Wallace S, Russell I, Hurwitz B, Watt I et al. Developing and implementing clinical practice guidelines. Qual Health Care 1995; 4: 55–64.[Free Full Text]

5 Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet 2003; 362: 1225–1230.[CrossRef][Web of Science][Medline]

6 Cranney M, Warren E, Barton S, Gardner K, Walley T. Why do GPs not implement evidence-based guidelines? A descriptive study. Fam Pract 2001; 18: 359–363.[Abstract/Free Full Text]

7 Jadad AR, Cook DJ, Jones A, Klassen TP, Tugwell P, Moher M et al. Methodology and reports of systematic reviews and meta-analyses: a comparison of Cochrane reviews with articles published in paper-based journals. J Am Med Assoc 1998; 280: 278–280.[Abstract/Free Full Text]

8 Jousimaa J, Kunnamo I. PDRD—a computer-based primary care decision support system. Med Inform 1993; 18: 103–112.

9 Harris RP, Helfand M, Woolf SH, Lohr KN, Mulrow CD, Teutsch SM et al. Current methods of the US Preventive Services Task Force: a review of the process. Am J Prev Med 2001; 20(3 Suppl): 21–35.[Web of Science][Medline]

10 Scottish Intercollegiate Guidelines network (SIGN). Forming guideline recommendations. In A Guideline Developers' Handbook. SIGN Publication No. 50; 2001.

11 GRADE Working Group. Grading quality of evidence and strength of recommendations. Br Med J 2004; 328: 1490–1498.[Abstract/Free Full Text]

12 Jousimaa J. The clinical use of computerised primary care guidelines [Doctoral dissertation]. Kuopio: University of Kuopio; 2001.

13 Jousimaa J, Kunnamo I, Makela M. Physicians' patterns of using a computerized collection of guidelines for primary care. Int J Tech Ass in HC 1998; 14: 484–493.

14 Butzlaff M, Vollmar H, Floer B, Koneczny N, Isfort J, Lange S. Learning with computerized guidelines in general practice?: A randomized controlled trial. Fam Pract 2004; 21: 183–188.[Abstract/Free Full Text]

15 Gillespie LD, Gillespie WJ. Finding current evidence: search strategies and common databases. Clin Orthop 2003; 413: 133–145.

16 Varonen H, Makela M. Practice guidelines in Finland: availability and quality. Qual Health Care 1997; 6: 75–79.[Abstract/Free Full Text]

17 Jeannot JG, Scherer F, Pittet V, Burnand B, Vader JP. Use of the World Wide Web to implement clinical practice guidelines: a feasibility study. J Med Internet Res 2003; 5: e12.[Medline]

18 Michie S, Johnston M. Changing clinical behaviour by making guidelines specific. Br Med J 2004; 328: 343–345.[Free Full Text]


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
Fam PractHome page
H. Varonen, T. Kortteisto, M. Kaila, and for the EBMeDS Study Group
What may help or hinder the implementation of computerized decision support systems (CDSSs): a focus group study with physicians
Fam. Pract., June 1, 2008; 25(3): 162 - 167.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
22/4/465    most recent
cmi029v1
Right arrow E-letters: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when E-letters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Varonen, H.
Right arrow Articles by Kunnamo, I.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Varonen, H.
Right arrow Articles by Kunnamo, I.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?