Family Practice Advance Access originally published online on August 17, 2006
Family Practice 2006 23(6):699-705; doi:10.1093/fampra/cml044
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
The use of text messaging to improve attendance in primary care: a randomized controlled trial
a International Medical University Puchong
b Klinik Alam Medic Puchong
c Klinik Leong Puchong
d KK Ampangan Wangsa Maju
e KK Kelana Jaya Wangsa Maju
f Klinik Kota Bharu Wangsa Maju
g Klinik Keluarga Wangsa Maju
h University Malaya
i International Medical University
j International Medical University
Correspondence to: Leong Kwok Chi, Department of Family Medicine, International Medical University, Jalan Rasah, 70300 Seremban, Malaysia. Email: leongk{at}pc.jaring.my
Received 1 March 2006; Accepted 5 July 2006.
| Abstract |
|---|
|
|
|---|
Background. Non-attendance is common in primary care and previous studies have reported that reminders were useful in reducing broken appointments.
Objective. To determine the effectiveness of a text messaging reminder in improving attendance in primary care.
Design. Multicentre three-arm randomized controlled trial.
Setting. Seven primary care clinics in Malaysia.
Participants. Patients (or their caregivers) who required follow-up at the clinics between 48 hours and 3 months from the recruitment date.
Interventions. Two intervention arms consisted of text messaging and mobile phone reminders 2448 hours prior to scheduled appointments. Control group did not receive any intervention.
Outcome measures. Attendance rates and costs of interventions.
Results. A total of 993 participants were eligible for analysis. Attendance rates of control, text messaging and mobile phone reminder groups were 48.1, 59.0 and 59.6%, respectively. The attendance rate of the text messaging reminder group was significantly higher compared with that of the control group (odds ratio 1.59, 95% confidence interval 1.17 to 2.17, P = 0.005). There was no statistically significant difference in attendance rates between text messaging and mobile phone reminder groups. The cost of text messaging reminder (RM 0.45 per attendance) was lower than mobile phone reminder (RM 0.82 per attendance).
Conclusions. Text messaging reminder system was effective in improving attendance rate in primary care. It was more cost-effective compared with the mobile phone reminder.
Keywords. Reminder, primary care, non-attendance, text messaging, randomized controlled trial (RCT).
| Introduction |
|---|
|
|
|---|
Non-attendance is when the patient does not appear for his or her appointment. It is common in primary care and it has been reported to range from 6.5 to 42%.1,2 Non-attendance disrupts continuity of patient care, delays treatment and affects doctorpatient relationship. Furthermore, it deprives other patients of earlier appointments, reduces efficiency of health systems and increases health care cost.
The main reasons for non-attendance were forgetfulness, practice error and a mix-up over dates and times3all of which are remediable through appropriate reminder services. Various reminder systems have been assessed with varying degree of success. A meta-analysis by Macharia2 revealed that mailed reminders and telephone prompts were useful in reducing broken appointments (OR 2.2 and 2.9, respectively). Providing patients with reasons for follow-up and obtaining formal agreement to attend future appointments also improved attendance. Other studies using reminder postcards and reminder telephone calls prior to appointment revealed significant differences between the control groups and those receiving interventions.4,5 Combinations of different reminder strategies have also reduced non-attendance up to 60%.6
Text messaging (also known as short messaging service or SMS or texting) is a new communication technology that allows a person with a mobile phone to send a text message to another mobile phone. The text messages are delivered almost instantly to the recipient mobile phone once it is switched on, but the text messages can then be read whenever convenient to the recipient. It is cheap, efficient, convenient and less intrusive compared with a mobile phone call. It is widely available and increasingly being used in many countries.7,8 It has been used in clinical care of patients with asthma,9 diabetes mellitus,10 travellers vaccination11 and smoking cessation.12
Text messaging appointment reminder systems have been piloted in UK hospitals, but no formal results has been reported.13 A randomized controlled trial (RCT) in an orthodontic clinic comparing text messaging reminder and control groups did not report any significant difference in attendance rates.14 A cohort study in outpatient specialist clinics showed that text messaging was an effective reminder system; however, this study was limited by its study design using a historical cohort as control.15
So far, there has been no published RCT assessing text messaging reminder system in primary care. Therefore, we conducted an RCT to determine whether text messaging reminder system was effective in improving attendance in primary care. We also hypothesized that text messaging would be more effective and less costly than a mobile phone call.
| Methods |
|---|
|
|
|---|
Settings
The primary care services in Malaysia consist of public and private clinics. These clinics provide acute, chronic and preventive care and have on-site dispensing facilities. Most patients travel less than 30 minutes to reach the nearest available primary care clinic. Most patients walk in to seek care in these clinics without prior appointments, and they can seek care at any private or public clinics of their choice based on ability to pay, convenience and satisfaction with the services provided. The average charge in a private clinic is RM30 while a patient has to pay only RM1 for care in the public clinic. (RM is Ringgit Malaysia, RM1 = Sterling £0.15) The charges include consultation fees and medications. The waiting time to see the doctor on arrival at the clinic is much longer at the public clinics compared with the private clinics.
The study was conducted in five private and two public primary care clinics.
Participants
The participants were patients who required follow-up at the clinics or their caregivers. The reasons for follow-up were recorded. The patients were eligible for inclusion if:
- Their follow-up appointments fell between 48 hours to 3 months from the recruitment date.
- They or their caregivers had a mobile phone with text messaging function.
Interventions
In both text messaging and mobile phone groups, a reminder was sent using a mobile phone 24 to 48 hours prior to the appointment. The text messaging and mobile phone messages consisted of patient's name and appointment details. To avoid unequal intervention, the mobile phone conversation was similar to the text messaging reminder message and no clinical or laboratory information was included. Successful contact was assumed when there was an indication of message sent on the mobile phone in the text messaging group or when the participants answered the phone in the mobile phone group. We did not leave voice messages in the mobile phone group. A maximum of three reminders were attempted in the intervention groups. In the control group, no reminder was sent.
Objectives
We hypothesized that text messaging reminders would be more effective than no reminder in improving attendance. In addition, we would like to compare the effectiveness and cost of text messaging with that of mobile phone reminders.
Outcomes
Attenders were defined as participants who turned up at any time during the clinic operating hours on the appointed day. Non-attenders were those who came on any day other than their appointed day, changed or cancelled their appointment and those who did not turn up at all (defined as more than 14 days later than appointed day).
Sample size
We assumed a baseline attendance rate of 50%. To detect a 15% absolute difference in attendance rates between text messaging reminder and no reminder, we needed 170 patients in each arm (power = 80%,
= 5%). To detect a 10% absolute difference in attendance rates between text messaging and mobile phone reminders, we needed 329 patients in each arm.
Randomization
The participants were randomized into three groups: no reminder (control), text messaging reminder and mobile phone reminder. An investigator who was not involved in patient recruitment and intervention created a randomization list using the block randomization method (software: Research Randomizer, http://www.randomizer.org/form.htm). A typical block for 18 research participants was as follows: 012, 021, 102, 120, 201, 210 (where 0 = control, 1 = mobile phone, 2 = text messaging); it represented all possible combinations of the above three interventions. The randomization list consisted of 56 blocks (equivalent to 1008 participants). The appropriate randomization list was then sent to each study centre. The research assistants responsible for enrolment were blinded to the intervention. The assigned intervention was revealed to the research assistants 48 hours prior to the scheduled appointment.
Cost-effectiveness analysis
We compared the costs of text messaging or mobile phone reminders by carrying out cost-effectiveness analysis. Effectiveness was measured by the attendance of the patients. In this study, the cost was studied from the viewpoint of the service providers only, as we assumed that the cost to society and the patients would be minimal, and would be similar in both programmes.
The total variable costs16 included:
- Variable labour: the wages and benefits per hour of the project research assistants involved, multiplied with the time spent sending text messaging or phoning from the doctor's clinic.
- Variable supplies: the text messaging and mobile phone telecommunication charges.
The wages and benefits were taken from the human resources records while the time spent sending the text messaging or phoning were recorded in time-activity logs. The text messaging and mobile phone telecommunication charges were recorded immediately from the notification of charges sent by the telecommunication company to the mobile phone after each transaction.
Certain fixed costs that would occur regardless of the number or type of reminders provided (e.g. housekeeping, administration costs, rent, building and equipment depreciation, insurance expenses, utilities) were not included. The capital cost of the mobile phone used to carry out the reminders was not included as this would be similar for both text messaging and mobile phone call. We assumed that additional fixed costs were minimal and that variable costs comprised the greatest portion of the individual programmes.17 Since costs and benefits were generated close to each other in terms of time, we did not consider it necessary to discount the costs and benefits.
Cost-effectiveness analysis was carried out to determine which method cost less per unit of effective intervention, i.e. cost per attendance (successful event). After the analyses, the ratio of cost per attendance for text messaging to mobile phone reminders was calculated.
Statistical methods
We used SPSS version 11.5 for data analysis. Intention to treat analysis was used. Attendance rates among the three groups were compared using chi-square test. Level of statistical significance was set at P = 0.05. For odds ratios (OR) calculation, the control group was used as the reference group. Where appropriate, number needed to treat (NNT) of the reminder intervention was also presented.
| Results |
|---|
|
|
|---|
Out of the 1111 patients we assessed, 993 were enrolled (Fig. 1). Of those who were excluded, 93 did not have mobile phones. Between 9 and 11 participants in each group did not receive the allocated intervention because they were assigned incorrectly by the research assistants. These 29 participants were included in the intention to treat analysis.
|
Baseline data
The demographic data of the participants were comparable in the three groups (Table 1). One-quarter of the participants were caregivers of the patients.
|
Outcomes
The attendance rates of control, text messaging and mobile phone reminder groups were 48.1, 59.0 and 59.6%, respectively (Table 2). The attendance rate of the text messaging group was significantly higher than that of the control group, but there was no difference between the text messaging group and the mobile phone group. For every nine text messaging reminders sent, one additional attendance was added. The text messaging reminder system cost less than half of the mobile phone reminder per attendance (Table 3).
|
|
Ancillary analyses
In subgroup analyses, the trend favours text messaging intervention, when the reason for re-attendance is for scheduled immunization and when the appointment is more than 4 weeks.
| Discussion |
|---|
|
|
|---|
This study showed that text messaging reminder was effective in improving attendance in primary care compared with a no-reminder control. It was also found to be more cost effective than mobile phone call reminders. This result may have significant impact on the choice of reminder system in primary care. Although the conventional telephone and mail reminders are effective in improving attendance, text messaging provides an alternative reminder system for primary care, which has a heavy patient load and requires an efficient appointment scheduling to improve attendance. Text messaging reminder can be made more efficient by linking the computerized appointment system to an automated system that will generate and send off prepared text messages. This would reduce manpower and mistakes due to human errors.
Implementation of a text messaging reminder system requires high mobile phone penetration rates among patients and their caregivers. Currently, the penetration rates of mobile phone ranged from 56.5% in Malaysia to 71.3% in Europe with an annual growth rate of 28.3 and 25.9%, respectively.7,8 However as people are more likely to change their mobile phone numbers compared with their land line telephones, text messaging reminder systems require regular updating.
Concerns have been raised about the privacy and confidentiality of the newer technologies.18 To address this issue, only participants' names and appointment dates were sent in the reminder messages. Care was taken to ensure no clinical information or laboratory results were conveyed in the messages.
Despite reminders,
40% of the participants did not keep to their appointments. This figure is high compared with other studies.1,19,20 In Malaysia, most of the primary care clinics do not have an appointment system and, therefore, the participants in this study might not be familiar with keeping to appointments. This could explain why 48% of the non-attenders came on days other than the appointed days. In health care systems where a patient is only attended to by appointment, text messaging may be more effective in improving attendance.
Economic evaluations
The cost-effectiveness analysis showed that it cost RM 0.45 per attendance for text messaging reminder as compared with RM 0.82 per attendance for mobile phone reminder. The ratio of cost per unit attendance of text messaging versus mobile phone was 0.55.
Since there was no statistically significant difference between text messaging and mobile phone reminders in terms of attendance rates, cost minimization analysis21 can be used to determine which reminder method had a lower cost. We found that text messaging was the cheaper option as suggested by the total costs i.e. RM 87.66 for text messaging reminders and RM 160.33 for mobile phone reminders. When we compared the two reminder systems, the ratio of the cost of text messaging versus mobile phone was 0.55. Therefore, our conclusion that text messaging was less costly was further strengthened.
It costs RM 2.65 per extra attendance gained for the text messaging arm and RM 4.58 for the mobile phone arm. Mobile phone reminders were more costly because the number of interventions was higher and each mobile phone conversation lasted longer compared with the text messaging reminders.
It cost RM0.27 per patient in the text messaging arm and RM0.49 per patient in the mobile phone arm. If a text messaging recall system is installed for all patients in the private clinics and RM0.27 added to their bill of RM30.00, there will only be a cost increase of 0.9% with the benefit of increasing attendance by 11%.
Limitations
In this study, attendance was defined strictly as those who attended the clinics on the scheduled dates. Those who came earlier or later were regarded as non-attenders. In practice, the quality of care would not be affected significantly in this group of patients.
As the text messaging reminder in this study did not require the participants to confirm receipt of reminders, we were uncertain whether all participants had received the text messages. However, assuming that those who did not receive messages were more likely to be non-attenders, this study would probably underestimate the effectiveness of text messaging reminder.
There was no attempt to leave messages in the answer-phone/voice-mail as the investigators were of the opinion that most people do not check their voice-mail and there is no way to check if the participants had retrieved their messages.
Economic effects would vary according to the prices of labour, mobile phone and text messaging charges in each country.
Further studies
We estimated that the total charges incurred with a land line to land line reminder is RM 96.24, assuming that the number of calls is the same as the mobile phone reminder. This total charge is comparable to that of the text messaging reminder (RM 87.66). We suspect that text messaging reminder could be considerably cheaper than land line to land line reminder because mobile phone users are more likely to be contactable, but this need to be verified by future research.
Ninety-three patients were excluded from this study because either they or their caregivers did not have a mobile phone. In implementing a text messaging reminder system, the needs of this group will need to be addressed.
The acceptability of a text messaging reminder system would be worth exploring in future research especially the issues of privacy and urgent messages rather than routine reminders.
The reasons of follow-up may have an impact on the attendance rates and, possibly, the effectiveness of different reminder systems. Further studies looking at the effectiveness of text messaging reminder in different types of follow-up will be warranted.
| Conclusion |
|---|
|
|
|---|
Text messaging reminder was effective in improving attendance rate in primary care compared with a no-reminder control. It was as effective but cost less than the mobile phone reminder.
| Acknowledgments |
|---|
The research protocol received ethical approval from the Institutional Review Board of International Medical University (IMU). IMU funded this study via an unrestricted grant. (Project ID No: IMU 087/2005) All the authors declared that they have no conflict of interest in this trial. We would like to thank Dr Shanthi V of the Clinical Research Centre, Ministry of Health Malaysia, and Professor James Arthur Dickinson of University of Calgary, Canada, for their comments in the preparation of the manuscript.
| Notes |
|---|
Leong KC, Chen WS, Leong KW, Mastura I, Mimi O, Sheikh MA, Zailinawati AH, Ng CJ, Phua KL and Teng CL. The use of text messaging to improve attendance in primary care: a randomised controlled trial. Family Practice 2006; 23: 699705.
| References |
|---|
|
|
|---|
1 Waller J and Hodgkin P. (2000) Defaulters in general practice: who are they and what can be done about them? Fam Pract 17:252253.
2 Macharia WM, Leon G, Rowe BH, Stephenson BJ, Haynes RB. (1992) An overview of interventions to improve compliance with appointment keeping for medical services. JAMA 267:18131817.[Abstract]
3 Hamilton W. (2001) General practice non-attendance. A questionnaire survey. (Pub ID: N0240056126). NHS National Research Register (4) Available at: http://www.nrr.nhs.uk/ViewDocument.asp?ID=N0240056126 (accessed 10 December, 2005).
4 Koren ME, Bartel JC, Corliss J. (1994) Interventions to improve patient appointments in an ambulatory care facility. J Ambul Care Manage 17:7680.[Medline]
5 Reti S. (2003) Improving outpatient department efficiency: a randomized controlled trial comparing hospital and general-practice telephone reminders. N Z Med J 116:U458.[Medline]
6 Read M, Byrne P, Walsh A. (1997) Dial a clinica new approach to reducing the number of defaulters. Br J Healthcare Manage 3:307310.
7 The Malaysian Communications and Multimedia Commission. Facts & Figures. Cellular subscribers. Available at: http://www.mcmc.gov.my/facts_figures/stats/ViewStatistic.asp?cc=81107278&srid=95962162 (accessed 10 December 2005).
8 International Telecommunication Union. Free Statistics. Mobile cellular, subscribers per 100 people. Available at: http://www.itu.int/ITU-D/ict/statistics/at_glance/cellular04.pdf (accessed 10 December 2005).
9 Ostojic V, Cvoriscec B, Ostojic SB, Reznikoff D, Stipic-Markovic A, Tudjman Z. (2005) Improving asthma control through telemedicine: a study of short-message service. Telemed J E Health 11:2835.[CrossRef][ISI][Medline]
10 Ferrer-Roca O, Cardenas A, Diaz-Cardama A, Pulido P. (2004) Mobile phone text messaging in the management of diabetes. J Telemed Telecare 10:282285.[CrossRef][ISI][Medline]
11 Vilella A, Bayas JM, Diaz MT, et al. (2004) The role of mobile phones in improving vaccination rates in travelers. Prev Med 38:503509.[CrossRef][ISI][Medline]
12 Rodgers A, Corbett T, Bramley D, et al. (2005) Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging. Tob Control 14:255261.
13 Dyer O. (2003) Patients will be reminded of appointments by text messages. BMJ 326:1281.
14 Bos A, Hoogstraten J, Prahl-Andersen B. (2005) Failed appointments in an orthodontic clinic. Am J Orthod Dentofacial Orthop 127:355357.[CrossRef][ISI][Medline]
15 Downer SR, Meara JG, Da Costa AC. (2005) Use of text messaging text messaging to improve outpatient attendance. Med J Aust 183:366368.[ISI][Medline]
16 Hashim MJ. (2001) Effectiveness of telephone reminders in improving rate of appointments kept at an outpatient clinic: a randomized controlled trial. J Am Board Fam Pract 14:193196.
17 Saywell RM. (2003) The cost effectiveness of 5 interventions to increase mammography adherence in a managed care population. Am J Manag Care 9:3344.[Medline]
18 Norwell N. Text messages raise medico-legal issues. BMJ (Rapid response. 28 March 2003). Available at: http://bmj.bmjjournals.com/cgi/eletters/326/7389/607text#messaging30784.
19 Weingarten N, Meyer DL, Schneid JA. (1997) Failed appointments in residency practices: who misses them and what providers are most affected? J Am Board Fam Pract 10:407411.
20 Neal RD, Lawlor DA, Allgar V, et al. (2001) Missed appointments in general practice: retrospective data analysis from four practices. Br J Gen Pract 51:830832.[ISI][Medline]
21 Drummond MF, O'Brien B, Stoddart GL, Torrance GW. (1997) Methods for the Economic Evaluation of Health Care Programmes 2nd edn (Oxford University Press, Oxford) pp. 97.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
C E Cohen, K M Coyne, S Mandalia, A-M Waters, and A K Sullivan Time to use text reminders in genitourinary medicine clinics Int J STD AIDS, January 1, 2008; 19(1): 12 - 13. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||

