Family Practice Advance Access originally published online on November 1, 2006
Family Practice 2007 24(1):41-47; doi:10.1093/fampra/cml056
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Personalised care, access, quality and team coordination are the main dimensions of family medicine output
a Institut Català de la Salut (ICS) Spain
b Consorci d'Atenció Primaria de Salut de l'Eixample (CAPSE) Spain
c Departament de Salut Pública Universitat de Barcelona Spain
d Departament de Salut Pública, Unitat de Bioestadística, Universitat de Barcelona Spain
e Unitat de Plans Estratègics, Departament de Salut, Generalitat de Catalunya Barcelona, Spain
f Departament de Medicina, Campus de Bellvitge, Universitat de Barcelona Spain
Correspondence to Joan Gené-Badia, Consorci d'Atenció Primaria de Salut de l'Eixample (CAPSE), C/Roselló 161, Barcelona 08036, Spain; Email: jgene{at}clinic.ub.es
Received 21 February 2006; Accepted 2 October 2006.
| Abstract |
|---|
|
|
|---|
Background: Health organisations continually seek good output indicators of family medicine health care provision because they are accountable to society, they need to compare services, and need to evaluate the impact of organisational reforms.
Objectives: Using the sources of information routinely available in health-service management, we sought to assess the groups of components of primary health care output that best serve to define the outcome of family medicine services.
Design: Cross-sectional descriptive study
Site: Primary health care in Catalunya
Participants: 213 primary health care teams
Measurements: Information was collected on team structure, user satisfaction, quality-of-professional-life of the health care professionals, and physicians' drug prescription. Confirmatory Factor Analysis was used to assess the number of dimensions that best explained the family medicine outcome.
Results: The model that best fits the structure of the data (AGFI = 0.778) is that which consists of three dimensions i.e. (1) the individual accessibility to the services and professionalpatient relationship; (2) the coordination within the health care team; (3) the scientific-technical quality of the service. The first two of these dimensions were correlated between themselves, but the third was totally independent of the other two.
Conclusions: Using sources of information that are routinely employed in primary health care services management, the model enables the measurement of the output of family medicine by considering the dimensions such as inter-personnel relationships, internal coordination of the team and the scientific-technical quality of the service. Despite its simplicity, this measure of the output incorporates the views not only of the users but of the health care professionals, as well.
| Introduction |
|---|
|
|
|---|
Health care systems need performance indicators of family medicine services for public accountability, for comparison between centres and countries1 and for evaluating the impact of health care reforms. To be generally applicable for comparing different service-provider organisations, these indicators need to be simple and based on the data derived from information systems that are routinely available within health care organisations.2
The Institute of Medicine in the USA recommended that family medicine practitioners should publish their performance indicators relating to costs, quality, accessibility and satisfaction of the patient as well as that of the health care professional.3 Further advice was to search for other indicators that would better illustrate the impact of the service on the citizen, and which would evaluate aspects related to the main components defining primary health care.4 A recent systematic review of the literature highlighted that such attributes of family medicine (accessibility, continuity, consultation duration, patientphysician relationship, coordination between services and implementation of preventive measures) were related to improvements in health, or in the satisfaction of the patient.5
Focus-group studies which collected the opinions of health care professionals, managers and users of family medicine services, identified four dimensions of the health care product. Combining their fundamental attributes these were: (1) access to the services; (2) coordination within the primary health care teams (PHCT), and with other levels of health care facilities; (3) relationship between the health care professionals and the users of the service; (4) scientific-technical quality of the PHCT and the range of services provided. Equity, satisfaction and efficiency were identified as the main cross-sectional axes of the components of output.6
Inevitably, there are different groupings of the same dimensions because many of them are intimately related.7,8 Hence, with the objective of attempting to unify the dimensions used in evaluating these services, we planned this study to describe the groupings that best define the output of family medicine services while using the sources of information that are routinely available in health care management.
| Materials and methods |
|---|
|
|
|---|
A cross-sectional study was designed to analyse the output of family medicine services from 267 PHCT which, in the year 2003, were integrated within the Institut Català de la Salut (ICS; the Catalan Health Service). This organization covers primary health care requirements for
77% of the population of the Autonomous Region of Catalonia (Spain). The other 23% of the population are covered by other health care providers.
Data sources
The variables studied were obtained from the following databases used routinely in the administration of the ICS in the year 2003. These included the structural database of the health care teams, a questionnaire of user satisfaction, a questionnaire assessing quality-of-professional-life, and the database of drug prescription.
Team structure. The database of team structure contains characteristics of the team such as geographical location, professional composition, extent of the catchment population, and quantitative indicators of clinical activity.
User satisfaction. The primary health care service user's questionnaire was designed to measure user satisfaction. These aspects included: team organization; performance of the physicians, nurses and clerical staff; care received; extent to which the health problem was resolved; and the physical premises of the Primary Care Centre (PCC). The questionnaire was voluntary and self-reporting. Each question of each section was measured on a scale of 0 (very dissatisfied) to 10 (very satisfied). Each PCC received 200 questionnaires biannually. The selection for the study sample was by quotas such that, of the 200 questionnaires, 50 were for paediatrics, 100 for the population aged between 15 and 64 years (50% for females and 50% for males), and the 50 remaining questionnaires distributed to the population >64 years of age (25 for females and 25 for males). Failures to respond were covered by substitution.
The questionnaire was validated in a sample of 1780 individuals, mean age 46.4 years (SD 15.5), 64.2% were women, who were attending 9 urban PCC over a period of 1 week in the year 2000.9 The reliability of the questionnaire was validated using Cronbach's alpha coefficient which demonstrated an optimal consistency of the five factors: the team's organization = 0.87; the performance of the physicians, nurses and clerical staff = 0.92; the care received = 0.96; the extent to which the health problem was resolved = 0.96; the physical premises of the PCC = 0.74 (i.e. good or excellent in all situations).
Quality of professional-life. The quality professional-life questionnaire (QPL) contained 35 items and, from which, a profile composed of three summed scores can be defined for overall QPL10: work demands, support from the hierarchy, and intrinsic motivation. Each item of the questionnaire was measured on a scale of 1 (very dissatisfied) to 10 (very satisfied). The questionnaire was distributed every year to every the PCHT during the month of November. The response rate to the QPL questionnaires in 2003 was 66.68%.11
The questionnaire was validated in a sample of professionals (health care and non-health-care workers) who were employed in March 1995 in 8 of the 9 Primary Care Directorates (PCD) of the Subdivision of the Costa de Ponent-Tarragona-Tortosa (SAP) of the ICS. Of the 4506 professionals, 2926 responded (64.8%). The reliability of the questionnaire was validated by Chronbach's alpha coefficient showing good consistency for the three defined factors: work demands = 0.81; support from the hierarchy = 0.86; intrinsic motivation = 0.75. Finally, the stability of the questionnaire was evaluated using the test-retest system administered in the Old Town Health Area of Barcelona (Area Básica de Salud Gòtic de Barcelona) with an interval of 15 days between the two administrations.
Prescription. The data on prescription were obtained from the invoices sent by the pharmacy offices of the participating centres. This database contained not only the cost per citizen but also the type of drug prescribed to each patient. With this information it is possible to generate a synthetic indicator of the quality of the prescriptions, termed Prescription Quality Standard. It is a pool of indicators that increases the score with respect to the following aspects: (1) the prescription of a high proportion of drugs with a demonstrably high efficacy and safety; (2) to limit the use of new drugs that do not add therapeutic value to the drugs already available for the same clinical indications; (3) to reduce the over-prescription of some groups of drugs (antibiotics, benzodiazepines, NSAIDs and proton pump inhibitors; and finally, (4) adherence to a selection of drugs recommended by evidence-based guidelines for the treatment of common primary health care problems (antihypertensive, hypolipaemiants, anti-diabetics, antibiotics, anti-asthmatics, anti-depressives, hypnotics, proton pump inhibitors and NSAID). Annually, a numerical objective is agreed for each performance indicator. This goal is calculated based on the 75th percentile of the previous year's performance for the overall group of physicians. The objectives may be achieved in various grades scored from 0 to 130 (http://www.eurodurg.com/country%20presentations.pdf).
Dimensions
Among the variables that were collected from these information sources were those that could be, potentially, a measure of each one of the four dimensions proposed in the qualitative study6 and, further, whose values would reflect the activity and capacity of the PHCT (Table 1). Accessibility and physicianpatient relationship were measured with those variables evaluated by the service users with respect to the function and organisation of the PHCT, in addition to the indicators of appropriateness of the numbers of PHCT professionals employed for the catchment population. Team coordination was measured from the perspective of the health care professionals working within the PHCT. The continuity of health care provision by the family physician and specialist was that perceived by the patient. The relationship between the health care professional and the patient was measured from variables that quantified the work-load of the physicians together with the patients' opinions on the manner in which they were treated, the perceived quality of the service, and the physician's empathy. The scientific-technical quality was evaluated using the prescription indicators taking into account the cost and the quality of drug appropriateness for the clinical indication. Also included was the overall consumption, the consumption of drugs for mental health disorders, chronic conditions and for prevention, since these aspects were identified as being essential by, both, health care professionals and by the patients.6
|
Statistical analyses
The dimensions of the output of primary care were evaluated using the methodology of Confirmatory Factor Analysis.12,13 The principal objective of the technique is to quantify the degree to which the correlations between several observed variables can be explained by a few latent variables which, in our study, were termed dimensions. In this sense, the procedure attempts to reduce data dimensionality.
The model parameters were estimated via maximum likelihood, which has the advantage of being scale free. Thus, parameter estimations are all comparable independently of the scale used to measure the variables. The correlations between the model dimensions as well as the correlations between the measurement errors of the variables that define each dimension were assess based on the modification index values12; incorporating those with a modification index >2. To determine regression coefficients not significantly different from zero and, furthermore, to eliminate them from the model, confidence intervals based on bootstrap methodology14 were used.
Three models were fitted. The first model consisted of four dimensions (described in Table 1). The second model had three dimensions and is the result of collapsing the dimension of accessibility and the dimension of the health care professional-patient relationship from the previous model. The new dimension indicates that easy accessibility to the PCC and to its PHCT favours the continuity of care and is conducive to good relationships between health care professionals and patients. Finally, the third model consisted of two dimensions and is the result of the dimension of accessibility to the PCC and to its PHCT being combined with the coordination dimension within the PHCT. The output remains separated into two aspects; one which refers to the technical quality of the health care and the other which groups all the aspects referring to the human factor and the organization of the services (inter-personnel relationships and team work).
The process of electing the most appropriate model was based on the differences in the
2 values (
2) between consecutive models, and in the adjusted goodness-of-fit index (AGFI)12 varying between 0 and 1 (where 1 defines the perfect fit). The models were fitted using the Amos 4 module of the SPSS software package.
| Results |
|---|
|
|
|---|
The analysis included a total of 213 PHCT out of the 267 that were within the administration remit of the ICS in the year 2003. Fifty-four PHCT were excluded from the study because of incomplete data sets. Table 2 summarises the PHCT data on those that did and did not, participate in the present study. There were no significant differences between these two groups of PHCT.
|
The model that best fitted the structure of the data was that which consisted of three dimensions (Table 3) with an AGFI of 0.778. Figure 1 contains the main parameter estimates of the model. The relationship between patient and health care professional, accessibility and coordination of the team dimensions correlated positively. Conversely, the scientific-technical quality dimension was independent of the others. Parameters that related the variables studied with each dimension had values between 0 and 1 if the relationship was positive and between 0 and 1 if negative (Figure 1). The variables related to the relationship between health care professional and patient and accessibility dimension were: organisation of the services, appropriate consultation time, satisfaction with the telephone consultation, quality of explanations provided by the nurse, attention to the user's needs, resolution of the user's problems and concern for the privacy of the user. With respect to the coordination of the team dimension, the significant variable was that of colleague support. Finally, the variables related to the scientific-technical quality dimension were: overall indicator of drug quality standard and the percentage of anti-hypertensive drugs prescribed.
|
|
| Discussion |
|---|
|
|
|---|
Our results show that many of the attributes that describe family medicine output are tightly inter-related. We identified a three dimensions model that explains, with high efficiently, the variability of the data (AGFI = 0.778). The three dimensions are those of: inter-personnel relationships, the team organisation, and scientific-technical quality. The first dimension is tightly linked to all those aspects describing personal relationships between the health care professionals and the patient, and also included aspects of accessibility of the patient to the services. The second refers to the capacity for team-work based on the coordination between different health care professionals. The third dimension, which is totally independent of the previous two, is based on scientific-technical quality, or the extent to which the health care procedures are based on the best evidence available.
Other authors have observed a relationship between accessibility and continuity with respect to the physicianpatient relationship. Responses by health care users in Massachusetts (USA) to a questionnaire were evaluated in relation to the impact on outcomes of the different components of the health care provision (accessibility, continuity, overall care, integration, clinical interaction, inter-personal relationship, confidence). The results indicated that the only factors that were associated with best outcomes were the patient's confidence in the physician and the physician's knowledge of the patient.7 Also of note was that the dimension of individualised clinical care was independent of the dimension of team coordination. An evaluation of the care provided by family physicians in Holland found that only two dimensions contributed independently to the final output of the care: one was related to the structure (management and organisation of the team) and the other was related to the process of clinical care.8
Despite interactions between aspects related to team organisation, physicianpatient relationship, and scientific-technical quality,1517 our model shows that teams that rely on good technical quality do not necessarily have good outputs in terms of inter-personal relationships with patients, or with respect to team coordination. Conversely, it is not unreasonable to expect that there would be an association between the dimension of patientphysician relationship and that of team coordination in primary care; teams having a good work-place environment having more satisfied users, as well.18
We need to highlight that the indicators introduced in the analysis were those variables that best fit the parameters identified in the qualitative study. We do not know if this same grouping would be maintained if other variables had been used.6 It would be of considerable interest to assess whether our model continues to be valid if applied to other health care organisations. The method would achieve full validation if the PHCT classified as good or bad performers under the criteria of the present model receive the same classification if other procedures of quality of health care evaluation of health services management were used.
It may appear surprising that the variables relating to scientific-technical aspects were derived only from information available on drug prescription. We used this source of data because most health care organisations make use of detailed prescription information because of the importance of this section within a health-service budget. Prescription data are more valid than that derived from audits of clinical records which, usually, are of small sample size. However, the increasing computerisation of clinical records in family medicine will enable more rapid analyses of whole populations and, as well, provide valid and valuable information on the technical quality of clinical procedures for inclusion in this dimension of family medicine output evaluation.
Family medicine services need to be able to measure their health care output using their own registries and should not have to rely on information from other levels of health care. As such, we chose not to include indicators that are becoming increasing popular, such as the concept of avoidable hospitalisation,19 since these data are obtained from registrations of patients' discharge from hospital which, often, are not readily available to PHCT.
Our current model provides an overview of family medicine output which incorporates not only hard indicators and objectives such as drug prescription, but also other more subjective indicators linked to the opinions of the users and the healthcare professionals. This perspective offers a better view of the expectations of health-and-service provision in primary care when the patient seeks help from the family physician.6,20 The evaluation of the family physician's performance exclusively based on objective indicators21 does not display the whole range of activities fulfilled in general practice.
We developed a model that allows measurement of the output of the service provided by the family physician by considering the dimensions of personal relationships, internal coordination of the PHCT, and the technical-scientific quality of the health care provision. We used the sources of information that are easily available because they are routinely employed in the management of primary health care services. Despite its simplicity of data collection, the aspects identified as being linked to the expectations from the service have components that relate not only to the healthcare professionals but also to the users. This family medicine output may be useful in identifying PHCT with problems in fulfilling their health care remit since these would be highlighted as outputs deviating from that of the majority. It also allows evaluation of the impact of reforms introduced to help improve team performance, and to monitor the team's progress in achieving previously defined targets.
| Acknowledgments |
|---|
Funding
The study was funded, in part, by a research grant from the Instituto de Salud Carlos III (FIS #PI021762).
| Notes |
|---|
Gené-Badia J, Ascaso C, Escaramis-Babiano G, Sampietro-Colom L, Catalán-Ramos A, Sans-Corrales M and Pujol-Ribera E. Personalised care, access, quality and team coordination are the main dimensions of family medicine output. Family Practice 2007; 24: 4147.
| References |
|---|
|
|
|---|
1 Engels Y, Dautzenberg M, Campbell S, et al. (2006) Testing a European set of indicators for the evaluation of the management of primary care practices. Fam Pract 23:137147.
2 Lakhani A, Coles J, Eayres D, Spence C, Rachet B. (2005) Creative use of existing clinical and health outcome data to assess NHS performance in England: Part 1performance indicators linked to clinical care. Br Med J 330:14261431.
3 Institute of Medicine. (1996) Primary care: America's health in a new era(National Academy Press, Washington, DC).
4 Rothemich S and Richmond V. (1997) Beware of false wizards: the need for more research on quality and outcomes in primary care. J Fam Pract 44:257259.[Web of Science][Medline]
5 Sans-Corrales M, Pujol-Ribera E, Gené-Badia J, Pasarín-Rua MI, Iglesias-Pérez B, Casajuana-Brunet J. Family medicine attributes related to satisfaction, health and costs. Fam Pract (in press).
6 Pujol Ribera E, Gené Badia J, Sans Corrales M, et al. El producto de la atención primaria definido por profesionales y usuarios. Gac Sanit (in press).
7 Safran DJ. (2003) Defining the future of primary care: what can we learn from patients? Ann Intern Med 138:248255.
8 Ram P, Grol R, van der Hombergh vd, Rethans JJ, van der Vleuten C, Aretz K. (1998) Structure and process: the relationship between practice management and actual clinical performance in general practice. Fam Pract 15:354362.
9 Cabezas MC, Barniol J, Valero C, et al. (2002) Consistencia interna y estructura factorial de un cuestionario de satisfacción de los usuarios en atención primaria de salud. Gac Sanit 16:109112.[Medline]
10 Cabezas C. (2000) La calidad de vida de los profesionales. FMC 7:5368.
11 Gené-Badia J, Escaramis-Babiano G, Sans-Corrales M, et al. (2006) Impact of economic incentives on quality of professional life and on end-user satisfaction in primary care. Health Policy Mar 16; [Epub ahead of print].
12 Bollen KA. (1989) Structural Equations with Latent Variables. Wiley series in probability and mathematical statisticsl.
13 Bryant FB, Yarnold PR, Michelson EA. (1999) Statistical methodology: VIII. using Confirmatory Factor Analysis (CFA) in emergency medicine research. Acad Emerg Med 6:5466.[Web of Science][Medline]
14 Efron B and Tibshirani R. (1993) An Introduction to the BootstrapChapman & Hall.
15 Campbell SM, Hann M, Hacker J, Burns C, Oliver D, Thapar A. (2001) Identifying predictors of high quality care in English general practice: observational study. Br Med J 323:784787.
16 Cabana MD and Jee SH. (2004) Does continuity of care improve patient outcomes? J Fam Pract 53:974980.[Web of Science][Medline]
17 Ahmed A, Allman R, Kiefe C, et al. (2003) Association of consultation between generalists and cardiologists with quality and outcomes of heart failure care. Am Heart J 145:10861093.[CrossRef][Web of Science][Medline]
18 Hass JS, Cook EF, Puopolo AL, Burstin HR, Cleary PD, Brennan TA. (2000) Is the professional satisfaction of general internists associated with the patient satisfaction? J Gen Intern Med 15:122128.[CrossRef][Web of Science][Medline]
19 Caminal J, Starfield B, Sanchez E, Casanova C, Morales M. (2004) The role of primary care in preventing ambulatory care sensitive conditions. Eur J Public Health 14:246251.
20 Palacio F, Marquet R, Oliver A, Castro P, Bel M, Piñol JL. (2003) Las expectativas de los pacientes: ¿qué aspectos valoran en un centro de salud? Un estudio cualitativo. Aten Primaria 31:307314.[CrossRef][Medline]
21 McColl A, Roderick P, Gabbay J, Smith H, Moore M. (1998) Performance indicators for primary care groups: an evidence based approach. Br Med J 317:13541360.
![]()
CiteULike
Connotea
Del.icio.us What's this?
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
