Skip to main content

Patient preferences for key organizational features of primary cardiovascular care in Quebec: a discrete choice experiment

Abstract

Background

Cardiovascular diseases and their risk factors are leading causes of morbidity and mortality worldwide, and are among the top reasons for primary care visits. Little is known about patient preferences for primary care in the context of chronic conditions. This study aimed to investigate the effect of key organizational features identified by patients and providers on patients’ choice of a preferred primary care practice to receive cardiovascular care.

Methods

A discrete choice experiment survey was completed by a weighted online sample of 501 Quebec residents having or being at risk of cardiovascular disease. Respondents completed one of two blocks of nine choice sets by indicating, among three hypothetical primary care practice alternatives in each choice set, their preferred and second-most preferred options. Alternatives were differentiated on the basis of five key attributes identified as priorities in an earlier Delphi study: listening to and respecting care preferences; providing personalized information; 24-to- 48-h accessibility in the event of a problem; continuity of care; and up-to-date clinical skills. Each attribute could be assigned a best, moderate, or worst level. Choices were analyzed using generalized multinomial logit modeling. Marginal effects and choice probabilities for policy-relevant scenarios were estimated.

Results

All five attributes significantly influenced choices of primary care practice. The marginal effects of worst attribute levels were of much greater magnitude than those of best levels for all attributes. Improving short-term accessibility from worst to moderate level had the largest average incremental effect on the probability of patients choosing a practice. Best continuity of care was more valued by older patients and those in poorer general health, but had nonsignificant impact unless it was coupled with enhanced short-term accessibility.

Conclusions

A balanced approach across the key organizational features covered seems more advantageous for primary care practices than focusing solely on achieving excellence in any single attribute. The interactions between patient preferences for short-term accessibility and continuity of care should be taken into account when planning and implementing organizational change in primary care. Whether these preferences are generalizable to other jurisdictions and subsets of primary care patients deserves further exploration.

Peer Review reports

Background

Cardiovascular diseases (CVD) and their risk factors, such as hypertension, dyslipidemia, and diabetes, are among the leading causes of morbidity and mortality globally [1, 2]. Virtually everyone is at risk of requiring cardiovascular healthcare during their lifetime, as approximately 90% of normotensive middle-aged and elderly individuals are expected to develop high blood pressure, the leading risk factor for CVD [3]. In several jurisdictions, primary care settings are responsible for the routine prevention and management of chronic conditions, including CVD. Hypertension and diabetes are among the most common reasons for visiting a primary care provider in many parts of the world [4]. In a high-COVID region of Canada, these also remained among the top five reasons for primary care visits during the COVID- 19 pandemic [5].

Primary care, by its very definition, encompasses the fundamental principles of accessibility, continuity, coordination, comprehensiveness, technical quality, and efficiency in delivering acute, chronic, and preventive care within the framework of family and community [6,7,8]. Due to its multidimensional and complex nature, primary care delivery has often remained a “black box” for policy-makers [6, 9]. Several observational studies have found associations between organizational characteristics of primary care practices and their performance on specific dimensions of care [10,11,12,13]. However, research has not identified an overall “winning” formula, leaving clinical settings with the difficult task of managing trade-offs between competing dimensions of care with little empirical guidance [14]. Understanding the importance patients place on organizational features and dimensions of primary care can contribute to priority-setting and structure care delivery by being more responsive to their preferences and needs.

Among different methods available to investigate patient preferences, discrete choice experiments (DCE) have become increasingly popular to inform a wide range of health services and policy questions in the context of scarce resources and limited real-world data [15,16,17]. A DCE is a quantitative research method that assumes that the value placed on a good or service is based on its attributes. In a DCE survey, participants are presented with a series of hypothetical options for the good or service under consideration from which they must choose (e.g., health interventions, treatment options, health services or policies). These options are defined using a number of attributes, which can in turn take on different values. By analyzing the choices made, researchers can identify which attributes are most important to participants, and how much weight is given to different levels of each attribute [18].

Several DCE studies have focused on patient preferences for primary care. A systematic review of such studies by Kleij et al. [19] found no consistent pattern in their preference choices, but estimates from DCE studies are known to be influenced by many study design features, including the study population, choice context, set of attributes and range of attribute levels examined, experimental design, and model specification [18, 20]. Careful tailoring of these factors with the targeted knowledge mobilization context is thus essential for DCE results to be relevant to end-users. An updated systematic review by Lim et al. [21] covering all DCE studies on patient preferences for primary care published until 2021 reported a paucity of evidence for chronic conditions. This prompted the authors to recommend that future DCE studies focus more on these conditions, given the central role of primary care in meeting the preventive care and ongoing management needs of patients with long-term conditions. To our knowledge, no DCE has been conducted to explore patient preferences regarding the organization of primary cardiovascular care despite the considerable burden and widespread prevalence of CVD. To fill out this knowledge gap, we set out to conduct a DCE with cardiovascular patients in Quebec to investigate the effect of priority organizational features on the choice of a primary care practice. Our study also aimed to estimate the expected choice probabilities of different policy-relevant scenarios of primary care practice.

Methods

Our DCE was administered through an online survey. We followed best-practice guidelines for the design, analysis and report of DCE studies [22,23,24,25]. Ethical approval was obtained from the University of Montreal Hospital Research Centre’s research ethics committee (project number 17.305).

Study setting

Quebec is Canada’s largest province in land area and the second most populous, with around 9 million residents. Each Canadian province and territory has a health insurance plan which provides universal coverage for medical services that is funded with assistance from federal cash and tax transfers. While several primary care practice models coexist in Quebec, including traditional solo clinics and local community health centers, family medicine groups are the main organizational model [26]. A family medicine group is generally composed of 6 to 12 family physicians who work together and in close collaboration with registered nurses and allied healthcare professionals (such as psychologists and social workers) to care for patients enrolled in the practice. This practice model is supported by a government funding and professional support program [27]. Affiliated patients remain free to consult other primary care providers, including walk-in clinics. However, access to other providers remains limited and few patients, if any, have the opportunity to choose their primary care setting, settling for the one they have, when they have one at all. According to Quebec’s statistics institute, over one in four residents were not affiliated with a primary care setting in 2023. Family physicians are free to accept or reject new patients, and receive a premium for registering orphan patients from a centralized waiting list managed by the government. Nevertheless, many enrolled patients turn to emergency departments for their acute care needs due to lack of timely access to their usual primary care source.

Attribute and level development

The attributes included in our DCE were identified from a previous study conducted using the Delphi technique [28]. The methods and results of this study have been published elsewhere [29]. Briefly, 36 panelists (20 patients and 16 providers) were recruited from urban, suburban, and remote primary care practices in Quebec. These panelists were asked to formulate, in free-text fields, key features to optimally organize primary cardiovascular care for patients, and then to assess their importance by rating and ranking them in iterative rounds of questionnaires interspersed with controlled feedback. Out of an initial set of 41 items, six proved to be highly prioritized by both patients and providers at the end of the structured communication process. These top items, which were consistent with broader research on patient priorities for the organization of primary care and chronic illness care [19, 30,31,32,33], formed the basis for the attributes in our DCE. However, to reduce the complexity of our choice tasks, two priority items related to relational and informational continuity were merged into a single continuity of care attribute encompassing both aspects. The key factor in interpreting this combined attribute relates to ensuring that there is a link (fluidity) between the patients’ visits so that they do not have to repeat their story and retrace their care trajectory at every encounter. Thus, our DCE study covered five key organizational features of primary care: listening to and respecting patient care preferences; providing personalized information to patients; 24-to- 48-h accessibility in the event of a problem; continuity of care; and up-to-date clinical skills. All but one attribute definition mentioned “professionals” in the plural to reflect the move toward team-based care in primary care settings that has been underway for the past twenty years in many jurisdictions, including Canada [34]. Because Canada has a universal, publicly funded healthcare system in which most primary care services are free at the point of use, a cost attribute was not included.

Three levels representing a worst (low), moderate, and best (high) amount were set for each attribute to account for potential nonlinear effects (see Table 1). Primary care accessibility in Quebec and Canada is relatively poor [35,36,37], and the levels used in other DCE studies for this attribute (e.g., ‘no waiting time’, ‘1 day’, ‘2 days’, ‘5 days’ until appointment [19]) seemed unrealistic with the estimated average waiting time of 24 days in Quebec [38]. Thus, our levels were set around how frequently a patient would be able to reach a clinic professional within a 24-to- 48-h delay in the event of a problem. This formulation also resonated with policy targets set by the Quebec government [39]. The levels for up-to-date clinical skills were calibrated around the five-year reference period for the continuing professional development cycle of family physicians in Quebec and Canada. A plausible range was determined by consulting with five practicing family physicians.

Table 1 Attributes and levels in the experiment

Experimental design

Our DCE followed a best-best design [40,41,42], in which participants were asked to choose their most preferred (first-best) and second-most preferred (second-best) options sequentially in choice sets of three unlabeled, hypothetical primary care practices. No opt-out option was provided. A near-orthogonal fractional factorial design was constructed to allow estimation of main attribute effects and prespecified interaction effects between 24-to- 48-h accessibility and continuity of care, due to reported tensions and synergies between these two attributes [10, 14, 43,44,45,46,47,48]. The experimental design was optimized in SAS 9.4 (SAS Institute Inc.) based on the relative D-efficiency criterion, with priors set to zero [49]. Dominant and dominated alternatives were prevented from occurring within choice sets [49], as they provide no relevant information on how respondents make trade-offs between attributes [23]. An alternative is dominant when all its attribute levels are at least as good or better than all the attribute levels of another alternative, which becomes dominated. Optimal designs with 18, 27, and 36 choice sets were examined. Due to negligible improvement in D-efficiency with larger designs, we opted for the 18-set design (83.9% D-efficiency). To further reduce respondent burden [50], the design was divided into two blocks of nine uncorrelated choice sets [49], to which participants were randomly assigned.

Survey design and target population

The online survey, available in French and English, had four sections. Appendix A1 in Additional file 1 presents the English version. The first section contained the information and consent form. The second section assessed participants’ basic profile and eligibility. Eligible respondents were Quebec residents aged 35 and over, with CVD or with a metabolic CVD risk factor (hypertension, dyslipidemia, or diabetes, excluding gestational diabetes). Profile and eligibility questions were taken from the Canadian Community Health Survey (CCHS) [51], an annual cross-sectional survey from Canada’s national statistical office. The third section of the survey pertained to the DCE. Respondents were instructed to answer each choice set as if they had to choose where to receive their primary cardiovascular care in real life. At any time, they could hover or click on an attribute to bring up its detailed description (see Table 1). All respondents completed an example choice set (Fig. 1) to familiarize themselves with the task before being randomized to their block of choice sets. This example deliberately contained a dominant and a dominated alternative, and answers were not included in the analyses. After the DCE, we assessed perceived task difficulty by using a standard user metric known as the Single Ease Question (SEQ) [52], a 7-point rating scale from 1- “very difficult” to 7- “very easy”.

Fig. 1
figure 1

The example choice set. Legend: The example choice set in the survey, which deliberately contained a dominant (Clinic B) and a dominated (Clinic A) option

The fourth survey section contained additional sociodemographic and health-related variables. These were selected based on their typicality in subgroup analyses and their relevance according to the panelists that had taken part in our prior Delphi study [29] (see Appendix A2 in Additional file 1). They included: main occupation, level of education, household income, general health, assessment of chronic comorbidities, severity of the cardiovascular health condition, importance attached to health, health literacy level, and readiness to change lifestyle. The first five covariables were measured by using the corresponding CCHS questions [51]. Health literacy was measured by using the BRIEF Health Literacy Screening Tool [53], a four-question self-report instrument validated in English and French [54, 55]. Readiness to change diet, physical activity level, tobacco, and alcohol consumption were measured separately by using 1-to- 10 Readiness Rulers [56, 57]. Such rulers with verbal anchors have been extensively used and adapted to support motivational interviewing in primary care settings [58, 59].

Three quality control questions were incorporated throughout the survey. Participants responding incorrectly to one of these questions were warned to be more careful and to fully read the rest of the questions carefully. Those failing two attention checks were prevented from continuing the survey and their responses were discarded. A soft launch of the survey was made with the first 33 respondents to test for problems with survey design and functioning. No problem was found and the data from these participants were included in the final dataset.

Data collection

We worked with Leger Opinion [60] (LEO), the largest proprietary panel in Canada, to coordinate the online survey programming, participant recruitment and data collection. The LEO panel includes more than 400 000 members across Canada and the United States mainly recruited randomly by traditional and mobile phone methodologies to increase representativeness. More than 70% of LEO panel members are recruited based on random selection using LEO’s call center. The other panelists are recruited through invitation and affiliate programs, social media, partner campaigns, word of mouth and offline recruitment based on various criteria (no river sampling). All LEO panel members are double opted-in and have gone through screening processes to prevent duplicate accounts and fraud. Several quality checks are in place, including mandatory profile update every six months and removal of sleepers; identification of cheaters or speeders and removal of repeat offenders; phone number verifications; and blocking of suspicious email addresses, domain names or IP addresses. When a survey is sent out, LEO uses proprietary software that draws on Canadian census data to generate samples that are more representative of the population, by factoring in a response rate based on age, gender, and region. Our survey was only sent to individuals identified in the LEO database as residing in Quebec and aged 35 and over, based on information in their verified profile and their IP address (access via VPN is blocked). Participants were not offered additional incentive for completing our survey outside of LEO’s built-in reward system, which includes earning chances to participate in contests to win prizes and receiving points that can be redeemed for online money transfers, credit or gift cards. We aimed to obtain 500 completed surveys. There is no gold standard approach to sample size calculation in a DCE, but this number largely exceeded the minimum sample size required to estimate main effects (n = 56) and all two-way interactions (n = 167) according to Johnson and Orme’s rule of thumb [61] (see Appendix A3 in Additional file 1 for calculations). However, we were also interested in estimating covariable effects to explore whether patient preferences varied according to some of their characteristics, which require larger sample sizes [18].

Statistical analysis

Attribute levels were dummy coded, with the reference categories selected to reflect an average primary care practice in Quebec. Thus, the moderate level was set as the reference for all attributes, except for 24-to- 48-h accessibility where the worst level was chosen. Rank-ordered logit (ROL) models were used to analyze the choice data to take advantage of the full ranking of alternatives provided by our best-best design. As different individuals can be expected to make different decisions in the same choice situations, taking preference heterogeneity into account reduces bias in the parameters estimated by the choice model [24]. To allow for flexible substitution patterns and account for unexplained heterogeneity in individual preferences (that is, variability not attributable to any patient characteristic examined), we used generalized multinomial logit (G-MNL) modeling [62] on the “exploded” ROL data, as proposed by Lancsar et al. [41], in what we call generalized rank-ordered logit (G-ROL) models.

Three progressive G-ROL models were estimated with standard errors clustered at the respondent level, using 1 000 draws for the simulation with the Broyden-Fletcher-Goldfarb-Shanno optimization method [63]. The first model (G-ROL1) included only main effects modelled as normally distributed random coefficients. The second model (G-ROL2) added the interaction terms between accessibility and continuity as fixed parameters, since no heterogeneity was found on three out of the four interaction coefficients. The final model (G-ROL3) accounted for explained preference heterogeneity (that is, variability attributable to observed patient characteristics) by adding, as fixed effects, significant covariable interactions from the second and last survey sections, including CVD status (with CVD or at risk of CVD) (see Appendix A4 in Additional file 1 for details). Based on the final model (G-ROL3), marginal effects and choice probabilities of selected primary care practice scenarios were calculated.

Sampling weights were applied in all our analyses to fit our respondents to the Quebec population according to the latest CCHS weighted dataset available at the time (2017–2018). Data weighting can reduce the accuracy of results, which is a concern when combined with a small sample size. However, we felt that the cost in reduced accuracy would be acceptable with 500 respondents. Weighting factors were calibrated based on participants’ sex, age group (in 10-year increments), education level (high school or less, postsecondary), and CVD status. For example, a sampling weight was given to all female respondents in our sample that were aged between 35–44 years, had a high school education level or less, and were at risk of CVD (without having CVD), so that their proportion in our sample would be equivalent to that in the CCHS weighted dataset for the Quebec population (weight = % in population divided by % in sample). The same procedure was repeated for all respondent subgroups. We excluded respondents who selected the dominated alternative in the example choice set as their first or second choice (n = 34), because we suspected that they might not have sufficiently understood the attribute levels or paid attention to the choice tasks. Sensitivity analyses were performed on our final model (G-ROL3) by including these respondents and by using unweighted data.

Statistical analyses were conducted in Stata 18.0 (StataCorp LLC, College Station, TX). Statistical significance was set at p < 0.05. G-ROL models and choice predictions were estimated using the gmnl and gmnlpred commands, respectively [64].

Results

Data collection took place from November 5 to November 12, 2021 and was stopped after 501 completed questionnaires were obtained. At that moment, 2 656 survey invitations had been sent to LEO panel members: 1 371 individuals (51.6%) had not yet opened the invitation message; 667 (25.1%) had opened the invitation but had not completed the consent form; 50 (1.9%) had refused to take part in the study; 14 (0.5%) had agreed but were ineligible based on the screening questions; 51 (1.9%) had not completed the DCE portion of the survey; and 2 respondents had been excluded for failing two attention checks. The characteristics of participants with complete choice data as well as the subset that was included in the final model are presented in Table 2, with and without sampling weights. Around 20% of our sample had CVD, and a third reported having comorbid mental and physical health conditions. Compared to the Quebec population aged ≥ 35 with a cardiovascular health condition, our unweighted sample overrepresented the younger age groups and underrepresented the oldest as well as those with a lower education level. Most participants completed the survey within a plausible time frame of between 11 and 19 min. The interquartile range of SEQ scores obtained (3–5) sat right in the middle of the scale, indicating that the choice task was neither found to be very easy nor very difficult by most respondents.

Table 2 Characteristics of respondents

Preference estimates

In the main effects-only model (G-ROL1), all preference coefficients were statistically significant (p ≤ 0.001) and in the expected direction. Best attribute levels had positive coefficients indicating that their presence increased the probability of choosing a particular primary care practice, while worst attribute levels had negative coefficients indicating decreased choice probability. When the interaction between 24-to- 48-h accessibility and continuity of care was added to the model (G-ROL2), best continuity no longer had an independent effect on choice of primary care practice (p = 0.160). However, two out of the four interaction coefficients were statistically significant: best continuity had a positive impact on clinic choice when combined with moderate or best short-term accessibility. G-ROL1 and G-ROL2 models are presented in Appendix A5 (see Additional file 1). The final model (G-ROL3, Table 3) had the same statistically significant main and interaction effects as G-ROL2, as well as two additional statistically significant covariable interactions: best continuity of care had a greater effect on respondents aged 65 years or more (p < 0.001), and on those reporting having fair or poor general health (p = 0.008) compared to younger and healthier respondents, respectively. Unexplained heterogeneity was found for all but one main attribute level (providing ‘a lot’ of personalized information), as indicated by the size and statistical significance of the standard deviations of the main coefficients. This means that different respondents placed a different relative importance on most primary care attributes.

Table 3 Preference results of the final generalized rank-ordered logit model (G-ROL3)

In the sensitivity analyses (see Appendix A6 in Additional file 1), removing the sampling weights made no difference on the sign or statistical significance of preference coefficients. However, one notable difference was observed when respondents selecting the dominated alternative in the example choice set were included in the model: the model’s correlation parameter (τ) increased from 0.310 to 0.495. Although sources of correlation cannot be disentangled from current choice models [66], this increase would be consistent with higher scale heterogeneity being introduced due to these participants responding more ‘randomly’ to the choice situations [62].

Predicted choice

The rightmost column of Table 3 presents the marginal effects of attribute levels on predicted clinic choice according to the final model (G-ROL3). These marginal effects represent the average difference, in percentage points, in the probability of choosing a primary care practice with a given attribute level compared to a practice with the reference attribute level. We found that the average marginal effects associated with moving from the worst to the moderate level for all five attributes were, to varying degrees, of greater magnitude than the corresponding marginal effects associated with moving from the moderate to the best level. The attribute level with the largest impact on clinic choice was best 24-to- 48-h accessibility (+ 20.5% change in choice probability). However, contrary to other attributes, the worst rather than the moderate level was the reference for this attribute. By calculating the full range of predicted choice change attributable to each attribute across the included levels, up-to-date clinical skills was the most influential organizational feature (22.7% marginal effect range), followed by 24-to- 48-h accessibility (20.5%), listening to and respecting care preferences (17.3%), continuity of care (15.1%), and lastly, providing personalized information (10.5%). Improving short-term accessibility from worst to moderate level was the incremental change with the largest average marginal effect on predicted choice of a primary care practice (+ 16.2%).

Predicted choice probabilities for selected policy-relevant scenarios of primary care practices are presented in Table 4. The first three scenarios examined relate to primary care practices with the worst, best, and reference levels in all attributes. Their mean predicted choice probabilities were 3.1%, 83.8%, and 36.6%, respectively. The last three scenarios reflect incremental deviations from the reference setting. Improving continuity of care to the best level had only a minor effect on mean predicted choice probability (+ 2.2% change in choice probability compared to the reference scenario). Comparatively, improving accessibility to a moderate level had a much greater impact (+ 20.7%). However, this gain was almost nullified when the improvement in accessibility was achieved at the expense of the worst continuity (+ 2.9%).

Table 4 Choice probabilities of selected primary care setting scenarios

Discussion

This study assessed patient preferences regarding key practice features for the organization of primary cardiovascular care by conducting a DCE study among a weighted sample of Quebec respondents with CVD or at CVD risk. All five attributes included in our study significantly influenced choices for primary care practices, but the organizational features that were most strongly valued by participants were keeping clinical skills up-to-date and rapid access to a professional in the event of a problem. Best continuity of care had no significant impact on patients when primary care practices had the worst short-term accessibility, but older patients and those in poorer general health valued best continuity more than others. Our respondents reported that completing the choice tasks was neither easy nor difficult. This is consistent with the balanced scenarios in our experimental design and the delicate trade-offs among key organizational attributes that were required of them, lending credibility to our results.

Our main findings resonate with other primary care DCE studies conducted in various jurisdictions. In England, Cheraghi-Sohi et al. [67] found that technical quality of care was among the attributes that primary care patients valued most regardless of clinical scenario, and that, in an urgent physical scenario, patients were willing to pay the most for a short waiting time. In their systematic review, Lim et al. [21] also reported that the attending professional’s experience or expertise showed robust evidence of influence on patients in the context of chronic disease care. However, due to the small number of chronic disease-specific DCE studies, the evidence was lacking for a number of attributes that are potentially important to patients. Our study contributes to strengthening the previously limited support for professional consideration of the patient’s perspective in the context of chronic disease [21]. Numerous studies have found that older patients tend to place greater emphasis on continuity of care [68]. Rubin et al. [69] reported that older patients placed a higher value on being able to see their own doctor rather than any available doctor for a primary care appointment. In Sweden, Hjelmgren and Anell [70] also found that older individuals and those in poor health expressed a stronger preference for registering with a specific doctor rather than a primary care team, emphasizing the importance of relational continuity in their healthcare. Moreover, the results of a recent study analyzing over 10 million consultations in 381 English primary care practices over a period of 11 years suggest that older patients, patients with multiple chronic conditions, and patients with mental health conditions are those for whom continuity of care may provide the highest productivity benefits [71].

However, providing rapid access to a clinic professional in the event of a problem had more influence than continuity of care in our study, a finding which seems to contrast with other DCE studies [69, 72, 73]. For example, Rubin et al. [69] concluded that speed of access was outweighed by continuity of care because their respondents were willing to wait a few extra days for an appointment with a doctor of their choice. In these studies, continuity of care was modelled dichotomously (e.g., doctor knows you well vs. does not know you), which likely affected the results and their interpretation. We observed that attaining the best level in the organizational attributes studied had less impact on choice than failing to achieve a moderate level. Thus, reports that a modest improvement in waiting time is not worth trading-off relational continuity would be consistent with our own results. A recent Canadian DCE which, similarly to our study, modelled wait time until appointment and familiarity with the provider as three-level attributes also found that timely access had more influence than continuity on patient choices for appointment bookings across a number of clinical scenarios [74].

To our knowledge, our DCE study was the first to specifically investigate the interactions between short-term accessibility and continuity of care. This enabled a finer understanding of how patients trade-off these two core and much-debated organizational features of primary care [6, 10, 14, 43,44,45,46,47,48]. Our results suggest that the value placed on short-term accessibility and continuity is, to some extent, conditional on each other. Respondents derived additional utility from best versus moderate continuity of care only when short-term accessibility to a professional in the primary care practice was at moderate or best level, and the combination of enhanced short-term access and best continuity produced a synergistic effect stronger than the sum of their individual main effects. Moreover, enhanced short-term accessibility in a context where continuity of care is at its worst resulted in only a trivial increase in choice probability compared to the reference scenario.

Strengths and limitations

This study had many strengths. Our DCE study followed a blocked best-best design which maximized statistical efficiency while keeping respondent burden reasonable [42, 50, 75]. The attributes included were based on previous research that had used qualitative and quantitative data to identify the most important organizational features to optimally organize primary cardiovascular care for patients, from the perspectives of patients themselves as well as primary care providers [29]. All of the organizational features studied are amenable to policy or practice-level change. Even clinical skills, which may seem like an individual attribute of clinicians, can be supported by practice features such as a shared vision from clinic leaders, the practice's organizational structure (including the sharing of administrative resources, the presence of competence-maintenance mechanisms such as continuous professional development activities and chart audits, and the number of diagnostic and therapeutic procedures available through on-site technical facilities), as well as team processes that foster innovation and task orientation [13, 76, 77]. Our respondents came from various age groups, socioeconomic backgrounds and health status, reflecting the heterogeneous populations followed in primary care. The choice context in our survey was based on participants’ current clinical situation, which maximized the realism of the experiment. Our analyses were weighted to mitigate the overrepresentation of younger and more educated individuals that is typical of online panels [78], and accounted for both explained (by observable characteristics) and unexplained heterogeneity to minimize bias [24]. A vast array of relevant covariables were considered to explain heterogeneity in patient preferences on top of the usual sociodemographic characteristics. However, only two covariable interactions remained significant in our final model. According to Fiebig et al. [79], most group-specific effects are often rendered insignificant with the addition of random individual-specific effects in choice models, as done with our G-ROL models. Only a small proportion of respondents failed the dominance test in the example choice set, and our findings were robust to their inclusion as well as the removal of sampling weights.

However, our study also had some limitations. Although similarities were found with primary care DCE studies conducted in other countries, our results were based on respondents from a single jurisdiction and may not be generalizable to other settings. Furthermore, participants were self-selected and their eligibility was based on self-report. We cannot exclude that some people may have misrepresented themselves, although we partnered with a reputable survey firm that is regularly solicited by major private and public organizations including governments and universities. Internet use is ubiquitous in the adult Quebec population [80], but our data collection method may have excluded some of the most vulnerable cardiovascular patients lacking a minimum level of digital literacy or access to an Internet-connected device. Respondents who opened the invitation and completed the questionnaire first may also have been unrepresentative of our target population in ways that were not corrected by data weighting (e.g., personality biases [81]). As such, our preference estimates may not reflect true population values.

Implications and future research

Based on the findings of this study, it is suggested that primary care practices should aim for a moderate level of attainment across all key organizational features covered, rather than focusing solely on achieving excellence in any single attribute. This balanced approach is deemed to be more advantageous. Thus, all other things being equal, the most impactful step that typical Quebec primary care practices should take to provide cardiovascular care that better aligns with patient preferences in this study would be to moderately improve their short-term accessibility. Amidst the debates between accessibility and continuity of care, primary care stakeholders should take note that the best continuity may appeal more to older and more frail patients, but all patients—including them—place significant importance on short-term accessibility in the event of a problem. Therefore, primary care practices that strive to provide excellent continuity of care to all patients without attending to their lack of short-term accessibility may be wasting much of their effort. Similarly, clinical settings that focus mainly on walk-in consultations and offer only minimal relational and informational continuity of care may not represent an attractive alternative for patients with or at risk of CVD. Finally, poor listening and respect for patient care preferences and longer clinical skill update cycles should especially be avoided, as these characteristics were powerful deterrents to our respondents.

We do not think that our findings are entirely due to the Quebec context because similar results have been observed elsewhere [21, 67, 68, 74]. However, this warrants further exploration in jurisdictions without significant primary care access issues. Our findings appear transferable to the management of other prevalent chronic physical health problems, many of which share common risk factors and follow-up requirements with CVD. However, this could also be examined more precisely in future studies. The preferences for primary care organization of younger patients, patients without any chronic condition, with only mental health issues or with complex socio-medical problems may also differ from those of adults followed for a chronic physical health problem. Finally, further methodological studies are required to explore whether the significant unexplained heterogeneity found in this and other DCE studies [24] may be reduced by incorporating additional observable characteristics or latent factors which were not accounted for in our analyses.

Conclusions

Primary care is inherently multidimensional and complex, and decision-makers at both clinical and political levels often manage trade-offs between competing dimensions of care with little knowledge of the importance patients place on them. In this study, a weighted online sample of cardiovascular patients in Quebec significantly valued up-to-date clinical skills, 24-to- 48-h accessibility to a professional in the event of a problem, listening to and respecting patient care preferences, continuity of care, and provision of personalized information in choosing a primary care practice. Patients were more negatively influenced by worst levels in these key organizational features than they were positively attracted by best levels of achievement, suggesting that a balanced approach may be preferable to trying to shine in any single attribute. Keeping professionals’ clinical skills up to date at shorter intervals was the most important attribute overall, but improving short-term accessibility from worst to moderate level was the most influential incremental change. This was the first DCE study to examine and report significant interaction effects between short-term accessibility and continuity of primary care in the context of chronic disease. Best continuity was more valued by older patients and those in poorer general health, but had nonsignificant impact when short-term accessibility to a practice professional was at its worst. Improving accessibility at the expense of worse continuity of care also had negligible net effect. These findings underline the importance of joint monitoring of the potential impact on short-term accessibility and continuity of care of any reorganization of primary care services, to ensure that the changes result in significant net added value for patients with chronic diseases. The extent to which these preferences are aligned with population parameters or generalizable to other jurisdictions and subsets of primary care patients should be explored further.

Data availability

The datasets generated and analyzed during the current study are available in the Figshare repository, https://doiorg.publicaciones.saludcastillayleon.es/https://doiorg.publicaciones.saludcastillayleon.es/10.6084/m9.figshare.26264096.v1.

Abbreviations

CCHS:

Canadian Community Health Survey

CVD:

Cardiovascular disease

DCE:

Discrete choice experiment

G-MNL:

Generalized multinomial logit

G-ROL:

Generalized rank-ordered logit

LEO:

Leger Opinion

ROL:

Rank-ordered logit

SEQ:

Single Ease Question

References

  1. GBD 2019 Diseases and Injuries Collaborators. Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. 2020;396:1204–22.

    Article  Google Scholar 

  2. GBD 2019 Risk Factors Collaborators. Global burden of 87 risk factors in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. 2020;396:1223–49.

    Article  Google Scholar 

  3. Vasan RS, Beiser A, Seshadri S, Larson MG, Kannel WB, D’Agostino RB, et al. Residual lifetime risk for developing hypertension in middle-aged women and men: The Framingham Heart Study. JAMA. 2002;287:1003–10.

    Article  PubMed  Google Scholar 

  4. Finley CR, Chan DS, Garrison S, Korownyk C, Kolber MR, Campbell S, et al. What are the most common conditions in primary care? Systematic review Can Fam Physician. 2018;64:832–40.

    PubMed  Google Scholar 

  5. Stephenson E, Butt DA, Gronsbell J, Ji C, O’Neill B, Crampton N, et al. Changes in the top 25 reasons for primary care visits during the COVID-19 pandemic in a high-COVID region of Canada. PLoS ONE. 2021;16:e0255992.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  6. Kringos DS, Boerma WGW, Hutchinson A, van der Zee J, Groenewegen PP. The breadth of primary care: a systematic literature review of its core dimensions. BMC Health Serv Res. 2010;10:65.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Institute of Medicine, Committee on the Future of Primary Care. Primary care: America’s health in a new era. Washington, D.C.: National Academy Press; 1996. https://doiorg.publicaciones.saludcastillayleon.es/10.17226/5152.

  8. Starfield B, Shi L, Macinko J. Contribution of Primary Care to Health Systems and Health. Milbank Q. 2005;83:457–502.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Measuring PHC. Primary Health Care Performance Initiative. 2022. https://www.improvingphc.org/measuring-phc. Accessed 7 Mar 2023.

  10. Haggerty JL, Pineault R, Beaulieu M-D, Brunelle Y, Gauthier J, Goulet F, et al. Practice features associated with patient-reported accessibility, continuity, and coordination of primary health care. Ann Fam Med. 2008;6:116–23.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Russell GM, Dahrouge S, Hogg W, Geneau R, Muldoon L, Tuna M. Managing chronic disease in Ontario primary care: the impact of organizational factors. Ann Fam Med. 2009;7:309–18.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Dahrouge S, Hogg WE, Russell G, Tuna M, Geneau R, Muldoon LK, et al. Impact of remuneration and organizational factors on completing preventive manoeuvres in primary care practices. CMAJ. 2012;184:E135-143.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Beaulieu M-D, Haggerty J, Tousignant P, Barnsley J, Hogg W, Geneau R, et al. Characteristics of primary care practices associated with high quality of care. CMAJ. 2013;185:E590-596.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Beaulieu M-D, Geneau R, Del Grande C, Denis J-L, Hudon E, Haggerty JL, et al. Providing high-quality care in primary care settings: how to make trade-offs. Can Fam Physician. 2014;60:e281-289.

    PubMed  PubMed Central  Google Scholar 

  15. de Bekker-Grob EW, Ryan M, Gerard K. Discrete choice experiments in health economics: a review of the literature. Health Econ. 2012;21:145–72.

    Article  PubMed  Google Scholar 

  16. Viney R, Lancsar E, Louviere J. Discrete choice experiments to measure consumer preferences for health and healthcare. Expert Rev Pharmacoecon Outcomes Res. 2002;2:319–26.

    Article  PubMed  Google Scholar 

  17. van den Broek-Altenburg E, Atherly A. Using discrete choice experiments to measure preferences for hard to observe choice attributes to inform health policy decisions. Health Econ Rev. 2020;10:18.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Lancsar E, Louviere J. Conducting discrete choice experiments to inform healthcare decision making: a user’s guide. Pharmacoeconomics. 2008;26:661–77.

    Article  PubMed  Google Scholar 

  19. Kleij K-S, Tangermann U, Amelung VE, Krauth C. Patients’ preferences for primary health care - a systematic literature review of discrete choice experiments. BMC Health Serv Res. 2017;17:476.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Bliemer MCJ, Rose JM. Experimental design influences on stated choice outputs: An empirical study in air travel choice. Transportation Research Part A: Policy and Practice. 2011;45:63–79.

    Google Scholar 

  21. Lim AH, Ng SW, Teh XR, Ong SM, Sivasampu S, Lim KK. Conjoint analyses of patients’ preferences for primary care: a systematic review. BMC Prim Care. 2022;23:234.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Bridges JFP, Hauber AB, Marshall D, Lloyd A, Prosser LA, Regier DA, et al. Conjoint analysis applications in health–a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. Value Health. 2011;14:403–13.

    Article  PubMed  Google Scholar 

  23. Reed Johnson F, Lancsar E, Marshall D, Kilambi V, Mühlbacher A, Regier DA, et al. Constructing experimental designs for discrete-choice experiments: report of the ISPOR Conjoint Analysis Experimental Design Good Research Practices Task Force. Value Health. 2013;16:3–13.

    Article  PubMed  CAS  Google Scholar 

  24. Vass C, Boeri M, Karim S, Marshall D, Craig B, Ho K-A, et al. Accounting for Preference Heterogeneity in Discrete-Choice Experiments: An ISPOR Special Interest Group Report. Value Health. 2022;25:685–94.

    Article  PubMed  Google Scholar 

  25. Hauber AB, González JM, Groothuis-Oudshoorn CGM, Prior T, Marshall DA, Cunningham C, et al. Statistical Methods for the Analysis of Discrete Choice Experiments: A Report of the ISPOR Conjoint Analysis Good Research Practices Task Force. Value Health. 2016;19:300–15.

    Article  PubMed  Google Scholar 

  26. Pomey M-P, Martin E, Forest P-G. Quebec’s Family Medicine Groups: Innovation and Compromise in the Reform of Front-Line Care. Canadian Political Science Review. 2009;3:31–46.

    Article  Google Scholar 

  27. Ministère de la Santé et des Services sociaux du Québec. Programme de financement et de soutien professionnel pour les groupes de médecine de famille (GMF). Publications du ministère de la Santé et des Services sociaux. 2023. https://publications.msss.gouv.qc.ca/msss/document-001527/. Accessed 20 Jun 2022.

  28. Chalmers J, Armour M. The Delphi Technique. In: Liamputtong P, editor. Handbook of Research Methods in Health Social Sciences. Singapore: Springer; 2019. p. 715–35. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/978-981-10-5251-4_99.

  29. Del Grande C, Kaczorowski J, Pomey M-P. What are the top priorities of patients and clinicians for the organization of primary cardiovascular care in Quebec? A modified e-Delphi study PLoS One. 2023;18:e0280051.

    Article  PubMed  Google Scholar 

  30. Wensing M, Jung HP, Mainz J, Olesen F, Grol R. A systematic review of the literature on patient priorities for general practice care. Part 1: Description of the research domain. Soc Sci Med. 1998;47:1573–88.

    Article  PubMed  CAS  Google Scholar 

  31. Cheraghi-Sohi S, Bower P, Mead N, McDonald R, Whalley D, Roland M. What are the key attributes of primary care for patients? Building a conceptual “map” of patient preferences. Health Expect. 2006;9:275–84.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Tran V-T, Riveros C, Péan C, Czarnobroda A, Ravaud P. Patients’ perspective on how to improve the care of people with chronic conditions in France: a citizen science study within the ComPaRe e-cohort. BMJ Qual Saf. 2019;28:875–86.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Tran V-T, Diard E, Ravaud P. Priorities to improve the care for chronic conditions and multimorbidity: a survey of patients and stakeholders nested within the ComPaRe e-cohort. BMJ Qual Saf. 2021;30:577–87.

    Article  PubMed  Google Scholar 

  34. Hutchison B, Levesque J-F, Strumpf E, Coyle N. Primary health care in Canada: systems in motion. Milbank Q. 2011;89:256–88.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Laberge M, Gaudreault M. Promoting access to family medicine in Québec, Canada: Analysis of bill 20, enacted in November 2015. Health Policy. 2019;123:901–5.

    Article  PubMed  Google Scholar 

  36. Doty MM, Shah A, Fields K, FitzGerald M, Williams II RD. Comparing Nations on Timeliness and Coordination of Health Care: Findings from the 2021 Commonwealth Fund International Health Policy Survey of Older Adults. Commonwealth Fund. 2021. https://www.commonwealthfund.org/publications/surveys/2021/oct/comparing-nations-timeliness-and-coordination-health-care. Accessed 20 Jun 2022.

  37. Canadian Institute for Health Information. How Canada Compares: Results From the Commonwealth Fund’s 2020 International Health Policy Survey of the General Population in 11 Countries. Ottawa, ON: CIHI; 2021. https://www.cihi.ca/sites/default/files/document/how-canada-compares-cmwf-survey-2020-meth-note-en.pdf.

  38. Haggerty JL, Pineault R, Beaulieu M-D, Brunelle Y, Gauthier J, Goulet F, et al. Room for improvement: patients’ experiences of primary care in Quebec before major reforms. Can Fam Physician. 2007;53:1057, 2001:e.1-6, 1056.

    PubMed  Google Scholar 

  39. La Presse Canadienne. Quebec reaches deal with family doctors to improve access to basic care. Montreal Gazette. 2022. https://montrealgazette.com/news/local-news/quebec-reaches-deal-with-familydoctors-to-improve-access-to-basic-care.

  40. Ghijben P, Lancsar E, Zavarsek S. Preferences for oral anticoagulants in atrial fibrillation: a best-best discrete choice experiment. Pharmacoeconomics. 2014;32:1115–27.

    Article  PubMed  Google Scholar 

  41. Lancsar E, Fiebig DG, Hole AR. Discrete Choice Experiments: A Guide to Model Specification. Estimation and Software Pharmacoeconomics. 2017;35:697–716.

    Article  PubMed  Google Scholar 

  42. Lancsar E, Louviere J, Donaldson C, Currie G, Burgess L. Best worst discrete choice experiments in health: Methods and an application. Soc Sci Med. 2013;76:74–82.

    Article  PubMed  Google Scholar 

  43. Lamarche PA, Beaulieu M-D, Pineault R, Contandriopoulos A-P, Denis J-L, Haggerty J. Choices for Change: The Path for Restructuring Primary Healthcare Services in Canada. Ottawa, ON: Canadian Health Services Research Foundation; 2003. https://www.eicpacis.ca/final_research/commissioned_research/policy_synthesis/pdf/choices_for_change_e.pdf.

  44. Bower P, Roland M, Campbell J, Mead N. Setting standards based on patients’ views on access and continuity: secondary analysis of data from the general practice assessment survey. BMJ. 2003;326:258.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Guthrie B, Wyke S. Personal continuity and access in UK general practice: a qualitative study of general practitioners’ and patients’ perceptions of when and how they matter. BMC Fam Pract. 2006;7:11.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Pineault R, Levesque J-F, Roberge D, Hamel M, Lamarche P, Haggerty J. Accessibility and Continuity of Care: A Study of Primary Healthcare in Québec. Gouvernement du Québec; 2009. https://www.inspq.qc.ca/sites/default/files/publications/911_servicespremligneanglais.pdf.

  47. Cook LL, Golonka RP, Cook CM, Walker RL, Faris P, Spenceley S, et al. Association between continuity and access in primary care: a retrospective cohort study. CMAJ Open. 2020;8:E722–30.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Pereira Gray D, Sidaway-Lee K, Johns C, Rickenbach M, Evans PH. Can general practice still provide meaningful continuity of care? BMJ. 2023;383:e074584.

    Article  PubMed  Google Scholar 

  49. Kuhfeld WF. Marketing Research Methods in SAS. Cary, NC, USA: SAS Institute Inc.; 2010.

    Google Scholar 

  50. Aiyegbusi OL, Roydhouse J, Rivera SC, Kamudoni P, Schache P, Wilson R, et al. Key considerations to reduce or address respondent burden in patient-reported outcome (PRO) data collection. Nat Commun. 2022;13:6026.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  51. Government of Canada. Canadian Community Health Survey - Annual Component (CCHS). Statistics Canada. 2022. https://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&SDDS=3226. Accessed 12 Dec 2022.

  52. Sauro J. 10 things to know about the Single Ease Question (SEQ). MeasuringU. 2012. https://measuringu.com/seq10/. Accessed 12 Aug 2022.

  53. Haun J, Noland-Dodd V, Varnes J, Graham-Pole J, Rienzo B, Donaldson P. Testing the BRIEF Health Literacy Screening Tool. Fed Pract. 2009;26:24–31.

    Google Scholar 

  54. Haun J, Luther S, Dodd V, Donaldson P. Measurement variation across health literacy assessments: implications for assessment selection in research and practice. J Health Commun. 2012;17(Suppl 3):141–59.

    Article  PubMed  Google Scholar 

  55. Perrin A, Siqueira do Prado L, Duché A, Schott A-M, Dima AL, Haesebaert J. Using the Brief Health Literacy Screen in Chronic Care in French Hospital Settings: Content Validity of Patient and Healthcare Professional Reports. Int J Environ Res Public Health. 2020;18:E96.

  56. Center for Substance Abuse Treatment. Chapter 8—Measuring Components of Client Motivation. In: Enhancing Motivation for Change in Substance Abuse Treatment. Rockville (MD): Substance Abuse and Mental Health Services Administration (US); 1999. p. 135–45. https://www.ncbi.nlm.nih.gov/books/NBK64975/.

  57. Maisto SA, Krenek M, Chung TA, Martin CS, Clark D, Cornelius JR. A Comparison of the Concurrent and Predictive Validity of Three Measures of Readiness to Change Alcohol Use in a Clinical Sample of Adolescents. Psychol Assess. 2011;23:983–94.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Zimmerman GL, Olsen CG, Bosworth MF. A “stages of change” approach to helping patients change behavior. Am Fam Physician. 2000;61:1409–16.

    PubMed  CAS  Google Scholar 

  59. Coleman MT, Pasternak RH. Effective strategies for behavior change. Prim Care. 2012;39:281–305.

    Article  PubMed  Google Scholar 

  60. Leger Opinion Services. Leger. 2024. https://leger360.com/leger-opinion/. Accessed 18 Jun 2024.

  61. Orme BK. Getting Started with Conjoint Analysis: Strategies for Product Design and Pricing Research. 2nd ed. Madison, WI: Research Publishers, LLC; 2010.

    Google Scholar 

  62. Fiebig DG, Keane MP, Louviere J, Wasi N. The Generalized Multinomial Logit Model: Accounting for Scale and Coefficient Heterogeneity. Mark Sci. 2010;29:393–421.

    Article  Google Scholar 

  63. Train KE. Discrete Choice Methods with Simulation. 2nd ed. Cambridge: Cambridge University Press; 2009.

    Google Scholar 

  64. Gu Y, Hole AR, Knox S. Fitting the Generalized Multinomial Logit Model in Stata. Stand Genomic Sci. 2013;13:382–97.

    Google Scholar 

  65. Williams R. Using the Margins Command to Estimate and Interpret Adjusted Predictions and Marginal Effects. Stand Genomic Sci. 2012;12:308–31.

    Google Scholar 

  66. Hess S, Train K. Correlation and scale in mixed logit models. Journal of Choice Modelling. 2017;23:1–8.

    Article  Google Scholar 

  67. Cheraghi-Sohi S, Hole AR, Mead N, McDonald R, Whalley D, Bower P, et al. What patients want from primary care consultations: a discrete choice experiment to identify patients’ priorities. Ann Fam Med. 2008;6:107–15.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Jung HP, Baerveldt C, Olesen F, Grol R, Wensing M. Patient characteristics as predictors of primary health care preferences: a systematic literature analysis. Health Expect. 2003;6:160–81.

    Article  PubMed  PubMed Central  Google Scholar 

  69. Rubin G, Bate A, George A, Shackley P, Hall N. Preferences for access to the GP: a discrete choice experiment. Br J Gen Pract. 2006;56:743–8.

    PubMed  PubMed Central  Google Scholar 

  70. Hjelmgren J, Anell A. Population preferences and choice of primary care models: A discrete choice experiment in Sweden. Health Policy. 2007;83:314–22.

    Article  PubMed  Google Scholar 

  71. Kajaria-Montag H, Freeman M, Scholtes S. Continuity of Care Increases Physician Productivity in Primary Care. Manag Sci. 2024. https://doiorg.publicaciones.saludcastillayleon.es/10.1287/mnsc.2021.02015.

    Article  Google Scholar 

  72. Gerard K, Salisbury C, Street D, Pope C, Baxter H. Is fast access to general practice all that should matter? A discrete choice experiment of patients’ preferences. J Health Serv Res Policy. 2008;13(Suppl 2):3–10.

    Article  PubMed  Google Scholar 

  73. Turner D, Tarrant C, Windridge K, Bryan S, Boulton M, Freeman G, et al. Do patients value continuity of care in general practice? An investigation using stated preference discrete choice experiments. J Health Serv Res Policy. 2007;12:132–7.

    Article  PubMed  Google Scholar 

  74. Oliver D, Deal K, Howard M, Qian H, Agarwal G, Guenter D. Patient trade-offs between continuity and access in primary care interprofessional teaching clinics in Canada: a cross-sectional survey using discrete choice experiment. BMJ Open. 2019;9:e023578.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Huls SPI, Lancsar E, Donkers B, Ride J. Two for the price of one: If moving beyond traditional single-best discrete choice experiments, should we use best-worst, best-best or ranking for preference elicitation? Health Econ. 2022;31:2630–47.

    Article  PubMed  PubMed Central  Google Scholar 

  76. Campbell SM, Hann M, Hacker J, Burns C, Oliver D, Thapar A, et al. Identifying predictors of high quality care in English general practice: observational study. BMJ. 2001;323:784–7.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  77. Goh TT, Eccles MP. Team climate and quality of care in primary health care: a review of studies using the Team Climate Inventory in the United Kingdom. BMC Res Notes. 2009;2:222.

    Article  PubMed  PubMed Central  Google Scholar 

  78. Bosnjak M, Haas I, Galesic M, Kaczmirek L, Bandilla W, Couper MP. Sample Composition Discrepancies in Different Stages of a Probability-based Online Panel. Field Methods. 2013. https://doiorg.publicaciones.saludcastillayleon.es/10.1177/1525822X12472951.

    Article  Google Scholar 

  79. Fiebig DG, Knox S, Viney R, Haas M, Street DJ. Preferences for new and existing contraceptive products. Health Econ. 2011;20(Suppl 1):35–52.

    Article  PubMed  Google Scholar 

  80. Portrait numérique des régions. Académie de la transformation numérique. 2021. https://transformation-numerique.ulaval.ca/enquetes-et-mesures/netendances/2021-07-portrait-numerique-des-regions. Accessed 20 Jun 2022.

  81. Valentino NA, Zhirkov K, Hillygus DS, Guay B. The Consequences of Personality Biases in Online Panels for Measuring Public Opinion. Public Opin Q. 2020;84:446–68.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Jocelyne Gagné for the administrative support provided, and Leger Opinion for programming the online survey and coordinating participant recruitment and data collection. We also acknowledge the four reviewers of the original submitted version of this manuscript for their insightful comments which enabled us to improve the published version.

Funding

This work was supported by the Fonds de Recherche du Québec – Santé [award number 36266] and the Dr. Sadok Besrour Chair in Family Medicine. The funders had no role in the conceptualization, design, data collection, analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

C.D.G., J.K. and M.P.P. conceived the study. C.D.G. and J.K. designed the discrete choice experiment. C.D.G. was responsible for the acquisition, analysis, and interpretation of data. J.K. contributed to the interpretation of data. C.D.G. wrote the original draft of the manuscript. J.K. and M.P.P. revised the manuscript draft. All authors reviewed and approved the submitted manuscript.

Corresponding author

Correspondence to Claudio Del Grande.

Ethics declarations

Ethics approval and consent to participate

All participants provided online consent to participate in the study after reviewing the information and consent form. The study was approved by the University of Montreal Hospital Research Centre’s research ethics committee (project number 17.305).

Consent for publication

Not applicable.

Competing interests

This study was partially supported by Dr. Sadok Besrour Chair in Family Medicine. J.K. is holder of that chair.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Del Grande, C., Kaczorowski, J. & Pomey, MP. Patient preferences for key organizational features of primary cardiovascular care in Quebec: a discrete choice experiment. BMC Prim. Care 26, 103 (2025). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12875-025-02810-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12875-025-02810-4

Keywords