Skip to main content

Like an umbrella, protecting me from the rain until I get to my destination”: Evaluating the implementation of a tailored primary care model for urban marginalized populations

Abstract

Background

Improving health equity and access to the highest possible standard of health care is a key issue of social accountability. Centretown Community Health Centre in Ottawa, Canada has iteratively developed a program to target and serve marginalized and complex populations since 1999. The program implementation was evaluated using a validated implementation framework.

Methods

Quantitative and qualitative data were collected through a health records extraction (n = 570), a client complexity assessment tool (n = 74), semi-structured interviews with clients and key stakeholders (n = 41), and a structured client satisfaction survey (n = 30). Data were analyzed using descriptive statistics and inductive thematic analysis.

Results

Five hundred and seventy unique clients were seen between November 1–30, 2021. A third of clients (34%) did not have a provincial health card for access to universal health care services, and most (68%) were homeless or a resident of rooming houses. Most clients who reported their income (92%) were at or below Canada’s official poverty line.

The total mean complexity score for clients seen over a one-month period (n = 74) was 16.68 (SD 6.75) where a total score of at least 13 of 33 is perceived to be a threshold for client biopsychosocial complexity. Clients gained the majority of their total score from the Social support assessment component of the tool.

Clients (n = 31) and key informants (n = 10) highlighted the importance of building relationships with this population, providing wrap-around care, and providing low-barrier care as major strength to the Urban Health program (UH). Key areas for improvement included the need to: i) increase staff diversity, ii) expand program hours and availability, and iii) improve access to harm reduction services. Clients appeared to be highly satisfied with the program, rating the program an average total score of 18.50 out of 20.

Conclusions

The program appears to serve marginalized and complex clients and seems well-received by the community. Our findings have relevance for other health care organizations seeking to better serve marginalized and medically and socially complex individuals and families in their communities.

Peer Review reports

Background

Primary care

Primary care is the entry point to health services for most health problems. A high quality primary care system can contribute to a reduction in avoidable hospitalization, better health outcomes, a decrease in mortality rates related to socioeconomic disparities, and higher life expectancy [1]. Quality of care is the extent to which health care services improve the probability of desired health outcomes being achieved for individuals and populations [2]. Further, quality of care can be measured and improved over time through the delivery of evidence-based care that acknowledges and addresses service-user (patient/client) experiences [2]. High quality primary care has been linked to increased access to services, improved delivery of care, and prevention and early management of health conditions [1]. In order to provide high quality care in primary care settings, health care providers must address health problems, provide client navigation through the health care systems, ensure a continuous relationship with clients, prevent and identify health conditions early, and establish links between community resources and clients and their families [3].

Marginalized and complex populations

Historically, persistently, or systematically marginalized populations are those who experience barriers to engaging in mainstream social, economic, cultural, or political life [4, 5]. Potential reasons for their marginalization may include aspects of their identity (i.e., gender, culture, language, race, sexual orientation) and socioeconomic status [4]. Further, this may include individuals who experience hardship due to homelessness (e.g., no fixed address), substance use, and prior involvement with the correctional system. Finally, groups such as Indigenous peoples, people with mental illnesses, LGBTQIA + and racial minorities (including immigrants/refugees) may also experience marginalization [6]. Urban marginalized populations often share common social determinants of health related to being unable to access social systems and/or experiences of poverty [6]. To serve the needs of marginalized populations, it is essential for health care providers to deliver both the indicated care for the client’s condition and proactively designed individualized care targeted towards specific sources of complexity and social determinants of health [7].

Client “complexity” can be defined as barriers to standard health care provision experienced by clients due to the severity of their psychosocial and medical conditions, lack of social safety, and lack of coordination of care or negative care system relationships [8]. Client complexity is linked to social determinants of health, wherein social and environmental elements contribute to an individual’s or community’s health risks [8]. Thus, social determinants of health may contribute to both marginalization and complexity [6, 8]. Complexity affects clinical presentations, the choice and organization of care, and clinical outcomes. Identifying and addressing the client's complexity can indicate the kind and level of team structure, care management, and social services involvement needed to provide quality primary care.

Providing care to marginalized and complex populations

Challenges to accessing primary care services have been documented for urban marginalized and complex individuals [9,10,11]. In Canada, economic, geographic, cultural, and language barriers may limit access to health care [9, 10]. Further, many clinics and specialists require proof of public health insurance for billing which hinders access and treatment options for those who face barriers to attaining identification documentation. A client’s lack of an address, personal identification documents, access to transportation, telephone, and social support to negotiate and navigate the system may contribute to barriers in accessing appropriate and timely care [6].

Low access to preventative medical care for this population has been associated with more complex presentations, higher morbidity and mortality, higher rates of emergency department visits, and inpatient admissions [12]. Additionally, stigmatization and discrimination within the health care system can contribute to reluctance to accessing services, contributing to a preventable worsening of health outcomes [6, 13].

Equitable access to primary care requires health care providers and organizations to consider social and health determinants, the needs of the proposed clients, and resources available to provide services to those that need it [14]. Barriers preventing access include the method in which care is offered as well as the ability of individuals to perceive, seek, reach, pay for, and engage with care [15]. The need for an integrated team approach is well-documented, and improves expertise, resources, shared responsibilities, and client-centered case management [6, 13, 16, 17].

Therefore, the purpose of this study was to evaluate the implementation of a program developed to meet the needs of urban marginalized populations in one service area in Ottawa, Canada. We evaluated the implementation of the program using client health records data, a provider-rated client complexity assessment, semi-structured interviews, and a client satisfaction survey. The questions guiding this evaluation were as follows:

  1. 1.

    What is the quality of the implementation of the program in terms of its services and client perceptions?

  2. 2.

    Does the implemented program align with its intended aim of engaging and caring for marginalized and complex populations?

Methods

Setting/context

The Centretown Community Health Centre (CCHC) is a community health centre in Ottawa, Canada with a catchment area that includes the city’s largest family shelter for refugee claimants, a young men’s shelter, a women’s shelter, as well as numerous rooming houses. This made for an ideal setting to evaluate the implementation of a primary care program for marginalized populations.

Process of program design

An Urban Health (UH) program was created to provide high quality, comprehensive, and interprofessional primary care services and tailored to target the needs of the urban and marginalized individuals in the community. Specifically, the program aimed to address the changing population demographics in the community health centre’s surrounding area, including large populations of people with lower income and immigrant status [18].

The UH program has evolved over the last 24 years. The program emerged organically through relationships between case managers and primary care providers working in the same space, and often serving similar clients. The need for designing a tailored program to provide holistic and equitable care for marginalized communities was recognized. The planning, development and operationalization of the program occurred through a series of interprofessional staff meetings (including with family physicians, nurse practitioners, case workers).

The objective of the program was to reduce barriers to the healthcare system for the most marginalized populations in Ottawa. Previous research conducted by the Centretown Community Health Centre helped to identify barriers in accessing care for marginalized and new immigrant and refugee populations [19]. The program now includes: a) flexible, no appointment primary care clinics; b) appointment-based services including evening access for clients and families when an appointment model serves them best; c) social supports services encompassing harm reduction, case management/coordination, social/healthcare system navigation, shower access, coaching, and counseling; d) on-site access to psychiatric services; and e) outreach social work and nursing services, on the streets, in rooming houses, and in shelters (specifically Ottawa women’s, family, and youth shelters).

Framework and reporting

To evaluate the implementation of the UH program, we aimed to also evaluate the health service quality and program fidelity. This was done with the goal of ensuring the program provides high quality primary care services and reaches its intended target population. The Proctor et al. [20] program implementation framework was utilized to guide the evaluation. The framework examines three distinct but interrelated outcomes: implementation, service, and client. These outcomes evaluate whether the program resembles what was intended when it was launched and if the program has reached its goals, indicating successful implementation. Service outcomes measure the quality and characteristics of the service delivery. Client outcomes measure the program users’ experience.

Implementation outcomes are positioned as preceding both service and client outcomes [21]. Theoretically, the more positive the implementation outcomes (i.e., if the program was implemented successfully), the more positive the service and client outcomes.

A subset of outcomes from the Proctor et al. framework were used to evaluate the UH program. They are defined below in Table 1.

Table 1 Outcomes used to evaluate the Urban Health program implementation from Proctor et al. [20]

Evaluation methods

The study involved using an embedded mixed methods design [23] to assess the implementation of the UH program. The evaluation of the UH program implementation involved four separate components and data sources, as detailed in Table 2.

Table 2 Description of evaluation methods, data sources, and data types

All components of this study were approved by the Ottawa Health Science Network (Protocol #: 2090011-01H) research ethics board on October 21, 2019.

Data analysis

Descriptive statistics were calculated for clients’ demographic characteristics (e.g., age, gender, immigration status, insurance, housing situation, length of time involved with the program, etc.) and client satisfaction with the UH program. Client demographics were used to identify which populations accessed the UH program.

Qualitative data were explored via inductive thematic analysis [31]. Thematic analysis is a method of systematically identifying, organizing, and offering insight into patterns of meaning (themes) that allows researchers to make sense of collective or shared meaning and experiences [31], without being limited to a particular theoretical or epistemological approach [32]. The interview transcripts were subjected to initial coding, defined as a process of breaking down, examining, comparing, conceptualizing, and categorizing data [31]. Themes and subthemes were then identified through constant comparison [31]. Two researchers (SK and HA) trained in qualitative research methodology conducted coding independently, with regular meetings to discuss coding discrepancies and generate themes based on similarities or differences within and across the dataset. NVivo 12 [33] was used to code interview transcripts and identify the main themes and subthemes. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement [34] and Consolidated Criteria for Reporting Qualitative Research (COREQ) [35] was used to report this study’s findings.

Results

Evaluation

Client health records extraction

Between July 1, 2020—June 30, 2021, 570 unique clients were seen, with 1859 total client visits (mean 3.26, SD 4.10) to the UH Program clinic. A third of clients (34%) did not have a provincial health card for access to universal health care services, and most (68%) were homeless or a resident of rooming houses. Of the 219 individuals who reported their income (not reported: n = 351), 92% were at or below Canada’s official poverty line ($0–14,999/year: 81%, $15,000–19,000/year: 11%). The most common chronic illnesses included substance use disorder (30%), psychiatric disorder(s) (29%), hypertension (18%), diabetes (10%), latent tuberculosis (7%), chronic hepatitis B or C (6%), and HIV (2%). Additional concurrent issues ranged from immigration issues (27%), issues with refugee claims (26%), problems with the healthcare system (20%), and language barriers (17%). The UH program services used by clients included medical (84%), social assistance (i.e., access to showers, clothing, general health system navigation, etc.; 84%), and mental health (26%) services.

Client complexity assessment

The AMPS score was calculated for all clients seen in the UH program between November 1–30, 2021 (n = 74). The total mean complexity score for clients seen during this time was 16.68 (SD 6.75) out of 33. On average, male clients (n = 35; mean 18.66, SD 5.85) had higher mean total scores than female clients (n = 37; mean 14.65, SD 7.11). The highest recorded AMPS score was in the 40–49 age group (n = 13; mean 21.31, SD 5.12). Table 3 presents the AMPS complexity score broken down by age and sex.

Table 3 Client AMPS complexity score by a) age range and b) sex between November 1–30, 2021

The mean attachment score for all clients was 2.95 out of 3.00 (SD 0.37), reflecting the inclusion criteria of the UH program, which specifically targets individuals and families with no primary care provider. Medical complexity had a mean score of 2.45 out of 6.00 (SD 1.26), suggesting that clients had medical symptoms which were typically well-controlled and stabilized. Psychiatric (mental health and addictions) complexity had a mean score of 3.68 out of 12.00 (SD 3.63), suggesting clients had mild to moderate mental health and addictions symptoms and management. The Social section had a mean of 6.09 out of 12.00 (SD 3.16), suggesting a moderate to high degree of poverty in the population, as well as low access to social supports, and hesitant attitude towards care providers. For the most part, clients gained the majority of their total score from the Social component of the tool, which may be reflective of the social marginalization of clients seen through the UH program.

Semi-structured interviews

Thirty-one clients and ten key informants (program staff and staff of partnering agencies) consented to participate in the semi-structured interviews. One client withdrew their consent to participate at the midpoint of the interview. Responses provided by this interviewee were included up to the point of withdrawal. Client demographics are presented in Table 4. Key informants from four different organizations participated in interviews.

Table 4 Demographics for clients who participated in interviews (n = 31)

During interviews, both clients and key informants highlighted the importance of building relationships with this population, providing wrap-around care, and providing low-barrier care as major strengths of the UH program. These findings support the idea that the program is appropriate, effective, person-centred, and acceptable to clients, which ultimately reflects the fidelity of the program’s iterative development. Themes and representative quotes are provided in Table 5.

Table 5 Themes identified from semi-structured interviews with clients (n = 31) and key informants (n = 10)

Client satisfaction

An adapted version of the CSQ-8© was embedded into the end of the client semi-structured interviews (n = 30; n = 1 withdrew midway through the interview). Clients were asked to score each item on a Likert scale of 1 to 4, with a total possible maximum score of 20 across the 5 items. Overall, clients within our sample appeared to be highly satisfied with the program, rating the program an average total score of 18.50 out of 20. Score breakdown is shown in Table 6.

Table 6 Client satisfaction ratings (N = 30) of the Urban Health (UH) program

Summary of evaluation and associated implementation outcomes

As previously mentioned, four evaluation methods were used to evaluate the success of the implementation of the UH program: client health record extraction (n = 1859), client complexity assessments (n = 74), semi-structured interviews (n = 31), and a client satisfaction survey (n = 30). Each tool served as a measure of one or more of the Proctor et al. implementation outcomes, as outlined below in Table 7.

Table 7 Overview of evaluation methods and associated outcomes from the Proctor et al. [20] Implementation Framework

Discussion

Overall, based on the evaluation methods used to assess the implementation of the UH program, clients and key informants found the program to demonstrate fidelity, appropriateness, person-centredness, equity, acceptability, effectiveness, and penetration. This evaluation indicates a successful implementation and evolution of the program, including achieving goals such as removing barriers to accessing health care for marginalized, complex individuals and families, and high client satisfaction with the program’s services. Key areas for improvement that were identified as a result of this work include the need to: i) increase diversity in staff to better represent and serve the population served, ii) expand program hours and availability to allow for better accessibility to services, and iii) improve access to harm reduction services within the program to better serve the population that uses substances.

Our study found that the client population served through Centretown Community Health Centre’s UH program is highly complex. We used the Health Connection Clinic Complexity Assessment Tool to quantify the complexity of clients by examining their attachment to a provider, medical conditions and management, psychiatric conditions and management, and social situation. This tool was developed and initially used at a community health centre serving clients living in Vancouver’s Downtown Eastside neighbourhood, which contains Canada’s lowest income postal code, and is at the epicentre of the national opioid crisis [36, 37]. Presumably, this population is one of the most complex in Canada with respect to biopsychosocial complexity. In the paper reporting on the development of the Health Connection Clinic Complexity Assessment Tool, program staff assigned an AMPS score to every client that was seen in their clinic over the course of 1 year, and found a mean complexity score of 14.38 [24]. In contrast, in applying the AMPS score to every client seen through the UH program over the course of one month, we found a total mean complexity score that was higher, with even higher mean scores when evaluating just male clients or those in the 40–49-year-old age group. This demonstrates that the complexity of the clients served by the UH program is comparable to one of the most complex populations in Canada.

Based on the results from our review of UH program clients’ electronic medical records, the majority of the program users are at or below the poverty line and a third did not have access to a provincial health card (i.e., likely immigrants/newcomers or individuals with no fixed address). According to Employment and Social Development Canada’s Poverty Reduction Strategy report [38], Canada’s official poverty line ranges from $16,436 to $20,639 of annual income for single individuals, depending on one’s geographical location. Given that 21.5% of single adults in Canada were living in poverty in 2020 and that those with immigrant or refugee status are more likely to be living in poverty [39], there is a clear need for services similar to the UH program across Canada to address the needs of these marginalized groups. The development and implementation of services targeting marginalized individuals, including those with low income or immigrant or refugee status is crucial given prior evidence of barriers to accessing health care [40,41,42,43] and economic impacts related to the COVID-19 pandemic disproportionately affecting these populations [44, 45].

In interviews conducted as part of this study, clients and key informants highlighted the importance of fostering a judgment-free space, building relationships and trust, and having access to low-barrier care involving multiple services. These findings are echoed by other community programs offering similar services for marginalized groups [46, 47] with an aim to reduce health care inequities. Overcoming the barriers faced by complex and marginalized communities require an integrated approach of understanding and addressing the social determinants of health affecting these groups in care delivery [4, 48] and collaborative, coordinated care services [6]. Accordingly, based on client and key informant perceptions of the UH program, societal factors such as health care coverage, income, access to care services, and housing are acknowledged, and clients’ individual needs are advocated for through the person-centred approach and wrap-around model of care offered by the program. Despite some areas of improvement being noted by participants, these results demonstrate the success of the program’s implementation, and indicate approaches that similar programs could take to ensure the needs of their clients are met.

The UH program’s objective is to reach urban marginalized population, and the complexity scores of its clients and low-income status supports the notion that this intended aim has been reached. Our findings are consistent with the fact that the service area of the UH program includes a neighbourhood with a high-prevalence of low-income constituents and a high index of socioeconomic disadvantage when compared to other neighbourhoods in Ottawa, Canada [49]. Given that most major urban centres have populations facing poverty, substance use, unstable housing, food insecurity, and new immigrant/refugees, we anticipate that our findings will be beneficial for other service providers seeking to develop and evaluate the implementation of programs serving urban marginalized populations.

Strengths and limitations

A key strength of this study is that it provides support for the development and implementation of a program targeting the needs of urban and marginalized individuals in the community, including those with lower income or immigrant status. Similar programs may be developed and implemented using our description of how the UH program was designed and our evaluation of its implementation.

The following limitations of this study must be considered. Interviews were conducted at one point in time, and therefore may not have captured the potentially evolving perspectives and needs of participants. Moreover, it is possible that individuals who were more enthusiastic about sharing their experiences, whether positive or negative, may have been more likely to participate in the interviews and client satisfaction assessment. This may have potentially introduced some bias into our findings. Client satisfaction ratings were collected at the end of semi-structured interviews. Therefore, our client satisfaction results are specific to the small sample of individuals who took part in interviews and may not be generalizable across all UH program clients. We attempted to ameliorate these limitations by recruiting a diverse range of individuals for participation in interviews.

Additionally, interviews for this project were completed during the summer of 2021, when many COVID-19 restrictions were still in place. At that time, many social services which are integral to the experience of UH program clients (i.e., social support groups, community cooking lessons, etc.) were put on hold, meaning that clients were not able to comment on these services’ impacts on their experience. It is also possible that screening for COVID symptoms at the health centre door may have excluded groups of clients with general poorer health from entering the health centre, and therefore having an opportunity to be recruited to the study. This may have contributed to more healthy clients being represented in our interview findings.

Another limitation may have been the use of the Health Connection Clinic Complexity Assessment Tool for the assessment of client complexity. While the AMPS score is theoretically sophisticated and robust [24, 25], in recent years it has been criticized due to the subjectivity of questionnaire methodology [50]. Instead, a new software tool has been created by the developers of the Health Connection Clinic Complexity Assessment Tool. This new software tool models the complexity of clients by complementing questionnaire data with analysis of electronic health record data from the community health centre, as well data from other service settings used by their clients throughout the city including other community health centers, detox centers, and emergency departments [51]. Unfortunately, the program does not currently have access to electronic health records at other services throughout the city, and therefore using a software similar to this was not possible for this project. We did however aim to mitigate the limitations of questionnaire subjectivity by holding a provider training session on the use of this tool prior to its use. We additionally used data from the program’s electronic health record to complement the AMPS results.

Lastly, in our experience, mental illness, the impact of substances on behavior and health care seeking approaches, and the impact of past experiences with the health care system, influence interactions between service providers and marginalized populations. Medical mistrust and potential impacts of sharing information, especially in marginalized populations, may have a strong negative influence on health system interactions [52,53,54,55]. Our tools did not capture and quantify these aspects.

Despite these limitations, this study adds to the literature on the development, implementation and evaluation of programs to address equitable access to primary care services for urban marginalized and complex populations. More research is needed to assess how marginalization and complexity affects primary care outcomes.

Conclusions

This study evaluated the implementation of a holistic, interprofessional program at a community health centre to address unmet needs of urban marginalized individuals who have historically encountered barriers to accessing quality health care. Based on our evaluation, we have found that the program is serving its intended population of individuals who do not have public system coverage for health care, are at or below the national poverty line, suffer from a myriad of chronic illnesses, and have high complexity as determined by attachment, medical, psychiatric, and social parameters. Client and key informant perceptions of the program were exceedingly positive though some areas of improvement were noted to enhance care delivery. Our findings have relevance for other health care organizations and care providers seeking to create and evaluate the implementation of their own programs to better serve urban marginalized individuals in their communities and reduce health care inequities.

Availability of data and materials

The de-identified dataset used and analyzed during the current study are available from the corresponding author on reasonable request. To preserve the anonymity of the interviewees, the transcribed interviews are not available for sharing.

References

  1. Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83(3):457–502. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/j.1468-0009.2005.00409.x.

    Article  PubMed  PubMed Central  Google Scholar 

  2. World Health Organization. Quality health services 2020. https://www.who.int/news-room/fact-sheets/detail/quality-health-services (Accessed 8 Sep 2023).

  3. Institute of Medicine (US) Committee on the Future of Primary Care. The Value of Primary Care. 1996. In: Primary Care: America's Health in a New Era [Internet]. Washington (DC): National Academies Press (US). Available from: https://www.ncbi.nlm.nih.gov/books/NBK232636/.

  4. Baah FO, Teitelman AM, Riegel B. Marginalization: Conceptualizing patient vulnerabilities in the framework of social determinants of health-An integrative review. Nurs Inq. 2019;26(1):e12268. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/nin.12268.

    Article  PubMed  Google Scholar 

  5. University of British Columbia Equity & Inclusion Office. Equity and inclusion glossary of terms [Internet]. 2023. https://equity.ubc.ca/resources/equity-inclusion-glossary-of-terms/ (Accessed 18 Apr 2024).

  6. Canadian Collaborative Mental Health Initiative. Establishing collaborative initiatives between mental health and primary care services for urban marginalized populations. A companion to the CCMHI planning and implementation toolkit for health care providers and planners 2006. http://www.shared-care.ca/files/EN_CompanionToolkitforUrbanMarginalized.pdf (Accessed 4 Aug 2023).

  7. Mount JK, Massanari RM, Teachman J. Patient care complexity as perceived by primary care physicians. Fam Syst Health. 2015;33(2):137–45. https://doiorg.publicaciones.saludcastillayleon.es/10.1037/fsh0000122.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Peek CJ, Baird MA, Coleman E. Primary care for patient complexity, not only disease. Fam Syst Health. 2009;27(4):287–302. https://doiorg.publicaciones.saludcastillayleon.es/10.1037/a0018048.

    Article  CAS  PubMed  Google Scholar 

  9. Aery A. Innovations to champion access to primary care for immigrants and refugees. Wellesley Institute: Advancing urban health. 2017. https://www.wellesleyinstitute.com/publications/innova-ons-to-champion-access-to-primary-care-for-immigrants-and-refugees/ (Accessed 27 Jul 2023).

  10. Ahmed S, Shommu NS, Rumana N, Barron GRS, Wicklum S, Turin TC. Barriers to access of primary healthcare by immigrant populations in canada: a literature review. J Immigrant Minority Health. 2016;18(6):1522–40. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s10903-015-0276-z.

    Article  Google Scholar 

  11. Kirmayer LJ, Narasiah L, Munoz M, Rashid M, Ryder AG, Guzder J, et al. Common mental health problems in immigrants and refugees: General approach in primary care. CMAJ. 2011;183(12):E959–67. https://doiorg.publicaciones.saludcastillayleon.es/10.1503/cmaj.090292.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Health Quality Ontario. Interventions to improve access to primary care for people who are homeless: a systematic review. Ont Health Technol Assess Ser. 2016;16(9):1–50.

    PubMed Central  Google Scholar 

  13. Kertesz SG, Holt CL, Steward JL, Jones RN, Roth DL, Stringfellow E, et al. Comparing homeless persons’ care experiences in tailored versus nontailored primary care programs. Am J Public Health. 2013;103 Suppl 2(Suppl 2):S331-9. https://doiorg.publicaciones.saludcastillayleon.es/10.2105/ajph.2013.301481.

    Article  PubMed  Google Scholar 

  14. Richard L, Furler J, Densley K, Haggerty J, Russell G, Levesque J-F, et al. Equity of access to primary healthcare for vulnerable populations: the IMPACT international online survey of innovations. Int J Equity Health. 2016;15(1):64. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12939-016-0351-7.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Khanassov V, Pluye P, Descoteaux S, Haggerty JL, Russell G, Gunn J, et al. Organizational interventions improving access to community-based primary health care for vulnerable populations: a scoping review. Int J Equity Health. 2016;15(1):168. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12939-016-0459-9.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Luchenski S, Maguire N, Aldridge RW, Hayward A, Story A, Perri P, et al. What works in inclusion health: overview of effective interventions for marginalised and excluded populations. Lancet. 2018;391(10117):266–80. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/s0140-6736(17)31959-1.

    Article  PubMed  Google Scholar 

  17. Sunderji N, Ghavam-Rassoul A, Ion A, Lin E. Driving improvements in the implementation of collaborative mental health care: A quality framework to guide measurement, improvement and research. Toronto: Canada; 2016.

    Google Scholar 

  18. The Planning Collective. Breaking Ground Without Breaking Community. Situational Report for Somerset West Community Health Centre & Creative Neighbourhoods 2018. http://www.creativeneighbourhoods.ca/reports/The%20Planning%20Collective%20Situational%20Report.pdf (Accessed 10 Jul 2023).

  19. Eyre A, Layiki-dehne A. Working with the new Canadian population: How the health care assumptions that patients carry with them from their countries of origin affect their ability to access health care in Canada. Family Medicine Forum; Quebec City, Quebec, Canada2006.

  20. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36(1):24–34. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s10488-008-0197-4.

    Article  PubMed  Google Scholar 

  21. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s10488-010-0319-7.

    Article  PubMed  Google Scholar 

  22. Public Health Ontario. Health Equity Data 2023. https://www.publichealthontario.ca/en/Data-and-Analysis/Health-Equity (Accessed 8 Sep 2023).

  23. Creswell J, Plano Clark V. Choosing a mixed methods design. Designing and conducting mixed methods research. 2nd ed. Thousand Oaks: SAGE Publications; 2011. p. 53–106.

    Google Scholar 

  24. Shukor AR, Edelman S, Brown D, Rivard C. Developing community-based primary health care for complex and vulnerable populations in the Vancouver coastal health region: healthconnection clinic. Permanente J. 2018;22:18–010. https://doiorg.publicaciones.saludcastillayleon.es/10.7812/tpp/18-010.

    Article  Google Scholar 

  25. de Jonge P, Huyse FJ, Stiefel FC, Slaets JP, Gans RO. INTERMED–a clinical instrument for biopsychosocial assessment. Psychosomatics. 2001;42(2):106–9. https://doiorg.publicaciones.saludcastillayleon.es/10.1176/appi.psy.42.2.106.

    Article  PubMed  Google Scholar 

  26. Huyse FJ, Lyons JS, Stiefel FC, Slaets JP, de Jonge P, Fink P, et al. “INTERMED”: a method to assess health service needs. I. Development and reliability. Gen Hosp Psychiatry. 1999;21(1):39–48. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/s0163-8343(98)00057-7.

    Article  CAS  PubMed  Google Scholar 

  27. Oliveira CA, Weber B, Dos Santos JLF, Zucoloto ML, de Camargo LL, Zanetti ACG, et al. Health complexity assessment in primary care: A validity and feasibility study of the INTERMED tool. PLoS ONE. 2022;17(2):e0263702. https://doiorg.publicaciones.saludcastillayleon.es/10.1371/journal.pone.0263702.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Stiefel FC, de Jonge P, Huyse FJ, Guex P, Slaets JP, Lyons JS, et al. “INTERMED”: a method to assess health service needs. II. Results on its validity and clinical use. Gen Hosp Psychiatry. 1999;21(1):49–56. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/s0163-8343(98)00061-9.

    Article  CAS  PubMed  Google Scholar 

  29. Attkisson CC, Zwick R. The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann. 1982;5(3):233–7. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/0149-7189(82)90074-x.

    Article  CAS  PubMed  Google Scholar 

  30. Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979;2(3):197–207. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/0149-7189(79)90094-6.

    Article  CAS  PubMed  Google Scholar 

  31. Braun V, Clarke V. Thematic analysis. In: Cooper H, Camic PM, Long DL, Panter AT, Rindskopf D, Sher KJ, editors. APA handbooks in psychology® APA handbook of research methods in psychology, Vol 2 Research designs: Quantitative, qualitative, neuropsychological, and biological 2. Washington, DC: American Psychological Association; 2012. p. 57–71.

    Google Scholar 

  32. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.

    Article  Google Scholar 

  33. Lumivero. NVivo [Software]. 2023. https://lumivero.com/products/nvivo/ (Accessed 31 Jul 2023).

  34. Vandenbroucke JP, von Elm E, Altman DG, Gøtzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. PLoS Med. 2007;4(10):e297. https://doiorg.publicaciones.saludcastillayleon.es/10.1371/journal.pmed.0040297.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57. https://doiorg.publicaciones.saludcastillayleon.es/10.1093/intqhc/mzm042.

    Article  PubMed  Google Scholar 

  36. Linden IA, Mar MY, Werker GR, Jang K, Krausz M. Research on a vulnerable neighborhood-the vancouver downtown eastside from 2001 to 2011. J Urban Health. 2013;90(3):559–73. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s11524-012-9771-x.

    Article  PubMed  Google Scholar 

  37. Somers JM, Moniruzzaman A, Rezansoff SN. Migration to the Downtown Eastside neighbourhood of Vancouver and changes in service use in a cohort of mentally ill homeless adults: a 10-year retrospective study. BMJ Open. 2016;6(1):e009043. https://doiorg.publicaciones.saludcastillayleon.es/10.1136/bmjopen-2015-009043.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Employment and Social Development Canada. Canada's first poverty reduction strategy 2018. https://www.canada.ca/en/employment-social-development/programs/poverty-reduction/reports/strategy.html (Accessed 31 Jul 2023).

  39. Statistics Canada. Disaggregated trends in poverty from the 2021 Census of Population 2021. https://www12.statcan.gc.ca/census-recensement/2021/as-sa/98-200-X/2021009/98-200-X2021009-eng.cfm (Accessed 31 Jul 2023).

  40. Chen J, Hou F. Unmet needs for health care. Health Rep. 2002;13(2):23–34.

    PubMed  Google Scholar 

  41. Family Service Association of Edmonton and the Income Security Action Committee. Working hard, living lean: a qualitative study of working low-income families in Edmonton. Sherwood Park: Holmgren Consulting Group; 1991.

  42. Williamson DL, Drummond J. Enhancing low-income parents’ capacities to promote their children’s health: education is not enough. Public Health Nurs. 2000;17(2):121–31. https://doiorg.publicaciones.saludcastillayleon.es/10.1046/j.1525-1446.2000.00121.x.

    Article  CAS  PubMed  Google Scholar 

  43. Wu Z, Penning MJ, Schimmele CM. Immigrant status and unmet health care needs. Can J Public Health. 2005;96(5):369–73. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/bf03404035.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Kantamneni N. The impact of the COVID-19 pandemic on marginalized populations in the United States: A research agenda. J Vocat Behav. 2020;119:103439. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.jvb.2020.103439.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Public Health Agency of Canada. From risk to resilience: An equity approach to COVID-19 2020. https://www.canada.ca/en/public-health/corporate/publications/chief-public-health-officer-reports-state-public-health-canada/from-risk-resilience-equity-approach-covid-19.html (Accessed 1 Aug 2023).

  46. Dutt A, Toolis E, Shi C, Moore C. “They really care about you, they really build relationships”: Care and justice in a community organization. Anal Soc Issues Public Policy. 2022;22(3):1017–37. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/asap.12324.

    Article  Google Scholar 

  47. Vanden Bossche D, Willems S, Decat P. Understanding trustful relationships between community health workers and vulnerable citizens during the COVID-19 pandemic: a realist evaluation. Int J Environ Res Public Health 2022;19(5). https://doiorg.publicaciones.saludcastillayleon.es/10.3390/ijerph19052496

  48. Andermann A. Taking action on the social determinants of health in clinical practice: a framework for health professionals. CMAJ. 2016;188(17–18):E474–83. https://doiorg.publicaciones.saludcastillayleon.es/10.1503/cmaj.160177.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Ottawa Neighbourhood Study. Centretown 2023. https://www.neighbourhoodstudy.ca/24centretown/#General%20Demographics/Racialized%20population/ (Accessed 31 Jul 2023).

  50. Shukor AR, Joe R, Sincraian G, Klazinga N, Kringos DS. A multi-sourced data analytics approach to measuring and assessing biopsychosocial complexity: the Vancouver Community Analytics Tool Complexity Module (VCAT-CM). Community Ment Health J. 2019;55(8):1326–43. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s10597-019-00417-5.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Joe R, Sincraian G, Shukor AR. The Vancouver Community Analytics Tool (VCAT): software enabling operationalization of the building blocks of high-performing primary care at community health centers in British Columbia, Canada. Permanente J. 2020;25:1. https://doiorg.publicaciones.saludcastillayleon.es/10.7812/tpp/20.050.

    Article  Google Scholar 

  52. Corbie-Smith G, Thomas SB, St. George DMM. Distrust, race, and research. Arch Inter Med. 2002;162(21):2458–63. https://doiorg.publicaciones.saludcastillayleon.es/10.1001/archinte.162.21.2458.

    Article  Google Scholar 

  53. Hammond WP, Matthews D, Mohottige D, Agyemang A, Corbie-Smith G. Masculinity, medical mistrust, and preventive health services delays among community-dwelling African-American men. J Gen Intern Med. 2010;25(12):1300–8. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s11606-010-1481-z.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Morgan SE. Many facets of reluctance: African Americans and the decision (not) to donate organs. J Natl Med Assoc. 2006;98(5):695–703.

    PubMed  PubMed Central  Google Scholar 

  55. Thompson HS, Valdimarsdottir HB, Winkel G, Jandorf L, Redd W. The group-based medical mistrust scale: psychometric properties and association with breast cancer screening. Prev Med. 2004;38(2):209–18. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.ypmed.2003.09.041.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study was funded by a PRIME grant (#20–939501804) from the Department of Family Medicine of the Faculty of Medicine at the University of Ottawa.

Author information

Authors and Affiliations

Authors

Contributions

AM, CG, AE, and SK developed the study concept and design, with AM and CG taking on supervisory roles. HC, SK, and AM contributed to the analysis of the client health record, client complexity assessment, and client satisfaction data. SK, HAH, and AM contributed to the analysis of the qualitative semi-structured interview data. SK, CG, AE, HAH, HC, CL, MK, and AM interpreted the study data to identify key findings. SK, AM, and MK prepared the draft manuscript. SK, CG, AE, HAH, HC, CL, MK, and AM critically revised the manuscript for important intellectual content, approved the final version of the manuscript to be published, and agreed to act as guarantor of the work.

Corresponding author

Correspondence to Andrew Mclellan.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Ottawa Health Science Network (Protocol #: 20190011-01H) research ethics board on October 21, 2019. Written informed consent was obtained from all interview participants. All methods were performed in accordance with the relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khorsand, S., Geller, C., Eyre, A. et al. Like an umbrella, protecting me from the rain until I get to my destination”: Evaluating the implementation of a tailored primary care model for urban marginalized populations. BMC Prim. Care 25, 347 (2024). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12875-024-02563-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12875-024-02563-6

Keywords