- Open Access
Improving intervention design to promote cervical cancer screening among hard-to-reach women: assessing beliefs and predicting individual attendance probabilities in Bogotá, Colombia
BMC Women's Health volume 22, Article number: 212 (2022)
Despite being a preventable disease, cervical cancer continues to be a public health concern, affecting mainly lower and middle-income countries. Therefore, in Bogotá a home-visit based program was instituted to increase screening uptake. However, around 40% of the visited women fail to attend their Pap smear test appointments. Using this program as a case study, this paper presents a methodology that combines machine learning methods, using routinely collected administrative data, with Champion’s Health Belief Model to assess women’s beliefs about cervical cancer screening. The aim is to improve the cost-effectiveness of behavioural interventions aiming to increase attendance for screening. The results presented here relate specifically to the case study, but the methodology is generic and can be applied in all low-income settings.
This is a cross-sectional study using two different datasets from the same population and a sequential modelling approach. To assess beliefs, we used a 37-item questionnaire to measure the constructs of the CHBM towards cervical cancer screening. Data were collected through a face-to-face survey (N = 1699). We examined instrument reliability using Cronbach’s coefficient and performed a principal component analysis to assess construct validity. Then, Kruskal–Wallis and Dunn tests were conducted to analyse differences on the HBM scores, among patients with different poverty levels. Next, we used data retrieved from administrative health records (N = 23,370) to fit a LASSO regression model to predict individual no-show probabilities. Finally, we used the results of the CHBM in the LASSO model to improve its accuracy.
Nine components were identified accounting for 57.7% of the variability of our data. Lower income patients were found to have a lower Health motivation score (p-value < 0.001), a higher Severity score (p-value < 0.001) and a higher Barriers score (p-value < 0.001). Additionally, patients between 25 and 30 years old and with higher poverty levels are less likely to attend their appointments (O.R 0.93 (CI: 0.83–0.98) and 0.74 (CI: 0.66–0.85), respectively). We also found a relationship between the CHBM scores and the patient attendance probability. Average AUROC score for our prediction model is 0.9.
In the case of Bogotá, our results highlight the need to develop education campaigns to address misconceptions about the disease mortality and treatment (aiming at decreasing perceived severity), particularly among younger patients living in extreme poverty. Additionally, it is important to conduct an economic evaluation of screening options to strengthen the cervical cancer screening program (to reduce perceived barriers). More widely, our prediction approach has the potential to improve the cost-effectiveness of behavioural interventions to increase attendance for screening in developing countries where funding is limited.
Cervical cancer is a preventable disease. However, in 2018, it was the fourth leading cause of cancer death among women worldwide . Although the overall Age Standardized Incidence Rate (ASIR), per 100,000 women is 13.1, it ranges from 6.0 in Australia and New Zealand to 40.1 in Eastern Africa . In fact, both incidence and mortality rates are associated with poverty and limited health education [2,3,4]. In 2018, around 84% of the cases and 88% of cervical cancer deaths occurred in poorly-resourced countries . Consequently, in 2020, the World Health Organization defined a set of goals to eradicate cervical cancer as a public health problem, emphasizing the need to improve human papillomavirus (HPV) vaccination coverage and screening uptake rates . Nevertheless, while in high income countries the implementation of screening and vaccination programs has been successful, for many lower and middle-income countries (LMICs) it still represents a major challenge [6,7,8,9]. In Colombia, the ASIR is 12.57 and mortality rates show geographical patterns affecting disproportionally low-income women .
ACS (Acciones Colectivas en Salud) is an outreach program designed by the Health Office in Bogotá (Secretaría Distrital de Salud, SDS) to increase health service utilization among hard-to-reach populations. The main idea is to improve health outcomes by engaging low-income patients with eleven preventive care strategies. In this context, some of the ACS activities are devoted to increasing early cervical cancer detection by improving Pap smear test uptake among hard-to-reach women. Every month, a group of community workers identifies women who are not complying with the screening program, visits them at home, provides basic training in cervical cancer risks, and schedules a Pap smear test for them at the nearest healthcare facility. Despite this effort, around 40% of the visited patients end up missing their appointments. Therefore, more information is required to design interventions aimed at increasing attendance levels. Indeed, behavioural interventions informed by patient beliefs about screening have been found to increase uptake rates . Additionally, accurate predictions of individual no-show probabilities could improve resource allocation by identifying those patients who would benefit the most from such interventions .
The Health Belief Model (HBM) is a widely used conceptual framework in health behavioural research . In its original version, introduced in the 1950s, the underlying theory is that the adoption of a protective health behaviour can be explained by the patient’s perceptions of their susceptibility and the severity of the “threat”, and the benefits of and barriers to the behaviour . Later, the model was extended to incorporate other categories . Rosenstock et al. , for example, proposed the inclusion of a Health Motivation category to assess the patient’s incentive to behave and maintain general good health. More recently, Champion  developed instruments to measure HBM constructs related to breast cancer behaviour. According to Ritchie et al. , Champion’s revised HBM (CHBM) has been found to explain between 25 and 89% of the variance in participation in mammography studies, in different contexts, over almost 40 years. Recent reviews on the use of the HBM to study cancer prevention behaviours can be found in [17,18,19].
In 2010, Guvenc et al.  adapted the instruments of the CHBM to assess beliefs towards cervical cancer screening. Since then, several studies have adopted the CHBM as a conceptual framework to understand cervical cancer screening behaviours. As expected, the resulting scores for each construct are highly context dependent. For example, studies using Guvenc’s scale have found susceptibility scores ranging from 2.2 in Saudi Arabia  to 4.8 in the USA . Consequently, two recent reviews have highlighted the need to conduct local empirical research to inform public policy and design tailored interventions, particularly among marginalized communities [23, 24].
This study aims to inform the design of behavioural interventions to increase attendance levels for cervical cancer screening, among hard-to-reach low-income women in Bogotá. To achieve this, we propose a two-fold approach: cervical-cancer belief assessment and individual no-show probability prediction. A cross-sectional face-to-face survey of a random sample of ACS patients was conducted. Our analytical approach is three-fold: first, we study the reliability and construct validity of Guvenc’s scale in our study context. Next, descriptive statistics and pairwise comparison of means are used to analyse the CHBM constructs. Finally, we develop a model to predict individual no-show probabilities using the survey results, patient sociodemographic information and appointment characteristics.
This section starts with a description of our study context. We provide basic information about the cervical screening program in Colombia and the definition of hard-to-reach women used by ACS in Bogotá. The beliefs assessment then follows, describing the survey instrument, its validation, and data collection procedure. Finally, we present the proposed modelling approach to predict individual attendance probabilities.
Study context and sample
In Colombia the coverage of the vaccination against the Human Papilloma Virus (HPV) remains low, despite being included in the free national immunization program . Therefore, cervical cancer control strategy is focused on early detection through screening. Women between 25 and 69 are eligible, following a 1–1-3 scheme. This means that screening is recommended annually and changed to a three-year interval after two consecutive annual negative results. Currently, the program is primarily based on cervical cytology and is included in the national health insurance, so no out-of-pocket payment is required when undergoing the examination [26, 27]. However, women do not receive any formal invitation to book a cytology appointment. Thus, the program relies on doctor recommendations and patient motivation. Although recent legislation recommended starting a transition to a HPV-test-based screening , the National Ministry of Health assessed operational barriers and decided to delay the pilot phase . SDS considers a patient to be hard-to-reach if despite being eligible, she has not attended a screening appointment in the preceding year. Additionally, low-income populations are classified into four poverty levels to prioritize their participation in social programs. In this context, ACS only covers people belonging to the three most severe levels of poverty (High, Medium, and Low). Our study population are hard-to-reach women covered by ACS in Bogotá.
All items in the CHBM questionnaire used a three-point Likert scale: disagree, neutral and agree. The aim of the cross-sectional survey was to estimate the proportion of patients selecting each option. In December 2019, 43,500 hard-to-reach women were covered by ACS. In the absence of information about responses to any of the CHBM questions among this target population, the sample size was determined using an assumed proportion of 50% ‘yes’ responses to a hypothetical yes/no question, with confidence level 95% and error 2.5%. This gave a required sample of at least 1485 participants. Following a process of stratified random sampling, SDS eventually invited 1750 hard-to-reach women to take the survey. A total of 1699 women (97%) consented and SDS provided the anonymized answers. Although the women in our study population were designated hard-to-reach, they were willing to receive a home visit from the ACS team and were asked to take the survey at the end of the visit. This might offer an explanation for the high uptake, as no incentives were offered. Additionally, appointment information and socio-demographic data (i.e. age of the patient and poverty index) were retrieved from SDS information systems. Pontificia Universidad Javeriana (FID-19–107), SDS (2019EE47807) and the University of Southampton (ERGO ID 48,583.A1) granted ethical approval for this study.
We used the items of the CHBM questionnaire for cervical cancer screening and Pap smear test, developed by Guvenc et al. . The statements were translated into Spanish and discussed with public health experts from SDS. As a result, taking into account the study context, six items were added to the list and five deleted. Hence, we used a 37-item survey (see Table 1) to assess the five constructs of the model: Susceptibility (4 items), Severity (7 items), Benefits (8 items), Health motivation (3 items) and Barriers (15 items). For data analysis, values of 1 (disagree), 3 (neutral) and 5 (agree) were assigned, following the convention in the literature . Construct validity was evaluated using principal component analysis and sample adequacy was assessed with the Kaiser–Meyer–Olkin (KMO) test. Finally, reliability of the scale was examined using item-rest subscale correlation and Cronbach’s Alpha coefficients.
Community workers collected data, at the end of home visits, between January and February 2020. Before data collection started, training took place in eight workshops with 280 community workers. During these workshops, the research project was presented and items of the instrument were analysed. As part of their enrolment process with SDS, community workers were previously trained in data collection, interaction with vulnerable communities and techniques to discuss health-related topics. Due to security concerns, it was decided that a printed version of the instrument should be used with each participant. Raw data were stored and anonymized by SDS. We used descriptive statistics to assess beliefs about cervical cancer screening. Pairwise comparison of means was performed to examine the effect of the participants poverty levels on each construct of the CHBM.
Predicting individual no-show probabilities
We analysed two data sets. First, SDS provided anonymised data from the 1699 surveyed patients (dataset 1). Table 2 presents the list of variables collected by ACS program managers, grouped into patient and appointment characteristics. These variables have been found to have good predictive value for medical appointment attendance . Five of these variables (age, lead time, month, and day) were previously used to model no-show behaviour for preventive care appointments in Bogotá . We also retrieved data from historical administrative records (dataset 2) relating to appointments scheduled for 23,384 women between 2017 and 2019 as part of the ACS program. Further details of the two datasets can be found in Additional File 1: Table S1, where it can be seen that the sociodemographic profiles of the women in both datasets are similar.
The methodology is described in detail in  and is summarised briefly here. For age and lead time we used decision trees to build categorical variables aiming at increasing model stability . Additionally, one-hot encoding was used to represent all the variables in the models. To improve interpretability, we performed variable selection using a LASSO (Least Absolute Shrinkage and Selection Operator) regression model . In cases with high correlation between independent variables, this model has been found to select only the best predictors and set the coefficients of the other variables to zero, avoiding multicollinearity problems . Finally, we randomly generated training (70%) and test sets (30%). Table 1 also shows the categories with the highest and lowest no-show rates, for each variable in each data set. For example, while in the data set 1 the patients between 30 and 49 years old have the highest no-show rate (41%), in the data set 2 the patients younger than 30 years old have a no-show rate of 51%. Detailed information about the samples, frequencies, and attendance levels for both data sets are provided in Additional file 1: Table S1.
To quantify the linear relationships between each variable and the no-show probability, we fitted a LASSO regression model. This model was proposed to overcome the accuracy and interpretability limitations of ordinary least-squares regression  and has been widely used to predict appointment attendance . In future, SDS will use individual no-show probabilities to classify patients into three groups: A, B and C. While patients in groups A (at high risk of no-show) and B (at medium risk) will receive different behavioural interventions, patients in group C (low risk) will not receive any intervention as they are likely to attend anyway. Therefore, we needed to select two cut-off points. This process is called cut-off point tuning and is based on ROC performance indicators . Consequently, the performance of the model was assessed using the average Area Under the Receiver Operating Characteristic (AUROC) score. This score ranges from 0 to 1, and can be interpreted as the average sensitivity of the classification considering all possible specificities .
We analysed average coefficients over 100 experiments. For each group of ten experiments, we randomly divided the data into ten groups, using nine for training and the other one for testing. Then, the testing group was iteratively changed. When this procedure is repeated 10 times, it is called a 10-by-10 cross validation process. Additionally, a parametric analysis was carried out to determine the penalty constant of the model. We decided to use the constant that maximizes AUROC score while maintaining the minimum possible number of variables. Scikit-Learn's logistic regression was used in our analysis, setting the alpha value to 0 .
To quantify the impact on accuracy, we conducted three experiments. For model 1, we used the variables presented in Table 1 for the surveyed patients (n = 1,699). For model 2, we used the same data set and included responses to the 37-item survey instrument. For model 3 a sequential approach was used as follows. First, we trained a model with the variables presented in Table 1, using information from Pap smear test appointments that were scheduled between 2017 and 2019 (dataset 2, n = 23,384). We hypothesized that by using these historical data the model would be better able to identify patterns of attendance. With this model, we predicted the no-show probability for each patient in the survey data set. Then, a second model was fitted using the first model prediction and the 37 items in the survey.
We present our results organized in three sections. Firstly, an assessment of the beliefs is presented. Then, the LASSO regression results are summarized. We use average odds ratios (OR) to quantify the impact of each variable on the attendance probability. Finally, the performance of the prediction approach is assessed. We analyse the added value, in terms of AUROC score, of using a sequential approach to predict individual attendance probabilities.
Figure 1 presents the distribution of the scores for the 37 items, grouped into nine components. We provide detailed results of the item reliability analysis and construct validation for the instrument in the Additional File 2. Response frequencies by item are provided in Additional File 1: Table S2. The average susceptibility score is 2.86, with 3.83 being the highest observed value (statement 1). When presented with the statement “It is likely that I will get cervical cancer in the future”, 56% of the participants agreed. However, judging by the other three items in the category, most of the participants showed a low perceived susceptibility. More than 40% of the participants disagreed with statements 2, 3 and 4. Similarly, only one component is identified for the heath motivation category. The average score for health motivation is 3.52, with items ranging from 3.05 to 4.03 on average. While 71% of the participants agreed with statement 20 “I eat well-balanced meals for my health”, only 44% reported that they exercise at least 3 times a week for their health (statement 21).
Figure 1 also shows that severity items were grouped into two components (2 and 3). The average score for component 2 is 4.27 and it includes items 5, 6 and 7. These items are all related to feeling anxiety about the idea of cervical cancer. On average, 78% of the participants agreed with these three statements. However, severity score decreases when participants are asked about possible consequences of the disease. The average score for component 3 is 3.37, with values ranging from 2.82 to 4.14. Finally, statements 9 and 10 score bellow 3.0. While 42% of the participants disagreed with the statement “Cervical cancer would threaten a relationship with my husband, boyfriend or partner”, 43% provide the same answer for the statement “If I developed cervical cancer, I would not live longer than 5 years”.
Barriers statements are grouped into components 7, 8 and 9 with average scores of 2.63, 2.34 and 1.51, respectively. Component 7 includes statements 23 and 24 both related to being afraid to have a Pap smear test, either because of a possible bad result or because they do not know what might happen. Both statements have similar distribution of answers, among participants: around 35% agreed and 55% disagreed. Component 8 includes statements 28, 29 and 32. These statements are related to the experience of taking a Pap smear test. Among participants, the test is perceived as painful (38%) and uncomfortable (49%). Additionally, 19% of the respondents believed that the health professionals performing the test are rude to women. Lastly, component 9 included four statements: 34, 35, 36 and 37. Interestingly, these four items were added to the instrument as result of the discussion with SDS public health experts. However, on average, 83% of the participants disagreed with the statements.
There is a relationship between the scores of three constructs of the CHBM, severity, motivation and barriers, and the poverty level of the participant. Kruskal–Wallis tests show that there are statistically significant differences in the scores of severity (p-value < 0.001), health motivation (p-value < 0.0028) and barriers (p-value < 0.001) between the three levels of poverty. Additionally, the Dunn tests show that participants at the higher level of poverty have lower health motivation score (p-value < 0.001), highest severity score (p-value < 0.001) and higher barriers score (p-value < 0.001). There is no statistically significant difference among the scores of the other two groups of participants. Pairwise comparisons for the nine components lead to similar conclusions regarding the poverty levels. Additional file 1: Table S3 presents the p-values for the Kruskal–Wallis test and the pairwise comparisons, using the Dunn test.
Variables affecting no-show probability
This section presents the LASSO regression results. We report the odds ratios (5th percentile, 95th percentile and average) for the 100 experiments. While Table 3 presents the results for the HBM survey, Table 4 presents the results for the patient and appointment characteristics. Both tables present the results of the same LASSO model. To model the outcome, a value of one is assigned to those patients attending their appointments. Therefore, higher odds ratios (ORs) mean lower no-show probabilities. This model has a good discriminatory power and its results are not sensitive to the sample. The average AUROC score is 0.79 with a standard deviation of 0.004.
There is a relationship between the CHBM constructs and the no-show probability. Table 3 summarises the ORs for the possible answers to 16 items of the survey. The other 21 items were found not to have a good predictive value for the attendance levels. Participants with higher perceived susceptibility are more likely to keep their appointments. Those who disagree with statements 1 and 3 have OR of 0.82 and 0.66, respectively. Additionally, patients with lower health motivation and perceived benefits are less likely to attend. The average ORs range from 0.54 to 1.09 for benefits and from 0.80 to 1.02 for health motivation.
Perceived severity and barriers affect the no-show probability. Patients who disagree with being afraid to think about cervical cancer are less likely to attend (OR 0.93). Surprisingly, those who do not worry about specific personal consequences of the disease have lower no-show probabilities (OR 1.26 and 1.27). Additionally, patients are more likely to attend if they are not afraid to have the test (OR 1.31), do not think that the test is painful (OR 1.23) or uncomfortable (1.42) and do not believe that the testing is only required for patients with an active sexual life (1.42). Lastly, patients have lower no-show probabilities if they are neutral to statements 29, 30 and 35.
We also find a relationship between patient and appointment characteristics and the attendance probability. As can be seen in Table 4, the age and the poverty level of the patient affect her attendance rate. The older the patient, the more likely they are to keep their appointment. Additionally, patients in the highest level of poverty have lower attendance probabilities. Table 4 also shows that reducing lead times might lead to better attendance levels. ORs range from 1 to 4.63 when the lead time is varied. Lastly, as the survey was conducted between January and February 2020, the model is not able to find possible seasonal patterns on the attendance rates. The ORs for February appointments are only slightly higher than the ones for January.
Improving prediction accuracy
In this section, we assess the performance of the three modelling approaches to predict individual attendance probabilities. Figure 2 summarizes the results of 300 experiments. Each point in the graph represents the average and standard deviation of the AUROC score for a group of ten experiments. Model 1 predicts the attendance probability using only patient and appointment variables presented in Table 1. Model 2 includes the same variables and the results from the HMB survey. Lastly, model 3 follows a sequential approach, combining data from 23,384 Pap smear appointments and the survey results.
Assessing patient beliefs towards cervical cancer screening adds value to the prediction process. By using the survey results, it is possible to increase the average AUROC score from 0.71 to 0.79. Arguably, collecting and processing this information is expensive. However, these results improve the understanding of the no-show phenomena and could be used to inform the design of interventions to increase attendance levels. This is particularly relevant in the context of hard-to-reach patients. Additionally, the performance of model 3 shows that it is possible to train one model with administrative data (routinely collected) and select a representative sample of patients to assess their beliefs. This strategy increases the AUROC score up to 0.9.
Compared to other studies using Guvenc’s scale, our results suggest that hard-to-reach women from Bogotá have lower perceived susceptibility [22, 37,38,39,40], higher perceived severity [21, 22, 37,38,39,40,41,42], higher perceived benefits [38,39,40,41,42,43,44] and lower perceived barriers [21, 38, 41, 42, 45, 46], towards cervical cancer screening. Recent reviews concluded that these beliefs have been less researched in Latin America [47, 48]. However, we identified among our participants three beliefs that have hampered the implementation of cervical cancer screening programs in other countries of the region. Firstly, for 32% of our participants there is a relationship between cancer history in the family and the susceptibility of developing cervical cancer [49, 50]. Secondly, 28% of the women believe that undergoing a Pap smear test is not required if one does not have an active sexual life [49, 51, 52]. Lastly, 41% of the surveyed patients think that a cervical cancer diagnosis might threaten the relationships with their husbands, boyfriends or partners [51, 53, 54].
Our regression results also confirm what has been found in previous research, in LMIC contexts outside Latin America. In Bogotá, patients are more willing to undergo a Pap smear test if they perceive themselves at risk of developing cervical cancer or understand the benefits of the screening program. Similarly, perceived susceptibility was associated with higher uptake rates in Ghana , Ethiopia  and Iran . Additionally, higher perceived benefits were found to encourage screening behaviours in Nepal , Ghana  and Ethiopia . In a recent review, Simbar et al.  concluded that training-based interventions are able to modify perceived susceptibility and benefits, leading to behavioural changes. Therefore, education among participants with higher no-show risk in Bogotá should aim at increasing perceived susceptibility.
We also find that poverty affects patients’ beliefs and attendance probabilities. Participants in the most severe level of poverty have lower perceived health motivation, higher perceived severity, higher perceived barriers and are less likely to keep their appointments. The relationship between poverty levels and cervical cancer screening behaviour [52, 59,60,61,62], or no-show rates [63,64,65,66], has been widely documented . However, little has been discussed about the differences in beliefs among women suffering different levels of poverty. Targeting marginalized communities with tailored interventions could improve screening uptake [2, 8, 67]. Therefore, our results suggest the need to develop new information material for lower income patients in Bogotá.
Cancer worries decrease attendance probability. The underlying assumption of the CHBM is that perceived susceptibility acts as an enabler for protective health behaviours. Indeed, several studies have found that perceived severity is associated with better cervical cancer screening uptake rates [20, 37, 41, 68, 69]. However, our results show that participants who believe that a cervical cancer diagnosis would threaten their relationships (41%) or change their whole life (74%), and participants who are afraid of a bad result (36%) are less likely to attend. Recent research has theorized that there is a difference between general (about the disease) and specific (about the consequences) cancer worries . In this context, it is possible that while worrying about developing cancer motivates early diagnosis behaviours, some specific worries about the consequences act as deterrents to screening attendance [71, 72]. Our results highlight the need to develop education campaigns to address misconceptions about the disease mortality and treatment.
There is a potential for improving attendance rates among hard-to-reach women in Bogotá by decreasing lead times. ORs range from 1 to 4.63 (IC 4–5.4) when the lead time is decreased. This relationship has been previously found in other no-show studies for healthcare appointments [73,74,75]. Further, while offering timely access to screening services is a key component in implementation success [76, 77], access problems are one of the main barriers towards cervical cancer screening in Latin America . It has been argued that in poorly-resourced systems, cytology-based screening programs are less effective than using a combination of different types of test [78, 79]. Our results highlight the need to conduct an economic evaluation of alternatives to strength the cervical cancer screening program in Bogotá. For example, including HPV testing and self-sampling have shown positive impacts in Argentina, Brazil and Mexico [80,81,82,83].
The main limitations of this study are related to the sample. First, we aimed at assessing beliefs among hard-to-reach women in Bogotá. Therefore, sampling among ACS participants is considered to be a good strategy. However, we are not able to draw conclusions about other relevant groups in the city. Further research on women outside the program could also inform public policy. Second, data were collected at the end of the home visit. Consequently, it is not possible to quantify the impact of the basic training provided by ACS community workers among our participants. However, we believe that the information provided by this assessment can be used to strengthen the program and ultimately improve health outcomes. Lastly, data were collected between January and February 2020. In Bogotá, the first confirmed case of COVID-19 was reported in March 2020 and restrictions on social distance were adopted two weeks later. Data collection was completed before the public became aware of the pandemic so we are confident this did not influence responses, but it is not possible to draw any conclusions on how the (widely available) information on the virus may subsequently have affected the health-seeking behaviours of our study population.
Our methodological approach has the potential to improve the cost-effectiveness of behavioural interventions to increase screening uptake among hard-to-reach women in any setting. Generally, behavioural strategies aimed at the whole population are not cost-effective [12, 84, 85]. Further, using mass interventions such as phone or text reminders might ignore the underlying reasons for the no-show behaviour among hard-to-reach populations [86, 87]. Therefore, by accurately predicting individual attendance probabilities, it is possible (and financially sustainable) to design tailored interventions for marginalized communities in low-resourced settings. More importantly, for each cohort of patients the model can be used to predict individual attendance probabilities and classify patients into different intervention groups. By doing so, costly behavioural interventions can be reserved for those with higher no-show risk. In this context, scores of the beliefs assessment can be used to select the most appropriate behavioural approach for each group. We have also shown that, following a sequential approach, it is possible to identify patients with higher no-show risk by exploiting a combination of routinely-collected data and a sample-based beliefs assessment. In Bogotá, interventions for younger patients living in extreme poverty should be prioritized. Additionally, educational campaigns should be designed to address misconceptions about the disease mortality and treatment.
Availability of data and materials
The datasets generated during and analysed during the current study are not publicly available due to patient confidentiality. However, they are available from SDS (subject to further ethical approval) on reasonable request. Please contact the corresponding author in the first instance.
Acciones colectivas en salud
Area under the receiver operating characteristics
Champion’s revised health belief model
Health belief model
Least absolute shrinkage and selection operator
Secretaría distrital de salud
Arbyn M, Weiderpass E, Bruni L, de Sanjosé S, Saraiya M, Ferlay J, et al. Estimates of incidence and mortality of cervical cancer in 2018: a worldwide analysis. Lancet Glob Heal. 2020;8:e191-203.
Amin R, Kolahi AA, Jahanmehr N, Abadi AR, Sohrabi MR. Disparities in cervical cancer screening participation in Iran: a cross-sectional analysis of the 2016 nationwide STEPS survey. BMC Public Health. 2020;20:1–8.
Zhang X, Zeng Q, Cai W, Ruan W. Trends of cervical cancer at global, regional, and national level: data from the global burden of disease study 2019. BMC Public Health. 2021;21:1–10.
Tatari CR, Andersen B, Andersen B, Brogaard T, Badre-Esfahani SK, Badre-Esfahani SK, et al. Perceptions about cancer and barriers towards cancer screening among ethnic minority women in a deprived area in Denmark - a qualitative study. BMC Public Health. 2020;20:1–10.
Gultekin M, Ramirez PT, Broutet N, Hutubessy R. World Health organization call for action to eliminate cervical cancer globally. Int J Gynecol Cancer. 2020;30:426–7.
Vale DB, Teixeira JC, Bragança JF, Derchain S, Sarian LO, Zeferino LC. Elimination of cervical cancer in low- and middle-income countries: Inequality of access and fragile healthcare systems. Int J Gynecol Obstet. 2021;152:7–11.
Canfell K, Kim JJ, Brisson M, Keane A, Simms KT, Caruana M, et al. Mortality impact of achieving WHO cervical cancer elimination targets: a comparative modelling analysis in 78 low-income and lower-middle-income countries. Lancet. 2020;395:591–603. https://doi.org/10.1016/S0140-6736(20)30157-4.
Pilleron S, Cabasag CJ, Ferlay J, Bray F, Luciani S, Almonte M, et al. Cervical cancer burden in Latin America and the Caribbean: where are we? Int J Cancer. 2020. https://doi.org/10.1002/ijc.32956.
Hinman AR, Orenstein WA. Elimination of cervical cancer: lessons learned from polio and earlier eradication programs. Prev Med (Baltim). 2020;2021(144):106325. https://doi.org/10.1016/j.ypmed.2020.106325.
Hernández Vargas JA, Ramírez Barbosa PX, Gil Quijano AM, Valbuena AM, Acuña L, González JA. Patterns of breast, prostate and cervical cancer incidence and mortality in Colombia: an administrative registry data analysis. BMC Cancer. 2020;20:1097. https://doi.org/10.1186/s12885-020-07611-9.
Noman S, Shahar HK, Abdul Rahman H, Ismail S, Abdulwahid Al-Jaberi M, Azzani M. The effectiveness of educational interventions on breast cancer screening uptake, knowledge, and beliefs among women: a systematic review. Int J Environ Res Public Health. 2021. https://doi.org/10.3390/ijerph18010263.
Wu Y, Liang Y, Zhou Q, Liu H, Lin G, Cai W, et al. Effectiveness of a short message service intervention to motivate people with positive results in preliminary colorectal cancer screening to undergo colonoscopy: a randomized controlled trial. Cancer. 2019. https://doi.org/10.1002/cncr.32043.
Champion V, Skinner CS. The health belief model. Heal Behav Heal Educ Theory Res Pract. 2008;4:45–65.
Rosentock IM. What research in motivation suggests for public health. Am J Public Health Nat Health. 1960;50(3 Pt 1):295–302. https://doi.org/10.2105/ajph.50.3_pt_1.295.
Rosenstock IM, Strecher VJ, Becker MH. Social learning theory and the health belief model. Health Educ Q. 1988;15:175–83. https://doi.org/10.1177/109019818801500203.
Champion V. Use of the health belief model in determining frequency of breast self-examination. Res Nurs Health. 1985;8:373–9.
Ritchie D, Van den Broucke S, Van Hal G. The health belief model and theory of planned behavior applied to mammography screening: a systematic review and meta-analysis. Public Health Nurs. 2020. https://doi.org/10.1111/phn.12842.
Lau J, Lim T-Z, Wong GJ, Tan K-K. The health belief model and colorectal cancer screening in the general population: a systematic review. Prev Med Rep. 2020;20:101223.
Naz MSG, Simbar M, Fakari FR, Ghasemi V. Effects of model-based interventions on breast cancer screening behavior of women: a systematic review. Asian Pacific J Cancer Prev APJCP. 2018;19:2031.
Guvenc G, Akyuz A, Açikel CH. Health belief model scale for cervical cancer and pap smear test: psychometric testing. J Adv Nurs. 2011;67:428–37.
Aldohaian AI, Alshammari SA, Arafah DM. Using the health belief model to assess beliefs and behaviors regarding cervical cancer screening among Saudi women: a cross-sectional observational study. BMC Womens Health. 2019;19:1–12.
Smith M, Mercado-Sierra M. Health beliefs as a predictor of screening behaviors among college students. Soc Work Public Health. 2021;00:1–14. https://doi.org/10.1080/19371918.2021.1905130.
De Cuevas RMA, Saini P, Roberts D, Beaver K, Chandrashekar M, Jain A, et al. A systematic review of barriers and enablers to South Asian women’s attendance for asymptomatic screening of breast and cervical cancers in emigrant countries. BMJ Open. 2018;8:1–17.
Maseko TN, Huang HC, Lin KC. Cervical cancer screening behavior of African women: the Rosenstock health belief model assessment. Health Care Women Int. 2019. https://doi.org/10.1080/07399332.2019.1677665.
Vorsters A, Bosch FX, Bosch FX, Bonanni P, Franco EL, Baay M, et al. Prevention and control of HPV infection and HPV-related cancers in Colombia- a meeting report. BMC Proc. 2020;14(Suppl 9):1–13. https://doi.org/10.1186/s12919-020-00192-2.
Bermedo-Carrasco S, Peña-Sánchez JN, Lepnurm R, Szafron M, Waldner C. Inequities in cervical cancer screening among Colombian women: a multilevel analysis of a nationwide survey. Cancer Epidemiol. 2015;39:229–36.
Ministerio de Salud y Proteccion Social. Resolution 603280; 2018. https://www.minsalud.gov.co/Normatividad_Nuevo/Resolución No. 3280 de 20183280.pdf.
Ministerio de Salud y Protección Social. Resolution 276; 2019. http://achc.org.co/wp-content/uploads/2019/02/RES-276-19-Modifica-tiempos-para-implementación-acciones-Ruta-Perinatal.pdf.
Aldohaian AI, Alshammari SA, Arafah DM. Using the health belief model to assess beliefs and behaviors regarding cervical cancer screening among Saudi women: a cross-sectional observational study 11 Medical and Health Sciences 1117 Public Health and Health Services. BMC Womens Health. 2019;19:1–12.
Dantas LF, Fleck JL, Cyrino FL, Hamacher S. No-shows in appointment scheduling – a systematic literature review. Health Policy (New York). 2018;122:412–21. https://doi.org/10.1016/j.healthpol.2018.02.002.
Barrera Ferro D, Brailsford S, Bravo C, Smith H. Improving healthcare access management by predicting patient no-show behaviour. Decis Support Syst. 2020. https://doi.org/10.1016/j.dss.2020.113398.
Thomas L, Crook J, Edelman D. Credit scoring and its applications. 2nd ed. Philadelphia, PA: SIAM-Society for Industrial and Applied Mathematics; 2017.
Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc Ser B. 1996;58:267–88. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x.
Muthukrishnan R, Lasso Rohini R. A feature selection technique in predictive modeling for machine learning. In: 2016 IEEE International Conference on Advances in Computer Applications (ICACA); 2016. p. 18–20.
Verbeke W, Baesens B, Bravo C. Profit-driven model evaluation and implementation. Profit Driv Bus Anal. 2017. https://doi.org/10.1002/9781119443179.ch6.
Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: machine learning in python. J Mach Learn Res. 2011;12:2825–30.
Mabotja MC, Levin J, Kawonga M. Beliefs and perceptions regarding cervical cancer and screening associated with Pap smear uptake in Johannesburg: a crosssectional study. PLoS ONE. 2021;16(2):1–13. https://doi.org/10.1371/journal.pone.0246574.
Samami E, Seyedi-Andi S, Bayat B, Shojaeizadeh D, Tori N. The effect of educational intervention based on the health belief model on knowledge, attitude, and function of women about Pap smear test at Iranian health centers: a randomized controlled clinical trial. J Educ Health Promot. 2021. https://doi.org/10.4103/jehp.jehp_33_20.
Nigussie T, Admassu B, Nigussie A. Cervical cancer screening service utilization and associated factors among age-eligible women in Jimma town using health belief model. South West Ethiop BMC Womens Health. 2019;19:1–10.
Daryani S, Shojaeezadeh D, Batebi A, Charati JY, Naghibi A. The effect of education based on a health belief model in women’s practice with regard to the Pap smear test. J Cancer Policy. 2016;8:51–6. https://doi.org/10.1016/j.jcpo.2015.11.001.
Maharjan M, Thapa N, Panthi D, Maharjan N, Petrini MA, Jiong Y. Health beliefs and practices regarding cervical cancer screening among women in Nepal: a descriptive cross-sectional study. Nurs Heal Sci. 2020;22:1084–93.
Kocaöz S, Özçelik H, Talas MS, Akkaya F, Özkul F, Kurtuluş A, et al. The effect of education on the early diagnosis of breast and cervix cancer on the women’s attitudes and behaviors regarding participating in screening programs. J Cancer Educ. 2018;33:821–32.
Smith BM, Martinez RN, Evans CT, Saban KL, Balbale S, Proescher EJ, et al. Barriers and strategies for coordinating care among veterans with traumatic brain injury: a mixed methods study of VA polytrauma care team members. Brain Inj. 2018;32:755–62. https://doi.org/10.1080/02699052.2018.1444205.
Mahajan A, Harish SP, Urpelainen J. The behavioral impact of basic energy access: a randomized controlled trial with solar lanterns in rural India. Energy Sustain Dev. 2020;57:214–25. https://doi.org/10.1016/j.esd.2020.04.005.
Reis N, Bebis H, Kose S, Sis A, Engin R, Yavan T. Knowledge, behavior and beliefs related to cervical cancer and screening among Turkish women. Asian Pacific J Cancer Prev. 2012;13:1463–70.
Demirtas B, Acikgoz I. Promoting attendance at cervical cancer screening: understanding the relationship with Turkish womens’ health beliefs. Asian Pacific J Cancer Prev. 2013;14:333–40.
Williams-Brennan L, Gastaldo D, Cole DC, Paszat L. Social determinants of health associated with cervical cancer screening among women living in developing countries: a scoping review. Arch Gynecol Obstet. 2012;286:1487–505.
Liebermann EJ, VanDevanter N, Hammer MJ, Fu MR. Social and cultural barriers to women’s participation in pap smear screening programs in low- and middle-income Latin American and Caribbean countries: an integrative review. J Transcult Nurs. 2018;29:591–602.
Urrutia SMT. Creencias sobre Papanicolaou y cáncer cérvicouterino en un grupo de mujeres chilenas. Rev Chil Obstet Ginecol. 2012;77:3–10.
Gajardo M, Urrutia MT. Creencias sobre el cancer cervicouterino y Papanicolaou y su relación con la adherencia al tamizaje. Rev Chil Obstet Ginecol. 2017;82:706–12.
Agurto I, Bishop A, Sánchez G, Betancourt Z, Robles S. Perceived barriers and benefits to cervical cancer screening in Latin America. Prev Med (Baltim). 2004;39:91–8. https://doi.org/10.1016/j.ypmed.2004.03.040.
Paz Soldan VA, Lee FH, Carcamo C, Holmes KK, Garnett GP, Garcia P. Who is getting Pap smears in urban Peru? Int J Epidemiol. 2008;37:862–9.
Liebermann EJ, VanDevanter N, Shirazian T, Frías Gúzman N, Niles M, Healton C, et al. Barriers to cervical cancer screening and treatment in the dominican republic: perspectives of focus group participants in the santo domingo area. J Transcult Nurs. 2020;31:121–7.
Victoria SA, Racquel EK, Lucila S, Melisa P, Viswanath K, Silvina A. Knowledge and perceptions regarding triage among human papillomavirus–tested women: a qualitative study of perspectives of low-income women in Argentina. Women’s Heal. 2020. https://doi.org/10.1177/1745506520976011.
Ampofo AG, Adumatta AD, Owusu E, Awuviry-Newton K. A cross-sectional study of barriers to cervical cancer screening uptake in Ghana: an application of the health belief model. PLoS ONE. 2020;15:1–16. https://doi.org/10.1371/journal.pone.0231459.
Mehraban SSZ, Namdar A, Naghizadeh MM. Assessment of preventive behavior for cervical cancer with the health belief model. Asian Pacific J Cancer Prev. 2018;19:2155–63.
Gemeda EY, Kare BB, Negera DG, Bona LG, Derese BD, Akale NB, et al. Prevalence and predictor of cervical cancer screening service uptake among women aged 25 years and above in Sidama Zone, Southern Ethiopia using health belief model. Cancer Control. 2020;27:1–8. https://doi.org/10.1177/1073274820954460.
Simbar M, Ghazanfarpour M, Abdolahian S. Effects of training based on the health belief model on Iranian women’s performance about cervical screening: a systematic review and meta-analysis. J Educ Health Promot. 2020;9:179. https://doi.org/10.4103/jehp.jehp_684_19.
Arrossi S, Ramos S, Paolino M, Sankaranarayanan R. Social inequality in Pap smear coverage: identifying under-users of cervical cancer screening in Argentina. Reprod Health Matters. 2008;16:50–8.
Ng’Ang’ AA, Nyangasi M, Nkonge NG, Gathitu E, Kibachio J, Gichangi P, et al. Predictors of cervical cancer screening among Kenyan women: Results of a nested case-control study in a nationally representative survey. BMC Public Health. 2018. https://doi.org/10.1186/s12889-018-6054-9.
Weng Q, Jiang J, Haji FM, Nondo LH, Zhou H. Women’s knowledge of and attitudes toward cervical cancer and cervical cancer screening in Zanzibar, Tanzania: a cross-sectional study. BMC Cancer. 2020;20:1–12.
Ilevbare OE, Adegoke AA, Adelowo CM. Drivers of cervical cancer screening uptake in Ibadan. Nigeria Heliyon. 2020;6:e03505.
French LR, Turner KM, Sharp DJ, Morley H, Goldsworthy L, Hamilton-Shield J. Characteristics of children who do not attend their hospital appointments, and GPs’ response: a mixed methods study in primary and secondary care. Br J Gen Pract. 2017;67:e483–9.
Lu JC, Dorfman AL, Ghadimi Mahani M, Lowery R, Yu S, Agarwal PP. Predictors of missed appointments in patients referred for congenital or pediatric cardiac magnetic resonance. Pediatr Radiol. 2017;47:911–6.
Daye D, Carrodeguas E, Glover M, Guerrier CE, Harvey HB, Flores EJ. Impact of delayed time to advanced imaging on missed appointments across different demographic and socioeconomic factors. J Am Coll Radiol. 2018;15:713–20. https://doi.org/10.1016/j.jacr.2018.01.023.
Mohammadi I, Wu H, Turkcan A, Toscos T, Doebbeling BN. Data analytics and modeling for appointment no-show in community health centers. J Prim Care Community Heal. 2018. https://doi.org/10.1177/2150132718811692.
Musa J, Achenbach CJ, O’Dwyer LC, Evans CT, McHugh M, Hou L, et al. Effect of cervical cancer education and provider recommendation for screening on screening rates: a systematic review and meta-analysis. PLoS ONE. 2017;12:e0183924. https://doi.org/10.1371/journal.pone.0183924.
Annan FM, Oppong Asante K, Kugbey N. Perceived seriousness mediates the influence of cervical cancer knowledge on screening practices among female university students in Ghana. BMC Womens Health. 2019;19:1–8.
Brandt T, Wubneh SB, Handebo S, Debalkie G, Ayanaw Y, Alemu K, et al. Genital self-sampling for HPV-based cervical cancer screening: a qualitative study of preferences and barriers in rural Ethiopia. BMC Public Health. 2019;19:1026.
Quaife SL, Waller J, von Wagner C, Vrinten C. Cancer worries and uptake of breast, cervical, and colorectal cancer screening: a population-based survey in England. J Med Screen. 2018. https://doi.org/10.1177/0969141318796258.
Vrinten C, McGregor LM, Heinrich M, von Wagner C, Waller J, Wardle J, et al. What do people fear about cancer? A systematic review and meta-synthesis of cancer fears in the general population. Psychooncology. 2017;26:1070–9.
Murphy PJ, Marlow LAV, Waller J, Vrinten C. What is it about a cancer diagnosis that would worry people? A population-based survey of adults in England. BMC Cancer. 2018;18:1–10.
Rosenbaum JI, Hippe DS, Bhargava P, Gunn ML, Mieloszyk RJ, Hall CS. Understanding why patients no-show: observations of 2.9 million outpatient imaging visits over 16 years. J Am Coll Radiol. 2018;15:944–50. https://doi.org/10.1016/j.jacr.2018.03.053.
Srinivas S, Ravindran AR. Optimizing outpatient appointment system using machine learning algorithms and scheduling rules: a prescriptive analytics framework. Expert Syst Appl. 2018;102:245–61. https://doi.org/10.1016/j.eswa.2018.02.022.
Parente CA, Salvatore D, Gallo GM, Cipollini F. Using overbooking to manage no-shows in an Italian healthcare center. BMC Health Serv Res. 2018;18:1–12.
Black E, Hyslop F, Richmond R. Barriers and facilitators to uptake of cervical cancer screening among women in Uganda: a systematic review. BMC Womens Health. 2019;19:1–12.
Carr KC, Sellors JW. Cervical cancer screening in low resource settings using visual inspection with acetic acid. J Midwifery Womens Health. 2004;49:329–37. https://doi.org/10.1016/j.jmwh.2004.02.015.
Sivaram S, Majumdar G, Perin D, Nessa A, Broeders M, Lynge E, et al. Population-based cancer screening programmes in low-income and middle-income countries: regional consultation of the International Cancer Screening Network in India. Lancet Oncol. 2018;19:e113–22. https://doi.org/10.1016/S1470-2045(18)30003-2.
Denny L, de Sanjose S, Mutebi M, Anderson BO, Kim J, Jeronimo J, et al. Interventions to close the divide for women with breast and cervical cancer between low-income and middle-income countries and high-income countries. Lancet. 2017;389:861–70. https://doi.org/10.1016/S0140-6736(16)31795-0.
Arrossi S. The impact of the HPV test in screening programs in Latin America: the case of Argentina. Salud Publica Mex. 2019;61:86–94.
Arrossi S, Paolino M, Laudi R, Thouyaret L. Changing the paradigm of cervical cancer prevention through introduction of HPV-testing: evaluation of the implementation process of the Jujuy demonstration Project in Argentina. Ecancermedicalscience. 2021;15:1199. https://doi.org/10.3332/ecancer.2021.1199.
Flores YN, Bishai DM, Lőrincz A, Shah KV, Lazcano-Ponce E, Hernández M, et al. HPV testing for cervical cancer screening appears more cost-effective than Papanicolau cytology in Mexico. Cancer Causes Control. 2011;22:261–72.
Vale DB, Silva MT, Discacciati MG, Polegatto I, Teixeira JC, Zeferino LC. Is the HPV-test more cost-effective than cytology in cervical cancer screening? An economic analysis from a middle-income country. PLoS ONE. 2021;16:e0251688. https://doi.org/10.1371/journal.pone.0251688.
Weaver KR, Talley M, Mullins M, Selleck C. Evaluating patient navigation to improve first appointment no-show rates in uninsured patients with diabetes. J Community Health Nurs. 2019;36:11–8. https://doi.org/10.1080/07370016.2018.1555315.
Schwebel FJ, Larimer ME. Using text message reminders in health care services: a narrative literature review. Internet Interv. 2018;13(June):82–104. https://doi.org/10.1016/j.invent.2018.06.002.
Spadea T, Bellini S, Kunst A, Stirbu I, Costa G. The impact of interventions to improve attendance in female cancer screening among lower socioeconomic groups: a review. Prev Med (Baltim). 2010;50:159–64. https://doi.org/10.1016/j.ypmed.2010.01.007.
Brouwers MC, De Vito C, Bahirathan L, Carol A, Carroll JC, Cotterchio M, et al. What implementation interventions increase cancer screening rates? a systematic review. Implement Sci. 2011;6:111. https://doi.org/10.1186/1748-5908-6-111.
We would like to thank the Acciones Colectivas team at SDS for their support during this project. Particularly, Patrica Arce and Laura Arango for their engagement and the 280 community workers who were involved in data collection.
The first author’s research is partially funded by a PhD scholarship from the healthcare research stream of the program Colombia Científica–Pasaporte a la Ciencia, granted by the Colombian Institute for Educational Technical Studies Abroad (Instituto Colombiano de Crédito Educativo y Estudios Técnicos en el Exterior, ICETEX).
Ethics approval and consent to participate
This research was conducted following relevant guidelines provided by the Declaration of Helsinki. Pontificia Universidad Javeriana (Faculty of Engineering’s Research and Ethics Committee: FID-19–107), SDS (Ethics Committee for Health Research 2019EE47807) and the University of Southampton (Faculty of Social Sciences’ Ethics and Research Committee ERGO ID 48583.A1) granted ethical approval for this study. Prior to data collection, basic information about the project was provided to all participants and informed consent was obtained. SDS provided anonymised data for this study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Barrera Ferro, D., Bayer, S., Brailsford, S. et al. Improving intervention design to promote cervical cancer screening among hard-to-reach women: assessing beliefs and predicting individual attendance probabilities in Bogotá, Colombia. BMC Women's Health 22, 212 (2022). https://doi.org/10.1186/s12905-022-01800-3
- Cervical cancer screening
- Health belief model
- No-show prediction
- Hard-to-reach women