Skip to main content
Download PDF

Implementation of an mHealth intervention to increase adherence to triage among HPV positive women with HPV—self-collection (ATICA study): post-implementation evaluation from the women's perspective

BMC Women's Health volume 23, Article number: 332 (2023) Cite this article

Abstract

Background

Low adherence to triage after positive screening is a widespread problem for cervical cancer screening programs in Low- and Middle-income Countries. Adherence to cytology-based triage can be challenging, especially among women with self-collected tests. SMS-based interventions are accepted by women and can increase screening uptake. The ATICA study was an effectiveness-implementation hybrid type I trial, combining a cluster randomized controlled trial (RCT) with a mixed-methods implementation evaluation involving quantitative and qualitative methods. Although the RCT provided evidence regarding the effectiveness of the SMS-based intervention, less is known about its acceptability, relevance, and usefulness from the women´s perspective.

Methods

We carried out a cross-sectional study based on a structured questionnaire among HPV-positive women who were enrolled in ATICA's intervention group. We measured acceptability, appropriateness, and message content comprehension. Also, we evaluated if the SMS message was considered a cue to encourage women to pick up their HPV test results and promote the triage.

Results

We interviewed 370 HPV-positive women. Acceptability of SMS messages among women who had received at least one message was high (97%). We found high levels of agreement in all appropriateness dimensions. More than 77% of women showed high comprehension of the content. Among women who received at least one SMS message, 76% went to the health center to pick up their results. Among those who got their results, 90% reported that the SMS message had influenced them to go. We found no significant differences in acceptability, appropriateness or message comprehension between women who adhered to triage and those who did not adhere after receiving the SMS messages.

Conclusion

The intervention was highly acceptable, and women reported SMS was an appropriate channel to be informed about HPV test results availability. SMS was also a useful cue to go to the health center to pick up results. The implementation did not encounter barriers associated with the SMS message itself, suggesting the existence of other obstacles to triage adherence. Our results support the RCT findings that scaling up SMS is a highly acceptable intervention to promote cervical screening triage adherence.

Peer Review reports

Background

The development of the human papillomavirus (HPV) test has changed the cervical cancer screening paradigm. It is a highly sensitive screening method [1,2,3] and it has been demonstrated to reduce cervical cancer incidence and mortality [2]. In addition, it allows women to self-collect samples, which increases screening coverage, especially among underscreened women [4, 5]. In an HPV-test-based program, triage tests are key to identify which HPV-positive women need triage, diagnosis and treatment procedures. Adhering to triage after a positive HPV test can be challenging, especially for women who performed self-collected tests because screening occurs outside the medical facility. After a positive screening result, patients must receive screening results, understand the meaning of positive results, and take action on that information to continue along the screening process to triage. Studies carried out in Argentina and other Latin American countries showed that women who had performed self-collection were less likely to complete follow-up procedures than women who performed clinician-collected tests [6,7,8,9,10,11,12]. mHealth interventions (i.e. the use of mobile technologies for public health) improve the link between users and health providers and have increased medication compliance, or adherence to medical visits via reminders for diverse health problems, and in different settings [13,14,15,16,17,18,19,20,21]. Regarding cervical cancer prevention, evidence has suggested that SMS-based interventions are highly accepted and they have been demonstrated to increase screening uptake [21,22,23]. To evaluate the effectiveness and implementation of a multi-component mHealth intervention to increase adherence to triage Pap among women with HPV-positive self-collected test, we conducted the ATICA Study (Application of Communication and Information Technologies to Self-Collection, for its initials in Spanish) [24, 25]. It was a hybrid type I trial, that combined a cluster randomized controlled trial (RCT) with a mixed-methods evaluation [24]. The multi-component mHealth intervention included: 1) one weekly SMS message (four-week period), notifying women that HPV results were available at the health center, 2) an SMS message sent to Community Health Workers (CHWs) to visit those women who, after 60 days from the HPV result, had not registered triage Pap [24]. The intervention was designed based on the Health Belief Model as described in other publications. We expected that the mHealth intervention acted as a specific cue to action and increase adherence to triage [26]. Final results of ATICA RCT showed that the multi-component mHealth intervention was effective to increase adherence to triage. In addition, weekly SMS messages also increased adherence to triage Pap at day 60 (54% of HPV-positive women in the intervention group versus 33% in the control group) [25].

Even though the SMS message was designed in formative research with women [26] and the RCT results showed that it was effective to increase adherence to triage compared to usual care [25], 46% of women of the intervention group did not have triage Pap in 60 days after receiving SMS messages [25]. Therefore, evaluating the intervention from the user´s perspective is important to identify potential implementation barriers that may have affected triage adherence (e.g. low acceptability, inappropriate fit, or confusing content). Indeed, an SMS message about a sexually transmitted infection such as HPV must be constructed and sent with caution. Patients’ privacy and confidentiality need to be protected and at the same time, the message must be short, easy to understand, and also culturally appropriate [26, 27]. Not considering the user’s perceptions about content, design, and context are documented barriers to the acceptability and effectiveness of SMS-based health interventions in other settings [20, 28, 29]. Although there is increasing evidence regarding the effectiveness of mHealth interventions for cancer prevention, less is known about acceptability, relevance, and usefulness from the user´s perspective.

In this paper we report results of a post-implementation evaluation in which we analyzed women’s perceptions about the first component of ATICA – the SMS message. We assessed acceptability, appropriateness, comprehension, and perception of the effect of the intervention on their adherence to triage. These implementation outcomes complement RCT results on effectiveness and implementation previously published [25, 30]. and will contribute to a deeper understanding of ATICA’s approach and identify the implementation factors that should be considered in future scale up.

Methods

Setting

This study took place in Jujuy province, which is in northwest Argentina. Majority (85%) of its population lives in urban areas and 69% are women. Out of the total province population, 45% had public health insurance [31]. In 2021, mobile phone penetration in urban areas was 90% [32].

The public health sector includes a network of public hospitals and primary health care centers which mostly provide care to informal economy workers and unemployed people who are not covered by social security or private insurance. For the uninsured, health services are provided free of cost. Around 700 CHWs visit approximately 110,000 households twice per year for health services such as height/weight measurements and child vaccination. HPV-testing has been the primary screening method for cervical cancer prevention since 2012 [7], targeting women aged 30 years and older attending the public health system. The screening protocol in Jujuy has been described elsewhere[7]. Briefly, HPV-positive women are triaged with cytology. Women with ASCUS + are referred to colposcopy and biopsy if needed. Women with histologically confirmed CIN2 + are referred for treatment. HPV-negative women are recommended re-screening in five years. In 2014, HPV self-collection offered by CHWs during home visits was introduced as a programmatic strategy to increase screening coverage. If a woman performs self-collection at home, she is instructed to go to the health center within 30 days to retrieve her results and, if her results are positive, then she must have triage cytology at the health center [33].

Study design

The design and methods of the ATICA study have been extensively described elsewhere [24]. After the RCT endpoints were completed, a cross-sectional survey was conducted using a structured questionnaire among HPV-positive women who were enrolled in the intervention group.

Data collection and sample

The list of HPV-positive women and their contact details were extracted from ATICA RCT database [24]. Of the 3241 women who participated in the intervention group, 445 had an HPV-positive result. All HPV-positive women from the intervention group were contacted by trained interviewers for an in-person/phone interview [24]. Interviews took place between December 2019 and October 2020. We interviewed 370 (83%) HPV-positive women; 59 women could not be reached, 3 had died and 13 refused to answer the survey.

The questionnaire included open-ended questions with dimensions related to women’s perceptions about the implementation of the SMS messages: acceptability, appropriateness, comprehension, and perception of the effect of the of the SMS message on their adherence to triage as described below.

Outcome measures

Women’s characteristics

We extracted the following sociodemographic variables from the ATICA RCT database: Age; Area of residence (Urban/Rural); Education (Never went to school/primary incomplete, Primary complete/ secondary incomplete, and Completed secondary/tertiary incomplete/complete); Overcrowding (> 3 people/room); Household with children younger than 5 years-old (Yes/No); Health insurance (Public /Private or social security); Screening in the last 10 years (HPV test or Pap). We also measured variables related to the use of technology: shared phones with other family members (Yes/No); had a personal computer (Yes/No); had Internet access through their mobile phone (Yes/No); used social networks apps (e.g., Facebook, WhatsApp, etc.) (Yes/No).

Acceptability and appropriateness of the intervention

Following Proctor´s Taxonomy of Implementation Outcomes [34], we measured acceptability and appropriateness, which are essential to understand the success (or failure) of the implementation of an intervention from users’ perspective.

Acceptability was defined as the perception among women that the mHealth intervention (SMS message) is agreeable or satisfactory. We evaluated acceptability measuring the level of agreement with the statement: “An SMS message is a good communication channel to be informed that the HPV self-collection result is available at the health center”.

Appropriateness was defined as women´s perceived fit, relevance, or compatibility of the SMS message as a communication channel through which to be informed about the availability of the HPV self-collection result. As noted by Proctor et al., appropriateness is conceptually similar to acceptability, and the literature reflects overlapping terms when discussing these constructs [34]. Following Proctor’s Taxonomy, we preserved the distinction because a given intervention may be perceived as appropriate but not acceptable, and vice versa [35]. For example, the SMS message could be perceived as a good channel of communication but if its content is not appropriate for the target population, the intervention might fail. To evaluate appropriateness, we measured the level of agreement with statements related to different aspects of the intervention: usefulness, frequency and number of messages, confidentiality, personalization, credibility, and pertinence of content.

We used a 5-category response option to measure the level of agreement (Strongly agree, Agree, Neutral, Disagree, and Strongly disagree) with a set of statements related to acceptability and appropriateness dimensions (Table 1):

Table 1 Acceptability and appropriateness dimensions and statements
Full size table

Comprehension

We evaluated comprehension of the SMS message content with multiple questions. First, we measured the level of agreement (Strongly agree, Agree, Neutral, Disagree, and Strongly disagree) with the statements: “The SMS content was confusing” and “The message was cut off”. Second, we asked women to describe the key ideas of the message: “What are the most important ideas in that text message?” (See SMS content in Fig. 1). Finally, we asked for suggestions to improve the content of the SMS message.

Fig. 1
figure 1

SMS message content

Full size image

SMS message as a cue to action

Following the Health Belief Model, the SMS message was conceptualized as a specific cue to encourage women to pick up their HPV test results and promote the triage [26]. We evaluated the level in which the SMS message was considered cue to go to the health center and pick up the results with the following questions: picked up the results after receiving the SMS messages (yes/no), number of days between receiving the SMS message and going to the health center, and SMS message as a cue to help women to decide to go to the health center (yes/no).

The information about triage adherence at day 60 was extracted from RCT database.

Data analysis

We conducted a descriptive analysis using frequencies and percentages for each variable. We also calculated the percentage of agreement (strongly agree/agree responses) with acceptability and appropriateness statements: number of answers strongly agree/agree out of the total of women who responded. For multiple-choice questions (e.g., variable "understanding of the message"), the percentage of each option was calculated as follows: number of times an option was chosen out of the total mentioned options. All percentages of agreement with acceptability, appropriateness and comprehension statements were calculated among women who remember received SMS messages.

We compared acceptability, appropriateness, comprehension, and perception of SMS messages as a cue to action by triage adherence. Association between variables was determined using Chi-squared tests. Significance was assumed at a two-sided value of p < 0.05. We used R statistical software (version 3.5.0) for all analysis.

Results

Women characteristics

Out of 445 HPV-positive women, 370 answered the survey (83%; N = 370/445). There were no significant differences regarding sociodemographic characteristics between women who responded to the survey and those who did not (Table 2).

Table 2 Characteristics of HPV-positive women enrolled in ATICA intervention by follow-up survey response
Full size table

Characteristics of interviewed women by triage adherence are shown in Table 3. Nearly two-thirds (64%) were aged 30–49, 78.1% lived in urban areas, and 60.8% had completed secondary or attended some higher education. Over half (57%) had been screened in the last 10 years. Most (88%) had a mobile phone with internet access and 89% used social networks. Few (13%) shared phone with family members.

Table 3 Characteristics of interviewed women
Full size table

Seventy-eight percent (N = 289/370) of HPV-positive women remembered that they had received at least one SMS message from ATICA. This percentage was higher among women with Pap at day 60 (82% vs. 73%). Only 7% of women had not received the SMS messages due to problems with the registered phone number.

Acceptability and appropriateness of the SMS message

Acceptability of SMS messages among women who remembered that they had received at least one SMS message from ATICA was high (97.2%, n = 278/286) with no significant differences between women with vs. without triage Pap at day 60 (Table 4).

Table 4 Level of agreement with acceptability, appropriateness, and comprehension statements
Full size table

All positive dimensions related to appropriateness of the SMS message also showed a high level of agreement and the negative dimensions had low agreement (Table 4).

Nearly all (98.9%, N = 282/285) of women agreed that the SMS messages were useful to remind them to go to the health center. In addition, most women did not report problems with the number of SMS messages they received and found the message timing to be appropriate.

The relevance of the SMS content was also high, as more than 90% of interviewed women agreed with positive statements about the SMS content. Ninety-two percent of women felt that the SMS was intended for them. Importantly, fewer women who did not attend triage agreed with this statement (87.8% vs. 94.4%, p = 0.049). In addition, only 19.3% agreed with the statement “the content of the SMS messages seemed cold to me”. The personalization of the SMS message was positively valued: only 4.2% were bothered by having their name in the SMS.

Nearly a quarter (23.6%) of the respondents questioned the number from which they received the message, which was higher among women who did not adhere to triage Pap than those who did (31.7% vs. 19.9%, p = 0.003).

SMS message comprehension and preferences

The comprehension of the SMS message content was high with more than 77% of open-ended mentions indicating that women understood the SMS key ideas (That the result is available. I have to go to the health center. That it is important that I go. I have to go). Seventeen percent of women reported that the content was confusing. There were no significant differences between women with vs. without triage Pap (Table 4).

88.1% of women who received the SMS message would not change its content.

SMS as a cue to action

Among the women who remembered receiving at least one SMS message, 76% (220/289) went to the health center to pick up their result. Almost a quarter of women did not go to the health center. The main reasons for this were: CHWs or a Health professional informed the results during a home visit; working reason; childcare and domestic workload; a health condition that needed attention; they thought that a CHW was going to call or visit them, and they did know where to pick it up.

Among those who picked up results, 90% (n = 199/220) reported that the SMS message had influenced them to go. Although this percentage was higher (91.4% vs. 88.4%) among women who adhered to triage Pap, it was not significantly different (p = 0.485). Sixty-nine percent of women went to the health center within 7 days after receiving the message, including 7.5% who went on the same day they received the SMS. The median time to go to the health center was 3.5 days after receiving the SMS.

Among the women who went to the health center to pick up HPV test results, 20.9% (n = 46/220) did not know the HPV result in the first attempt. The main reasons for this were: “the hospital had not sent the results to the health center” (39%), “the person who delivers the results (e.g. gynecologist) was not present in that moment (23%), and “additional appointment needed” (12.2%). Among these women, 76% (n = 35/46) returned at least once (average 2 times; range 1–7 times).

Discussion

To our knowledge this is the first study that evaluated implementation outcomes of a mHealth intervention which effectively increased adherence to triage Pap among HPV-positive women in a Latin American country. Our post-intervention study showed high acceptability among women. All dimensions related to appropriateness also reported a high level of agreement: most women mentioned that the intervention was useful, positively valued the content, and found the number of messages and their timing were adequate. In addition, the comprehension of the SMS message content was high, and most women perceived the SMS message as a tool that influenced them to go to the health center to get their results. Findings showed high acceptability, appropriateness, and comprehension of the SMS message among HPV-positive women with no significant differences by triage adherence after receiving the SMS messages. These results are important as lack of comprehension of the SMS, as well as its low acceptability by the target population have been indicated in the literature as a main obstacle for effectiveness of mHealth strategies. These findings provide a comprehensive understanding of the effectiveness reported in ATICA trial [25], and could contribute to future scale up of the intervention.

High acceptability of an mHealth intervention is key to understanding its success [18]. Women’s acceptability of the intervention was high. Most considered that an SMS message was a good communication channel to be informed that the HPV self-collection result was available at the health center. The high acceptability reported in our study is consistent with results from other studies that showed that mobile interventions were an acceptable way of providing reminders for medication or appointments [35]. This high acceptability among women in ATICA is related to the women´s positive perceptions about the appropriateness of the message. Regarding the pertinence of content, most women mentioned that the health center was taking care of them and felt that the message was intended for them. However, the percentage of women who felt that the message was intended for them was slightly lower among women without triage. Other studies showed that participants indicated that the tone and content of the message could influence their acceptance and their engagement with the messages [36,37,38,39,40]. The SMS content and tone were carefully designed and pilot tested [26], which are key elements for the success of mHealth interventions [35, 41]. In addition, personalization of the message, including women´s names, was accepted by most women. ATICA results are similar to other studies that evaluated SMS-based health promotion intervention in which personalized SMS messages (e.g. with the recipient’s name) have been associated with greater intervention efficacy [35, 41]. High acceptability and appropriateness of the intervention are consistent with the effectiveness proved in the RCT. Our results on effectiveness and implementation showed that SMS messages could be a good option to send health information related to the availability of HPV results in low and middle resource settings.

Legitimacy of the sender is key to engagement with SMS-based interventions [36]. In our evaluation, we observed that mistrustful of the sender was higher among women without triage (32% vs. 20%). Results of ATICA´s formative research highlighted the need for messages to come from a trusted source. Similar recommendations have been made in a study on HIV testing among African immigrants in the United Kingdom [42]. Several studies have found that participants’ perceptions of the message source or sender could influence their perception of the intervention’s credibility and value [42,43,44,45]. Many studies suggest that the sender should be known and identifiable, otherwise recipients were more likely to ignore or delete the message [40, 43]. These results underscore that a trustworthy sender is a key element to be considered in future scale up to engage the recipient and to achieve high adherence to triage.

Low comprehension of the content of the message could be a potential barrier to the effectiveness of an SMS-based intervention [46]. In our study, most women mentioned that the message was clear and correctly interpreted its meaning. Our results support others’ findings on the importance of a careful development of message content [40, 47, 48] with attention to use of simple and clear language [49,50,51]. A study conducted in Chile about SMS preferences of under-screened women showed that clarity and simplicity of the message were very important for them [27]. A systematic review of qualitative studies about user´s perceptions of and experiences with mHealth interventions, showed that participants wanted short and concise messages that were easy to understand [35]. Thus, our results emphasized the need to adapt SMS content to the specific cultural context and intervention goals in order to guarantee high acceptability, effectiveness, and scalability of SMS-based health interventions.

Privacy and confidentiality issues, such as disclosing a result to a third-person in shared cellphones, are paramount for SMS-based health intervention [52, 53]. Several authors have noted that confidentiality is a challenge for SMS delivered to shared mobile phones to promote the treatment of sexually transmitted infections. In studies on sexually transmitted infections and SMS interventions, the main concern mentioned regarding confidentiality was the danger of disclosing results among relatives [54, 55]. In our study, only 10% of women did not like the SMS because a family member might read it, though there were not differences between women with and without Pap at day 60. These results suggest SMS message privacy was not raised as a serious concern. Although our protocol initially stipulated that the SMS message would include the HPV result, our previous formative research indicated that women preferred not to receive it, as they raised concerns about confidentiality, and considered that result delivery was a responsibility of a health professional. Using neutral language and tailoring the content are strategies that could contribute to dealing with confidentiality and privacy issues [35]. In our study, the SMS message only mentioned the term “self-collection”, and informed women about the test result availability and the importance of attending the health centre [24,25,26]. Omitting the result and the term HPV-testing in the SMS message might have reduced worries related to privacy and increased the intervention acceptability.

Several studies have shown the effectiveness of SMS-based strategies as reminders to increase adherence to medical visits [35]. In our study almost 100% of women considered that the SMS was useful to remind them to go to the health center to pick up results and 90% of women who went to the health center to pick up the result mentioned that the SMS message had influenced them to go. In addition, 50% of women went to the health center promptly—less than 4 days after receiving the message—and in some cases, the same day they received the SMS message. These results complement the ones related to the effectiveness reported in ATICA trial. The intervention significantly decreased the time to triage, showing that the triage level of 50% was reached around day 50 in the intervention group and around day 100 in the control group [25]. SMS works as a cue to action and improves adherence to triage, not only increasing the number of women that access to it but also reducing access time. This reduction could contribute to improving time to access to other steps of cancer care continuum such as diagnosis and treatment.

Our results showed high acceptability, appropriateness, and comprehension of the SMS message with no significant differences by triage Pap adherence at day 60 after receiving the SMS messages. These results indicate that the implementation of the intervention did not encounter barriers associated with the characteristics of the SMS message itself, suggesting the existence of other barriers to triage adherence. In fact, around 20% of women who went to the health center after receiving the SMS did not know the HPV result in the first attempt due to institutional barriers. Several studies showed that main barriers to follow up among women with positive screening results were related to institutional barriers, such as delays in result delivery or not receiving results, lack of appointments, or lack of human resources to take the samples [56, 57]. The use of a highly acceptable, low cost mHealth strategy, like ATICA’s SMS messages, could facilitate communication between women and providers and improve this critical step (i.e., delivery of results) in the cancer care continuum. However, to improve its effectiveness, the SMS-based intervention must be accompanied by improvements at the institutional level to guarantee timely access to triage, colposcopy, and treatment if needed.

Like all studies, there are some limitations to this analysis that must be taken into account. Due to COVID-19 pandemic the field work was interrupted, and it was not possible to contact all HPV positive women. However, sociodemographic characteristics of responding and non-responding women were similar. In addition, a low proportion of women were interviewed by phone between September and October 2020 with potential recall bias. It is also possible that courtesy bias could have resulted in an over-estimation of the acceptability of the SMS strategy.

Conclusion

Results from this post-intervention survey showed that the ATICA mHealth intervention was highly accepted among the target population. The intervention was perceived as an appropriate communication channel to be informed about HPV test result availability and as a useful cue to go to the health center to pick up results. Our findings contribute to a more comprehensive understanding of the effectiveness achieved in the ATICA RCT and provided evidence that could be useful for scaling up the intervention in similar settings.

Availability of data and materials

De-identified individual participant data on which summary statistics and tables are based will be made available from the point of, and up to five years after the acceptance for publication of the main findings. These data can be requested to the Principal Investigator (Dr. Silvina Arrossi) and only under a data-sharing agreement. Other materials such as forms and questionnaires will be made freely available upon request which can be made to the Principal Investigator.

Abbreviations

ASCUS + :

Atypical Squamous Cells of Undetermined Significance or worse.

CHWs:

Community Health Workers

CIN2 + :

Cervical Intraepithelial Neoplasia grade 2 or worse.

HPV:

Human papillomavirus

LMIC:

Low- and Middle-Income Countries

RCT:

Cluster randomized controlled trial

SMS:

Short messaging service

References

  1. Sankaranarayanan R, Nene BM, Shastri SS, et al. HPV screening for cervical cancer in rural India. N Engl J Med. 2009;360:1385–94.

    Article  CAS  PubMed  Google Scholar 

  2. Bouvard V, Wentzensen N, Mackie A, et al. The IARC perspective on cervical cancer screening. N Engl J Med. 2021;385(20):1908–18. https://doi.org/10.1056/NEJMsr2030640.

    Article  PubMed  Google Scholar 

  3. IARC (2022). Cervical cancer screening. IARC Handb Cancer Prev. 18:1–456. Available from: https://publications.iarc.fr/604.

  4. Arbyn M, Smith SB, Temin S, Sultana F, Castle P. Collaboration on self-sampling and HPV testing. Detecting cervical precancer and reaching underscreened women by using HPV testing on self-samples: updated meta-analyses. BMJ. 2018;363:4823.

    Article  Google Scholar 

  5. Arrossi S, Thouyaret L, Herrero R, et al. Effect of self-collection of HPV DNA offered by community health workers at home visits on uptake of screening for cervical cancer (the EMA study): a population-based cluster-randomised trial. Lancet Glob Health. 2015;3:e85-94.

    Article  PubMed  Google Scholar 

  6. Fernández-Deaza G, Caicedo-Martínez M, Serrano B, Roura E, Castillo JS, De Sanjosé S, Bruni L, Murillo R. Cervical cancer screening programs in Latin America: current recommendations for facing elimination challenges. Salud Publica Mex. 2022;64(4, jul-ago):415–23. https://doi.org/10.21149/13204. (PMID: 36130384).

    Article  PubMed  Google Scholar 

  7. Arrossi S, Paolino M, Laudi R, et al. Programmatic human papillomavirus testing in cervical cancer prevention in the Jujuy Demonstration Project in Argentina: a population-based, before-and-after retrospective cohort study. Lancet Global Health. 2019;7:772–83. https://doi.org/10.1016/S2214-109X(19)30048-8.

    Article  Google Scholar 

  8. Arrossi S, Paolino M, Thouyaret L, et al. Evaluation of scaling-up of HPV self-collection offered by community health workers at home visits to increase screening among socially vulnerable under-screened women in Jujuy Province Argentina. Implement Sci. 2017;12:17. https://doi.org/10.1186/s13012-017-0548-1.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Sancho-Garnier H, Tamalet C, Halfon P, et al. HPV self-sampling or the Pap-smear: a randomized study among cervical screening non-attenders from lower socioeconomic groups in France. Int J Cancer. 2013;133(11):2681–7. https://doi.org/10.1002/ijc.28283.

    Article  CAS  PubMed  Google Scholar 

  10. Holme F, Maldonado F, Martinez-Granera OB, et al. HPV-based cervical cancer screening in Nicaragua: from testing to treatment. BMC Public Health. 2020;20(1):495. https://doi.org/10.1186/s12889-020-08601-z.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Paolino M, Gago J, Pera AL, Cinto O, Thouyaret L, Arrossi S. Adherence to triage among women with HPV-positive self-collection: a study in a middle-low income population in Argentina. Ecancermedicalscience. 2020;10(14):1138. https://doi.org/10.3332/ecancer.2020.1138.

    Article  Google Scholar 

  12. Zapka J, Taplin S, Anhang Price R, et al. Factors in quality care—the case of follow-up to abnormal cancer screening tests—problems in the steps and interfaces of care. J Natl Cancer Inst Monogr. 2010;40:58–71. https://doi.org/10.1093/jncimonographs/lgq009.

    Article  Google Scholar 

  13. Kannisto KA, Koivunen MH, Välimäki MA. Use of mobile phone text message reminders in health care services: a narrative literature review. J Med Int Res. 2014;16(10):e222. https://doi.org/10.2196/jmir.3442.

    Article  Google Scholar 

  14. Hamine S, Gerth-Guyette E, Faulx D, Green BB, Ginsburg AS. Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review. J Med Internet Res. 2015;17(2):1–15. https://doi.org/10.2196/jmir.3951.

    Article  Google Scholar 

  15. Beratarrechea A, Lee AG, Willner JM, Jahangir E, Ciapponi A, Rubinstein A. The impact of mobile health interventions on chronic disease outcomes in developing countries: a systematic review. Telemed J E Health. 2014. https://doi.org/10.1089/tmj.2012.0328.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Nglazi MD, Bekker L, Wood R, Hussey GD, Wiysonge CS. Mobile phone text messaging for promoting adherence to anti-tuberculosis treatment: a systematic review protocol. Syst Rev. 2013;16(2):6. https://doi.org/10.1186/2046-4053-2-6.

    Article  Google Scholar 

  17. Bloomfield GS, Vedanthan R, Vasudevan L, Kithei A, Were M, Velazquez EJ. Mobile health for non-communicable diseases in Sub-Saharan Africa: a systematic review of the literature and strategic framework for research. Global Health. 2014;13(10):49. https://doi.org/10.1186/1744-8603-10-49.

    Article  Google Scholar 

  18. Barello S, Triberti S, Graffigna G, Libreri C, Serino S, Hibbard J, et al. eHealth for patient engagement: a systematic review. Front Psychol. 2015;6:2013. https://doi.org/10.3389/fpsyg.2015.02013.

    Article  PubMed  Google Scholar 

  19. Hamine S, Gerth-Guyette E, Faulx D, Green BB, Ginsburg AS. Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review. J Med Internet Res. 2015;17(2):e52. https://doi.org/10.2196/jmir.3951.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Hall CS, Fottrell E, Wilkinson S, Byass P. Assessing the impact of mHealth interventions in low- and middle-income countries–what has been shown to work? Glob Health Action. 2014;7:25606. https://doi.org/10.3402/gha.v7.25606.

    Article  PubMed  Google Scholar 

  21. Uy C, Lopez J, Trinh-Shevrin C, Kwon SC, Sherman SE, Liang PS. Text messaging interventions on cancer screening rates: a systematic review. J Med Internet Res. 2017;19(8):1–12. https://doi.org/10.2196/jmir.789.

    Article  Google Scholar 

  22. Rashid RM, Ramli S, John J, Dahlui M. Cost effective analysis of recall methods for cervical cancer screening in Selangor–results from a prospective randomized controlled trial. Asian Pac J Cancer Prev. 2014;15(13):5143–7. https://doi.org/10.7314/apjcp.2014.15.13.5143.

    Article  PubMed  Google Scholar 

  23. Ganta V, Moonie S, Patel D, Hunt AT, Richardson J, Di John D, et al. Timely reminder interventions to improve annual Papanicolaou (Pap) smear rates among HIV-infected women in an outpatient center of southern Nevada: a short report. AIDS Care. 2017;29(9):1099–101. https://doi.org/10.1080/09540121.2017.1322677.

    Article  PubMed  Google Scholar 

  24. Arrossi S, Paolino M, Orellana L, Thouyaret L, Kohler RE, Viswanath K. Mixed-methods approach to evaluate an mHealth intervention to increase adherence to triage of human papillomavirus-positive women who have performed self-collection (the ATICA study): Study protocol for a hybrid type i cluster randomized effectiveness-imp. Trials. 2019;20(1):148. https://doi.org/10.1186/s13063-019-3229-3.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Arrossi S, Paolino M, Sánchez Antelo V, Thouyaret L, Kohler REE, Cuberli M, Orellana L. Effectiveness of an mHealth intervention to increase adherence to triage of HPV DNA positive women who have performed self-collection (the ATICA study): A hybrid type I cluster randomised effectiveness-implementation trial. Lancet Reg Health - Am. 2022;9(Cc):100199. https://doi.org/10.1016/j.lana.2022.100199.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Sanchez Antelo V, Kohler RE, Curotto M, Viswanath KV, Paolino M, Arrossi S. Developing SMS content to promote papanicolaou triage among women who performed HPV self-collection test: qualitative study. JMIR Form Res. 2020;4(3):1–14. https://doi.org/10.2196/14652.

    Article  Google Scholar 

  27. Soto M, Martinez-Gutierrez J, Momany M, Capurro D, Ciampi Spode F, Cea E, Puschel K. Preferences of underserved chilean women on a mobile technology intervention for cervical cancer screening: Qualitative study. JMIR Mhealth Uhealth. 2018;6(11):1–9. https://doi.org/10.2196/mhealth.9494.

    Article  Google Scholar 

  28. Kruse C, Betancourt J, Ortiz S, Valdes Luna SM, Bamrah IK, Segovia N. Barriers to the use of mobile health in improving health outcomes in developing countries: systematic review. J Med Internet Res. 2019;21(10):13263. https://doi.org/10.2196/13263. (PMID: 31593543; PMCID: PMC6811771).

    Article  Google Scholar 

  29. Linde DS, Andersen MS, Mwaiselage J, Manongi R, Kjaer SK, Rasch V. Effectiveness of one-way text messaging on attendance to follow-up cervical cancer screening among human papillomavirus- positive tanzanian women (Connected2Care): parallel-group ran- domized controlled Trial. J Med Internet Res. 2020;22:e15863. https://doi.org/10.2196/15863.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Straw C, Sanchez-Antelo V, Kohler R, Paolino M, Viswanath K, Arrossi S. Implementation and scaling-up of an effective mHealth intervention to increase adherence to triage of HPV-positive women (ATICA study): perceptions of health decision-makers and health-care providers. BMC Health Serv Res. 2023;23(1):47. https://doi.org/10.1186/s12913-023-09022-5.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Jujuy Province. DiPEC (Dirección Provincial de Estadística y Censos). San Salvador Datos Censales URL: http://dipec.jujuy.gob.ar/indicadores-sociales/salud/#183-187-cobertura-de-salud

  32. Instituto Nacional de Estadisticas y Censos (INDEC). Uso tecnología Acceso y uso de tecnologías de la información y la comunicación. EPH Cuarto trimestre de 2021. Informes Técnicos. Vol. 6, no 89. Ciencia y tecnología. Vol. 6, no 1, Buenos Aires. https://www.indec.gob.ar/uploads/informesdeprensa/mautic_05_22843D61C141.pdf.

  33. Arrossi S, Thouyaret L, Paul L. Recomendaciones para el tamizaje, seguimiento y tratamiento de mujeres para la prevencion del cancer cervico-uterino en el marco de la incorporacion de la prueba de VPH. Buenos Aires: Ministerio de Salud de la Nacion; 2015. [cited 2021 September]. Available from: https://bancos.salud.gob. ar/recurso/recomendaciones-para-el-tamizaje-seguimiento-y-trata miento-de-mujeres-para-la-prevencion.

  34. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. https://doi.org/10.1007/s10488-010-0319-7.

    Article  PubMed  Google Scholar 

  35. Ames HM, Glenton C, Lewin S, Tamrat T, Akama E, Leon N. Clients’ perceptions and experiences of targeted digital communication accessible via mobile devices for reproductive, maternal, newborn, child, and adolescent health: a qualitative evidence synthesis. Cochrane Database Syst Rev. 2019;10(10):CD013447. https://doi.org/10.1002/14651858.CD013447.

    Article  PubMed  Google Scholar 

  36. Cates JR, Ortiz RR, North S, Martin A, Smith R, Coyne-Beasley T. Partnering with middle school students to design text messages about HPV vaccination. Health Promot Pract. 2015;16(2):244–55.

    Article  PubMed  Google Scholar 

  37. Curioso WH, Quistberg DA, Cabello R, Gozzer E, Garcia PJ, Holmes KK, Kurth AE. “It’s time for your life”: How should we remind patients to take medicines using short text messages? AMIA Annu Symp Proc. 2009;2009:129–33.

    PubMed  PubMed Central  Google Scholar 

  38. French RS, McCarthy O, Baraitser P, Wellings K, Bailey JV, Free C. Young people’s views and experiences of a mobile phone texting intervention to promote safer sex behavior. JMIR Mhealth Uhealth. 2016;4(2):e26. https://doi.org/10.2196/mhealth.4302.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Munro S, Hui A, Salmons V, Solomon C, Gemmell E, Torabi N, Janssen PA. SmartMom text messaging for prenatal education: a qualitative focus group study to explore Canadian women’s perceptions. JMIR Public Health Surveill. 2017;3(1):e7. https://doi.org/10.2196/publichealth.6949.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Menacho LA, Blas MM, Alva IE, Orellana ER. Short text messages to motivate HIV testing among men who have sex with men: a qualitative study in Lima Peru. Open AIDS J. 2013;7:1.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Head KJ, Noar SM, Iannarino NT, Grant HN. Efficacy of text messaging-based interventions for health promotion: a meta-analysis. Soc Sci Med. 2013;97:41–8. https://doi.org/10.1016/j.socscimed.2013.08.003.

    Article  PubMed  Google Scholar 

  42. Evans C, Turner K, Suggs LS, Occa A, Juma A, Blake H. Developing a mHealth intervention to promote uptake of HIV testing among African communities in the UK: a qualitative study. BMC Public Health. 2016;16(1):656.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Greaney ML, De Jesus M, Sprunck-Harrild KM, Tellez T, Bastani R, Battaglia TA, et al. Designing audience-centered interactive voice response messages to promote cancer screenings among low-income Latinas. Prev Chronic Dis. 2014;11:130213. https://doi.org/10.5888/pcd11.130213.

    Article  Google Scholar 

  44. Rana Y, Haberer J, Huang H, Kambugu A, Mukasa B, Thirumurthy H, et al. Short message service (SMS)-based intervention to improve treatment adherence among HIV- positive youth in Uganda: focus group findings. PLoS ONE. 2015;10(4): e0125187.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Rodrigues R, Poongulali S, Balaji K, Atkins S, Ashorn P, De Costa A. “The phone reminder is important, but will others get to know about my illness?” Patient perceptions of an mHealth antiretroviral treatment support intervention in the HIVIND trial in South India. BMJ Open. 2015;5(11): e007574.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Moodley J, Constant D, Botha MH, van der Merwe FH, Edwards A, Momberg M. Exploring the feasibility of using mobile phones to improve the management of clients with cervical cancer precursor lesions. BMC Womens Health. 2019;19(1):2. https://doi.org/10.1186/s12905-018-0702-1.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Maar MA, Yeates K, Toth Z, Barron M, Boesch L, Hua-Stewart D, et al. Unpacking the Black Box: a formative research approach to the development of theory-driven, evidence-based, and culturally safe text messages in mobile health interventions. JMIR Mhealth Uhealth. 2016;4(1):e10. https://doi.org/10.2196/mhealth.4994. (FREE Full text Medline: 26800712).

    Article  PubMed  PubMed Central  Google Scholar 

  48. Braciszewski JM, Tran TB, Moore RS, Bock BC, Tzilos GK, Chamberlain P, et al. Developing a tailored texting preventive intervention: a card sort methodology. J Appl Biobehav Res. 2017;22(2):pii: e12060. https://doi.org/10.1111/jabr.12060. (Medline: 28694680).

    Article  Google Scholar 

  49. Abroms LC, Whittaker R, Free C, van Alstyne JM, Schindler-Ruwisch JM. Developing and pretesting a text messaging program for health behavior change: recommended steps. JMIR Mhealth Uhealth. 2015;3(4):e107. https://doi.org/10.2196/mhealth.4917. (FREE Full text Medline: 26690917).

    Article  PubMed  PubMed Central  Google Scholar 

  50. Campbell JI, Aturinda I, Mwesigwa E, Burns B, Santorino D, Haberer JE, et al. The technology acceptance model for resource-limited settings (TAM-RLS): a novel framework for mobile health interventions targeted to low-literacy end-users in resource-limited settings. AIDS Behav. 2017;21(11):3129–40. https://doi.org/10.1007/s10461-017-1765-y.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Odeny TA, Newman M, Bukusi EA, McClelland RS, Cohen CR, Camlin CS. Developing content for a mHealth intervention to promote postpartum retention in prevention of mother-to-child HIV transmission programs and early infant diagnosis of HIV: a qualitative study. PLoS One. 2014;9(9):e106383. https://doi.org/10.1371/journal.pone.0106383.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  52. Giguere R, Brown W III, Balán IC, Dolezal C, Ho T, Sheinfil A, Ibitoye M, Lama JR, McGowan I, Cranston RD, Carballo-Diéguez A. Are participants concerned about privacy and security when using short message service to report product adherence in a rectal microbicide trial? J Am Med Inform Assoc. 2018;25(4):393–400. https://doi.org/10.1093/jamia/ocx081.

    Article  PubMed  Google Scholar 

  53. Ronen K, Unger JA, Drake AL, Perrier T, Akinyi P, Osborn L, Matemo D, O’Malley G, Kinuthia J, John-Stewart G. SMS messaging to improve ART adherence: perspectives of pregnant HIV-infected women in Kenya on HIV-related message content. AIDS Care. 2018;30(4):500–5. https://doi.org/10.1080/09540121.2017.1417971.

    Article  PubMed  Google Scholar 

  54. Jennings L, Ong’ech J, Simiyu R, Sirengo M, Kassaye S. Exploring the use of mobile phone technology for the enhancement of the prevention of mother-to-child transmission of HIV program in Nyanza, Kenya: a qualitative study. BMC Public Health. 2013;13:1131. https://doi.org/10.1186/1471-2458-13-1131.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Nachega JB, Skinner D, Jennings L, Magidson J, Altice F, Burke J, et al. Acceptability and feasibility of mHealth and community-based directly observed antiretroviral therapy to prevent mother-to-child HIV transmission in South African pregnant women under Option B+: an exploratory study. Patient Prefer Adherence. 2016;10:683–90. https://doi.org/10.2147/PPA.S100002.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Paolino M, Sankaranarayanan R, Arrossi S. Determinantes sociales del abandono del diagnóstico y el tratamiento de mujeres con Papanicolaou anormal en Buenos Aires, Argentina [Social determinants of dropout from diagnosis and treatment by women with abnormal Pap smears in Buenos Aires, Argentina]. Rev Panam Salud Publica. 2013;34(6):437–45.

    PubMed  Google Scholar 

  57. Paolino M, Arrossi S. Analysis of the reasons for abandoning the follow-up and treatment process in women with pre-cancerous cervical lesions in the province of Jujuy: implications for health management. Salud Colect. 2012;8(3):247–61. https://doi.org/10.1590/S1851-82652012000400003. (Spanish).

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank the interviewers who carried out the women survey. We also thanks Julieta Zalacain Colombo, Mariana Curotto, Milca Cuberli and Laura Thouyaret for their comments of the preliminary draft of the structure questionary, Fernando Binder and Juan David Mazzadi for their support in data processing and Marisa D`Alessandro for her help in English edition. Finally, we especially thank the women who participated in the study.

Funding

ATICA study was funded by the National Cancer Institute of the National Institutes of Health under Award Number R01CA218306. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. ATICA study was led by the Center for the Study of State and Society, in association with the Dana Farber Cancer Institute/Harvard T.H. Chan School of Public Health, USA, Deakin University, Australia, and Rutgers University, USA, with support and in collaboration from the Argentinean National Cancer Institute and the Jujuy Ministry of Health.

Author information

Authors and Affiliations

  1. Centre for the Study of State and Society, National Council for Scientific and Technical Research AR, Buenos Aires, Argentina

    Melisa Paolino, Victoria Sánchez Antelo & Silvina Arrossi

  2. Cancer Health Equity, Cancer Institute of New Jersey, Rutgers - the State University of New Jersey, New Jersey, USA

    Racquel E. Kohler

  3. Department of Social and Behavioral Sciences, Harvard T.H. Chan School of Public Health, Harvard University, Boston, USA

    Kasisomayajula Viswanath

Authors
  1. Melisa Paolino
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Victoria Sánchez Antelo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Racquel E. Kohler
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kasisomayajula Viswanath
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Silvina Arrossi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study design and analysis. SA was the principal investigator. MP and VSA led data analysis and interpretation, and writing of the first draft of the manuscript, in consultation with SA; VSA, RK, and KV made substantial contributions to the conception and design of the study, data analysis, and made a critical revision of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Melisa Paolino.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Bioethics Review Committee of Jujuy’s Ministry of Health and the CEMIC’s Institutional Review Boards, Harvard T.H Chan School of Public Health and Rutgers University, and the Deakin University Human Research Ethics Committee. All participant women signed an informed consent and all methods were carried out in accordance with the Declaration of Helsinki. The trial has been registered in ClinicalTrials.gov (NCT03478397, Registered on 20 March 2018). Data collection was carried out using specific instruments and data storage was done with appropriate security, privacy and automatic backup system. All data was treated as confidential and kept for as long as required by The Argentinean Personal Data Protection Law No. 25,326. Each participating subject was assigned a unique study identification number with a defined format. All the participant’s forms and electronic records will be identified with this unique number. Access to the database will be restricted to the principal investigator of the study and the authorized working group.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Paolino, M., Sánchez Antelo, V., Kohler, R.E. et al. Implementation of an mHealth intervention to increase adherence to triage among HPV positive women with HPV—self-collection (ATICA study): post-implementation evaluation from the women's perspective. BMC Women's Health 23, 332 (2023). https://doi.org/10.1186/s12905-023-02475-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12905-023-02475-0

Keywords

BMC Women's Health

ISSN: 1472-6874

Contact us