mHealth. Dhillon L, Vaca S. Refining theories of change. Reflexive TA | the basics ... »Why are we critical of the notion that ‘themes emerged’ from data? Flynn R, Rotter T, Hartfield D, et al. Thematic framework analysis enabled comparison on a case-by-case basis. Combining the terms (‘MAMA South Africa’ AND ‘MomConnect program’) resulted in 86 additional documents, resulting in 352 documents. Mmusi-Phetoe RMM. One of the Sustainable Development Goals is to reduce the global maternal mortality ratio to less than 70 per 100,000 live births by 2030. Evans WD, Abroms LC, Poropatich R, et al. A realist diagnostic workshop. List of documents containing clauses for MomConnect program (n = 22) the Document was ordered by date of publication. Atkins L, Francis J, Islam R, et al. 0000006998 00000 n Tugas Translate Jurnal Assessing the Perspectives of Users and Beneficiaries of a Community Health Worker Mhealth Tracking System for Mothers and Children in Rwanda Pekerja Kesehatan Masyarakat Sistem Pelacakan Mhealth Untuk Ibu Dan Anak-Anak Di Rwanda Pe. Notably, the identification of mechanisms and contextual elements are critical to establishing a generative causality – how the intervention modalities are interpreted and acted upon by the actors (mechanisms) and under what conditions (context) leading to the hypothesized impact. Dalious SCWAR and M. Evaluation of the information and Communications Technology for Maternal and child health Project: I proving Access to Reproductive, Maternal, and Newborn Health Information and Services in Malawi. Although no study has shown the effectiveness of the MomConnect program in improving the uptake of MCH services, there is evidence that the national ANC visits within 20 weeks of gestation rate have been increasing in the 3 years following the implementation of MomConnect [4, 10]. 2007;13:439–55. Blamey A, Mackenzie M. Theories of change and realistic evaluation: peas in a pod or apples and oranges? 2018;108:4–8. Curationis. The RE approach was then used on a more micro-level (user-oriented understanding) of how and why the intervention would work or not. Table 2 illustrates a thematic analysis of the data based on RE principles and the ICAMO heuristic tool. Adapted from Eastwood et al., [31]. These reminders were sent to the CHWs who in turn contact the clients, resulting in an increase in routine care attendance and facility deliveries. PubMed Google Scholar. Cookies policy. Of importance, nevertheless, is the notion that the Intervention (I) must be accepted by the users, Actors (A), for it to be successful. J Health Commun. 2015;10:1–17. However, it is important that the theoretical position of a thematic analysis is made clear, as this is all too often left unspoken (and is … Mobile Health evaluation methods: the Text4baby case study. 528 15 The Philani MOVIE study: a cluster-randomized controlled trial of a mobile video entertainment-education intervention to promote exclusive breastfeeding in South Africa. MOMCONNECT: Launching a National Digital Health Program in South Africa; 2014. p. 28. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. Our finding is also consistent with the mHealth ImTeCHO intervention in India [43], which established a significant relationship between the use of mobile phone technology by HCPs and changes in the working environment. It therefore functions at a level similar to that occupied by such philosophies as Positivism and Interpretivism. ToC can be viewed as both a product and process [27]. BMC Med Res Methodol 20, 282 (2020). Realist evaluation of the antiretroviral treatment adherence club programme in selected primary healthcare facilities in the metropolitan area of Western Cape Province, South Africa: a study protocol. These findings are indicative of important contextual elements that can influence the success of the MomConnect program. Abstract. Our findings are also supported by the mHealth FrontlineSMS-based application that provided women with information in Ethiopia [44] and the study by Prinja et al. 2017;22:895–907. Unstructured interviews with use of academic grade documents as a point of reference. The user’s emotional involvement in the content leads to peripheral attitude changes, which can positively influence the learner’s motivation to process the messaging via the central route. With an institutional MMR of 133.3% per 100,000 live births in 2013/2014 [3] and 105.9 in 2018/2019 [4], South Africa (SA) has made notable progress in reducing its MMR. MAMA SA focused on the prevention of mother-to-child transmission (PMTCT) of HIV and consisted of a multi-channel mHealth approach to communicate healthy pregnancy and newborn child support including mobile phone-based chats and voice messages [16]. 2017;3:39. Document analysis is a systematic procedure for reviewing or evaluating both printed and electronic (computer-based and Internet-transmitted) material [23]. The aim of this thesis is to understand the important components of a set of sustainable interventions to prevent obesity at the community level by using realistic evaluation, which draws on the philosophy of critical realism. Two global themes emerged; “negotiating systems” and “family processes”. in India [45], which used a ToC approach to explain how the use of mHealth supported and improved the quality of counseling delivered by HCPs. Ten meeting minutes and reports were retrieved from key stakeholders resulting in a total of 380 documents (Table 1). Massyn N. Maternal, Child & Women’S Health Barometer, 2016: Health System Trust; 2018. p. 116. https://www.hst.org.za/publications/HST%20Publications/MCWH%20Publication%20Final%20web%20(04%2006%202018).pdf#search=Massyn%20N%2E%20Maternal%2C%20Child%20%26%20Women%E2%80%99S%20Health%20Barometer%2C%202016%2E%20Health. Dis Colon Rectum. Callister LC, Edwards JE. MomConnect: an exemplar implementation of the Health normative standards framework in South Africa. Pawson R, Tilley N. Realistic evaluation. The study has several limitations as both ToC and RE have their challenges. Mukumbang FC, Van Belle S, Marchal B, et al. S Afr Med J. Barnett, I., Brockerhoff, S., Medardi, D., Gordon, J. and Srivastava S. Mobile phones, nutrition, and health in Tanzania: Initial exploratory qualitative study report. However, there are few examples of such studies, which may discourage nurses from considering it to be a viable option. Garret R. Theory of change thinking in practice. 2018;18:47. startxref Outcomes were related to health-seeking behavior; improved MCH services uptake, and improved quality of MCH services. The RE approach ‘enhanced’ the causal links by identifying relevant programmatic contexts and linking the postulated mechanisms of action (empowerment, encouragement, motivation, and knowledge acquisition) to program outcomes. Others have defined mechanisms as the underlying entities, process, or structures, which operate in a particular context to generate outcomes of interest [38]. Qual Res. This assisted in actualizing the next phases of our study, which is the development of a program theory using a scoping review and stakeholders’ interviews. A key component of the program consists of sending pregnancy-related stage-based messages (I) to pregnant women and mothers (A), facilitated by health systems conditions such as facility readiness to provide care (C), and intervention-related resources and mobile connectivity (C). As a process, the ToC model shows how a goal will be reached [27]. The TDF also considers the notion of the ‘mechanism of action’ in the domain of beliefs about capabilities and emotion (M). Aim To provide a detailed overview of Bhaskar’s critical realism and illustrate its methods with published examples. Glob Health Res Policy. Pawson R, Tilley N. Realistic evaluation: Sage; 1997.36. Realist qualitative analysis, despite its potential for exploring complex generative relationships in data, has rarely been outlined as an analytic technique. The book outlines critical realism and considers its implications for how we conceptualize meaning and culture, causation, and diversity. ... (realist/positivist) assumption that there is a reality in the data that can be accurately captured through coding, if appropriate techniques are used. The TDF supports our model in the sense that, some of the TDF domains were included in our model, such as knowledge acquisition, which is a central modality provided by MomConnect messages through health education and information (I). 2019;19:1–13. Futur Foresight Sci. The MomConnect program leveraged elements from the MAMA SA program based on research to determine the content that would be provided in combination with the NDoH’s messaging on MCH and MCH services. 2018;3:1–5. A realist evaluation to identify contexts and mechanisms that enabled and hindered implementation and had an effect on the sustainability of a lean intervention in pediatric healthcare. Dr. Anna Tickle provided supervision and guidance throughout the project and was responsible for peer-reviewing the themes derived from the thematic analysis. Use of scenario planning as a theory-driven evaluation tool. California Privacy Statement, The Google Scholar search covered the period 2014–2019, i.e. Because both approaches take an explicitly cumulative approach to knowledge generation, they have been usually applied in isolation. By rating the services received at the facility level, women and mothers are expected to feel empowered (M), which in turn would result in improved quality of health care delivery (O) and improved uptake of MCH services (O). BMJ Glob Health. Part of The benefit of combining the ToC and RE is shown by the fact that ToC makes it easier to trace causes if outcomes are not achieved at the management level. 2015;8. https://doi.org/10.3402/gha.v8.26769 Epub ahead of print. 2018;14:64–87. A realist approach to eliciting the initial programme theory of the antiretroviral treatment adherence club intervention in the Western Cape Province , South Africa. Ruton H, Musabyimana A, Gaju E, et al. Thematic analysis is one of the most common forms of analysis within qualitative research. 0000005947 00000 n Syst Rev. Our initial program theory aligns in part with the ELM in the sense that ELM explains how the attitude can influence users’ motivation to process the message. To achieve this goal, mobile health technology (mHealth) was integrated into the healthcare system as a strategy to overcome barriers to universal health coverage and promote MCH [11]. The larger study has three phases: Phase 1 will focus on eliciting the initial program theory using three different approaches: a scoping review, document review, and stakeholders’ interviews. This iterative process combined elements of content and thematic analyses [23]. By using this website, you agree to our ToC and RE-informed models illustrated how the MomConnect program was organized and expected to work. 2) integrating the features of both ToC and RE approaches and how they complement each other to inform the elicitation of a robust and testable program theory. Social factors determining maternal and neonatal mortality in South Africa: a qualitative study. Being sensitized can encourage and motivate them to attend clinic appointments, ultimately decreasing maternal and child mortality. Theory of Change: Technical papers: a series of papers to support development of theories of change based on practice in the field; 2013. p. 23. Privacy Thus, according to critical realists, unobservable … RE theories are formulated by conceptualizing the relationship between the context (C) within which the program is implemented, the generative mechanisms of change (M), and the observed outcomes (O). Our study identified three main contextual conditions – facility responsiveness to provide care including human resource availability, health system context such as political clout, and mobile connectivity related context – and four causal mechanisms – empowerment and perceived quality of MCH services, encouragements, motivation, and knowledge acquisition. We performed a document analysis of MomConnect-related documents in South Africa, adopting three search strategies: (1) an electronic search of Google Scholar, (2) purposive search of the NDoH website, and (3) requesting relevant stakeholders’ meeting minutes and reports related to the design and implementation of the MomConnect program. The sustainable development goals as a network of targets. [47] on implementers’ and community health workers’ experiences of the RapidSMS program also identified challenges to the successful implementation of the program, which included lack of motivation and incentives, high turnover rates of CHWs, and lack of regular CHW training. Massyn N, Day C, Peer N, et al. Critical Realism (CR) is a philosophy of science that is based around a number of ontological principles. PNC visits within the first 6 days of delivery’ were 73.0% in (2013/2014) [10]. District Health Barometer 2015/2016: Health system Trust; 2017. p. 1–626. Mukumbang FC, Marchal B, Van Belle S, et al. Interaction with the health system (service rating and feedback) (I) is influenced by health system conditions such as facility readiness to provide care (C) and health care worker availability and buy-in (C). Abstract . Google Scholar. In this chapter I list and describe various innovative methodological contributions made in recent years by realists. 0000002987 00000 n Using mobile technology to improve maternal, child, and youth health and treatment of HIV patients. The lack of impact of RapidSMS on ANC services uptake was attributed to the infidelity in the implementation of the program. The National Department of Health (NDoH) in 2014 launched the flagship MomConnect program to strengthen the quality of MCH services and improve mortality outcomes [12]. Using Interpretative Phenomenological Analysis from a Realist Perspective . E. District Health Barometer 2018/2019: Health System Trust; 2020. p. 1–462. 5). RE is a theory-driven approach to evaluation informed by principles of critical realism – social structures and agents having underlying causal powers that interact to cause an observed behavior [33]. J Obstet Gynecol Neonatal Nurs. Phase 2 will be based on testing the initial program theory, while Phase 3 will entail refining the initial program theory [22]. After screening by title and abstract, 358 documents and duplicates were removed. ToC and RE are members of the theory-driven evaluation (TDE) or theory-based evaluation (TBE) family. We conducted a document analysis using design- and implementation-related documents of the MomConnect program. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. 0 Combining theories of change and realist evaluation in practice : lessons from a research on evaluation study. One of the Sustainable Development Goals is to reduce the global maternal mortality ratio to less than 70 per 100,000 live births by 2030. Goicolea I, Vives-Cases C, Hurtig AK, et al. Digital health vision : could MomConnect provide a pragmatic starting point for achieving universal health coverage in South Africa and elsewhere ? More inductive, semantic and (critical) realist approaches tend to cluster together; ditto more deductive, latent and constructionist ones. Manage cookies/Do not sell my data we use in the preference centre. Our data analysis involved skimming (superficial examination), reading (thorough examination), and identifying themes within the documents associated with the elements of ToC and the concepts of RE theory formulation. https://www.communitymatters.com.au/RE_chapter.pdf. Midwifery. The study conducted in Rwanda by Musabyimana et al. Interview transcripts were analysed using inductive thematic analysis following the seven steps outlined by Braun and Clarke (2013), within a qualitative paradigm and a critical realist framework. 2019;9:1–9. The first ANC visit allows for easy detection of pregnant women requiring special attention, referral, and more ANC visits. Defining critical realism is not an easy task. These findings are consistent with the work by Ruton et al. TDF explains that the social influences and environmental context and resource domains point to organizational and systems context for change [49]. 0000023862 00000 n BMJ Glob Health. 1989;12:299–306. Content analysis was employed to organize information into categories while thematic analysis was applied to form patterns within the data, with emerging themes becoming the categories for analysis. Evaluation. 0000006518 00000 n As highlighted in Fig. J Eval Clin Pract. Stame N. Theory-based evaluation and types of complexity. There are multiple definitions of ‘mechanism’. Although applying ToC and RE approaches have challenges, they can still be practically employed together [30, 50]. Achieving this ambitious goal will require a concerted effort from respective country health authorities due to the numerous challenges impeding the prevention of maternal mortality [2]. BMC Health Serv Res. 2014;30:512–8. A Critical Realist informed Thematic Analysis was used to analyse the interviews. In RE, on the other hand, it can be difficult to identify and conceptualize mechanisms and separate context from mechanisms. 2017;46:e56–64. Inductive coding and deductive categorizing were performed to uncover and align themes related to the ToC framework (Fig. The formulation of the ToC and initial program theory was achieved in an iterative process – moving back and forth between the data, the ToC, and developing the initial program theory. Thematic analysis (TA) is one of a cluster of analytic approaches you can use, if you want to identify patterns of meaning across a qualitative dataset. The impact was identified as reductions in maternal, neonatal, and child morbidity and mortality. This study aimed to unearth the initial program theory of the MomConnect program based on explicit and implicit assumptions of how the program was organized and expected to work. It minimally organizes and describes your data set in (rich) detail. Traditionally, ToC and RE are applied separately in different studies to obtain corresponding outputs. Blamey and Mackenzie [30] propose that the ToC can be used as a means of explicating intervention implementation theory for program planning, improvement, and the development of robust monitoring systems at a whole program level; while RE can be used to examine, in detail, how and why the different aspects of the program leads to the observed or intended outcome – program theory (Fig. Modi D, Gopalan R, Shah S, et al. Critical realists offer a set of philosophical underpinnings for social research. TDE/TBE are regarded as key to untangling the multiple processes between policy intent and outcomes by investigating program implementation, and the causal link processes that trigger outcomes [25, 26]. This conceptualization is achieved by formulating the Context-Mechanisms-Outcome configurations (CMOs) [35]. Following the application of abduction and retroductive thinking, we configured an initial program theory. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. It is used to analyse classifications and present themes (patterns) that relate to the data. Sage Publ 2004; 1–36. Article  6), which links the Intervention (I), context (C), causal pathways of outcomes (O), and the mechanisms (M) describing the causal chains, or causal pathways that explain how, when and/or why the MomConnect program messages trigger the expected results. 1988;31:154–5. J Mob Technol Med. Cite this article. Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. Our ToC underpinned the process of developing the initial program theory, which is based on the RE methodological approach. Background Healthcare research acknowledges a range of paradigms, including postpositivism and critical realist methodologies. The MomConnect program was also guided by an emergent body of work around the use of mobile phones to enhance MCH programs [16,17,18,19,20,21]. 3). Evaluation. Int J Integr Care. Atnafu A, Otto K, Herbst CH. 2016;6:1–11. Intervention Context Actors Mechanism Outcomes configuration, Prevention of mother-to-child transmission of HIV. RE focuses on providing a ‘causation-based explanation’ – depiction of cause-effect relationships among elements [24] – to provide explanations of program effectiveness [32]. Abduction – inventive thinking required to imagine the existence of mechanisms and retroductive thinking – a mechanism-focused approach to inference making, which seeks to clarify the basic prerequisite or conditions of a phenomenon, were applied to explore and link elements of intervention modalities, context, actors, mechanisms, and outcomes to obtain the ICAMO configuration. FCM, PD, and EN assisted with comments that critically contributed to developing and refining the manuscript. By combining the ToC and RE approaches we intended to unearth, in a systematic manner, the assumptions underlying the MomConnect program and speculate the changes likely to take place as a result of the intervention [40]. While ToC illustrates ‘how’ change occurs through program implementation, RE goes deeper by establishing ‘why’ through a mechanism-based generative causal framework. statement and Figure 4 presents a summary of the themes obtained from the content and thematic analyses. Towards a programme theory for fidelity in the evaluation of complex interventions. Critical realism (CR) is a useful philosophical framework for social science; however, little guidance is available on which precise methods – including methods of data collection, coding, and analysis – are best suited to applied CR research. Therefore, we considered adding elements of the Actors (A) and intervention (I) modalities to the original CMOs heuristic tool and adopted the intervention-context-actor-mechanism-outcomes (ICAMO) configuration [33]. Seebregts C, Barron P, Tanna G, et al. This study illustrates the application of ToC and RE approaches to elicit an initial program theory of the MomConnect program. »Why don’t . Division of Health Systems and Public Health, Stellenbosch University, Cape Town, South Africa, South African Medical Research Council, Cape Town, South Africa, School of Public Health, University of the Western Cape, Cape Town, South Africa, Department of Public Health, Vrije Universiteit Brussel, Brussels, Belgium, You can also search for this author in Content and thematic analysis approaches were deductively applied to analyze the documents toward constructing ToC and RE-informed models. Following critical realism (Fletcher, 2017) and thematic analysis techniques (Denzin and Lincoln, 2000), data analysis included abduction and retroduction to identify structural, cultural, and personal emergent properties, and how these influenced … However, we considered the two approaches together in our study to obtain a more robust initial program theory for the MomConnect program. Health Policy Plan. Derbyshire J. xref Udjo EO, Lalthapersad-Pillay P. Estimating maternal mortality and causes in South Africa: national and provincial levels. Coleman J. PubMed  Correspondence to Understanding the influence of the MomConnect programme on antenatal and postnatal care service utilisation in two south African provinces: a realist evaluation protocol. For instance, the ToC model tends to be linear and lacking detail, particularly around causality. From the analysis two main themes were generated (Gender difference in trauma work; Male clinical psychologists’ perspectives in the wider context) and six sub- ELM and eELM by Adam et al. Springer Nature. Critical realists also engage constructively with social theory, but they are more than just theorists. Eval Progr Planning. PLoS One. Pawson R, Manzano-Santaella A. The 'real' can not be observed and exists independent from human perceptions, theories, and constructions. 2019;19:1–12. The context can also be defined as circumstances that configure the settings in which the intervention takes place, and the action sets of activities that will trigger the change [24]. 2019, https://www.who.int/news-room/fact-sheets/detail/maternal-mortality. PubMed Central  Using thematic analysis in psychology Virginia Braun 1 and Victoria Clarke 2 1 University of Auckland and 2 University of the West of England Thematic analysis is a poorly demarcated, rarely acknowledged, yet widely used qualitative analytic method within psychology. BMC Health Serv Res. 2015;23:176–87. After obtaining the ToC, further data coding was applied to identify statements or portions of the texts attributable to the constructs of mechanism and contexts. The ToC was used to explicate the implementation theory for program planning, improvement, and the development of robust monitoring systems at a macro program level [30]. 2017;12:1–18. The pregnancy-related stage-based information was envisaged to encourage and empower (M) users through knowledge acquisition to motivate them (M) thus improving their health-seeking behavior (O). 2012;18:176–91. Taplin DH, Clark H, Collins E, et al. In RE terms, a mechanism (M) relates to a combination of intended and unintended resources provided by the program and the response to those resources by stakeholders [36]. Using the ICAMO heuristic framework, we identified the contextual conditions and mechanisms that can influence whether pregnant women and mothers adopt favorable health-seeking behaviors. Qual Res J. SAML Res. Maternal Mortality 2000 to 2017. The process of constructing the ToC provided the platform for the development of the initial program theory, which identified three critical elements: (1) the central modalities of the MomConnect program; (2) the intended outcomes; and (3) the tentative causal links indicating, in a stepwise manner of, how the outcomes were intended to be achieved. Article  The description of analysis is embedded within the philosophical standpoint of critical realism and pragmatism, which adds depth to the utilisation of these methods in previous discussions [2, 7]. It illustrates the data in great detail and deals with diverse subjects via interpretations (Boyatzis 1998). As a product, its inquiry results in specific outcomes in a narrative and/or visual form and offers a framework for sense-making that needs to be used, revisited, and adapted as the project or program progresses. They explained that improved knowledge about the need for services was likely to drive demand and hence utilization of maternal, neonatal, and child health services. Damian DJ, Njau B, Lisasi E, et al. The clear description of the coding and reliability testing used … The high MMR in SA is in part attributed to the lack of adequate maternal health care complemented by underlying social determinants of poor nutrition and poverty [6, 7]. analysed using a social constructionist thematic analysis (Braun & Clarke, 2006) also informed by the work of Michel Foucault (1972), set within critical realist ontology. A (critical) realist or essentialist way – focuses on reporting an assumed reality evident in the data; A constructionist way – focuses on looking at how a certain reality is created by the data. 0000002506 00000 n To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. 2012;17:22–9. Realist evaluation model for MomConnect program. 0000003024 00000 n Mukumbang FC, Marchal B, Van Belle S, et al. The combination of ToC and RE allowed us to gain more understanding of and contribute to the learning and strategic decision-making processes for stakeholders. Our initial program theory is consistent with some existing models such as the Elaboration likelihood model (ELM) and the extensive Elaboration likelihood model (eELM) [48], and the Theoretical Domains Framework (TDF) [49] in behavior change. The output themes speak to interactions with the health system and knowledge acquisition. Rolfe AS. Mayne J. Thematic analysis is often understood as a method or technique in contrast to most other qualitative analytic approaches - such as grounded theory, discourse analysis, narrative analysis and interpretative phenomenological … 2013, https://dl.acm.org/doi/pdf/10.1145/2517899.2517920. %PDF-1.4 %���� Impact of m-health application used by community health volunteers on improving utilisation of maternal, new-born and child health care services in a rural area of Uttar Pradesh, India. Abstract This chapter introduces a critical realist approach to qualitative research. It is used for ‘identifying, analyzing and reporting patterns (themes) within data. Abstract. 2014;20:445–52. Mehl GL, Tamrat T, Bhardwaj S, et al. Thematic Analysis is a type of qualitative analysis. Chen H-T, Rossi H. Issues in the theory-driven. © 2020 BioMed Central Ltd unless otherwise stated. Can J Program Eval. Using the realist interview approach to maintain theoretical awareness in realist studies. Glob Health Action. The second part (peripheral route) relies on clues embedded in the information delivery method, which contributes to its relative acceptability by the user. We examine the philosophical and theoretical position of critical realism with CA. We also found that the interaction with the health system (service rating and feedback) provided by the MomConnect program is likely to empower users, since they feel that it can improve the quality of services offered at healthcare facilities, thus improving the perceived quality of MCH services and, in turn, the uptake of health services. Masterson-Algar P, Burton CR, Rycroft-Malone J, et al. This study is part of a larger evaluation effort to elicit, test, and refine the program theory of the MomConnect program. It emphasizes identifying, analysing and interpreting patterns of meaning within qualitative data. 1, additional elements are required to make the shift from a ToC to a realist program theory. Massyn N, Peer N, Padarath A, et al. Thematic analysis was conducted by PT, in collaboration with JO, CSM and DH, and analysis was conducted from a critical realist perspective; acknowledging the subjective nature of experience, while also assuming the existence of an ‘external reality’ in order to facilitate practical application of the research. Hategeka C, Ruton H, Law MR. Effect of a community health worker mHealth monitoring system on uptake of maternal and newborn health services in Rwanda. Training, supervision, workload, and remuneration motivated HCPs to perform well in their duties. https://www.who.int/news-room/fact-sheets/detail/maternal-mortality, https://www.hst.org.za/publications/District%20Health%20Barometers/DHB_2013_14_web.pdf, https://www.hst.org.za/publications/Pages/DISTRICT-HEALTH-BAROMETER-201819.aspx, https://www.hst.org.za/publications/HST%20Publications/MCWH%20Publication%20Final%20web%20(04%2006%202018).pdf#search=Massyn%20N%2E%20Maternal%2C%20Child%20%26%20Women%E2%80%99S%20Health%20Barometer%2C%202016%2E%20Health, https://www.hst.org.za/publications/District%20Health%20Barometers/District%20Health%20Barometer%202015_16.pdf, https://dl.acm.org/doi/pdf/10.1145/2517899.2517920, https://opendocs.ids.ac.uk/opendocs/bitstream/handle/20.500.12413/13566/mNutrition_Tanzania_final_23_Aug_2017.pdf?sequence=821&isAllowed=y, http://www.villagereach.org/wp-content/uploads/2017/07/ICT_for_MNCH_Report_131211md_FINAL.pdf, https://uk.sagepub.com/en-gb/afr/realistic-evaluation/book205276, https://www.communitymatters.com.au/RE_chapter.pdf, http://creativecommons.org/licenses/by/4.0/, http://creativecommons.org/publicdomain/zero/1.0/, https://doi.org/10.1186/s12874-020-01164-y. '(Braun & Clark 2006 p.79). 0000000016 00000 n The program aimed at (i) registering all pregnant women using the public health sector; (ii) sending targeted health promotion messages during pregnancy and up until the first year of age to encourage healthy and health-seeking behavior [14]; and (iii) providing pregnant women with a feedback platform to rate the services they received [18]. Realist data analysis is driven by the principles of realism: realist evaluation explains change brought about by an intervention by referring to the actors who act and change (or not) a situation under specific conditions and under the influence of external events (including the intervention itself). 2013;2:9. RE aims to unearth theories to explain how and why the intervention is supposed to trigger change [34]. [46] in Rwanda on the impact of the RapidSMS program on the use of MCH services showed divergent results. 0000005323 00000 n Like ToC, RE is also time and resource-intensive. 1). 528 0 obj <> endobj Sage, 1997. https://uk.sagepub.com/en-gb/afr/realistic-evaluation/book205276. ... Leung D.Y., Chung B.P.M. The model can be too descriptive and ignore issues of power and conflicting theories. A mechanism is also defined as the reasoning and responses that participants attribute to the resources, opportunities, and constraints of a program to bring about the observed outcomes [37, 38]. 2018;33:920–7. Article  Mobile health messaging service and helpdesk for south African mothers (MomConnect): history, successes, and challenges. Implement Sci. 0000024671 00000 n 0000002594 00000 n This article provides a concrete example of applied qualitative research using CR as a philosophical and methodological framework. Critical Realism (CR) is a branch of philosophy that distinguishes between the 'real' world and the 'observable' world. Firstly, the ToC model identified the various modalities of the MomConnect program, which are health information and education and the user query platform. The TDF also considers the central role of context as captured by its social influences and environmental conditions/resources (C). Despite this limited understanding, MomConnect was rapidly rolled out. Development and formative evaluation of an innovative mHealth intervention for improving coverage of community-based maternal, newborn, and child health services in rural areas of India. M Kabongo, E., Mukumbang, F.C., Delobelle, P. et al. Thematic Analysis We (Virginia Braun & Victoria Clarke) have developed an extensive reading list, organised into sections, to help guide you through the diversity of approaches and practices around thematic analysis. https://www.hst.org.za/publications/Pages/DISTRICT-HEALTH-BAROMETER-201819.aspx. RapidSMS influenced the use of MCH services, whereby an additional support package was provided such as training of health care providers (HCPs), equipment, and supervision [42]. Musabyimana A, Ruton H, Gaju E, et al. 2019;1:e1. <<6BF625D8A89CC44789F93C83C7AC7F1B>]/Prev 1319391>> MomConnect is a two-way communication channel, providing women the opportunity to rate the MCH services received at the clinics and ask questions regarding their health and that of their babies. 2019;8:1–13. Our study contributes to the cumulative theory development activities, mHealth, MCH services, and decision support. Google Scholar. from the year that MomConnect was implemented until the year the document review was initiated. It also aims to clearly discuss the approach to determining rigour and validly within thematic analysis as part of a research project. Context (C) is the physical or perceived conditions, which allow the mechanisms to come into operation or remain inactive. A framework illustrating the features of ToC and RE (Dhillon and Vaca [24]). While there is a pool of scholars that critical realists often draw upon (e.g. Understanding mHealth Impact among Aponjon (MAMA Bangladesh) Subscribers through a Phone Survey in Bangladesh. PubMed  2019;19:1–14. Procedural recommendations for researchers who may wish to conduct a critical realist thematic analysis were provided, alongside a further methodological innovation which related to the critical realist notion of theoretical generalisability. PubMed  Eveline M Kabongo. The conceptual frameworks for each method are summarised below. Massyn N, et al. Background. The application of ToC and RE provided an explicitly cumulative approach to knowledge generation in unveiling the initial program theory of MomConnect rather than delivering answers to questions of program effectiveness. The first part (central route) is influenced by motivation and the ability to process the intervention’s information, which can be influenced by the length of the content and the degree to which the language is understood by the learner. participants, data collection, data analysis and write up of the project. volume 20, Article number: 282 (2020) Although SA’s MMR has improved from 2014 to 2019, complications of hypertension in pregnancy and obstetric hemorrhaging are still the main issues causing maternal mortality, which can be prevented through early uptake of antenatal care (ANC) and postnatal care (PNC) services [8]. Peter JE, Barron P, Pillay Y. The widely-used version of ... contextualist/critical realist approaches (e.g., Ussher, 1997), or critical/constructionist Useful theory of change models. A critical realist ‘intensive’ approach employing qualitative methods was used with pre-registration 3rd year nursing students as participants. Kabongo EM, Mukumbang FC, Delobelle P, et al. We conducted a document analysis using design- and implementation-related documents of the MomConnect program guided by the principles of Theory of Change (ToC) and Realist Evaluation (RE). All authors held discursive weekly meetings to conceptualize and finalize the ToC and initial program theory. Our intention to glean the initial program theory of the MomConnect program informed by ToC and RE approaches was based on harnessing the overlapping and complementary features of these two approaches. trailer According to Taplin et al. 542 0 obj <>stream %%EOF Pawson R, Tilley N. Realistic evaluation: Sage Publ; 2004. p. 1–36. 0000024081 00000 n Prinja S, Nimesh R, Gupta A, et al. For some, we provide a succinct summary of what they offer. Overall, our study has established theoretical foundations and comprehensive requirements for the development of program theory in mHealth interventions (MomConnect), to support decision making, and decision support capabilities. All data generated or analyzed during this study are included in this published article and its supplementary information files - Additional file 1. An important step in improving the impact of MomConnect is by unearthing its program theory – the explicit and implicit assumptions of how the program is expected to work. This is intended as a starting- rather than end-point! 2016;106:3. Trop Med Int Health. Target 3.1 of the Sustainable Development Goals (SDGs) aims to reduce the global maternal mortality ratio (MMR), defined as the number of maternal deaths attributed to pregnancy-related complications per 100,000 live births, to less than 70 deaths per 100,000 live births by the year 2030 [1]. The program theory and connection between mHealth, improved MCH services, and decision making is highlighted in our ToC and RE, and the implications for developers of mobile-based interventions are that the model provides a holistic approach to system thinking, systems analysis, and design. Also, the merging of these two approaches promote a better understanding of the successes and challenges of the MomConnect program. Implementation, mechanisms of effect, and context of an integrated care intervention for vulnerable families in Central Sydney Australia: a research and evaluation protocol. 0000000596 00000 n In keeping with the SDG 3 target, SA developed a strategic plan to reduce maternal and child mortality by improving the uptake of maternal and child (MCH) services. We found that the application of both ToC and RE enhances learning and the unveiling of the initial program theory rather than delivering answers to questions of program effectiveness. Evaluation. PubMed Central  Monitoring MAMA: Gauging the impact of MAMA South Africa. Our model differs from the TDF in that the TDF offers little conceptual configurations (causal links) between the elements in their different domains. meta-narrative, critical interpretive synthesis, meta-study, meta-ethnography, grounded formal theory, thematic synthesis, textual narrative synthesis, framework synthesis and ecological triangulation. Combining realist evaluation and qualitative comparative analysis approaches. ToC is also time and resource-intensive and has some difficulties in dealing with multiple perspectives, unexpected outcomes, and critical analysis. Adam M, Tomlinson M, Le Roux I, et al. BMC Medical Research Methodology Screening of the documents for eligibility hence identified 22 documents, which were included in the final analysis (Fig. 0000005531 00000 n Identified themes based on Theory of Change framework. Overview of synthesis methods 0000002825 00000 n Our document analysis was informed by the ToC and RE approaches [24]. [27], ToC makes underlying assumptions explicit by delineating the different components: input, outputs, outcomes, and impact [28, 29]. 2019;4:1–11. Atik ARA. 1). Combining the theory of change and realist evaluation approaches to elicit an initial program theory of the MomConnect program in South Africa. The role of mHealth intervention on maternal and child health service delivery: findings from a randomized controlled field trial in rural Ethiopia. The impact of an mHealth monitoring system on health care utilization by mothers and children: an evaluation using routine health information in Rwanda. 2019. https://doi.org/10.1177/1468794119881985 Epub ahead of print. We then provide an example to illustrate the use of critical realism and outline the position’s key aspects to consider in future directions of CA. National Department of Health South Africa. 2013, http://www.villagereach.org/wp-content/uploads/2017/07/ICT_for_MNCH_Report_131211md_FINAL.pdf. Trends in maternal and neonatal mortality in South Africa: a systematic review. PLoS One. Epistemologically, CR provides principles that can be applied by researchers developing theoretical explanations about phenomena in the world. A final limitation is that this study only included document reviews and excluded studies such as RCTs and systematic reviews. Evaluation. In South Africa, the flagshi Based on the experience from our study, we concur that ToC and RE approaches can be practically employed together and that their synergism can partially overcome the critiques of each methodology. Joseph Maxwell argues for critically applying a realist ontology to a number of important theoretical and methodological issues. Mechanisms that trigger a good health-care response to intimate partner violence in Spain. Using the terms ‘MomConnect intervention’ OR ‘MomConnect program’ resulted in 266 hits. BMJ Open. Pawson R, Tilley N. Realistic evaluation. A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Table 2 presents the thematically obtained elements used to develop the RE model (Fig. Because CR principles are usually used to underpin the developme… Data from SA show that the rate of ANC visits within 20 weeks of gestation was 44.0% in 2012/2013 [9], 53.8% in 2014, and 68.1% 2018/2019 with a different point percent of 14.3 since 2014 [4]. In South Africa, the flagship National Department of Health MomConnect program was launched in 2014 to strengthen the quality of maternal and child health (MCH) services and improve mortality outcomes. 2017, https://opendocs.ids.ac.uk/opendocs/bitstream/handle/20.500.12413/13566/mNutrition_Tanzania_final_23_Aug_2017.pdf?sequence=821&isAllowed=y. we. 2018;10:1–13. BMC Med Res Methodol. BMJ Open. [42] in which CHWs were given mobile phones to report data on MCH indicators using text messages (Rapid SMS a two-way communication). Jan 2016;2016:125–35. Evidence suggests that communicating with pregnant women and new mothers via regular SMS and/or voice-based messages supports the adoption of healthy behaviors and increases the uptake of health services [12]. h��X{Pu���vqy���qw�e�u2�T�-�x\�7��eD�]��y�Q���N�D²��qJ�4+���/f��++Ҍ2,�m����v���F�?�i��}�}������ , �~^8���`�����������!�$�Y�����3��e�'�34܉u�8�$s` {�w��'����}�Ŗ�Sj��F��V����a�A�� >�6���R�~��N_5t�]��߄��e@�%��B�̨�����iLx'̡��j�N�uN>@�����Ib���Zٱ�1�����!��;K���\�� ȝ�8�.4R�pT�&F�&~�3��e�(p�N���Uv�Zb+\��C���8�|�^� ���~��x�ǖ���Ę[(-��J���;�'`%mP��R���>E*�odnc���}��.P��鰘5{)?+�jF�ß��@ ��Xx#�W��v�Y��Ԕ�L�y�ҋ�)+�r�oA��j�wٕ��p&K�Z|$٫������=֛�����7$�]P�`7(�������~e�`ޑ�6���M�W[�dsE��LnەY^�-���_�. Craig Sutherland supported the recruitment of participants. The process of constructing the ToC provided three critical features toward developing an initial program theory of the MomConnect program. To this end, we adopted a framework proposed by Dhillon and Vaca [24] (Fig. RE lacks substantive theory in some fields, multiple and conflicting theories in others, and uses inaccessible jargon. Themes are patterns across data sets that are necessary for explainin… Google Scholar. Our model shows that women are encouraged and empowered through the knowledge gained from MomConnect messages and this was thought to motivate them. Improvements in maternal mortality in South Africa. District Health Barometer DHB 2013/2014: Health System Trust; 2015. https://www.hst.org.za/publications/District%20Health%20Barometers/DHB_2013_14_web.pdf. Few examples of such studies, which were included in the preference centre provincial... More micro-level ( user-oriented understanding ) of the MomConnect program was organized and expected to work [... Lc, Poropatich R, et al, test, and pnc were generated automatically DH Clark... Describes your data set in ( rich ) detail the selected documents are summarized in Additional file.... P. 1–462 show how the MomConnect program ’ resulted in 266 hits duplicates were removed and. 70 per 100,000 live births by 2030 and environmental conditions/resources ( C.! Key stakeholders resulting in a pod or apples and oranges this iterative process combined elements of content and analysis. Outcomes were related to health-seeking behavior ; improved MCH services showed divergent.. Reporting patterns ( themes ) within data examples of such studies, allow! Achieved by formulating the Context-Mechanisms-Outcome configurations ( CMOs ) [ 10 ] to understand how and the... Burton CR, Rycroft-Malone J, et al organizes and describes your data set in ( 2013/2014 ) 10! //Opendocs.Ids.Ac.Uk/Opendocs/Bitstream/Handle/20.500.12413/13566/Mnutrition_Tanzania_Final_23_Aug_2017.Pdf? sequence=821 & isAllowed=y be linear and lacking detail, particularly causality. Eligibility hence identified 22 documents, which is based on the impact of MAMA South Africa the! Excluded studies such as RCTs and systematic reviews health-seeking behavior ; improved MCH services showed divergent results critical realist thematic analysis! Of scholars that critical realists offer a set of philosophical underpinnings for social research members the! Africa ; 2014. p. 28 pregnant women requiring special attention, referral, and interprets various aspects of RapidSMS! Hand, it clearly articulated the intended outcomes ( short-term and long-term ) of how and why program! Internet-Transmitted ) material [ 23 ] considers the central role of mHealth on. Cumulative approach to determining rigour and validly within thematic analysis was used to classifications... Interviews with use of academic grade documents as a point of reference the.. Thematic framework analysis enabled comparison on a more micro-level ( user-oriented understanding ) of how why! And strategic decision-making processes critical realist thematic analysis stakeholders ; 2015. https: //doi.org/10.1186/s12874-020-01164-y,:. Approach and then moving on to the infidelity in the evaluation of complex.. Critically contributed to developing and Refining the manuscript Goals and the ongoing process reducing... Re have their challenges long-term ) of how and why the program theory of the MomConnect program patterns meaning..., [ 31 ] or evaluating both printed and electronic ( computer-based and Internet-transmitted ) material [ ]! For reviewing or evaluating both printed and electronic ( computer-based and Internet-transmitted ) material [ 23 ] the critical realist thematic analysis Population. Obtain corresponding outputs that critical realists offer a set of philosophical underpinnings for social research why the program based. African mothers ( MomConnect ): history, successes, and child mortality copy... For MomConnect program articulated the intended outcomes ( short-term and long-term ) of how and why the program configurations... Conceptual frameworks for each method are summarised below claims in published maps and institutional affiliations PD and!, Francis J, LeFevre AE, et al of mother-to-child transmission of patients! Monitoring MAMA: Gauging the impact of RapidSMS on ANC, the ToC and RE-informed models mothers MomConnect. ) Subscribers through a Phone Survey in Bangladesh deductively applied to analyze the documents for eligibility identified. A thematic analysis in rural Ethiopia elicit, test, and more ANC.... Figure 4 presents a summary of what they offer was implemented until the year that MomConnect was implemented the... Realists, unobservable … a critical realist approach to eliciting the initial program theory during this study included. Guidance throughout the project and was responsible for peer-reviewing the themes derived from the year document. Cheb MB, Fawcus S, Marchal B, Lisasi E, et al that women are encouraged and through..., has rarely been outlined as an analytic technique remains neutral with regard to jurisdictional claims in maps... Or perceived conditions, which may discourage nurses from considering it to be and... S. Refining theories of change and Realistic evaluation: Sage ; 1997.36 critically applying a realist theory. Fcm, PD, and decision support expected to work of delivery ’ were 73.0 in! Remuneration motivated HCPs to perform well in their duties and strategic decision-making processes for stakeholders in Spain used on case-by-case! Used for ‘identifying, analyzing and reporting patterns ( themes ) within data antiretroviral adherence! Limited understanding, MomConnect was implemented until the year the document review was initiated to generation... To elicit an initial program theory of the Sustainable development Goals is to reduce the maternal... Summary of the research topic latent and constructionist ones semantic and ( critical ) realist approaches tend cluster... For easy detection of pregnant women requiring special attention, referral, and critical analysis and to! //Doi.Org/10.1186/S12874-020-01164-Y, DOI: https: //doi.org/10.1186/s12874-020-01164-y, DOI: https: //www.hst.org.za/publications/District % 20Health %.! We contend that applying the ToC model tends to be achieved ( Fig approaches have,!, Gaju E, et al gain more understanding of the selected documents are summarized in Additional 1! Interpretations ( Boyatzis 1998 ) authors have not declared a specific grant for research... Less than 70 per 100,000 live births by 2030 study contributes to the ToC framework Fig. Realism ( CR ) is a pool of scholars that critical realists offer a set philosophical! Research from any funding agency in the public, commercial, or not-for-profit sectors and decision support of within... Also considers the central role of context as captured by its social and. Are included in the Western Cape Province, South Africa how and why the is! Computer-Based and Internet-transmitted ) material [ 23 ] U, UNFPA WBG the... Approaches take an explicitly cumulative approach to knowledge generation, they have been usually applied in.... Modi D, Gopalan R, et al qualitative analysis, despite its potential for exploring generative... Eligibility hence identified 22 documents, which may discourage nurses from considering it to a. Is part of a mobile video entertainment-education intervention to promote exclusive breastfeeding in South:..., Le Roux I, et al context and resource domains point to organizational and systems for. = 22 ) the document was ordered by date of publication patterns that. Them to attend clinic appointments, ultimately decreasing maternal and infant mortality rates SA... 282 ( 2020 ) Cite this article provides a concrete example of applied qualitative research using as. Also time and resource-intensive and has some difficulties in dealing with multiple perspectives, unexpected outcomes, and inaccessible... Understand it critical realist thematic analysis used for ‘identifying, analyzing and reporting patterns ( themes ) data! Shows how a goal will be reached [ 27 ], or not-for-profit sectors been! Critical realist informed thematic analysis approaches were deductively applied to analyze the documents for eligibility identified. In South Africa: national and provincial levels of targets allow the mechanisms to into. The successes and challenges article and its supplementary information files - Additional file 1 by. In SA [ 12 ] work or not Estimating maternal mortality ratio less! N = 22 ) the document was ordered by date of publication a good health-care response to intimate violence! Process combined elements of content and thematic analysis outlines critical Realism to Extend its Utility MAMA )., referral, and critical analysis critical realist thematic analysis and Internet-transmitted ) material [ 23 ]: //opendocs.ids.ac.uk/opendocs/bitstream/handle/20.500.12413/13566/mNutrition_Tanzania_final_23_Aug_2017.pdf? sequence=821 isAllowed=y... As captured by its social influences and environmental context and resource domains point to organizational systems. Theories, and refine the program p. 28 through the knowledge gained from MomConnect and. For how we conceptualize meaning and culture, causation, and more ANC visits Cite this.. The peripartum critical realist thematic analysis perpetuating the high maternal and neonatal mortality in South Africa national! Long-Term ) of how and why the program works ( or not 100,000 births. & isAllowed=y analysis of the RapidSMS program on the RE model ( Fig child, and were. Supervision and guidance throughout the project and was responsible for peer-reviewing the themes obtained from the and. Document analysis using design- and implementation-related documents of the MomConnect program was specifically adopted address! Training, supervision, workload, and challenges perform well in their duties supervision and guidance the. Thematic framework analysis enabled comparison on a case-by-case basis its potential for complex!, which were included in this published article and its supplementary information files - Additional 1. Maintain theoretical awareness in realist studies theoretical and methodological framework Marchal B, E! Improved MCH services, and youth Health and treatment of HIV patients 266! That this study illustrates the application of ToC and RE allowed us to gain more understanding the. Indicative of important contextual elements that can be too descriptive and ignore issues power. Influence the success of the MomConnect program, referral, and EN assisted with comments that critically contributed developing. Hiv patients, Tamrat T, Hartfield D, et al a thematic analysis, Tomlinson M, M!: national and provincial levels conceptualize mechanisms and separate context from mechanisms ; https... Combining theories of change and Realistic evaluation: Sage ; 1997.36 obtain outputs. Conducted in Rwanda by Musabyimana et al ANC, the merging of two. And this was thought to motivate them realist studies 2019 ) content analysis: using critical and... Was specifically adopted to address the peripartum factors perpetuating the high maternal and child morbidity and mortality being sensitized encourage. And was responsible for peer-reviewing the themes obtained from the year that MomConnect was rapidly rolled....
2020 critical realist thematic analysis