ࡱ> ]bjbjVV <<C$$gw4h#7 !"!!!""" $t~-,"",,-!!B222,T!!!2,22b$ѡ!CC. V X0cn.HѡѡѢ<"b%2P'("""--`2^""",,,,"""""""""$ -: Chapter 5: Extracting Qualitative Evidence This chapter should be cited as: Noyes J & Lewin S. Chapter 5: Extracting qualitative evidence. In: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C (editors), Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. Version 1 (updated August 2011). Cochrane Collaboration Qualitative Methods Group, 2011. Available from URL HYPERLINK "http://cqrmg.cochrane.org/supplemental-handbook-guidance"http://cqrmg.cochrane.org/supplemental-handbook-guidance Key Points The method of data extraction should be informed by the purpose of the review Extraction templates and approaches should be determined by the needs of the specific review Extraction of qualitative evidence is typically an iterative process. Review authors may move between reading primary papers, data extraction and synthesis / interpretation in several cycles, as key themes and questions emerge from the synthesis Introduction The purpose of this chapter is to outline ways in which evidence from reports of primary qualitative research studies might be extracted to inform, enhance, extend and supplement Cochrane reviews. This chapter aims to enable review authors to consider: 1. The context and purpose for which data are to be extracted 2. Methodological issues when deciding on an approach to extracting qualitative data 3. Some of the approaches available for the extraction of qualitative evidence. Extracting qualitative evidence: concepts and issues Data extraction appears, at first glance, to be a relatively straightforward component of a systematic review. In practice, the approach used may have a significant impact on the review findings through shaping the range of data feeding into the synthesis. In most systematic reviews of quantitative studies data extraction is a relatively linear process. Key items for data extraction are specified in advance in a data extraction template, based on the participants, interventions, comparisons and outcomes of interest. This template is then applied to each included study. In reviews of qualitative studies, data extraction is typically a more iterative process. Review authors may move between reading primary papers, data extraction and synthesis / interpretation in several cycles as key themes and questions emerge from the synthesis. These themes then need to be cross-checked against the primary papers. Data extraction in qualitative synthesis shares with primary qualitative research the importance of immersing oneself in the data. The focus and range of data extraction should be informed by the purpose of the review. A scoping or mapping (informing) review may require a different template to a review of process evaluation/implementation studies (enhancing) or a qualitative evidence synthesis to address questions of effectiveness (extending) or questions other than effectiveness (supplementing) . Several different approaches to extraction have been used in the qualitative synthesis literature (e.g. Munro et al. 2008; Briggs and Fleming 2007; Greenhalgh et al. 2007; Noyes & Popay 2007). Some of these are discussed below. What counts as qualitative evidence? Qualitative findings in study reports may be presented in a number of forms, including text, tables, mapping and diagrammatic representations of theory. Review authors may want to draw on all of these forms of qualitative data in their synthesis. Before starting a review, authors need clear agreement on what constitutes qualitative methods and evidence. This will enable them to identify and select eligible studies for their review. A shared definition can also be used to distinguish qualitative evidence and quantitative evidence in mixed method papers. There are a range of views regarding what might be defined as qualitative evidence (see Box 1). The definition used has implications for both inclusion decisions (see chapter 3 for further discussion of inclusion decisions) and data extraction. Two principal approaches have been used to decide what counts as qualitative evidence for the purposes of extraction. In the first approach, data (or themes) are extracted from a primary study only if they are illustrated by a direct quotation from a respondent (Briggs & Flemming 2007, JBI 2008). Having a direct quotation increases the face validity of the data or themes reported. However, constraints such as journal article length and style may preclude the inclusion of data extracts for all themes in published papers. Important themes may therefore be lost in this process. In the second approach, all themes or other qualitative data identified in the primary studies and relevant to the review question are extracted, regardless of whether or not they are illustrated directly by a direct quotation. This approach allows data extraction to be more inclusive. However it also makes it more difficult to judge the validity of the themes presented, including how these have emerged from the data. Review authors need to consider which approach will best facilitate the synthesis that they are undertaking. Box 1: Examples from published syntheses of definitions of qualitative evidence Any study that utilized both qualitative data collection and analysis methods (Munro et al. 2007, Noyes & Popay 2007) Studies in which qualitative methods were used to describe peoples experiences (Briggs & Flemming 2007) Any study reporting empirical, non-numerical data (Marston & King 2006) Papers had to report results of qualitative (i.e., textbased and interpretive) analysis based on qualitative methods of data collection. (Smith et al. 2005, p826) Qualitative methods were used to describe peoples experience of living with a leg ulcer e.g. phenomenological studies; grounded theory; descriptive; focus groups or interview studies. (Briggs and Flemming 2007, p320) Approaches to extracting qualitative data Several different approaches to extracting qualitative data from included studies are discussed below. Inclusive or selective extraction of qualitative findings In inclusive approaches to data extraction all eligible data are included to avoid omitting findings of potential value to the synthesis. Meta-ethnography, for example, takes this approach, extracting all relevant data presented in a paper, including author interpretations (Noblit & Hare 1988). For example, the full text of each included primary study can be scanned, uploaded into a qualitative analysis software package and treated as a primary textual data source for analysis. Thomas and Harden (2008) describe this process in relation to a review on healthy eating in children: In our example review, while it was relatively easy to identify 'data' in the studies usually in the form of quotations from the children themselves it was often difficult to identify key concepts or succinct summaries of findings, especially for studies that had undertaken relatively simple analyses and had not gone much further than describing and summarising what the children had said. To resolve this problem we took study findings to be all of the text labelled as 'results' or 'findings' in study reports though we also found 'findings' in the abstracts which were not always reported in the same way in the text. Study reports ranged in size from a few pages to full final project reports. We entered all the results of the studies verbatim into QSR's NVivo software for qualitative data analysis. While this approach is more comprehensive, it is also more resource intensive. However, the use of a more inclusive approach may have advantages with regard to undertaking further syntheses. For example, the approach used by the EPPI Centre seeks to extract data from all included studies using a universal template. This data is subsequently stored in a database for use in subsequent syntheses (Harden et al. 2004). Harden et al. (2004) attest to the value of using a data extraction tool in helping to deconstruct each study and then being able to reconstruct the studies in a standardized format, using evidence tables and structured summaries, to facilitate comparison between them. In more selective approaches to extraction only particular types of data are extracted, for example data meeting pre-specified quality standards; data that are supported by direct extracts from interviews or observations; or data related to a specific issue or question. For example, reviews using the meta-aggregation approach extract only the findings substantiated by direct data extracts or quotations (Pearson 2004). This approach may be useful where very large volumes of data or studies have been included in the review. However, more selective approaches to data extraction may be difficult to explain or justify during write-up of the review findings. Furthermore, selective approaches may result in the under-representation of findings from papers, or sections of papers, in which the authors did not illustrate their findings with direct quotations from interviews or other primary sources (Briggs and Fleming 2007). The choice between these two approaches is largely methodological, based on the review authors understandings of what constitutes qualitative evidence and of how to ensure quality. It may also be influenced by the degree of transparency or auditability of findings required by those commissioning the review. Extracting only a limited core set of items or extracting a wider set of items The approach to data extraction will be influenced by the purpose of the review. This is highlighted by the contrast between the forms of data extraction used for mapping reviews or knowledge maps and those used for in-depth syntheses. By mapping reviews we mean reviews that attempt to systematically identify and describe studies addressing a particular question, rather than attempting to extract and synthesise the findings of these studies. For example, mapping could be used to describe systematically the available qualitative studies on parents views of childhood vaccination. Mapping reviews can inform Cochrane reviews by setting out the full range of research in a field; identifying gaps in evidence; and helping to define the question for the Cochrane review. For such reviews, it may be sufficient to code or extract only a limited core set of items from each study. This may include items such as research questions, study design, country and setting, respondent groups and, where relevant, intervention types and how these interventions were delivered (Woodman et al. 2008; Bates and Coren 2006). An assessment of the quality of the studies may not be undertaken. A recent systematic map used this approach to describe the existing literature on the extent and impact of parental mental health problems on families and the acceptability, accessibility and effectiveness of interventions (Bates and Coren 2006). For more in-depth syntheses to enhance, extend or supplement a Cochrane review, it may be necessary to extract a wider set of items. In addition to the core items listed above, these may include the data collection and analysis approaches used; how consent was obtained; the key themes emerging from the analysis; the authors interpretations of their data; and any explanatory models developed (for example, Marston & King 2006; Noyes & Popay 2007; Taylor et al. 2010). As noted above, this form of data extraction may take a more iterative approach and is also more resource intensive than extracting a very limited set of core items. Using a theoretical framework to guide data extraction The choice of data extraction framework needs to be made based on the approach to synthesis chosen for the review (see chapter 8). Some syntheses develop an interpretive or theoretical framework early on in the review process, based on an initial reading of the included studies. Alternatively, a theoretical or conceptual framework for the phenomenon or process may already be available in the literature. Such frameworks can, in turn, can be used to guide the data extraction process (Ritchie & Spencer 1994). In this approach, data on findings from each study are extracted into the categories or domains identified by the pre-specified framework. Additional domains may be added as data extraction continues and the framework is developed further (for examples, see Noyes and Popay 2007, which developed a thematic framework as the review progressed, and Lloyd Jones et al. 2005, which used the Framework Approach). A strength of this approach is that it helps to focus data extraction on findings relevant to the review question (Thomas and Harden 2008). It is also particularly useful for areas in which well accepted theoretical frameworks already exist. In form, it is congruent with approaches used in primary qualitative research, in which a coding frame developed through analysis of initial data is then applied to data collected subsequently. Potential disadvantages of this approach are that, unless it is applied in a flexible/developmental way, it may restrict the development of new models or the refinement of an existing model through establishing a synthesis framework very early in the review process, or neglecting qualitative data that do not fit into the chosen framework. Some review authors, rather than using a formal data extraction form for the study findings, use a more inductive, flexible approach in which the primary studies are read and re-read to establish familiarity with the findings. Relevant themes and concepts are noted down as this reading progresses and a model to explain the data is then developed later (Smith et al. 2005; Munro et al. 2007). Any of these approaches can be used to extract qualitative data from mixed method papers that include a qualitative component (also see below). Again, the approach used should be informed by the purpose of the synthesis as well as the nature of the available data. Whatever approach is chosen, review authors need to demonstrate a transparent and systematic process to selecting data for extraction. To facilitate this, most review teams develop a standard data extraction form or template for application to all included studies. The common features of such standardized forms are: A systematic approach: the same data extraction approach is applied across all studies but with flexibility for different study methodologies and designs (see below). The inclusion of data covering the areas highlighted in Table 1. Table 1: Common features of standardized data extraction forms Data extraction fieldInformation extractedContext and participantsDetailed information is extracted on the study setting, participants, the intervention delivered etc. This may aid later interpretation and synthesis by helping to retain the context in which the data are embedded. For example, it may be important to know whether a particular issue emerged from data collection with nurses or doctors or whether there was variation in views across settings, such as respondents interviewed in care homes and those interviewed at home. If context is lost during the synthesis process, the findings of the primary studies may be misinterpreted. To avoid this, referral back to the original papers may be used alongside extracted data during the analysis process.Study design and methods usedThis includes the methodological approach taken by the study; the specific data collection and analysis methods utilized; and any theoretical models used to interpret or contextualize the findings. The data extraction approach, and therefore the data extraction template, may need to be flexible so as to accommodate data collected within different qualitative methodologies (ethnography, phenomenology etc.) and using different methods (interview, focus groups, observations, document analysis etc.).FindingsThis covers the key themes or concepts identified in the primary studies. In extracting these findings, some review authors attempt to distinguish between first and second order interpretations.Quality of the studyDifferent approaches to appraising study quality have been used, as discussed in Chapter 6. Additional Box 1 includes several examples of the items included in data extraction forms for qualitative syntheses. Templates designed by other review organizations may also be helpful. For example, see: the UK National Institute for Health and Clinical Excellence (NICE) universal template (NICE 2006; British Psychological Association & Gaskell 2007) see Additional Box 1.4 the guidance regarding intervention description included in the data extraction templates developed by the Cochrane Effective Practice and Organisation of Care (EPOC 2006) and Consumers and Communication Review Groups (Cochrane Consumers and Communication Review Group 2009), Additional considerations Review authors may choose to involve more than one reviewer in data extraction for each included study and then compare these extractions and resolve any differences through discussion and reference to the original studies. This may help to ensure consistency of data extraction and congruence between the data extracted and the material in the original study. Even where only one review author undertakes most of the data extraction for a synthesis, it may be useful for a second author to validate at least a sample of these data extractions. Appraisal of the quality of included studies is an important component of the review process (see Chapter 6). Some argue that quality appraisal may be performed at the same time as the data extraction as part of the process of familiarizing oneself with the studies. Others suggest, however, that such assessments are best done separately (either before or after data extraction) as they require examining studies with a different lens. To some extent a decision on when to perform quality appraisal will depend on the tool that is being used. For example, if the tool is focused on technical markers of quality (e.g. the CASP tool CASP 2006), it may be straightforward to conduct the appraisal at the same time as data extraction. If the tool is focused on theoretical markers on quality (e.g. in Noyes & Popay 2007), it may be easier to conduct the appraisal separately as an understanding of the study as a whole is needed. Chapter 6 discusses quality appraisal in more detail. Qualitative analysis software packages, such as Nvivo and Atlas, may facilitate data extraction and support subsequent analysis. Dixon-Woods and colleagues (2005) describe systematically identifying the participant demographics, methods of data collection, methods of data analysis and major findings of each paper and assembling these onto a matrix using Access software. However, such specialist software is not essential. Choosing an appropriate method of data extraction Table 2 reflects how the type of review (informing, enhancing, extending, supplementing), as well as the synthesis approach (aggregative, interpretive etc.), might influence the approach to data extraction. Table 2: Choosing the most appropriate approach to data extraction* Use of qualitative evidence Informing reviews by using evidence from qualitative research to help define and refine the question, and to ensure the review includes appropriate studies and addresses important outcomesEnhancing reviews by synthesising evidence from qualitative research identified whilst looking for evidence of effectiveness from trials Extending reviews by undertaking a search to specifically seek out evidence from qualitative studies to address questions directly related to the effectiveness reviewSupplementing reviews by synthesising qualitative evidence within a stand-alone, but complementary, qualitative review to address questions on aspects other than effectiveness+Examples of reviews- Bates and Coren 2006: parental mental health - Rees et al. 2006: young people and physical activity - Oliver et al. 2008: young people and mental healthReviews of process evaluations and implementation studies, e.g.: - Greenhalgh et al. 2007: school feeding interventions - Roen et al. 2006: injury prevention - Glenton et al. 2010: lay health worker interventionsReviews focusing on what works for whom and in what circumstances, e.g.: - Thomas et al. 2003: healthy eating in children - Pound et al. 2005: treatment taking - Noyes & Popay 2007: TB treatment adherence - Carlsen et al. 2007: attitudes to guidelinesType of synthesisDescriptive / mapping with limited synthesisAggregative or InterpretativeInterpretativeInterpretativeData extraction approach used- Bates and Coren 2006: Each study was keyworded for generic issues such as study design, language, country, focus, population etc. and for topic specific issues such as intervention types, intervention sites and people providing the interventions. - Rees et al. 2006 and Oliver et al. 2008: Data were extracted from each view study on study aims, context, methods, sample and findings. Quality assessment criteria were also applied.- Roen et al. 2006: individual members of the team reading and re-reading texts and identifying ways in which evidence of implementation processes could be identified. (p1062) - Glenton et al. 2010: For those studies that were included, we extracted information regarding the objective of the qualitative study; the methods of data collection and analysis used; and the key themes and categories identified.Thomas et al. 2003: reports of relevant studies were first classified broadly using keywording system. For the views studies, a standardised data extraction and quality assessment framework, piloted previously and combined with an additional framework developed for the review specifically, was used. These tools enabled reviewers to extract data on the methodological and substantive details of the studies.- Pound et al. 2005: data extraction not well described - Noyes & Popay 2007: Our framework for data extraction consisted of two main domains: information about the study focus and methods, and findings illuminating the factors that shape decision making about treatment for TB. Data extraction and synthesis was thematic akin to the approach to analysis in much qualitative research. (p231) - Carlsen et al 2007: The selected studies were read and reread. Key themes and categories were identified, much as they would be in primary qualitative research. Searching for themes continued until all the studies were accounted for and no new themes were discerned. (p972)Key issuesFor scoping or mapping reviews, which often include a large number of studies, the number of items extracted for each study may need to be kept small so as to ensure that the review is manageable. Where the focus is on mapping the range of studies in an area, it may not be necessary to extract data on study findings. Reviews are more likely to be descriptive or aggregative than interpretive, and so the extent of immersion in the data may be less.In this form of qualitative synthesis, both aggregative and interpretive approaches may be used. For the former, the extent of immersion in the data may be less. Data extraction may be done concurrently for quantitative and qualitative data, particularly when the latter is embedded in RCT reports or other mixed method process evaluations.Reviews are more likely to be interpretive and require substantial immersion in the data.Reviews are more likely to be interpretive and require substantial immersion in the data.* At present, there are few published Cochrane syntheses of qualitative studies but these will be added as they become available. + Reviews of qualitative studies to supplement Cochrane reviews of effects are not standard Cochrane policy at present. Challenges within the data extraction process Within a Cochrane context, several challenges arise commonly within the data extraction process. Firstly, it may be difficult to distinguish qualitative and quantitative data in mixed method papers because of inadequate description of methods and active (and often useful) attempts to integrate these data in both the results and discussion sections. Consequently, review authors may disagree on which data should be extracted for a synthesis of qualitative studies. A second challenge concerns distinguishing first from second order interpretations. Some methodologists suggest that it is important to distinguish, and extract separately, first and second order interpretations so that these can be considered separately in the synthesis (Britten et al. 2002). For example, second order interpretations, which are usually more theorized, may make an important contribution to developing a conceptual framework for syntheses using the meta-ethnographic approach (Britten et al. 2002). However, the usefulness of this distinction between first and second order interpretations is questionable, given that all reported data are the product of author interpretation. Methodologists have also questioned the distinction between second and third order interpretations (Dixon-Woods et al. 2006), instead proposing that a synthesis produces new synthetic constructs which are a consequence of the reshaping, or interpretation, of data from individual studies to create a new model or framework. Another important challenge is how to distinguish first and second order interpretations from conjecture that is not rooted in data. Review authors need to consider how to ensure that the themes extracted from primary studies emerge from data and its analysis rather than from armchair theorizing by researchers. Another key consideration in the data extraction process is ensuring that the data extracted address the key questions of the stakeholders: Most reviews, but particularly those that have been commissioned, report to a range of stakeholders (consumers, health care providers, health care managers etc.), each of whom may have specific questions that they hope that the review will address. Once a decision is reached with stakeholders on the review objectives, the data extraction form needs to be developed to identify and include data that will address these objectives. Finally, the data extraction process is very much dependent on reporting quality in published studies. Concerns have been expressed about the quality of reporting and interpretation (or lack of it) in published reports of qualitative studies (Sandelowski and Barroso 2002; Munro et al 2008; Harden et al. 2004). For example, a synthesis of studies of childrens views on healthy eating identified a number of weaknesses, including poor reporting of the study sample and data analysis methods; and insufficient use of strategies for enhancing the reliability of data collection and analysis, including ensuring that this analysis was grounded in the views of children (Thomas et al. 2004). Poor reporting quality may limit the contribution of data from individual studies to the overall synthesis and may also be difficult to distinguish from poor study quality. Conclusions It is important to choose a data extraction approach that is appropriate to the review question, the type of review (whether it is focused on informing, enhancing, extending or supplementing a Cochrane review) and the available evidence. Regardless of the data extraction approach used, the process needs to be systematic and transparent and needs to be described in detail in the final review document. This allows the reader to establish an audit trail between the primary studies, data extraction and the synthesis findings. The formal, technical process of data extraction is a necessary, but clearly not sufficient, element of a synthesis. It provides the substrate for the subsequent interpretive and creative element of giving meaning to the data. Close attention to the data extraction process will facilitate an initial understanding and description of the shared characteristics of the body of the evidence and will pave the way for the more analytic and interpretive process of synthesis to follow. Additional boxes Additional Box 1: Examples of items included in data extraction forms1.1: Standard data extraction form (Munro et al. 2007 )Country Aims of study Ethics how ethical issues were addressed Study setting Theoretical background of study Sampling approach Participant characteristics Data collection methods Data analysis approach Key themes identified in the study (1st order interpretations) Data extracts related to the key themes Author explanations of the key themes (2nd order interpretations) Recommendations made by authors Assessment of study quality 1.2: Data extraction form based on a theoretical framework (Noyes & Popay 2007) Study focus and methods: Aim Research Questions Data collection methods Sample characteristics Context and setting Approaches to data analysis and interpretation Factors shaping individual decision making in relation to TB diagnosis and treatment: Social action, persistence and creativity Material circumstances and resources Lay and professional knowledge systems about the causes and consequences of TB and its treatment Public discourse around TB and social stigma attaching to it Sanctions and incentives in relation to diagnosis and treatment Social relationship of care and professional attitudes and behaviour System/Service organisation and delivery and the inverse care law 1.3: Data extraction form based on the Framework Approach (Lloyd Jones et al. 2005)Major construct/theory investigated (if applicable): Research method: There is a stated or implied method Yes / No If yes, that method is: If yes, that method fits the research purpose Yes / No If yes, that method is accurately rendered Yes / No The use of method-linked techniques for other than method-linked purposes is explained (e.g. the use of theoretical sampling in a descriptive study) Yes / No / Not applicable Nature of sample: General description of research approach: Major findings: Research design: a) Problem statement: There is a discernible problem which led to the study (whether explicitly stated or implicit in the research purpose and/or literature review) Yes / No If yes, what? The problem is accurately depicted Yes / No / Not applicable The problem is related to the research purpose and/or the literature review Yes / No / Not applicable The problem establishes the significance of the research purpose, or why the researcher wanted to conduct the study (beyond simply stating that no-one has studied this before) Yes / No / Not applicable b) Research questions: there is a discernible set of research purposes and/or questions which are either explicitly expressed or implicitly stated (e.g. in statements such as I hope to show that or I will argue that) Yes / No If yes, what? The research purposes or questions are linked to the problem and/or the literature review Yes / No The research questions are amenable to qualitative study Yes / No c) Literature review: The literature review is related to the research problem Yes / No It is clearly stated whether the literature review reflects what the researchers knew and believed before data collection, during data collection, during data analysis or after data analysis Yes / No. If yes, state which The review shows a critical attitude, rather than simply and/or indiscriminately summarising studies Yes / No The review shows a discernible logic that points towards the research purpose Yes / No d) Theoretical framework There is an explicitly stated or implicitly identified theoretical framework or frame of reference Yes / No If yes, name or describe framework Whether stated or implied, the framework fits the target phenomenon Yes / No / Not applicable If explicitly stated as the guiding framework for the study, it plays a discernible role in the way in which the study was conducted and/or the findings were treated (in contrast to a frame of reference which is clearly operating in a study, but which is not demonstrably recognised by the researcher) Yes / No / Not applicable The presentation of the theoretical framework clarifies whether it influenced researchers going into the field of study (i.e. before any data were collected), or while in the field, or during data analysis or after data analysis Yes / No / Not applicable e) Identification of other assumptions: Other assumptions, preconceptions, presuppositions of researcher are identified? Yes / No f) Researcher credentials: Documentation of researchers discipline? Yes / No If yes, what? Institution to which researcher affiliated: Any other pertinent information about researcher (e.g. methodological preference, conceptual preference)? g) Sampling and participants: Description of type of sampling procedure? Yes / No The sample size and configuration fit the purpose and sampling strategy Yes / No / Not applicable The sample size and configuration can support claims to informational redundancy, or theoretical or scene saturation Yes / No The sample size and configuration can support the findings Yes / No Features of the sample critical to the understanding of the findings are described Yes / No Sites of recruitment fit the evolving needs of the study Yes / No / Not applicable Identification of inclusion criteria? Yes / No Discussion of attrition in longitudinal studies? Yes / No / Not applicable h) Data gathering strategy(ies): Clear description of data gathering procedures? Yes / No If no, how could the description be improved? Data collection techniques and sources fit the purpose and mindsets of the study Yes / No Specific data collection techniques are tailored to the reported study Yes / No Data collection techniques are accurately rendered (e.g. participant observation is not confused with the observation that develops during interviews and focus groups) Yes / No The findings are demonstrably based on the sources of data presented (as opposed to when e.g. document study is presented as a data collection strategy but there is no evidence of its use) Yes / No Data collection techniques are correctly used (e.g. focus groups are used to stimulate group interaction rather than as opportunities to ask each participant the same question) Yes / No The sequence and timing of data collection strategies vis--vis each other fit the purpose and mindsets of the study Yes / No / Not applicable The data collection sites (e.g. interview rooms) are conducive to data collection Yes / No Any alterations in technique fit the evolving needs of the study Yes / No / Not applicable Description of gaining access? Yes / No Recruitment and consent techniques were tailored to fit the sensitivity of the subject matter and/or vulnerability of subjects Yes / No Data collection and management techniques were tailored to fit the sensitivity of the subject matter and/or vulnerability of subjects Yes / No The time period for data collection is explicitly stated Yes / No i) Data management and analysis strategies The method(s) used are described Yes / No If yes, what are they? The data management techniques fit the purposes and the data Yes / No j) Findings: There is a discernible set of results distinguishable from the data (case descriptions, supportive quotes etc) collected by the researchers Yes / No The results are distinguishable from the researchers discussion of results, or from the results of other studies to which the researcher refers Yes / No Interpretations of data are demonstrably plausible and/or sufficiently substantiated with data Yes / No Data are sufficiently analysed and interpreted Yes / No Findings address the research purpose Yes / No Variations in sample and/or data are addressed Yes / No Concepts or ideas are well-developed and linked to each other Yes / No Concepts are used precisely Yes / No The analysis is well supported by representative quotes/findings? Yes / No The analysis of data fits the data (as opposed to e.g. focus group data being analysed on an individual level and the analysis taking no account of group interaction) Yes / No Provision of evidence as to how representative in the sample the various findings were? Yes / No k) Conclusions, discussion, implications, suggestions for further study The discussion pertains to all significant findings? Yes / No The interpretive statements correspond to the findings? Yes / No The study findings are linked to the findings of other studies, or to other relevant literatures (whether previously discussed or newly introduced) Yes / No The clinical, political, theoretical and/or other significance of the findings is thoughtfully considered when recommendations are made for changes in practice or for further research (as opposed to e.g. just recommending actions which are the opposite of the study findings) Yes / No Details of recommendations made, if any: Details of suggestions for future research, if any: The findings are relevant for contemporary use Yes / No l) Validity Non-research relationship of researcher to participants: Evidence that researcher has considered the effect of his/her presence on the research findings? Yes / No Evidence that researcher has considered possibility of researcher bias or misinterpretation? Yes / No Identification of the distinctive limitations of the study, not just the so-called limitations of qualitative research (e.g. issues of generalisability in case study research)? Yes / No Specific limitations identified: Validation techniques are used that fit the purpose, methods, sample, data and findings of the study: Yes / No / Not applicable Validation techniques are correctly used: Yes / No m) Form of report: There is a coherent logic to the reporting of findings Yes / No Visual displays, quotes, cases and numbers clarify, summarise, substantiate or otherwise illuminate the findings (as opposed to being at odds with them e.g. when a quote contains more ideas than recognised by the researcher, or a path diagram shows a relationship between variables at odds with the relationship between them depicted in the text) Yes / No The numerical value of terms such as most, some, sometimes etc is clear Yes / No The empirical referent for a theme or concept is clear (i.e. types of behaviour, strategies employed by the participants etc) The title and section headings are an accurate reflection of content Yes / No The form fits the audience for whom the report was produced Yes / No Other considerations/thoughts: Decision to include in meta-study: Yes / No /undecided (give details)  1.4: NICE data extraction form (British Psychological Society & Gaskell 2007)Eligibility: Does the evidence fit within the scope of the review? Type of study Participants Study aims Are the aims and purpose of the study clearly stated? Key findings Evaluative summary: Draw together brief comments on the study as a whole and its strengths and weaknesses. Is further work required? What are its implications for policy, practice and theory, if any? Ethical standards: Was ethical committee approval obtained? Was informed consent obtained? Does the study address ethical issues adequately? Has confidentiality been maintained? Area and care setting: What is the geographical and care setting for the study? What is the rationale and appropriateness for this choice? Is there sufficient detail about the setting? Over what period did the data collection take place? Sample: Inclusion and exclusion criteria: Who was included in the study? Who was excluded from the study? Selection: How was the sample selected? Were there any factors that influenced how the sample was selected (e.g. access, timescale issues)? Size: What is the size of the sample and groups comprising the study? Appropriateness: What is the size of the sample and groups comprising the study? Data collection: Methods: What data collection methods were used? Was the data collection adequately described and rigorously conducted? Role of researcher: What is the role of the researcher within the setting? Are there any potential conflicts of interest? Fieldwork: Is the process of fieldwork adequately described? Data analysis: How are the data analysed? How adequate is the description of the data analysis? Is adequate evidence provided to support the analysis (e.g. use of original data, iterative analysis, efforts to establish validity and reliability)? Is the study set in context in terms of findings and relevant theory? Researchers potential bias: Are the researchers /researchers own position, assumptions and possible biases outlined? Indicate how they could affect the study in terms of analysis and interpretation of the data Reflexivity: Are the findings substantiated by the data and has consideration been given to any limitations of the methods or data that may have affected the results? Findings: Themes Conclusions Opinions: What this person argues Policy and practice: Generalisability: To what extent are the study findings generalisable? What is the country of study? How applicable are the study findings to the system in the UK? Are the conclusions justified? Implications for policy Implications for practice  Additional Box 2: Example of a completed data extraction form drawn from a review by Munro et al. (2007) Synthesis aim for Munro et al. review: to understand the factors considered important by patients, caregivers and health care providers in contributing to TB medication adherence. Extraction itemDetailsCitationLiefooghe R, Michiels N, Habib S, Moran MB, de Muynck A (1995) Perception and social consequences of tuberculosis: A focus group study of tuberculosis patients in Sialkot, Pakistan. Soc Sci Med 41: 16851692.ReviewerReviewer 1 Note that cross-checking would be the next step, process of comparison, discrepancies clarifiedCountryPakistanAimsTo explore the cultural factors influencing perceptions of tuberculosis (TB) and their effect upon treatment adherenceEthics how ethical issues were addressedNot statedUrban/ruralUrbanSocio-demographics of the country / regionmean age = 35 years. Females = 29 yrs, males = 40 yrs. 86% Muslim, 14% Christian. 72% new TB patients, 14% relapsed TB patients, 14% readmitted defaultersRecruitment context (e.g. where people were recruited from)Inpatients admitted to hospital TB wardsPreventive/curative medicineCurativeData quality ratingAssessment not includedParticipantsTB patientsTheoretical backgroundHealth Belief Model (Becker and Maiman 1975), adapted by Barnhoorn and Adriaanse (1992) for TB complianceSamplingnot discussedSample (participant) characteristicsSee socio-demographic characteristics aboveData collectionFocus group discussions conducted by 'village animators' who were trained as moderators by a clinical psychologist. Discussions conducted in the hospital, in the language of participants and were fully audio-recorded. They were also observed by the clinical psychologist. Interview guide utilised. No health workers present. Recordings translated and transcribed into EnglishData analysisThree researchers "analysed the transcriptions independently. Relevant topics related to the research questions were identified and coded. The coded material was sorted according to topic. Each researcher analysed the content and separately formulated his / her conclusions. Their findings were compared and checked for consistency." (p1687)Themes(1) Perceptions of TB: most participants perceived TB as an important health problem and a dangerous disease. Some thought it was contagious while others did not. Seen as a 'family disease' rather than one of individuals. Not all patients thought that the disease could be cured. (2) TB diagnosis and treatment: Most families have difficulty in accepting the diagnosis, and this may negatively influence treatment adherence, although many families supportive of patient. Patients also find the disease hard to accept, fear the adverse responses of others and may resist the diagnosis. The diagnosis is associated with feeling of anxiety and isolation. (3) Social consequences of the disease: the attitudes of friends and neighbours to TB patients were seen as negative (the disease is socially stigmatising) and there is a widespread belief that the patient will always be contagious. The disease may affect the chances of marriage or result in divorce or other family problems. (4) Financial burden: Both direct and indirect costs seen as important, particularly for male patients who usually the main bread winners. (5) Pregnancy and TB treatment: pregnant women may not take their treatment because they believe that the drugs are not effective in pregnancy and intolerance to the drugs is increased.Data extractsNot included in this tableAuthor explanation(1) Because it is widely believed that the disease cannot be cured, many patients are afraid to be labelled as having TB and may therefore reject both the diagnosis and the treatment. (2) Social stigma for both the individual and the family contribute to treatment defaulting. "Family pressure' is an important factor in accepting or denying the diagnosis and treatment. (3) The costs of treatment are also related to poor adherence and families may have to make large financial sacrifices to continue treatment. (4) Beliefs about TB and pregnancy may also contribute to poor adherence. (5) The findings of the study fit well with the Barnhoorn and Adriaanse model.Recommendations(1) Health education should become an integral part of the TB programme (2) The psychological and social implications of the disease need attention - patients and relative should receive regular counselling from specially trained health workers. (3) "Health professionals should anticipate critical moments in treatment adherence and assist the patient and his / her family to bridge them" (p1691) (4) Health professionals need to be careful not to stigmatise the disease through their attitudes and practices, and should also receive health education. Additional Box 3: Example of a completed data extraction form drawn a review by Noyes and Popay (2007) Synthesis questions for the Noyes and Popay review: 1. What does qualitative research tell us about the facilitators and barriers to accessing and complying with TB treatment? 2. What does qualitative research tell us about the diverse results and effect sizes of the RCT included in the Cochrane quantitative systematic review? Paper: Liefooghe et al. Perception and social consequences of TB: A focus group study of TB pts in Sialkot, Pakistan. Soc Sci Med 1995;41(12):1685-1692.Study focus and methods: Aim: To explore the cultural factors influencing perceptions of TB and their effect on treatment adherence. Research Questions: Not stated. Method: Focus groups with hospitalised patients with TB undergoing 8 weeks of supervised therapy (directly observed therapy). Sample: 3 female and 3 male focus groups each with 8 pts (48pts in total). Mean age overall 35yrs (( 15.5yrs). Men 40yrs (( 15.7 yrs), Women 29yrs (( 13.2 yrs). 86% Muslim; 14% Christian. Women are much younger than men in the sample. 72% new pts. 14% relapsed, 14% readmitted defaulters. Context: Participants in-patients in TB hospital in Pakistan. Approaches to data analysis and interpretation: Focus groups were tape recorded and transcribed. 3 researchers independently analysed transcripts thematically. Findings between the 3 researchers were then compared. Factors shaping individual decision making in relation to TB diagnosis and treatment: Social action, persistence and creativity: Once recovered from the shock of diagnosis, families were generally supportive (although not all women received the same support as men). Some women hid their diagnosis. Material circumstances and resources: TXR is expensive (2 months salary for average worker). Pts (especially women) dependent on families for money for treatment. Not all willing to pay, others make large sacrifices. Some pts unable to work due to illness/hospitalisation. Because this form of directly observed therapy required being an in-patient for the first 8 weeks, the cost of hospitalisation was prohibitive for some families (in particular women who may have been reliant on their husband and in-laws for money). Lay and professional knowledge systems about the causes and consequences of TB and its treatment: Lay: individuals explanatory models did not always coincide with the medical model (especially concerning the curability of disease and pregnancy) and professionals saw this as a barrier to treatment Most pts said that TB is a major problem and contagious. Others did not perceive TB to be infectious and attributed it to other causes. TB was perceived to be a family (not individual) disease. Pts hoped for a cure but not all were convinced they would be cured. Diagnosis causes deep distress in families. Some feel they have been punished by God. Women stopped taking TB medication during pregnancy as they believed that intolerance to the drugs increased. Pregnancy was also thought in one area to reactivate TB. Public discourse around TB and social stigma attaching to it: Negative family attitudes impacted on treatment access and adherence. Pts very shocked by diagnosis- some rejected /denied diagnosis. Treatment defaulting by patients is one of the major causes of failure in TB control programs. Some pts treated negatively by friends/families. Others were not. Liefooghe et al aimed to look at the experiences of men and women separately and by doing so found that women suffered an increased burden of stigma than men and in particular a diagnosis of TB could effect their marriage prospects. Some women forced from the family home because of diagnosis. Although some women had supportive husbands. Stigmatising behaviours were also reinforced by health care professionals Sanctions and incentives in relation to diagnosis and treatment: People had to undergo compulsory hospitalisation for the first 8 weeks of therapy (for which patients had to pay). Women also were subjected to negative sanctions (see under stigma). Social relationship of care and professional attitudes and behaviour: Outcomes of treatment were different depending on gender, age and position in family (with women facing most challenges). Some staff reinforced stigma of disease. Attitudes of staff at hospital perceived to reinforce erroneous ideas concerning infectivity and stigma. System/Service organisation and delivery and the inverse care law: Compulsory hospitalisation and payment for care may have deterred patients from coming forward. This is not explored in the paper as only patients undergoing treatment in hospital were interviewed.  References Bates, S. and Coren, E. (2006) Systematic map no.1: the extent and impact of parental mental health problems on families and the acceptability, accessibility and effectiveness of interventions. London: SCIE. Briggs M, Flemming K. (2007) Living with leg ulceration: a synthesis of qualitative research. Journal of Advanced Nursing. 59(4): 319328. The British Psychological Society and Gaskell. (2007) Dementia: A NICESCIE Guideline on supporting people with dementia and their carers in health and social care. National Clinical Practice Guideline Number 42. National Collaborating Centre for Mental Health. Britten N, Campbell R, Pope C, Donovan J, Morgan M, Pill R. (2002) Synthesis of qualitative research: a worked example using meta ethnography. J Health Services Res Policy. 7:20916. Carlsen B, Glenton C, Pope C. (2007)  HYPERLINK "http://www.ncbi.nlm.nih.gov/pubmed/18252073?ordinalpos=2&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum" Thou shalt versus thou shalt not: a meta-synthesis of GPs' attitudes to clinical practice guidelines. Br J Gen Pract. 57(545): 971-8. CASP Critical Appraisal Skills Programme. (2006) Making sense of evidence: 10 questions to help you make sense of qualitative research. Public Health Resource Unit, England.. Available at:  HYPERLINK "http://www.medev.ac.uk/static/uploads/workshop_resources/166/166_Qualitative_Appraisal_Tool.pdf" http://www.medev.ac.uk/static/uploads/workshop_resources/166/166_Qualitative_Appraisal_Tool.pdf Cochrane Consumers and Communication Review Group. (2009) Data Extraction Template for Cochrane Reviews.. Available at:  HYPERLINK "http://www.latrobe.edu.au/chcp/cochrane/resources.html" http://www.latrobe.edu.au/chcp/cochrane/resources.html Dixon-Woods, M et al (2005) Vulnerable groups and access to health care: a critical interpretive review Report for the National Co-ordinating Centre for NHS Service Delivery and Organisation R & D (NCCSDO) April 2005, revised August 2005 Prepared by Mary Dixon Woods Ms Deborah Kirk Ms Shona Agarwal Dr Ellen Annandale Dr Tony Arthur Dr Janet Harvey Dr Ronald Hsu Dr Savita Katbamna Dr Richard Olsen Dr Lucy Smith Dr Richard Riley Dr Alex Sutton Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, Hsu R, Katbamna S, Olsen R, Smith L, Riley R, Sutton AJ. (2006) Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 26;6:35 EPOC. (2010) Data collection checklist. Available at:  HYPERLINK "http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/datacollectionchecklist.pdf" http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/datacollectionchecklist.pdf Glenton C, Lewin S, Scheel I. Still too little qualitative research to shed light on results from reviews of effectiveness trials: A case study of a Cochrane review on the use of lay health workers. 2010. In review. Greenhalgh T, Kristjannson E, Robinson V. (2007) Realist review to understand the efficacy of school feeding programmes. BMJ. 335: 858-861. Harden A, Garcia J, Oliver S, Rees R, Shepherd J, Brunton G, Oakley A. (2004)  HYPERLINK "http://www.ncbi.nlm.nih.gov/pubmed/15310807?ordinalpos=7&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum" Applying systematic review methods to studies of people's views: an example from public health research. J Epidemiol Community Health. ;58(9): 794-800. The Joanna Briggs Institute Reviewers Manual, 2008 Edition. http://www.joannabriggs.edu.au/about/home.php Lloyd Jones M et al. (2005) Role development and effective practice in specialist and advanced practice roles in acute hospital settings: systematic review and meta-synthesis Journal of Advanced Nursing. 49 (2): 191209. Marston C, King E. (2006) Factors that shape young people's sexual behaviour: a systematic review. Lancet. 368(9547): 1581-6. Munro S, Lewin S, Smith H, Engel M, Fretheim A, Volmink J. (2008) Conducting a meta-ethnography of qualitative literature: lessons learnt. BMC Medical Research Methodology. 8:21. Munro S, Lewin S, Smith H, Engel M, Fretheim A, Volmink J. (2007) Adherence to tuberculosis treatment: a qualitative systematic review of stakeholder perceptions. PLOS Medicine. 4(7): e238. NICE (2006) Methods for development of NICE public health guidance, NICE UK. Available at:  HYPERLINK "http://www.nice.org.uk/phmethods" http://www.nice.org.uk/phmethods Accessed 23 December 2008. Noblit G, Hare R. (1988) Meta-ethnography: synthesising qualitative studies. Newbury Park, CA: Sage. . Noyes J, & Popay J. (2007) Directly observed therapy and tuberculosis: how can a systematic review of qualitative research contribute to improving services? A qualitative meta-synthesis. J Adv Nurs. 57(3):227-43. Oliver S, Harden A, Rees R, Shepherd J, Brunton G, Oakley A. (2008)  HYPERLINK "http://www.ncbi.nlm.nih.gov/pubmed/17984295?ordinalpos=3&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum" Young people and mental health: novel methods for systematic review of research on barriers and facilitators. Health Educ Res. 23(5): 770-90. Pearson A. (2004) Balancing the evidence: incorporating the synthesis of qualitative data into systematic reviews. JBI Reports. 2(2), 4564. Pound P, Britten N, Morgan M, Yardley L, Pope C, Daker-White G, Campbell R. (2005) Resisting medicines: a synthesis of qualitative studies of medicine taking. Social Science & Medicine 6: 133-155 Rees R, Kavanagh J, Harden A, Shepherd J, Brunton G, Oliver S, Oakley A. (2006)  HYPERLINK "http://www.ncbi.nlm.nih.gov/pubmed/17041020?ordinalpos=1&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum" Young people and physical activity: a systematic review matching their views to effective interventions. Health Educ Res. 21(6): 806-25. Ritchie, J. & Spencer, L. (1994). Qualitative data analysis for applied policy research" by Jane Ritchie and Liz Spencer in A.Bryman and R. G. Burgess [eds.] Analyzing qualitative data,, pp.173-194. Sandelowski, M. & Barroso, J. (2002). Reading qualitative studies. International Journal of Qualitative Methods, 1 (1), Article 5 Schutz A. (1971) Collected Papers . Volume 1. The Hague , Martinus Nijhoff;, 361. Smith LK, Pope C, Botha JL. (2005) Patients' help-seeking experiences and delay in cancer presentation: a qualitative synthesis. Lancet.;366(9488): 825-31. Taylor CA, Shaw RL, Dale J, French DP.(2010) Enhancing delivery of health behaviour change interventions in primary care: A meta-synthesis of views and experiences of primary care nurses. Patient Educ Couns. Nov 2. Thomas J, Harden A, Oakley A, Oliver S, Sutcliffe K, Rees R, Brunton G, & Kavanagh F. (2004) Integrating Qualitative Research with trials in systematic reviews: an example review from public health shows how integration is possible and some potential benefits. BMJ 328: 1010-12 Thomas J, Sutcliffe K, Harden A, Oakley A, Oliver S, Rees R, Brunton G, Kavanagh J. (2003) Children and Healthy Eating: A systematic review of barriers and facilitators. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London. University of London.. Available at: http://eppi.ioe.ac.uk/EPPIWebContent/hp/reports/healthy_eating02/Final_report_web.pdf Thomas J, Harden A. (2008) Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 8: 45. Woodman J, Lorenc T, Harden A, Oakley A (2008) Social and environmental interventions to reduce childhood obesity: a systematic map of reviews. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London.  First order interpretations or primary themes are those that reflect participants' understandings, as reported in the included studies (usually found in the results section of an article). Second order interpretations are the interpretations of participants' understandings made by authors of these studies (and usually found in the discussion and conclusion section of an article). Third order interpretations arise out of the synthesis of both first and second order interpretations into a new model or theory about a phenomenon. (Schutz 1971; Munro 2008)  For both Boxes 2 and 3, the extracted data presented was the first stage in an iterative process of analysis that moved between the original paper, the extracted data and the emerging synthesis framework.     Version 1. 23 December 2010 PAGE  PAGE 1   ,-LaM 8 9 : ; êjcXcXGX=4hyVh:tCJ(hyVhyV0J35!hyVhyV0JfHq jhyVhyVU hyVhyV-hyVhyV0J36B*fHphq $hyV0J3B*fHphq *hyVhyV0J3B*fHphq 0hyVhyV0J35B*\fHphq hyVhYCJ(hyVhY5CJ aJ hyVhyV5CJ aJ hyV5CJ aJ hyVhv<5CJ aJ hyVhv<,-: ; < G H $7$8$H$a$gdyV $h^ha$gdyV $ & Fa$gdyV$a$gdyV1 & F([$\$gdyV$a$gdyVgdyV; < G H W  % : O 5 = r s x y ۴~o~`~~QhyVh>^mH nH sH tH hyVh7mH nH sH tH hyVh~3mH nH sH tH hyVh^mH nH sH tH hyVhYmH nH sH tH hyVhY>*CJ hyVhv<56CJaJhyVhv<CJ(hyVh)CJ( hyVh.j hyVh hyVh~3 hyVh) hyVhMqhyVhY56CJaJhyVhYCJ(    & * 9 = > a z }  +ӵӡyrkrdrdrd hyVh%/ hyVh>^ hyVhv<'hyVhY>*CJ aJ mH nH sH tH 'hyVh.j>*CJ aJ mH nH sH tH 'hyVhr>*CJ aJ mH nH sH tH hyVh7mH nH sH tH hyVh9smH nH sH tH hyVhrmH nH sH tH hyVhYmH nH sH tH hyVh>^mH nH sH tH $ : ,-/0 $$Ifa$gdyV$a$gdyV $7$8$H$a$gdyV"8F_mnr ,- *8CJOPV^abefsĽĶġ hyVhzHT hyVhX hyVh9s hyVhz hyVh1z hyVh# hyVh hyVhr< hyVh>^ hyVhphyVh>^B*phf hyVh~3 hyVhv< hyVh%/ hyVh.j6)acl{cIc5?H9KQT䳺ȥ䥞 hyVh3< hyVh] hyVhF2 hyVh# hyVh[U hyVhG hyVhmq hyVh~3 hyVhr< hyVh_ hyVh hyVhv<hyVhv<5CJaJhyVhv<CJ ;Tcfkl0HIP[_`45;BHLMN ()*,-ݹݹݲǫβݢhyVhv<CJ hyVh hyVhp hyVh7 hyVhzHT hyVh# hyVhE3hyVhv<5 hyVhv< hyVh hyVh/ hyVh] hyVh3<9aN*zzzzz$ & F$Ifa$gdyVtkd$$Ifl,""  t 0644 lap *+,-WB"C"s%t%0({k$]^a$gdyV $ & F a$gdyV $7$8$H$a$gdyV$a$gdyVekd$$Ifl,"" t0644 la -W^ !!!!!!!C"s%t%%%%%&1&3&?&M&e&{&&&&&''''''"'žžžžžݑőőŊݑݑݑݑ| hyVh9L hyVh hyVh| hyVhXchyVh 6CJ hyVh  hyVh-I hyVh/ hyVh# hyVh(e hyVhdhyVhv<6] hyVhE3 hyVhv< hyVh]'hyVhv<5CJaJmH nH sH tH 0"'#'O'/(0(1(((((() )?)@))))***?*****&+>+\+g+v+++++++q,,,,, - - -Z-\-.!.%.0.H./,/»׻´޻ަוצ׎ hyVhn hyVh hyVhOShyVhv<6] hyVh hyVh hyVh1z hyVh] hyVh(e hyVh_A hyVhc hyVhXc hyVhv<hyVh9L0J+CJaJ hyVh9L hyVha50(1(++ - - -\-22q5r5s55::N<O<===>>&@ $h^ha$gdyV 7$8$H$gdyV $ & F a$gdyV$a$gdyV,/Y/^/h//////////////00b0t0000161;1=1M1k1m1z1{1}111111111122222222X4Y4~44444444r5s5ֺ֥֬֬ hyVh hyVhN hyVhx hyVhj hyVh# hyVhD hyVh] hyVhv< hyVhTW hyVhXc hyVh hyVhn hyVh(>s555)6*6-6<6m66666F7O7P7T7777788888899999?9@9B9C9D9U9^9i9999995:>::;;;;N<O<b<žﷰžũӢ̍̔ hyVh9 hyVhx hyVh< hyVh|nX hyVhR hyVhN hyVhP } hyVh# hyVh^ hyVh; hyVhhZ hyVh hyVh[U hyVhOS hyVhv<hyVhv<6]5b<c<==============Z>k>>>??&@)@@@@@@AOA{A|AAMDkDbFjFkF,G-G.G0GDGEG]GgGGG䬢䎘䎘zz hyVh*jhyVh350JUhyVh356]hyVhP }6]hyVhP }5\ hyVh35 hyVh&R hyVhGu hyVh4 hyVhg4 hyVh< hyVh# hyVhx hyVhP } hyVhY hyVhv< hyVhN0&@@AAOAeA{A|AALDPkd $$Ifl0,"t$  t0644 lap $IfgdyV$a$gdyV $ & Fa$gdyV LDMDkDaF~~ $IfgdyVxkd$$Ifl0,"t$ t0644 laaFbFkF/G~~ $IfgdyVxkd\$$Ifl0,"t$ t0644 la/G0GEGG~~ $IfgdyVxkd$$Ifl0,"t$ t0644 laGGGGGGGGGHH/H\H_HiHkHpHsHtHwHHHHHHHHIIIIIȴqcqUqhyVh QOJQJ\^JhyVh#OJQJ\^JhyVhF0OJQJ\^JhyVh<OJQJ\^JhyVhv<OJQJ^JhyVh QOJQJ^JhyVh<OJQJ^JhyVh35OJQJ^J hyVh< hyVh Q hyVh9 hyVhF0 hyVhv< hyVhOy hyVhP } hyVh35 hyVh1zGGGpHI2J3JMJnLoLGPHPQQrr " & F# 7gdyV$a$gdyVxkdv$$Ifl0,"t$ t0644 la II0J1J2J3JMJLLOOPPGPHPQQ%R-R:R}RRRRRRRRRRR9S:Szzpf\fRhyVhL5\hyVhj d5\hyVh{j+5\hyVhvc5\ hyVh.9P hyVhv< hyVhs hyVhj d'hyVhv<5CJaJmH nH sH tH hyVh9CJ hyVh# hyVh1z hyVh9hyVh96hyVhv<CJ hyVhNOJQJ^JhyVh QOJQJ^JhyVhF0OJQJ^J QQ%RRRR;SXSTTFUU $IfgdyV $7$8$H$a$gdyV$a$gdyV :S;S?SBSWSXSiSjSTT&T'TTTTTTTEUFU[U\UUUUUVVV VVVV"V:V=VBVIVqVrVʿʿʿʿ։։րwnwwewhyVh#CJhyVhj dCJhyVhv<CJhyVhfgCJhyVhC5hyVhBCJH*aJnH tH hyVhmCJaJnH tH hyVhv<CJaJnH tH hyVhv<CJaJhyVhv<5CJaJhyVhv<5hyVh2(5hyVh a5hyVhcd5hyVhv<5\'UUkd$$Iflr yU"/wv  J  t 2帷0644 lap2帷U V;VrVVV WFW}WWWXMX|X $IfgdyV rV{VVVVVVVVVVVVVWWW"W&W'W.W2W3W4WEWFWOWVW}WWWWWWWWWWWWWWWWʸwhyVh#CJmH sH hyVh#iCJmH sH hyVhLCJmH sH hyVhv<CJmH sH hyVhCJmH sH hyVhCJhyVhCCJhyVh7CJhyVhwCJhyVhv<CJhyVhmCJhyVh#CJhyVhfgCJ+WWXX X!X&X'X/X5X8XKXLXOXTXUXVX]XbXcXdXqX{X}XXXXXYY-YZZZZZZZ/Z6Z:ZZZZZZZʹʰʧʞ尕vvhyVhwCJhyVhGCJhyVhmCJmH sH hyVhmCJhyVhB!CJhyVh)CJhyVhx CJhyVhLCJhyVhv<5hyVhv<CJhyVh1zCJhyVhH* hyVh:KhyVh+>5hyVh@IS5 hyVh+>hyVhq>*CJ hyVhA]>*CJ hyVhv<CJ( hyVhA] hyVhI hyVhj hyVhv<'hyVhv<5CJaJmH nH sH tH hyVhv<>*CJ( hyVhP; hyVh hyVh# hyVh>"g%vvv| $$Ifa$gdyVwkd~ $$Ifl,""  t 0644 lap vvvw0w>w^wpwwwww#xexx||||||||||||| $$Ifa$gdyVwkd' $$Ifl,""  t 0644 lap Txcxxxxxxyyyyy{{{{{C|}~ʀ΀\hgk(,^bquae<YǟҾڝ hyVhOy hyVhXhyVh:K5hyVh:KmH sH  hyVhf`hyVh:K>*CJ hyVh:K5CJhyVh:K6 hyVh# hyVh:KhyVh@IS>*CJ hyVh+> hyVh@IS9xxxxx$a$gdyVgkd $$Ifl,"" t0644 la $$Ifa$gdyVxxyy&y?yWykyyyyzAz||||i||||||$$/&`#$/Ifa$gdyV $$Ifa$gdyVwkdL $$Ifl,""  t 0644 lap Azzz{d{{{{{$a$gdyVgkd $$Ifl,"" t0644 la $$Ifa$gdyV{{2|C|q||||}}}}}~rrrrr & F$IfgdyV $IfgdyVwkdq $$Ifl,""  t 0644 lap ~~~~g45M-ԁՁ.  & F `$If^gdyV & F `$If^gdyV & F `$If^gdyV $If^gdyV & F `$If^gdyV $IfgdyV {ӃԃZ}݄&&'OƇ $If^gdyV & F `$If^gdyV & F"$IfgdyV & F$IfgdyV $IfgdyV & F `$If^gdyV5VՉwˊGHiы, & F `$If^gdyV $If^gdyV & F `$If^gdyV & F$IfgdyV $IfgdyV & F `$If^gdyV,2C$=ב56C $If^gdyV & F `$If^gdyV $IfgdyV & F `$If^gdyV & F `$If^gdyVCْtݓFǔ?STۖ٘7op| & F $IfgdyV & F$IfgdyV $IfgdyV & F$IfgdyV Bc,lѝ);<[ $$Ifa$gdyV & F$IfgdyV $IfgdyV & F! `$If^gdyV $IfgdyV & F $IfgdyV $IfgdyV$a$gdyVgkd $$Ifl,"" t0644 la:HU`m 8rݢtttt & F$$IfgdyV $IfgdyVtkd$$IfF!L"  t 0644 lap `8qrܢݢ=}~ Qc-B$% иޝޝޝދޝޝދޝhyVh@ISCJ hyVhOyhyVhOyB*phhyVhOy6B*]phhyVhOy6B*phhyVhX6B*phhyVhXB*phhyVhX6B*]phhyVhOy6hyVhX6 hyVhXhyVhX>*CJ 1ݢ~ R.%ө & F'$IfgdyV & F&$IfgdyV & F%$IfgdyV $IfgdyV & F$$IfgdyV\]"* 7$8$H$gdyV$a$gdyVekd$$IfF!L" t0644 la $IfgdyV ;GMSUZ[\]{|*+4y{ 5AMTYüsshssssshyVhA]CJaJhyVhq6CJ]aJhyVhqCJaJhyVhq5CJ\aJ hyVh hyVh(*jhyVh 0JU hyVhq hyVh')hyVh')5\hyVh 5\hyVhq5\hyVh@IS5\hyVhq>*CJ hyVh+>>*CJ '*+4z9Qkd*$$Iflh0T!&l,"44 la $IfgdyVkkd$$Iflh0T!&l ,"44 lapz{ TQkd$$Ifl0T!&&l,"44 la $IfgdyVQkd$$Ifl0T!&&l,"44 la 5@AMSTQkd$$Iflc0T!&&l,"44 la $IfgdyVQkdJ$$IflO0T!&l,"44 laSTWTQkdj$$Ifl0T!&&l,"44 la $IfgdyVQkd $$Ifl0T!&&l,"44 laYZW֮r{ܯesʲѲ'ºҺ&JVefglmnxyr hyVhhyVh(*>*hyVhq>*CJ hyVh hyVh')hyVhB 5\hyVh')5\hyVh 5\hyVh@IS5\hyVh:K5\ hyVhGD hyVhqhyVhqCJaJhyVhq6CJ]aJhyVh 6CJ]aJ,ծTQkd*$$Ifl0T!&l,"44 la $IfgdyVQkd$$Ifl0T!&l,"44 laծ֮qTQkd$$Ifl_0T!&&l,"44 la $IfgdyVQkd$$Ifl'0T!&l,"44 laqr{ۯTQkd$$Ifl70T!&l,"44 la $IfgdyVQkdJ$$Ifl0T!&&l,"44 laۯܯdesɲTQkdj$$Ifl0T!&l,"44 la $IfgdyVQkd $$Ifl0T!&l,"44 laɲʲѲTQkd*$$Ifl0T!&l,"44 la $IfgdyVQkd$$Ifl0T!&l,"44 la'ºҺTQkd$$Iflm0T!&l,"44 la $IfgdyVQkd$$Ifl0T!&l,"44 lamn!T $$Ifa$gdyV$a$gdyVgdyVQkdJ$$Ifl0T!&l,"44 lax !\]¾STUlosۿy 56 ¹sss jhyVhGDCJaJhyVhGD5CJ\aJhyVhGDCJaJhyVhGD6>*CJ]aJ hyVhGDhyVhGDCJhyVhGDCJhyVh CJhyVh 6>*CJ]aJhyVhB >*CJ hyVh2( hyVh hyVh^ hyVh(*-TUoۿy $$Ifa$gdyV $$Ifa$gdyV]kd$$Ifl$$0$64 la D#nx~ !$$Ifa$gdyV $$Ifa$gdyV $$Ifa$gdyV]kd-$$Ifl$$0$64 la 7N ^#cbmxyz{|}~K\ryùyrkrckrkr\ hyVhOyhyVhE36 hyVhJ hyVhE3hyVhXc6 hyVhXchyVh1z>*CJ hyVhv<5CJaJhyVh >*CJ hyVhRhyVhR>*CJ hyVhq>*CJ hyVhB >*CJ hyVhGDhyVhGDCJaJhyVhGD5CJ\aJ#hyVhGD56>*CJ\]aJ$xyz{|}~[\gdyV$a$gdyV]kd$$Ifl$$0$64 la=>+2~tu)0*+;ؾؾز띈nnn2jhyVhb)(B*OJQJU^JnH phtH )hyVhJB*OJQJ^JnH phtH )hyVhb)(B*OJQJ^JnH phtH hyVhE36mH sH jhyVhE3UmH sH hyVhJmH sH hyVhE3mH sH hyVhE36 hyVhE3 hyVhOy hyVhJ#EFVWST,-JKf $[$\$gdyV"gdyVgdyVKLF8LVW]dǵǵǥyncnTnTjhyVh QUmH sH hyVhJmH sH hyVh QmH sH hyVhE3mH sH hyVhE36hyVhE3h7O= hyVhE3hyVh9L6 hyVh9LhyVh Q0JjhyVh QU hyVhJ hyVh Q hyVhb)()hyVhb)(B*OJQJ^JnH phtH )hyVhofB*OJQJ^JnH phtH QRTo,-W^ 7@AJKfμyng`X`Q hyVhE3hyVhR6 hyVhR hyVhJhyVhRmHsH hyVh[UhyVh[UCJaJhyVh[UmH sH jhyVhE3UmH sH hyVhE36mH sH hyVhJmH sH hyVhE3mH sH  hyVh\hhyVh\hmH sH hyVh QmH sH jhyVh QUmH sH hyVh Q0JmH sH  OV ky34OPQjr~|} пЫ򕍕{{{shyVhz6jhyVhzU hyVhzhyVh1z6 hyVh1zhyVh350JOJQJ^J'jAhyVh35OJQJU^J!jhyVh35OJQJU^JhyVh35OJQJ^JhyVhE3OJQJ^JhyVhE36 hyVhE3 hyVhJ+PQ ab34$% $[$\$gdyV$1$7$8$^a$gdyV"gdyVgdyV <UbZ[#34<=>E`%KRԺԳͳͳ|| hyVhNhyVhE36mH sH hyVh*WmH sH hyVhK'6] hyVhK'hyVh+6 hyVh+hyVhz6jhyVhzU hyVhJ hyVhzhyVhE36 hyVhE3hyVhJmH sH hyVhE3mH sH / kr79 "#&'VǼDZǦsh\hQDjh\Th 0JUhyVh(emH sH hyVhXc6mH sH hyVhXcmH sH hyVh0J/mH sH hyVh 0J/mH sH hyVh 0J06mH sH hyVhJmH sH hyVh mH sH hyVh#imH sH hyVhJmH sH hyVhE3mH sH hyVhE3mHsHhyVhE36mHsH hyVhE3 hyVhNhyVhN6%'H!"$%ABC#$a$gd>^#$a$gd gd35-gdyV 7$8$H$gdyVgdyV $[$\$gdyV&56H:GHIJb "#%ABCDJKLNOUVvlflflfl h 0Jjh 0JUh>^h CJaJjhEUhE h h h h h CJaJmH sH h h CJaJ!jh h 0JCJUaJ$hNh CJaJmH nH sH tH h CJaJmH nH sH tH $h\Th CJaJmH nH sH tH  h\Th %CLMNYZ[\] 7$8$H$gdyVh]h&`#$VWXY[\]hyVh(emH sH hEh h 0Jjh 0JUhE0JmHnHu,1h/ =!"#$% 51h0:pvc= /!"#$% ,1h/ =!"#$% $$If!vh5"#v":V l  t 065"p u$$If!vh5"#v":V l t065"$$If!vh5t5$#vt#v$:V l  t065t5$p$$If!vh5t5$#vt#v$:V l t065t5$$$If!vh5t5$#vt#v$:V l t065t5$$$If!vh5t5$#vt#v$:V l t065t5$$$If!vh5t5$#vt#v$:V l t065t5$I$$If!vh5w5v 5 55J #vw#vv #v #v#vJ :V l  t 2帷065w5v 5 55J p2帷M$$If!vh5w5v 5 55J #vw#vv #v #v#vJ :V l     t 2帷065w5v 5 55J p2帷I$$If!vh5w5v 5 55J #vw#vv #v #v#vJ :V l  t 2帷065w5v 5 55J p2帷I$$If!vh5w5v 5 55J #vw#vv #v #v#vJ :V l     t 2帷065w5v 5 55J p2帷I$$If!vh5w5v 5 55J #vw#vv #v #v#vJ :V l  t 2帷065w5v 5 55J p2帷$$If!vh5"#v":V l  t 065"/ p $$If!vh5"#v":V l  t 065"p $$If!vh5"#v":V l t065"/ $$If!vh5"#v":V l  t 065"p $$If!vh5"#v":V l t065"/ $$If!vh5"#v":V l  t 065"p z$$If!vh5"#v":V l t065"$$If!vh5L"#vL":V F  t 065L"p u$$If!vh5L"#vL":V F t065L"$$If!vh55l#v#vl:V lh ,"55l9p^$$If!vh55l#v#vl:V lh,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V lO,"55l9^$$If!vh55l#v#vl:V lc,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V l',"55l9^$$If!vh55l#v#vl:V l_,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V l7,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V l,"55l9^$$If!vh55l#v#vl:V lm,"55l9^$$If!vh55l#v#vl:V l,"55l9$$If!vh5$#v$:V l0$65$4$$If!vh5$#v$:V l0$65$4$$If!vh5$#v$:V l0$65$/ 4DyK !http://www.nice.org.uk/phmethodsyK Bhttp://www.nice.org.uk/phmethods^4 002 0@P`p2( 0@P`p 0@P`p 0@P`p 0@P`p 0@P`p 0@P`p8XV~_HmHnHsHtH@`@ NormalCJ_HaJmH sH tH ||  Heading 1% & F x&d@&P)5CJ(KH$OJQJ\^JaJmH sH ujj  Heading 2$ & F xZ@&%5CJ OJQJ\^JaJ$mH sH uff  Heading 3 & F x<@&%5CJOJQJ\^JaJ mH sH u^B^  Heading 4  & F @&%5CJOJQJ\^JaJmH sH uDA`D Default Paragraph FontVi@V  Table Normal :V 44 la (k (No List H@H  Balloon TextCJOJQJ^JaJB'B Comment ReferenceCJaJ<@<  Comment TextCJaJ@j@ Comment Subject5\HC@2H pBody Text Indentx^>@B>  Footnote TextCJaJ@&@Q@ Footnote ReferenceH*4 @b4 Footer  9r .)@q. Page NumberLL k@dtitle19d[$^9CJaJmH sH tH >B@> Body TextCJmH sH u4U@4 0 Hyperlink >*ph$$ volume"" issue"" pagesRR k@dauthors19dH^9CJaJmH sH tH PP k@dsource19dx^9CJaJmH sH tH .. k@d journalname>Q@> GD Body Text 3!xCJaJbo"b <Default "7$8$H$-B*CJOJQJ^J_HaJmH phsH tH 4@24 2>^0Header # 9r DOBD E3authors$dd[$\$ mH sH tH 2/Q2 XcA0B*CJ^JaJphjcj P } Table Grid7:V&0&6q6 Vf41CJOJQJ^JaJo(66 9Lf21CJ6OJQJ^JaJ6o(66 9Lf31CJOJQJ^JaJo(66 9Lf51CJ OJQJ^JaJ o(8O8 9Lf261CJOJQJ^JaJo(@@ Ntitle,dd[$\$ mHsHtHFOF Nrprtbody-dd[$\$ mHsHtH<< Naux.dd[$\$ mHsHtHO Nsrc O NjrnlN^@N N Normal (Web)1dd[$\$ mHsHtHB!B #\D0 Header CharCJaJmH sH tH 8o18 yVapple-style-spanPK![Content_Types].xmlj0Eжr(΢Iw},-j4 wP-t#bΙ{UTU^hd}㨫)*1P' ^W0)T9<l#$yi};~@(Hu* Dנz/0ǰ $ X3aZ,D0j~3߶b~i>3\`?/[G\!-Rk.sԻ..a濭?PK!֧6 _rels/.relsj0 }Q%v/C/}(h"O = C?hv=Ʌ%[xp{۵_Pѣ<1H0ORBdJE4b$q_6LR7`0̞O,En7Lib/SeеPK!kytheme/theme/themeManager.xml M @}w7c(EbˮCAǠҟ7՛K Y, e.|,H,lxɴIsQ}#Ր ֵ+!,^$j=GW)E+& 8PK!Ptheme/theme/theme1.xmlYOo6w toc'vuر-MniP@I}úama[إ4:lЯGRX^6؊>$ !)O^rC$y@/yH*񄴽)޵߻UDb`}"qۋJחX^)I`nEp)liV[]1M<OP6r=zgbIguSebORD۫qu gZo~ٺlAplxpT0+[}`jzAV2Fi@qv֬5\|ʜ̭NleXdsjcs7f W+Ն7`g ȘJj|h(KD- dXiJ؇(x$( :;˹! I_TS 1?E??ZBΪmU/?~xY'y5g&΋/ɋ>GMGeD3Vq%'#q$8K)fw9:ĵ x}rxwr:\TZaG*y8IjbRc|XŻǿI u3KGnD1NIBs RuK>V.EL+M2#'fi ~V vl{u8zH *:(W☕ ~JTe\O*tHGHY}KNP*ݾ˦TѼ9/#A7qZ$*c?qUnwN%Oi4 =3ڗP 1Pm \\9Mؓ2aD];Yt\[x]}Wr|]g- eW )6-rCSj id DЇAΜIqbJ#x꺃 6k#ASh&ʌt(Q%p%m&]caSl=X\P1Mh9MVdDAaVB[݈fJíP|8 քAV^f Hn- "d>znNJ ة>b&2vKyϼD:,AGm\nziÙ.uχYC6OMf3or$5NHT[XF64T,ќM0E)`#5XY`פ;%1U٥m;R>QD DcpU'&LE/pm%]8firS4d 7y\`JnίI R3U~7+׸#m qBiDi*L69mY&iHE=(K&N!V.KeLDĕ{D vEꦚdeNƟe(MN9ߜR6&3(a/DUz<{ˊYȳV)9Z[4^n5!J?Q3eBoCM m<.vpIYfZY_p[=al-Y}Nc͙ŋ4vfavl'SA8|*u{-ߟ0%M07%<ҍPK! ѐ'theme/theme/_rels/themeManager.xml.relsM 0wooӺ&݈Э5 6?$Q ,.aic21h:qm@RN;d`o7gK(M&$R(.1r'JЊT8V"AȻHu}|$b{P8g/]QAsم(#L[PK-![Content_Types].xmlPK-!֧6 +_rels/.relsPK-!kytheme/theme/themeManager.xmlPK-!Ptheme/theme/theme1.xmlPK-! ѐ' theme/theme/_rels/themeManager.xml.relsPK] ,?Z]0J{]].e *5BBBBBBBBBBBBBBBE; T-"',/s5b<GI:SrVWZvaf0pTxYx V]y{|~ *0(&@LDaF/GGQUU|X}XXX``ddvvxxAz{~ ,C ݢ*z SծqۯɲTx%C]z}8t*KQ3|Z]XXXXXXXXX*15<>E!!8@0(  B S  ?1xEdRyERzER{E$S|EdS}ES~ET ; E ; E ; E; ET; E; E; E; ET; E; E; E; ET; E; E; EW E4W EtW EW EW E4W EtW EW E4W EtW EW EW E4W EtW ELl.El.El.E m.ELm.Em.Em.E n.ELn.En.En.E o.E Lo.Eo.00??znznףף'ϹϹMM8> ""0SS^      !"#$%&'()*+,-.0/35??}nnޣ%//׹׹SS;N  ,66 XZ^    !"#$%&'()*+,-.0/ 9*urn:schemas-microsoft-com:office:smarttagsState:0*urn:schemas-microsoft-com:office:smarttagsStreet=*urn:schemas-microsoft-com:office:smarttags PlaceName=*urn:schemas-microsoft-com:office:smarttags PlaceType?*urn:schemas-microsoft-com:office:smarttags stockticker;1*urn:schemas-microsoft-com:office:smarttagsaddress9+*urn:schemas-microsoft-com:office:smarttagsplaceB**urn:schemas-microsoft-com:office:smarttagscountry-region8'*urn:schemas-microsoft-com:office:smarttagsCity8*urn:schemas-microsoft-com:office:smarttagsdate HD 12200823DayMonthYear101010+*10'+**+10'+**+'+'+*+''++'+10-LN_ajlHN8 B OPVPWWT[QW|4:w~ !"$%[^-<H4N W7&8O99b>k>0?E?^@p@HHH;KXKM NMPPPQRRXXXjdj\nonnn2tCtvv5xMxy-yyyz {{{{{|&~-H6C6?JTҎێp| ~Bc,<[8\~y4{5TѥrܧesѪ'²ҲNWIfkXb%"9 '!"$%A[^l!"$%[^(!#P92Z j$*Z*t`*r^$! q !~L:'#<2O'^+'jZT,UL0jU/Z*]G/6\n-7Tز ]71M8J:T/> e(H?^~eE@+R'~El$3G`8AGH^*rK0n4L⾾6fM.@h\|9%m5m$wB6*}=zblOjY^`^`^`^`^`^`^`^`^`P^`PCJOJQJo(  8^`OJQJo( ^`OJQJo(   ^ `OJQJo(   ^ `OJQJo(o xx^x`OJQJo( HH^H`OJQJo( ^`OJQJo(o ^`OJQJo(h^`OJQJo(hHh^`OJQJ^Jo(hHohp^p`OJQJo(hHh@ ^@ `OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohP^P`OJQJo(hH   h^ `OJQJo(  P^`POJQJo(  PP^P`OJQJo(    ^ `OJQJo(    ^ `OJQJo(o  ^`OJQJo(  ^`OJQJo(  ``^``OJQJo(o  00^0`OJQJo( `P`^``PCJOJQJo(  ^`OJQJo(o  pp^p`OJQJo(  @ @ ^@ `OJQJo(  ^`OJQJo(o  ^`OJQJo(  ^`OJQJo(  ^`OJQJo(o  PP^P`OJQJo(`P`^``PCJOJQJo( ^`OJQJo(o pp^p`OJQJo( @ @ ^@ `OJQJo( ^`OJQJo(o ^`OJQJo( ^`OJQJo( ^`OJQJo(o PP^P`OJQJo(`P`^``PCJOJQJo( ^`OJQJo(o pp^p`OJQJo( @ @ ^@ `OJQJo( ^`OJQJo(o ^`OJQJo( ^`OJQJo( ^`OJQJo(o PP^P`OJQJo(`P`^``PCJOJQJo( ^`OJQJo(o pp^p`OJQJo( @ @ ^@ `OJQJo( ^`OJQJo(o ^`OJQJo( ^`OJQJo( ^`OJQJo(o PP^P`OJQJo(P^`PCJOJQJo( XX^X`OJQJo(o ((^(`OJQJo(   ^ `OJQJo(   ^ `OJQJo(o ^`OJQJo( hh^h`OJQJo( 88^8`OJQJo(o ^`OJQJo(h^`OJQJo(hHh^`OJQJ^Jo(hHohpp^p`OJQJo(hHh@ @ ^@ `OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohPP^P`OJQJo(hHh hh^h`o(hH.h88^8`OJQJ^Jo(hHoh^`OJQJo(hHh  ^ `OJQJo(hHh  ^ `OJQJ^Jo(hHohxx^x`OJQJo(hHhHH^H`OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hH  @^@`OJQJo(  P^`POJQJo(  pp^p`OJQJo(  @ @ ^@ `OJQJo(  ^`OJQJo(o  ^`OJQJo(  ^`OJQJo(  ^`OJQJo(o  PP^P`OJQJo(hhh^h`OJQJo(hHh88^8`OJQJ^Jo(hHoh^`OJQJo(hHh  ^ `OJQJo(hHh  ^ `OJQJ^Jo(hHohxx^x`OJQJo(hHhHH^H`OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hH `P`^``PCJOJQJo(  ^`OJQJo(o  pp^p`OJQJo(  @ @ ^@ `OJQJo(  ^`OJQJo(o  ^`OJQJo(  ^`OJQJo(  ^`OJQJo(o  PP^P`OJQJo( ^`o(hHXQUL ^`o(hHXQUL.  ^`o(hH XQUL..  ^`o(hH XQUL... ^`o(hH ^`o(hH  ^ `o(hH  8x^`8o(hH........  `H^``o(hH.........hP^`PCJOJQJo(h ^`OJQJo(oh ^`OJQJo(h   ^ `OJQJo(h   ^ `OJQJo(oh PP^P`OJQJo(h   ^ `OJQJo(h ^`OJQJo(oh ^`OJQJo(hhh^h`OJQJo(hHh88^8`OJQJ^Jo(hHoh^`OJQJo(hHh  ^ `OJQJo(hHh  ^ `OJQJ^Jo(hHohxx^x`OJQJo(hHhHH^H`OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohpp^p`OJQJo(hHh@ @ ^@ `OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohPP^P`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohpp^p`OJQJo(hHh@ @ ^@ `OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohPP^P`OJQJo(hH`P`^``PCJOJQJo( ^`OJQJo(o pp^p`OJQJo( @ @ ^@ `OJQJo( ^`OJQJo(o ^`OJQJo( ^`OJQJo( ^`OJQJo(o PP^P`OJQJo(h^`OJQJo(hHh^`OJQJ^Jo(hHohp^p`OJQJo(hHh@ ^@ `OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohP^P`OJQJo(hH`P`^``PCJOJQJo( ^`OJQJo(o pp^p`OJQJo( @ @ ^@ `OJQJo( ^`OJQJo(o ^`OJQJo( ^`OJQJo( ^`OJQJo(o PP^P`OJQJo(hhh^h`OJQJo(hHh88^8`OJQJ^Jo(hHoh^`OJQJo(hHh  ^ `OJQJo(hHh  ^ `OJQJ^Jo(hHohxx^x`OJQJo(hHhHH^H`OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHP^`PCJOJQJo( ^`OJQJo(o ^`OJQJo(   ^ `OJQJo( ` ` ^` `OJQJo(o 00^0`OJQJo( ^`OJQJo( ^`OJQJo(o ^`OJQJo(`P`^``PCJOJQJo( ^`OJQJo(o pp^p`OJQJo( @ @ ^@ `OJQJo( ^`OJQJo(o ^`OJQJo( ^`OJQJo( ^`OJQJo(o PP^P`OJQJo(h^`OJQJo(hHh^`OJQJ^Jo(hHohpp^p`OJQJo(hHh@ @ ^@ `OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohPP^P`OJQJo(hHP^`PCJOJQJo( ^`OJQJo(o ^`OJQJo(   ^ `OJQJo( ` ` ^` `OJQJo(o 00^0`OJQJo( ^`OJQJo( ^`OJQJo(o ^`OJQJo(TT^T`OJQJ^Jo(^`OJQJ^Jo(opp^p`OJQJ^Jo(@ @ ^@ `OJQJ^Jo(^`OJQJ^Jo(o^`OJQJ^Jo(^`OJQJ^Jo(^`OJQJ^Jo(oPP^P`OJQJ^Jo(h^`OJQJo(hHh^`OJQJ^Jo(hHohp^p`OJQJo(hHh@ ^@ `OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohP^P`OJQJo(hH `P`^``PCJOJQJo(  P^`POJQJo(pp^p`o()  @ @ ^@ `OJQJo(  ^`OJQJo(o  ^`OJQJo(  ^`OJQJo(  ^`OJQJo(o  PP^P`OJQJo(hhh^h`OJQJo(hHh88^8`OJQJ^Jo(hHoh^`OJQJo(hHh  ^ `OJQJo(hHh  ^ `OJQJ^Jo(hHohxx^x`OJQJo(hHhHH^H`OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hH`P`^``PCJOJQJo( ^`OJQJo( pp^p`OJQJo( @ @ ^@ `OJQJo( ^`OJQJo(o ^`OJQJo( ^`OJQJo( ^`OJQJo(o PP^P`OJQJo(`P`^``PCJOJQJo( ^`OJQJo(o pp^p`OJQJo( @ @ ^@ `OJQJo( ^`OJQJo(o ^`OJQJo( ^`OJQJo( ^`OJQJo(o PP^P`OJQJo(`P`^``PCJOJQJo( ^`OJQJo(o pp^p`OJQJo( @ @ ^@ `OJQJo( ^`OJQJo(o ^`OJQJo( ^`OJQJo( ^`OJQJo(o PP^P`OJQJo(h^`OJQJo(hHh^`OJQJ^Jo(hHohp^p`OJQJo(hHh@ ^@ `OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohP^P`OJQJo(hHP^`PCJOJQJo( ^`OJQJo(o ^`OJQJo(   ^ `OJQJo( ` ` ^` `OJQJo(o 00^0`OJQJo( ^`OJQJo( ^`OJQJo(o ^`OJQJo(P^`PCJOJQJo( ^`OJQJo(o ^`OJQJo(   ^ `OJQJo( ` ` ^` `OJQJo(o 00^0`OJQJo( ^`OJQJo( ^`OJQJo(o ^`OJQJo(h^`OJQJo(hHh^`OJQJ^Jo(hHohpp^p`OJQJo(hHh@ @ ^@ `OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohPP^P`OJQJo(hHhhh^h`OJQJo(hHh88^8`OJQJ^Jo(hHoh^`OJQJo(hHh  ^ `OJQJo(hHh  ^ `OJQJ^Jo(hHohxx^x`OJQJo(hHhHH^H`OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohpp^p`OJQJo(hHh@ @ ^@ `OJQJo(hHh^`OJQJ^Jo(hHoh^`OJQJo(hHh^`OJQJo(hHh^`OJQJ^Jo(hHohPP^P`OJQJo(hH( ]74L$3G=zm$wO/>([2O']G/ZT,# 3 D[ B C  @ +&RRjzIp9cZ(MVXN U.<nk .V B!#V'b)(2(')H)*])*+{j+&R,2.%/F0F2E3~3;6YM6\7K:r<v<7O=?_AQBC\DGDPDF{JG^`HjH-IwIhqJzJp8Nj#O.9P QVQ@ISzHT[UVhVyVTW|nXC3ZY\A]A]c^w2b.Zbcb cXc}cj dk@dcdWg>"g6i#i.jX9kmq#EqMqUr~`r\br9s!t^i L;^Tlag4p_4 (*hZa qdJ| ma\hW'nZ(e9zrsMn)L<Y- aC&d7d|GdwRof\Ta87|qbNm]7o =T<DN^ 3<d4OS^Chx Hvc]~&fg XP;1"E35:tf`Y`(D:KH&BA9L2a;g*W5\c5nX;9qjui}qK'Q~N_N+)GEN.InstantFormat< EN.LibrariesqAw<ENInstantFormat><Enabled>0</Enabled><ScanUnformatted>1</ScanUnformatted><ScanChanges>1</ScanChanges></ENInstantFormat>U<ENLibraries><Libraries><item>Endnote library_SL.enl</item></Libraries></ENLibraries>@]@UnknownG*Ax Times New Roman5Symbol3. *Cx Arial5. .[`)TahomaA. Trebuchet MS;Wingdings?= * Courier NewA BCambria Math"1h*f*f&f#uf#u!x24dH 2qHP?;2!xxDraft 1 Chapter outline peter_finchu0039686(                           ! " # $ % & ' Oh+'0`    (4<DLTDraft 1 Chapter outline peter_finch Normal.dotm u00396863Microsoft Office Word@0fId@^B@Cf#GVT$mr qX&" WMFCC ]}lVT$m EMF}*{#a   % %  Rp@Times New Romanͤ `ѤΤQ?j`ѤXΤ ϤDѤlP?j`ѤXΤ qhXΤ`Ѥ \Grh+ȬZ XG*Ax Times ew RomanNDΤ-hΤΤzhΤ\Gdv% % %  T'_̇@*z@LVersion 1. 23 December 2010H,!'22222H-,,N2-!2222TT'_̇@*z@LP -!" Rp@Times New Roman" T" " 8" Q?j" " " " lP?j" " qh" " Grh+ȬZ XG*Ax Times ew RomanQD" -h " " zhH" Gdv% % %  TT&_̇@*z@LP )!"  % % % TT._̇@*z@LP -!" !. TT._̇@*z@L.P12TT_̇@*z@L.P -!." "  % % %  TTX_̇@*z@LP -Rp{@Times New Roman" T" " 8" Q?j" " " " lP?j" " qh" " ܀Grh+ȬZ XG*Ax Times ew Roman ND" -h " " zhH" ܀Gdv% % %  Txc_̇@*z@GL\Chapter`JCJ,;;TTc_̇@*z@GLP !TT*c_̇@*z@GLP5CTX+xc_̇@*z@+GLP: -!Ty c_̇@*z@yGLExtracting Qualitative EvidenceYC,;D;,%JC"gJC%%,C,%C;"YC%J;J;<TT  c_̇@*z@ GLP HRpY@Times New Roman" T" " 8" Q?j" " " " lP?j" " qh" " \Grh+ȬZ XG*Ax Times ew RomanDD" -h " " zhH" \Gdv% % %  TT gA "_̇@*z@ LP LRp@Times New Roman" " " t" Q?j" " \" " lP?j" " qh" " Grh+ȬZ XG*Ax Times ew Roman,QD " -h\" \" zh" Gdv% % %     '% Ld x!??% (   % % % T"_̇@*z@~LThis chapter should be cited asC8',828!,,'82888,,!,82'% % % T$Y _̇@*z@~Lt: Noyes J & Lewin SH30-'(M<,I28TXZ $ _̇@*z@Z ~LP. T| $ _̇@*z@ ~L\Chapter C2,2,!TT $ _̇@*z@ ~LP52TX $G _̇@*z@ ~LP: TH $_̇@*z@H ~L|Extracting qualitative =3!,,1122,,2,!"     '% Ldq v!??% (   T|O_̇@*z@L\evidence,22,2,,TP_̇@*z@PJL. In: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C  2H40,'(C222HH,22,'HI,!2-2HH,!!'(<,H28<2,2H222C!" Rp@Times New Roman" T" " 8" Q?j" " " " lP?j" " qh" " ̲Grh+ȬZ XG*Ax Times ew RomanJD" -h " " zhH" ̲Gdv% % %     '% Ld\{o v!??% (   % % % T q{_̇@*z@d Ld(editors), !,22!'!% % % Tr u{_̇@*z@rdILSupplementary Guidance for Inclusion of Qualitative Research in Cochrane 2222,I,22',H2222,,2'!2,2'223H222,,=,',2',23C2,2'22,!"     '% Ldyy v!??% (   % % % T}&" WMFC =}_̇@*z@LSystematic Reviews of Intervent2,',H2,=-,,C'2!2,',,2Tl}_̇@*z@LXions.22'% % % TT}_̇@*z@LP TH}_̇@*z@*LVersion 1 (updated August 2011). Cochrane H-!'222!232,,2H312'2222!C2-2!,2,!"     '% Ld a v!??% (   T a_̇@*z@JALCollaboration Qualitative Methods Group, 2011. Available from URLC2,22!,22H2,,2,Y,222'H!2222222H2,,2,!!2NHD<TT  a_̇@*z@ JLP !" % % %     '% Ld_c _v v!??% (   Rp@Times New Roman" " 4" " Q?j4" ," " " lP?j4" ," qh," 4" Grh+ȬZ XG*Ax Times ew RomanID`" -h" " zh" Gdv% % % % % %  T0c, _̇@*z@&Lhttp://cqrmg.cochrane.org/supplemental22,2!N1,2,3!,2,3"1'222,N,2,TT- cM _̇@*z@- LP-!T|N c _̇@*z@N L\handbook3,222232TT c _̇@*z@ LP-!T| cc _̇@*z@ L\guidance122,3,-'% Ldc v !??% ( % % %  TTd a _̇@*z@d LP 6!"  % % % TT A _̇@*z@ oLP L TT A T_̇@*z@ /LP LRp@Times New Roman" T" " 8" Q?j" " " " lP?j" " qh" " Grh+ȬZ XG*Ax Times ew RomanDD" -h " " zhH" Gdv% % %  TY_̇@*z@ L`Key PointsN44G; A -TTY+_̇@*z@LP ; % % % TT9 _̇@*z@t LP LRp @Symbol" " " t" Q?j" " \" " lP?j" " qh" " LGrh+ȬZ X5Symbol?jK?j-/ ,G0PD " -h\" \" zh" LGdv% % % Rp @"Arial" " " t" Q?j" " \" " lP?j" " qh" " ,Grh +ȬZ X3. *Cx Arial?j?j-/ GGD " -h\" \" zh" ,Gdv% % %  % % % TT  _̇@*z@ LP.% % % TT  _̇@*z@ LP h% % % T  _̇@*z@ LlThe method of d=2,N,2222!2T  _̇@*z@ >Lata extraction should be informed by the purpose of the review,,,3!,,22'22222,2!2!N,3302,23!22',2!2,!,3,HTT  _̇@*z@ LP -!"  TT  _̇@*z@o LP - % % % TT  _̇@*z@ LP.% % % TT  _̇@*z@ LP h% % % TT V _̇@*z@ LPE=T W *  _̇@*z@W #Lxtraction templates and approaches 3!,,22(,N2,,'(,22(,22!2,,3,'(Tl+   _̇@*z@+ LXshoul'222T$  _̇@*z@ $Ld be determined by the needs of the 2(2,)2,,!N2,2(40(2,(2-,2((2!(2,!"  T ys _̇@*z@\ Llspecific review'2,,!,",2,HTTy s _̇@*z@y\ LP TT s _̇@*z@\ LP -!"  TTu  _̇@*z@ LP - % % % TT _ _̇@*z@J LP.% % % TT _ _̇@*z@J &" WMFC }LP gh% % % T  } a _̇@*z@J #LExtraction of qualitative evidence =3!,,222!22,,2,,22,2,,T~ 8 a _̇@*z@~ J Ldis typically'02,,0TT9 R a _̇@*z@9 J LP TS Xa _̇@*z@S J Ltan iterative process,2,!,2,2!2-,''TY a _̇@*z@YJ Lp. Review authors C,2,H,222!'!"  Tdb  _̇@*z@ LTmay N-08Tb  _̇@*z@ ELmove between reading primary papers, data extraction and synthesis / uN23,83,H-,28",-22183!N,#083,2,!'83,,8,3!,,229,228)022,''8!"  TT  F _̇@*z@/ ,Linterpretation in several cycles, as key the2,!2!,,22,2,',2,!,,-0,,',,',2.0,2,T F _̇@*z@ / "Lmes and questions emerge from the N,'-,22,22,'22',,N,"1,,!"2N,2,!"  TH  _̇@*z@ L`synthesisL (022,'(TTH  _̇@*z@ LP n-!"  % % % TT y_̇@*z@TLP _L % % % TT{_̇@*z@LP H- % % % TT9_̇@*z@LP !L % % % TO3_̇@*z@ LdIntroduction.A -;;@4 !;@TTP3_̇@*z@PLP !;Rp {@Times New Roman" T" " 8" Q?j" " " " lP?j" " qh" " Grh+ȬZ XG*Ax Times ew RomanHD" -h " " zhH" Gdv% % %  TT6)_̇@*z@LP e< % % % T >_̇@*z@'8LThe purpose of this chapter is to outline ways in which =2,22!22',2!2',2,2,!'2222,H-0'2H2,2T| " >_̇@*z@ 'L\evidence,22,2,,TT# ? >_̇@*z@# 'LP 2 T@ >_̇@*z@@ 'L|from reports of primary "!2N!,32!'2!2!N,"0 T@_̇@*z@Lqualitative research studies22,,2,I!,(,,",2I'32,'TT@_̇@*z@LP HITl@_̇@*z@LXmight'N12TT@ _̇@*z@LP aIT @d _̇@*z@  Lhbe extracted L3,J,3!,,,2ITe @_̇@*z@e Lto inform, enhance, extend and 42I2!2!NI,23,2,-I,3,22I,23 T$_̇@*z@ Lsupplement Cochrane reviews'222,N,2C2,2!,2,!,3,H'TX$_̇@*z@ LP. TT$_̇@*z@ LP - TT&_̇@*z@LP - TR _̇@*z@LThis chapter aims to enable =2',2,2,!,N'2,3-2,TxS{ _̇@*z@SL\review t!,2,HT| _̇@*z@| L`authors to,222!'2TT ! _̇@*z@ LP T|" t _̇@*z@" L\consider,23'2,!TTu  _̇@*z@u LP: TT  _̇@*z@ LP - T` Q}_̇@*z@fLT1. -2TTR }_̇@*z@RfLPT=T` }_̇@*z@fLThe 2,T D}_̇@*z@fLtcontext and purpose ,22,3,2222!23',T`E }_̇@*z@EfLTfor!2!TT }_̇@*z@fLP T  }_̇@*z@f Ldwhich data H2,23,,T`  }_̇@*z@ fLTare -!,TT 1 }_̇@*z@ fLP T2  }_̇@*z@2 fLlto be extracted23,,3!,,,3T&WMFC}T  }_̇@*z@ fLP _- T`Q_̇@*z@LT2. 2TTR_̇@*z@RLPM!YT M _̇@*z@#Lethodological issues when deciding _,222221,,''2,'H2,22,,231TN @ _̇@*z@N Lon an approach to extract_22,2,23!2,,22,3!,,T`A  _̇@*z@A LTingT31TT  _̇@*z@ LP s T ?_̇@*z@ Llqualitative data22,,2,2,-TT@l_̇@*z@@LP - T`Qc_̇@*z@LLT3. 2TTRc_̇@*z@RLLPSN8T< c_̇@*z@L(Lome of the approaches available for the 2N,2!2,,22!2-,2-',2,,2,!2!3,Tl  c_̇@*z@ LLXextra,3!,Tp t c_̇@*z@ LLXction ,22Tu  c_̇@*z@u LLhof qualitative2!22,,2,TT  c_̇@*z@ LLP T| c_̇@*z@ LL\evidence,22,2-,TTc_̇@*z@LLP.TTHc_̇@*z@LLP _- TTe_̇@*z@LP 2-% % %  Rp {@Times New Roman" " 4" " Q?j4" ," " " lP?j4" ," qh," 4" LGrh+ȬZ XG*Ax Times ew RomantDD`" -h" " zh" LGdv% % % % % % T p_̇@*z@Q!LExtracting qualitative evidence: QC%,;;%%CC!CC;%%%;&%C;!;C%C;C;;%!TT  p_̇@*z@ QLPc;T  p_̇@*z@ QLponcepts and issuesCC;;C%4!;CC!%44C;4' % Ld_ d_ !??% ( TT  p_̇@*z@ QLP _< % % % Ttq_̇@*z@\LData extraction appears, at first glance, to be a relatively straightforward component of a H,,,3!,,22,23,,!',!!'1,2-,22,,",,2,0'",12!2!I,!2-2N222,22!- T(U_̇@*z@>OLsystematic review. In practice, the approach used may have a significant impactn(0',N,,$!,2,H% 2$2",,,,$2,$,22!3,,2$2'-2$N-/$3,2,$,$'12!,,2$N2,,TTU_̇@*z@>LP *z$TxU_̇@*z@>L\on the 222$1+ T W_̇@*z@NLreview findings through shaping the range of data feeding into the synthesis. !,2,H!2231'2!2312'2,2212,!,31,3!2,-!,,231222,)022,''TTW'_̇@*z@LP 2- TT;_̇@*z@$LP -% % 666666666666666666666666666666666666 6 66 6  6 66 6  6 66 6  6 66 6  6 66 6 66666666666666666666  d."System????????????????--@Times New Roman--- 42 .ZfVersion 1. 23 December 2010    2 .f ,f'@Times New Roman--- 2 ; f ,f'--- 2 Zf ,f',  2  1 2    , ''---  2 SZf @Times New Roman---2 eZfChaptere   2 ef  2 ef52 ef: :2 efExtracting Qualitative Evidence        2 ef @Times New Roman--- 2 {3f @Times New Roman--- - @ !~Z- ---:2 ZfThis chapter should be cited as---(2 f: Noyes J & Lewin S   2 ^f. 2 dfChapter  2 f52 f: .2 fExtracting qualitative ,f' - @ !Z- 2 Zfevidencez2 Jf. In: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C          ,f'@Times New Roman--- - @ !Z- ---2 Z f(editors), ---y2 IfSupplementary Guidance for Inclusion of Qualitative Research in Cochrane   ,f' - @ !Z- ---:2 ZfSystematic Reviews of Intervent 2 fions.n--- 2 f J2 *fVersion 1 (updated August 2011). Cochrane  ,f' - @ !RZ- m2 ZAfCollaboration Qualitative Methods Group, 2011. Available from URL       2 f ,f'--- - @ !$Z- @Times New Roman------ D2 Z&fhttp://cqrmg.cochrane.org/supplemental   2 f-2 fhandbook 2 Nf-2 Rfguidance- @ !$Z- ---  2 ~f ,f'--- 2 3f  2 3f @Times New Roman- - - 2 Z fKey Points  2 f --- 2 "Zf @Symbol- - - @"Arial- - - - - - 2 3lf- - - 2 3rf ---"2 3~fThe method of d h2 3>fata extraction should be informed by the purpose of the review  2 3f ,f' 2 AZf - - - 2 Olf- - - 2 Orf --- 2 O~fE@2 O#fxtraction templates and approaches t 2 O9fshoulnA2 OS$fd be determined by the needs of the  ,f'"2 ]~fspecific review 2 ]f  2 ]f ,f' 2 klf - - - 2 zlf- - - 2 zrf ---@2 z~#fExtraction of qualitative evidence 2 z$ fis typically 2 zZf )2 z]fan iterative process%2 zf. Review authors e ,f'2 ~fmay s2 Efmove between reading primary papers, data extraction and synthesis /   ,f'M2 ~,finterpretation in several cycles, as key the>2 U"fmes and questions emerge from the   ,f'2 ~ fsynthesis 2 f ,f'--- 2 lf --- 2 Zf --- 2 Zf - - - 2 Z fIntroduction 2 f @Times New Roman- - -  2 Zf ---_2 Z8fThe purpose of this chapter is to outline ways in which   2 jfevidence 2 f /2 ffrom reports of primary   52 Zfqualitative research studies   2 f 2 fmightn  2  f 2  fbe extracted   :2 _fto inform, enhance, extend and      42 +Zfsupplement Cochrane reviewsa  2 +f.  2 +f  2 8Zf 52 FZfThis chapter aims to enable  2 Ffreview e2 F fauthors to 2 F5f 2 F8fconsider 2 Faf: 2 Fdf 2 TZf1. s 2 TffT2 Tnfhe s)2 T|fcontext and purpose 2 Tffors 2 Tf 2 T fwhich data 2 T(fares 2 T7f "2 T:fto be extracted 2 Tf 2 bZf2. s 2 bffM @2 bq#fethodological issues when deciding  12 bfon an approach to extract2 bfings 2 bf #2 bfqualitative data 2 bf 2 pZf3. s 2 pffSG2 pm(fome of the approaches available for the  2 p.fextrad2 pFfction  2 pafof qualitative 2 pf 2 pfevidence 2 pf. 2 pf  2 }Zf - - - @Times New Roman- - - - - - =2 Z!fExtracting qualitative evidence: o  2 *fc&2 1foncepts and issues - @ !NZ- 2 f ---2 Z\fData extraction appears, at first glance, to be a relatively straightforward component of a   2 ZOfsystematic review. In practice, the approach used may have a significant impact     2 f 2 fon the e2 ZNfreview findings through shaping the range of data feeding into the synthesis.   2 f  2 Zf --ffffffeeeeeeeeeeeeeeeedddddddddddddddd՜.+,D՜.+,L hp   K.U.Leuvenu Draft 1 Chapter outline Title  8@ _PID_HLINKSAH 6~\http://www.ncbi.nlm.nih.gov/pubmed/17041020?ordinalpos=1&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum" uYhttp://www.ncbi.nlm.nih.gov/pubmed/17984295?ordinalpos=3&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum" J!http://www.nice.org.uk/phmethods" vZhttp://www.ncbi.nlm.nih.gov/pubmed/15310807?ordinalpos=7&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum" d* [http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/datacollectionchecklist.pdf" }g 7http://www.latrobe.edu.au/chcp/cochrane/resources.html" ="`http://www.medev.ac.uk/static/uploads/workshop_resources/166/166_Qualitative_Appraisal_Tool.pdf" s[http://www.ncbi.nlm.nih.gov/pubmed/18252073?ordinalpos=2&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum" 9http://cqrmg.cochrane.org/supplemental-handbook-guidance"   !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~      !"#$%&'()*+,-./012345678:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~Root Entry FRPCData :1Table@WordDocumentSummaryInformation(9DocumentSummaryInformation8Macros pCCCCVBA pCCCCdirThisDocument _VBA_PROJECTPROJECT ;F  !"#$%&'()*+,-./0123456789:<=>?@C0* pHdProjectQ(@= l uN J< rstdole>stdoleP h%^*\G{00020430-C 0046}#2.0#0#C:\Windows\system32\e2.tlb#OLE Automation`ENormalENCrmaQF  *\C m! OfficgOficg!G{2DF8D04C-5BFA-101B-BHDE5gAAe4 2ggram Files\C ommonMicrosoft Shared\OFFICE12\MSO.DLL#M 1 Ob Library%zBeThisDocumenPtG TfisDHcuQ@Ienn 2E HB1BB,!)"B+BB)xME (S"SS"<(1Normal.ThisDocument8(%HxAttribute VB_Name = "ThisDocument" Bas1Normal.VGlobal!SpaclFalse CreatablPre declaIdTru BExposeTemplateDeriv$Custom izC1a *\G{000204EF-0000-0000-C000-000000000046}#4.0#9#C:\PROGRA~1\COMMON~1\MICROS~1\VBA\VBA6\VBE6.DLL#Visual Basic For Applications*\G{00020905-0000-0000-C000-000000000046}#8.4#0#C:\Program Files\Microsoft Office\Office12\MSWORD.OLB#Microsoft Word 12.0 Object Library*\G{00020430-0000-0000-C000-000000000046}#2.0#0#C:\Windows\system32\stdole2.tlb#OLE Automation*\CNormal*\CNormaluN(*\G{2DF8D04C-5BFA-101B-BDE5-00AA0044DE52}#2.4#0#C:\Program Files\Common Files\Microsoft Shared\OFFICE12\MSO.DLL#Microsoft Office 12.0 Object Library uN ThisDocument034ec77502ThisDocument)  HEZ\=` %WordkVBAWin16~Win32MacVBA6#Project1 stdole`Project- ThisDocument< _EvaluateNormalOfficeuDocumentjT ID="{24D3092C-42D1-4920-BA57-CE71FD770129}" Document=ThisDocument/&H00000000 Name="Project" HelpContextID="0" VersionCompatible32="393222000" CMG="CAC87EB64CBA4CBA4CBA4CBA" DPB="94962080204B214B214B" GC="5E5CEADA7E6E496F496FB6" [Host Extender Info] &H00000001={3832D640-CF90-11CF-8E43-00A0C911005A};VBE;&H00000000 ThisDocumentThisDocument  F'Microsoft Office Word 97-2003 Document MSWordDocWord.Document.89qPROJECTwmA)CompObjBy