what are the ways to verify conclusions for qualitative research

• 10.3k views
• Results & Discussion

Q: How is the conclusion drawn in qualitative research?

Asked by Bill Sheehan on 09 Jul, 2020

Hello Bill – Welcome to the forum!

Straight away, when you say ‘how is the conclusion drawn,’ we trust it means ‘how you reach the conclusion’ rather than ‘how you write the conclusion.’

The first would depend on the findings of the study and how astutely you analyze them. This in turn would depend on how well you have designed the study, carefully inspected the results, and avoided bias to as much extent as possible. For insights into these aspects, you may refer to these resources:

• What are the possible problems that may be encountered in Qualitative Research?
• How can I evaluate qualitative data from different sources consistently and stringently without becoming too subjective and making too many assumptions?
• 7 Biases to avoid in qualitative research

The second meaning – that of ‘writing’ – is simpler, but of course, needs to come from the conclusion(s) you have drawn.

Having said that, the conclusion of a qualitative study can at times be quite detailed. This would depend on the complexity of the study. A questionnaire about likes and dislikes is simpler to score, interpret, and infer than a focus group, interview, or case study. In the case of a simpler study, you may reiterate the key findings of the study in the conclusion. In the case of a more complex study, which involves deeper analysis and may have some (if not significant) margin of error, you will also need to talk about the limitations and implications of the study.

The limitations may be in the area of methodology, participant response, or data collection. While you may have employed a methodology that seemed robust before starting the study, after the study, you may see opportunities for improvement, which you could include in the conclusion.

In quali research, it becomes especially important to talk about implications as you may not be able to draw some/any conclusions with a significant amount of surety. In these cases, you could talk about what the findings seem to suggest and what further studies they could lead to. Quali studies often tend to build on the previous one. [To see just how detailed the conclusion can get, you may refer to this part-documentation of a study .]

Finally, note that the conclusions are usually written in the Discussion section, but at times, can be a separate section (after the Discussion).

For more insights and information on writing the conclusion, you may refer to these resources:

• Is it okay not to have conclusion but only implication in qualitative research?
• What is meant by relevance to clinical practice?
• How to write the most effective results and discussion sections [Course]

Hope that helps. All the best for wrapping up – and then submitting – your paper!

Answered by Irfan Syed on 10 Jul, 2020

• Upvote this Answer

This content belongs to the Manuscript Writing Stage

Translate your research into a publication-worthy manuscript by understanding the nuances of academic writing. Subscribe and get curated reads that will help you write an excellent manuscript.

Confirm that you would also like to sign up for free personalized email coaching for this stage.

Trending Searches

• Statement of the problem
• Background of study
• Scope of the study
• Types of qualitative research
• Rationale of the study
• Concept paper
• Literature review
• Introduction in research
• Under "Editor Evaluation"
• Ethics in research

Recent Searches

• Review paper
• Responding to reviewer comments
• Predatory publishers
• Scope and delimitations
• Open access
• Plagiarism in research
• Journal selection tips
• Editor assigned
• Types of articles
• "Reject and Resubmit" status
• Decision in process
• Conflict of interest

Criteria for Good Qualitative Research: A Comprehensive Review

• Regular Article
• Open access
• Published: 18 September 2021
• Volume 31 , pages 679–689, ( 2022 )

Cite this article

You have full access to this open access article

• Drishti Yadav   ORCID: orcid.org/0000-0002-2974-0323 1  

84k Accesses

28 Citations

72 Altmetric

Explore all metrics

This review aims to synthesize a published set of evaluative criteria for good qualitative research. The aim is to shed light on existing standards for assessing the rigor of qualitative research encompassing a range of epistemological and ontological standpoints. Using a systematic search strategy, published journal articles that deliberate criteria for rigorous research were identified. Then, references of relevant articles were surveyed to find noteworthy, distinct, and well-defined pointers to good qualitative research. This review presents an investigative assessment of the pivotal features in qualitative research that can permit the readers to pass judgment on its quality and to condemn it as good research when objectively and adequately utilized. Overall, this review underlines the crux of qualitative research and accentuates the necessity to evaluate such research by the very tenets of its being. It also offers some prospects and recommendations to improve the quality of qualitative research. Based on the findings of this review, it is concluded that quality criteria are the aftereffect of socio-institutional procedures and existing paradigmatic conducts. Owing to the paradigmatic diversity of qualitative research, a single and specific set of quality criteria is neither feasible nor anticipated. Since qualitative research is not a cohesive discipline, researchers need to educate and familiarize themselves with applicable norms and decisive factors to evaluate qualitative research from within its theoretical and methodological framework of origin.

Similar content being viewed by others

Good Qualitative Research: Opening up the Debate

Beyond qualitative/quantitative structuralism: the positivist qualitative research and the paradigmatic disclaimer.

What is Qualitative in Research

Avoid common mistakes on your manuscript.

Introduction

“… It is important to regularly dialogue about what makes for good qualitative research” (Tracy, 2010 , p. 837)

To decide what represents good qualitative research is highly debatable. There are numerous methods that are contained within qualitative research and that are established on diverse philosophical perspectives. Bryman et al., ( 2008 , p. 262) suggest that “It is widely assumed that whereas quality criteria for quantitative research are well‐known and widely agreed, this is not the case for qualitative research.” Hence, the question “how to evaluate the quality of qualitative research” has been continuously debated. There are many areas of science and technology wherein these debates on the assessment of qualitative research have taken place. Examples include various areas of psychology: general psychology (Madill et al., 2000 ); counseling psychology (Morrow, 2005 ); and clinical psychology (Barker & Pistrang, 2005 ), and other disciplines of social sciences: social policy (Bryman et al., 2008 ); health research (Sparkes, 2001 ); business and management research (Johnson et al., 2006 ); information systems (Klein & Myers, 1999 ); and environmental studies (Reid & Gough, 2000 ). In the literature, these debates are enthused by the impression that the blanket application of criteria for good qualitative research developed around the positivist paradigm is improper. Such debates are based on the wide range of philosophical backgrounds within which qualitative research is conducted (e.g., Sandberg, 2000 ; Schwandt, 1996 ). The existence of methodological diversity led to the formulation of different sets of criteria applicable to qualitative research.

Among qualitative researchers, the dilemma of governing the measures to assess the quality of research is not a new phenomenon, especially when the virtuous triad of objectivity, reliability, and validity (Spencer et al., 2004 ) are not adequate. Occasionally, the criteria of quantitative research are used to evaluate qualitative research (Cohen & Crabtree, 2008 ; Lather, 2004 ). Indeed, Howe ( 2004 ) claims that the prevailing paradigm in educational research is scientifically based experimental research. Hypotheses and conjectures about the preeminence of quantitative research can weaken the worth and usefulness of qualitative research by neglecting the prominence of harmonizing match for purpose on research paradigm, the epistemological stance of the researcher, and the choice of methodology. Researchers have been reprimanded concerning this in “paradigmatic controversies, contradictions, and emerging confluences” (Lincoln & Guba, 2000 ).

In general, qualitative research tends to come from a very different paradigmatic stance and intrinsically demands distinctive and out-of-the-ordinary criteria for evaluating good research and varieties of research contributions that can be made. This review attempts to present a series of evaluative criteria for qualitative researchers, arguing that their choice of criteria needs to be compatible with the unique nature of the research in question (its methodology, aims, and assumptions). This review aims to assist researchers in identifying some of the indispensable features or markers of high-quality qualitative research. In a nutshell, the purpose of this systematic literature review is to analyze the existing knowledge on high-quality qualitative research and to verify the existence of research studies dealing with the critical assessment of qualitative research based on the concept of diverse paradigmatic stances. Contrary to the existing reviews, this review also suggests some critical directions to follow to improve the quality of qualitative research in different epistemological and ontological perspectives. This review is also intended to provide guidelines for the acceleration of future developments and dialogues among qualitative researchers in the context of assessing the qualitative research.

The rest of this review article is structured in the following fashion: Sect.  Methods describes the method followed for performing this review. Section Criteria for Evaluating Qualitative Studies provides a comprehensive description of the criteria for evaluating qualitative studies. This section is followed by a summary of the strategies to improve the quality of qualitative research in Sect.  Improving Quality: Strategies . Section  How to Assess the Quality of the Research Findings? provides details on how to assess the quality of the research findings. After that, some of the quality checklists (as tools to evaluate quality) are discussed in Sect.  Quality Checklists: Tools for Assessing the Quality . At last, the review ends with the concluding remarks presented in Sect.  Conclusions, Future Directions and Outlook . Some prospects in qualitative research for enhancing its quality and usefulness in the social and techno-scientific research community are also presented in Sect.  Conclusions, Future Directions and Outlook .

For this review, a comprehensive literature search was performed from many databases using generic search terms such as Qualitative Research , Criteria , etc . The following databases were chosen for the literature search based on the high number of results: IEEE Explore, ScienceDirect, PubMed, Google Scholar, and Web of Science. The following keywords (and their combinations using Boolean connectives OR/AND) were adopted for the literature search: qualitative research, criteria, quality, assessment, and validity. The synonyms for these keywords were collected and arranged in a logical structure (see Table 1 ). All publications in journals and conference proceedings later than 1950 till 2021 were considered for the search. Other articles extracted from the references of the papers identified in the electronic search were also included. A large number of publications on qualitative research were retrieved during the initial screening. Hence, to include the searches with the main focus on criteria for good qualitative research, an inclusion criterion was utilized in the search string.

From the selected databases, the search retrieved a total of 765 publications. Then, the duplicate records were removed. After that, based on the title and abstract, the remaining 426 publications were screened for their relevance by using the following inclusion and exclusion criteria (see Table 2 ). Publications focusing on evaluation criteria for good qualitative research were included, whereas those works which delivered theoretical concepts on qualitative research were excluded. Based on the screening and eligibility, 45 research articles were identified that offered explicit criteria for evaluating the quality of qualitative research and were found to be relevant to this review.

Figure  1 illustrates the complete review process in the form of PRISMA flow diagram. PRISMA, i.e., “preferred reporting items for systematic reviews and meta-analyses” is employed in systematic reviews to refine the quality of reporting.

PRISMA flow diagram illustrating the search and inclusion process. N represents the number of records

Criteria for Evaluating Qualitative Studies

Fundamental criteria: general research quality.

Various researchers have put forward criteria for evaluating qualitative research, which have been summarized in Table 3 . Also, the criteria outlined in Table 4 effectively deliver the various approaches to evaluate and assess the quality of qualitative work. The entries in Table 4 are based on Tracy’s “Eight big‐tent criteria for excellent qualitative research” (Tracy, 2010 ). Tracy argues that high-quality qualitative work should formulate criteria focusing on the worthiness, relevance, timeliness, significance, morality, and practicality of the research topic, and the ethical stance of the research itself. Researchers have also suggested a series of questions as guiding principles to assess the quality of a qualitative study (Mays & Pope, 2020 ). Nassaji ( 2020 ) argues that good qualitative research should be robust, well informed, and thoroughly documented.

Qualitative Research: Interpretive Paradigms

All qualitative researchers follow highly abstract principles which bring together beliefs about ontology, epistemology, and methodology. These beliefs govern how the researcher perceives and acts. The net, which encompasses the researcher’s epistemological, ontological, and methodological premises, is referred to as a paradigm, or an interpretive structure, a “Basic set of beliefs that guides action” (Guba, 1990 ). Four major interpretive paradigms structure the qualitative research: positivist and postpositivist, constructivist interpretive, critical (Marxist, emancipatory), and feminist poststructural. The complexity of these four abstract paradigms increases at the level of concrete, specific interpretive communities. Table 5 presents these paradigms and their assumptions, including their criteria for evaluating research, and the typical form that an interpretive or theoretical statement assumes in each paradigm. Moreover, for evaluating qualitative research, quantitative conceptualizations of reliability and validity are proven to be incompatible (Horsburgh, 2003 ). In addition, a series of questions have been put forward in the literature to assist a reviewer (who is proficient in qualitative methods) for meticulous assessment and endorsement of qualitative research (Morse, 2003 ). Hammersley ( 2007 ) also suggests that guiding principles for qualitative research are advantageous, but methodological pluralism should not be simply acknowledged for all qualitative approaches. Seale ( 1999 ) also points out the significance of methodological cognizance in research studies.

Table 5 reflects that criteria for assessing the quality of qualitative research are the aftermath of socio-institutional practices and existing paradigmatic standpoints. Owing to the paradigmatic diversity of qualitative research, a single set of quality criteria is neither possible nor desirable. Hence, the researchers must be reflexive about the criteria they use in the various roles they play within their research community.

Improving Quality: Strategies

Another critical question is “How can the qualitative researchers ensure that the abovementioned quality criteria can be met?” Lincoln and Guba ( 1986 ) delineated several strategies to intensify each criteria of trustworthiness. Other researchers (Merriam & Tisdell, 2016 ; Shenton, 2004 ) also presented such strategies. A brief description of these strategies is shown in Table 6 .

It is worth mentioning that generalizability is also an integral part of qualitative research (Hays & McKibben, 2021 ). In general, the guiding principle pertaining to generalizability speaks about inducing and comprehending knowledge to synthesize interpretive components of an underlying context. Table 7 summarizes the main metasynthesis steps required to ascertain generalizability in qualitative research.

Figure  2 reflects the crucial components of a conceptual framework and their contribution to decisions regarding research design, implementation, and applications of results to future thinking, study, and practice (Johnson et al., 2020 ). The synergy and interrelationship of these components signifies their role to different stances of a qualitative research study.

Essential elements of a conceptual framework

In a nutshell, to assess the rationale of a study, its conceptual framework and research question(s), quality criteria must take account of the following: lucid context for the problem statement in the introduction; well-articulated research problems and questions; precise conceptual framework; distinct research purpose; and clear presentation and investigation of the paradigms. These criteria would expedite the quality of qualitative research.

How to Assess the Quality of the Research Findings?

The inclusion of quotes or similar research data enhances the confirmability in the write-up of the findings. The use of expressions (for instance, “80% of all respondents agreed that” or “only one of the interviewees mentioned that”) may also quantify qualitative findings (Stenfors et al., 2020 ). On the other hand, the persuasive reason for “why this may not help in intensifying the research” has also been provided (Monrouxe & Rees, 2020 ). Further, the Discussion and Conclusion sections of an article also prove robust markers of high-quality qualitative research, as elucidated in Table 8 .

Quality Checklists: Tools for Assessing the Quality

Numerous checklists are available to speed up the assessment of the quality of qualitative research. However, if used uncritically and recklessly concerning the research context, these checklists may be counterproductive. I recommend that such lists and guiding principles may assist in pinpointing the markers of high-quality qualitative research. However, considering enormous variations in the authors’ theoretical and philosophical contexts, I would emphasize that high dependability on such checklists may say little about whether the findings can be applied in your setting. A combination of such checklists might be appropriate for novice researchers. Some of these checklists are listed below:

The most commonly used framework is Consolidated Criteria for Reporting Qualitative Research (COREQ) (Tong et al., 2007 ). This framework is recommended by some journals to be followed by the authors during article submission.

Standards for Reporting Qualitative Research (SRQR) is another checklist that has been created particularly for medical education (O’Brien et al., 2014 ).

Also, Tracy ( 2010 ) and Critical Appraisal Skills Programme (CASP, 2021 ) offer criteria for qualitative research relevant across methods and approaches.

Further, researchers have also outlined different criteria as hallmarks of high-quality qualitative research. For instance, the “Road Trip Checklist” (Epp & Otnes, 2021 ) provides a quick reference to specific questions to address different elements of high-quality qualitative research.

Conclusions, Future Directions, and Outlook

This work presents a broad review of the criteria for good qualitative research. In addition, this article presents an exploratory analysis of the essential elements in qualitative research that can enable the readers of qualitative work to judge it as good research when objectively and adequately utilized. In this review, some of the essential markers that indicate high-quality qualitative research have been highlighted. I scope them narrowly to achieve rigor in qualitative research and note that they do not completely cover the broader considerations necessary for high-quality research. This review points out that a universal and versatile one-size-fits-all guideline for evaluating the quality of qualitative research does not exist. In other words, this review also emphasizes the non-existence of a set of common guidelines among qualitative researchers. In unison, this review reinforces that each qualitative approach should be treated uniquely on account of its own distinctive features for different epistemological and disciplinary positions. Owing to the sensitivity of the worth of qualitative research towards the specific context and the type of paradigmatic stance, researchers should themselves analyze what approaches can be and must be tailored to ensemble the distinct characteristics of the phenomenon under investigation. Although this article does not assert to put forward a magic bullet and to provide a one-stop solution for dealing with dilemmas about how, why, or whether to evaluate the “goodness” of qualitative research, it offers a platform to assist the researchers in improving their qualitative studies. This work provides an assembly of concerns to reflect on, a series of questions to ask, and multiple sets of criteria to look at, when attempting to determine the quality of qualitative research. Overall, this review underlines the crux of qualitative research and accentuates the need to evaluate such research by the very tenets of its being. Bringing together the vital arguments and delineating the requirements that good qualitative research should satisfy, this review strives to equip the researchers as well as reviewers to make well-versed judgment about the worth and significance of the qualitative research under scrutiny. In a nutshell, a comprehensive portrayal of the research process (from the context of research to the research objectives, research questions and design, speculative foundations, and from approaches of collecting data to analyzing the results, to deriving inferences) frequently proliferates the quality of a qualitative research.

Prospects : A Road Ahead for Qualitative Research

Irrefutably, qualitative research is a vivacious and evolving discipline wherein different epistemological and disciplinary positions have their own characteristics and importance. In addition, not surprisingly, owing to the sprouting and varied features of qualitative research, no consensus has been pulled off till date. Researchers have reflected various concerns and proposed several recommendations for editors and reviewers on conducting reviews of critical qualitative research (Levitt et al., 2021 ; McGinley et al., 2021 ). Following are some prospects and a few recommendations put forward towards the maturation of qualitative research and its quality evaluation:

In general, most of the manuscript and grant reviewers are not qualitative experts. Hence, it is more likely that they would prefer to adopt a broad set of criteria. However, researchers and reviewers need to keep in mind that it is inappropriate to utilize the same approaches and conducts among all qualitative research. Therefore, future work needs to focus on educating researchers and reviewers about the criteria to evaluate qualitative research from within the suitable theoretical and methodological context.

There is an urgent need to refurbish and augment critical assessment of some well-known and widely accepted tools (including checklists such as COREQ, SRQR) to interrogate their applicability on different aspects (along with their epistemological ramifications).

Efforts should be made towards creating more space for creativity, experimentation, and a dialogue between the diverse traditions of qualitative research. This would potentially help to avoid the enforcement of one's own set of quality criteria on the work carried out by others.

Moreover, journal reviewers need to be aware of various methodological practices and philosophical debates.

It is pivotal to highlight the expressions and considerations of qualitative researchers and bring them into a more open and transparent dialogue about assessing qualitative research in techno-scientific, academic, sociocultural, and political rooms.

Frequent debates on the use of evaluative criteria are required to solve some potentially resolved issues (including the applicability of a single set of criteria in multi-disciplinary aspects). Such debates would not only benefit the group of qualitative researchers themselves, but primarily assist in augmenting the well-being and vivacity of the entire discipline.

To conclude, I speculate that the criteria, and my perspective, may transfer to other methods, approaches, and contexts. I hope that they spark dialog and debate – about criteria for excellent qualitative research and the underpinnings of the discipline more broadly – and, therefore, help improve the quality of a qualitative study. Further, I anticipate that this review will assist the researchers to contemplate on the quality of their own research, to substantiate research design and help the reviewers to review qualitative research for journals. On a final note, I pinpoint the need to formulate a framework (encompassing the prerequisites of a qualitative study) by the cohesive efforts of qualitative researchers of different disciplines with different theoretic-paradigmatic origins. I believe that tailoring such a framework (of guiding principles) paves the way for qualitative researchers to consolidate the status of qualitative research in the wide-ranging open science debate. Dialogue on this issue across different approaches is crucial for the impending prospects of socio-techno-educational research.

Amin, M. E. K., Nørgaard, L. S., Cavaco, A. M., Witry, M. J., Hillman, L., Cernasev, A., & Desselle, S. P. (2020). Establishing trustworthiness and authenticity in qualitative pharmacy research. Research in Social and Administrative Pharmacy, 16 (10), 1472–1482.

Article   Google Scholar  

Barker, C., & Pistrang, N. (2005). Quality criteria under methodological pluralism: Implications for conducting and evaluating research. American Journal of Community Psychology, 35 (3–4), 201–212.

Bryman, A., Becker, S., & Sempik, J. (2008). Quality criteria for quantitative, qualitative and mixed methods research: A view from social policy. International Journal of Social Research Methodology, 11 (4), 261–276.

Caelli, K., Ray, L., & Mill, J. (2003). ‘Clear as mud’: Toward greater clarity in generic qualitative research. International Journal of Qualitative Methods, 2 (2), 1–13.

CASP (2021). CASP checklists. Retrieved May 2021 from https://casp-uk.net/casp-tools-checklists/

Cohen, D. J., & Crabtree, B. F. (2008). Evaluative criteria for qualitative research in health care: Controversies and recommendations. The Annals of Family Medicine, 6 (4), 331–339.

Denzin, N. K., & Lincoln, Y. S. (2005). Introduction: The discipline and practice of qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), The sage handbook of qualitative research (pp. 1–32). Sage Publications Ltd.

Google Scholar  

Elliott, R., Fischer, C. T., & Rennie, D. L. (1999). Evolving guidelines for publication of qualitative research studies in psychology and related fields. British Journal of Clinical Psychology, 38 (3), 215–229.

Epp, A. M., & Otnes, C. C. (2021). High-quality qualitative research: Getting into gear. Journal of Service Research . https://doi.org/10.1177/1094670520961445

Guba, E. G. (1990). The paradigm dialog. In Alternative paradigms conference, mar, 1989, Indiana u, school of education, San Francisco, ca, us . Sage Publications, Inc.

Hammersley, M. (2007). The issue of quality in qualitative research. International Journal of Research and Method in Education, 30 (3), 287–305.

Haven, T. L., Errington, T. M., Gleditsch, K. S., van Grootel, L., Jacobs, A. M., Kern, F. G., & Mokkink, L. B. (2020). Preregistering qualitative research: A Delphi study. International Journal of Qualitative Methods, 19 , 1609406920976417.

Hays, D. G., & McKibben, W. B. (2021). Promoting rigorous research: Generalizability and qualitative research. Journal of Counseling and Development, 99 (2), 178–188.

Horsburgh, D. (2003). Evaluation of qualitative research. Journal of Clinical Nursing, 12 (2), 307–312.

Howe, K. R. (2004). A critique of experimentalism. Qualitative Inquiry, 10 (1), 42–46.

Johnson, J. L., Adkins, D., & Chauvin, S. (2020). A review of the quality indicators of rigor in qualitative research. American Journal of Pharmaceutical Education, 84 (1), 7120.

Johnson, P., Buehring, A., Cassell, C., & Symon, G. (2006). Evaluating qualitative management research: Towards a contingent criteriology. International Journal of Management Reviews, 8 (3), 131–156.

Klein, H. K., & Myers, M. D. (1999). A set of principles for conducting and evaluating interpretive field studies in information systems. MIS Quarterly, 23 (1), 67–93.

Lather, P. (2004). This is your father’s paradigm: Government intrusion and the case of qualitative research in education. Qualitative Inquiry, 10 (1), 15–34.

Levitt, H. M., Morrill, Z., Collins, K. M., & Rizo, J. L. (2021). The methodological integrity of critical qualitative research: Principles to support design and research review. Journal of Counseling Psychology, 68 (3), 357.

Lincoln, Y. S., & Guba, E. G. (1986). But is it rigorous? Trustworthiness and authenticity in naturalistic evaluation. New Directions for Program Evaluation, 1986 (30), 73–84.

Lincoln, Y. S., & Guba, E. G. (2000). Paradigmatic controversies, contradictions and emerging confluences. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (2nd ed., pp. 163–188). Sage Publications.

Madill, A., Jordan, A., & Shirley, C. (2000). Objectivity and reliability in qualitative analysis: Realist, contextualist and radical constructionist epistemologies. British Journal of Psychology, 91 (1), 1–20.

Mays, N., & Pope, C. (2020). Quality in qualitative research. Qualitative Research in Health Care . https://doi.org/10.1002/9781119410867.ch15

McGinley, S., Wei, W., Zhang, L., & Zheng, Y. (2021). The state of qualitative research in hospitality: A 5-year review 2014 to 2019. Cornell Hospitality Quarterly, 62 (1), 8–20.

Merriam, S., & Tisdell, E. (2016). Qualitative research: A guide to design and implementation. San Francisco, US.

Meyer, M., & Dykes, J. (2019). Criteria for rigor in visualization design study. IEEE Transactions on Visualization and Computer Graphics, 26 (1), 87–97.

Monrouxe, L. V., & Rees, C. E. (2020). When I say… quantification in qualitative research. Medical Education, 54 (3), 186–187.

Morrow, S. L. (2005). Quality and trustworthiness in qualitative research in counseling psychology. Journal of Counseling Psychology, 52 (2), 250.

Morse, J. M. (2003). A review committee’s guide for evaluating qualitative proposals. Qualitative Health Research, 13 (6), 833–851.

Nassaji, H. (2020). Good qualitative research. Language Teaching Research, 24 (4), 427–431.

O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine, 89 (9), 1245–1251.

O’Connor, C., & Joffe, H. (2020). Intercoder reliability in qualitative research: Debates and practical guidelines. International Journal of Qualitative Methods, 19 , 1609406919899220.

Reid, A., & Gough, S. (2000). Guidelines for reporting and evaluating qualitative research: What are the alternatives? Environmental Education Research, 6 (1), 59–91.

Rocco, T. S. (2010). Criteria for evaluating qualitative studies. Human Resource Development International . https://doi.org/10.1080/13678868.2010.501959

Sandberg, J. (2000). Understanding human competence at work: An interpretative approach. Academy of Management Journal, 43 (1), 9–25.

Schwandt, T. A. (1996). Farewell to criteriology. Qualitative Inquiry, 2 (1), 58–72.

Seale, C. (1999). Quality in qualitative research. Qualitative Inquiry, 5 (4), 465–478.

Shenton, A. K. (2004). Strategies for ensuring trustworthiness in qualitative research projects. Education for Information, 22 (2), 63–75.

Sparkes, A. C. (2001). Myth 94: Qualitative health researchers will agree about validity. Qualitative Health Research, 11 (4), 538–552.

Spencer, L., Ritchie, J., Lewis, J., & Dillon, L. (2004). Quality in qualitative evaluation: A framework for assessing research evidence.

Stenfors, T., Kajamaa, A., & Bennett, D. (2020). How to assess the quality of qualitative research. The Clinical Teacher, 17 (6), 596–599.

Taylor, E. W., Beck, J., & Ainsworth, E. (2001). Publishing qualitative adult education research: A peer review perspective. Studies in the Education of Adults, 33 (2), 163–179.

Tong, A., Sainsbury, P., & Craig, J. (2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care, 19 (6), 349–357.

Tracy, S. J. (2010). Qualitative quality: Eight “big-tent” criteria for excellent qualitative research. Qualitative Inquiry, 16 (10), 837–851.

Download references

Open access funding provided by TU Wien (TUW).

Author information

Authors and affiliations.

Faculty of Informatics, Technische Universität Wien, 1040, Vienna, Austria

Drishti Yadav

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Drishti Yadav .

Ethics declarations

Conflict of interest.

The author declares no conflict of interest.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Yadav, D. Criteria for Good Qualitative Research: A Comprehensive Review. Asia-Pacific Edu Res 31 , 679–689 (2022). https://doi.org/10.1007/s40299-021-00619-0

Download citation

Accepted : 28 August 2021

Published : 18 September 2021

Issue Date : December 2022

DOI : https://doi.org/10.1007/s40299-021-00619-0

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Qualitative research
• Evaluative criteria
• Find a journal
• Publish with us
• Track your research

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

4 Gathering and Analyzing Qualitative Data

Gathering and analyzing qualitative data.

As the role of clinician researchers expands beyond the bedside, it is important to consider the possibilities of inquiry beyond the quantitative approach. In contrast to the quantitative approach, qualitative methodology is highly inductive and relies on the background and interpretation of the researcher to derive meaning from the gathering and analytic processes central to qualitative inquiry.

Chapter 4: Learning Objectives

As you explore the research opportunities central to your interests to consider whether qualitative component would enrich your work, you’ll be able to:

• Define what qualitative research is
• Compare qualitative and quantitative approaches
• Describe the process of creating themes from recurring ideas gleaned from narrative interviews

What Is Qualitative Research?

Quantitative researchers typically start with a focused research question or hypothesis, collect a small amount of numerical data from a large number of individuals, describe the resulting data using statistical techniques, and draw general conclusions about some large population. Although this method is by far the most common approach to conducting empirical research in fields such as respiratory care and other clinical fields, there is an important alternative called qualitative research. Qualitative research originated in the disciplines of anthropology and sociology but is now used to study psychological topics as well. Qualitative researchers generally begin with a less focused research question, collect large amounts of relatively “unfiltered” data from a relatively small number of individuals, and describe their data using nonstatistical techniques, such as grounded theory, thematic analysis, critical discourse analysis, or interpretative phenomenological analysis. They are usually less concerned with drawing general conclusions about human behavior than with understanding in detail the experience of their research participants.

Consider, for example, a study by researcher Per Lindqvist and his colleagues, who wanted to learn how the families of teenage suicide victims cope with their loss (Lindqvist, Johansson, & Karlsson, 2008). They did not have a specific research question or hypothesis, such as, What percentage of family members join suicide support groups? Instead, they wanted to understand the variety of reactions that families had, with a focus on what it is like from their perspectives. To address this question, they interviewed the families of 10 teenage suicide victims in their homes in rural Sweden. The interviews were relatively unstructured, beginning with a general request for the families to talk about the victim and ending with an invitation to talk about anything else that they wanted to tell the interviewer. One of the most important themes that emerged from these interviews was that even as life returned to “normal,” the families continued to struggle with the question of why their loved one committed suicide. This struggle appeared to be especially difficult for families in which the suicide was most unexpected.

The Purpose of Qualitative Research

The strength of quantitative research is its ability to provide precise answers to specific research questions and to draw general conclusions about human behavior. This method is how we know that people have a strong tendency to obey authority figures, for example, and that female undergraduate students are not substantially more talkative than male undergraduate students. But while quantitative research is good at providing precise answers to specific research questions, it is not nearly as good at generating novel and interesting research questions. Likewise, while quantitative research is good at drawing general conclusions about human behavior, it is not nearly as good at providing detailed descriptions of the behavior of particular groups in particular situations. And quantitative research is not very good at communicating what it is actually like to be a member of a particular group in a particular situation.

But the relative weaknesses of quantitative research are the relative strengths of qualitative research. Qualitative research can help researchers to generate new and interesting research questions and hypotheses. The research of Lindqvist and colleagues, for example, suggests that there may be a general relationship between how unexpected a suicide is and how consumed the family is with trying to understand why the teen committed suicide. This relationship can now be explored using quantitative research. But it is unclear whether this question would have arisen at all without the researchers sitting down with the families and listening to what they themselves wanted to say about their experience. Qualitative research can also provide rich and detailed descriptions of human behavior in the real-world contexts in which it occurs. Among qualitative researchers, this depth is often referred to as “thick description” (Geertz, 1973) .

Similarly, qualitative research can convey a sense of what it is actually like to be a member of a particular group or in a particular situation—what qualitative researchers often refer to as the “lived experience” of the research participants. Lindqvist and colleagues, for example, describe how all the families spontaneously offered to show the interviewer the victim’s bedroom or the place where the suicide occurred—revealing the importance of these physical locations to the families. It seems unlikely that a quantitative study would have discovered this detail. The table below lists some contrasts between qualitative and quantitative research

Data Collection and Analysis in Qualitative Research

Data collection approaches in qualitative research are quite varied and can involve naturalistic observation, participant observation, archival data, artwork, and many other things. But one of the most common approaches, especially for psychological research, is to conduct interviews. Interviews in qualitative research can be unstructured—consisting of a small number of general questions or prompts that allow participants to talk about what is of interest to them—or structured, where there is a strict script that the interviewer does not deviate from. Most interviews are in between the two and are called semi-structured interviews, where the researcher has a few consistent questions and can follow up by asking more detailed questions about the topics that come up. Such interviews can be lengthy and detailed, but they are usually conducted with a relatively small sample. The unstructured interview was the approach used by Lindqvist and colleagues in their research on the families of suicide victims because the researchers were aware that how much was disclosed about such a sensitive topic should be led by the families, not by the researchers.

Another approach used in qualitative research involves small groups of people who participate together in interviews focused on a particular topic or issue, known as focus groups. The interaction among participants in a focus group can sometimes bring out more information than can be learned in a one- on-one interview. The use of focus groups has become a standard technique in business and industry among those who want to understand consumer tastes and preferences. The content of all focus group interviews is usually recorded and transcribed to facilitate later analyses. However, we know from social psychology that group dynamics are often at play in any group, including focus groups, and it is useful to be aware of those possibilities. For example, the desire to be liked by others can lead participants to provide inaccurate answers that they believe will be perceived favorably by the other participants. The same may be said for personality characteristics. For example, highly extraverted participants can sometimes dominate discussions within focus groups.

Data Analysis in Qualitative Research

Although quantitative and qualitative research generally differ along several important dimensions (e.g., the specificity of the research question, the type of data collected), it is the method of data analysis that distinguishes them more clearly than anything else. To illustrate this idea, imagine a team of researchers that conducts a series of unstructured interviews with people recovering from alcohol use disorder to learn about the role of their religious faith in their recovery. Although this project sounds like qualitative research, imagine further that once they collect the data, they code the data in terms of how often each participant mentions God (or a “higher power”), and they then use descriptive and inferential statistics to find out whether those who mention God more often are more successful in abstaining from alcohol. Now it sounds like quantitative research. In other words, the quantitative-qualitative distinction depends more on what researchers do with the data they have collected than with why or how they collected the data.

But what does qualitative data analysis look like? Just as there are many ways to collect data in qualitative research, there are many ways to analyze data. Here we focus on one general approach called grounded theory (Glaser & Strauss, 1967) . This approach was developed within the field of sociology in the 1960s and has gradually gained popularity in psychology. Remember that in quantitative research, it is typical for the researcher to start with a theory, derive a hypothesis from that theory, and then collect data to test that specific hypothesis. In qualitative research using grounded theory, researchers start with the data and develop a theory or an interpretation that is “grounded in” those data. They do this analysis in stages. First, they identify ideas that are repeated throughout the data. Then they organize these ideas into a smaller number of broader themes. Finally, they write a theoretical narrative—an interpretation of the data in terms of the themes that they have identified. This theoretical narrative focuses on the subjective experience of the participants and is usually supported by many direct quotations from the participants themselves.

As an example, consider a study by researchers Laura Abrams and Laura Curran, who used the grounded theory approach to study the experience of postpartum depression symptoms among low-income mothers (Abrams & Curran, 2009) . Their data were the result of unstructured interviews with 19 participants. The table below hows the five broad themes the researchers identified and the more specific repeating ideas that made up each of those themes. In their research report, they provide numerous quotations from their participants, such as this one from “Destiny:”

“Well, just recently my apartment was broken into and the fact that his Medicaid for some reason was cancelled so a lot of things was happening within the last two weeks all at one time. So that in itself I don’t want to say almost drove me mad but it put me in a funk….Like I really was depressed. (p. 357)”

Their theoretical narrative focused on the participants’ experience of their symptoms, not as an abstract “affective disorder” but as closely tied to the daily struggle of raising children alone under often difficult circumstances. The table below illustrates the process of creating themes from repeating ideas in the qualitative research gathering and analysis process.

Given their differences, it may come as no surprise that quantitative and qualitative research do not coexist in complete harmony. Some quantitative researchers criticize qualitative methods on the grounds that they lack objectivity, are difficult to evaluate in terms of reliability and validity, and do not allow generalization to people or situations other than those actually studied. At the same time, some qualitative researchers criticize quantitative methods on the grounds that they overlook the richness of human behavior and experience and instead answer simple questions about easily quantifiable variables.

In general, however, qualitative researchers are well aware of the issues of objectivity, reliability, validity, and generalizability. In fact, they have developed a number of frameworks for addressing these issues (which are beyond the scope of our discussion). And in general, quantitative researchers are well aware of the issue of oversimplification. They do not believe that all human behavior and experience can be adequately described in terms of a small number of variables and the statistical relationships among them. Instead, they use simplification as a strategy for uncovering general principles of human behavior.

Many researchers from both the quantitative and qualitative camps now agree that the two approaches can and should be combined into what has come to be called mixed-methods research (Todd, Nerlich, McKeown, & Clarke, 2004). In fact, the studies by Lindqvist and colleagues and by Abrams and Curran both combined quantitative and qualitative approaches. One approach to combining quantitative and qualitative research is to use qualitative research for hypothesis generation and quantitative research for hypothesis testing. Again, while a qualitative study might suggest that families who experience an unexpected suicide have more difficulty resolving the question of why, a well-designed quantitative study could test a hypothesis by measuring these specific variables in a large sample. A second approach to combining quantitative and qualitative research is referred to as triangulation. The idea is to use both quantitative and qualitative methods simultaneously to study the same general questions and to compare the results. If the results of the quantitative and qualitative methods converge on the same general conclusion, they reinforce and enrich each other. If the results diverge, then they suggest an interesting new question: Why do the results diverge and how can they be reconciled?

Using qualitative research can often help clarify quantitative results via triangulation. Trenor, Yu, Waight, Zerda, and Sha (2008) investigated the experience of female engineering students at a university. In the first phase, female engineering students were asked to complete a survey, where they rated a number of their perceptions, including their sense of belonging. Their results were compared across the student ethnicities, and statistically, the various ethnic groups showed no differences in their ratings of their sense of belonging.

One might look at that result and conclude that ethnicity does not have anything to do with one’s sense of belonging. However, in the second phase, the authors also conducted interviews with the students, and in those interviews, many minority students reported how the diversity of cultures at the university enhanced their sense of belonging. Without the qualitative component, we might have drawn the wrong conclusion about the quantitative results.

This example shows how qualitative and quantitative research work together to help us understand human behavior. Some researchers have characterized qualitative research as best for identifying behaviors or the phenomenon whereas quantitative research is best for understanding meaning or identifying the mechanism. However, Bryman (2012) argues for breaking down the divide between these arbitrarily different ways of investigating the same questions.

Key Takeaways

• The qualitative approach is centered on an inductive method of reasoning
• The qualitative approach focuses on understanding phenomenon through the perspective of those experiencing it
• Researchers search for recurring topics and group themes to build upon theory to explain findings
• A mixed methods approach uses both quantitative and qualitative methods to explain different aspects of a phenomenon, processes, or practice
• This chapter can be attributed to Research Methods in Psychology by Rajiv S. Jhangiani, I-Chant A. Chiang, Carrie Cuttler, & Dana C. Leighton is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License, except where otherwise noted. This adaptation constitutes the fourth edition of this textbook, and builds upon the second Canadian edition by Rajiv S. Jhangiani (Kwantlen Polytechnic University) and I-Chant A. Chiang (Quest University Canada), the second American edition by Dana C. Leighton (Texas A&M University-Texarkana), and the third American edition by Carrie Cuttler (Washington State University) and feedback from several peer reviewers coordinated by the Rebus Community. This edition is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. ↵

Gathering and Analyzing Qualitative Data Copyright © by megankoster is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.

Share This Book

Chapter 1. Introduction

“Science is in danger, and for that reason it is becoming dangerous” -Pierre Bourdieu, Science of Science and Reflexivity

Why an Open Access Textbook on Qualitative Research Methods?

I have been teaching qualitative research methods to both undergraduates and graduate students for many years.  Although there are some excellent textbooks out there, they are often costly, and none of them, to my mind, properly introduces qualitative research methods to the beginning student (whether undergraduate or graduate student).  In contrast, this open-access textbook is designed as a (free) true introduction to the subject, with helpful, practical pointers on how to conduct research and how to access more advanced instruction.  

Textbooks are typically arranged in one of two ways: (1) by technique (each chapter covers one method used in qualitative research); or (2) by process (chapters advance from research design through publication).  But both of these approaches are necessary for the beginner student.  This textbook will have sections dedicated to the process as well as the techniques of qualitative research.  This is a true “comprehensive” book for the beginning student.  In addition to covering techniques of data collection and data analysis, it provides a road map of how to get started and how to keep going and where to go for advanced instruction.  It covers aspects of research design and research communication as well as methods employed.  Along the way, it includes examples from many different disciplines in the social sciences.

The primary goal has been to create a useful, accessible, engaging textbook for use across many disciplines.  And, let’s face it.  Textbooks can be boring.  I hope readers find this to be a little different.  I have tried to write in a practical and forthright manner, with many lively examples and references to good and intellectually creative qualitative research.  Woven throughout the text are short textual asides (in colored textboxes) by professional (academic) qualitative researchers in various disciplines.  These short accounts by practitioners should help inspire students.  So, let’s begin!

What is Research?

When we use the word research , what exactly do we mean by that?  This is one of those words that everyone thinks they understand, but it is worth beginning this textbook with a short explanation.  We use the term to refer to “empirical research,” which is actually a historically specific approach to understanding the world around us.  Think about how you know things about the world. [1] You might know your mother loves you because she’s told you she does.  Or because that is what “mothers” do by tradition.  Or you might know because you’ve looked for evidence that she does, like taking care of you when you are sick or reading to you in bed or working two jobs so you can have the things you need to do OK in life.  Maybe it seems churlish to look for evidence; you just take it “on faith” that you are loved.

Only one of the above comes close to what we mean by research.  Empirical research is research (investigation) based on evidence.  Conclusions can then be drawn from observable data.  This observable data can also be “tested” or checked.  If the data cannot be tested, that is a good indication that we are not doing research.  Note that we can never “prove” conclusively, through observable data, that our mothers love us.  We might have some “disconfirming evidence” (that time she didn’t show up to your graduation, for example) that could push you to question an original hypothesis , but no amount of “confirming evidence” will ever allow us to say with 100% certainty, “my mother loves me.”  Faith and tradition and authority work differently.  Our knowledge can be 100% certain using each of those alternative methods of knowledge, but our certainty in those cases will not be based on facts or evidence.

For many periods of history, those in power have been nervous about “science” because it uses evidence and facts as the primary source of understanding the world, and facts can be at odds with what power or authority or tradition want you to believe.  That is why I say that scientific empirical research is a historically specific approach to understand the world.  You are in college or university now partly to learn how to engage in this historically specific approach.

In the sixteenth and seventeenth centuries in Europe, there was a newfound respect for empirical research, some of which was seriously challenging to the established church.  Using observations and testing them, scientists found that the earth was not at the center of the universe, for example, but rather that it was but one planet of many which circled the sun. [2]   For the next two centuries, the science of astronomy, physics, biology, and chemistry emerged and became disciplines taught in universities.  All used the scientific method of observation and testing to advance knowledge.  Knowledge about people , however, and social institutions, however, was still left to faith, tradition, and authority.  Historians and philosophers and poets wrote about the human condition, but none of them used research to do so. [3]

It was not until the nineteenth century that “social science” really emerged, using the scientific method (empirical observation) to understand people and social institutions.  New fields of sociology, economics, political science, and anthropology emerged.  The first sociologists, people like Auguste Comte and Karl Marx, sought specifically to apply the scientific method of research to understand society, Engels famously claiming that Marx had done for the social world what Darwin did for the natural world, tracings its laws of development.  Today we tend to take for granted the naturalness of science here, but it is actually a pretty recent and radical development.

To return to the question, “does your mother love you?”  Well, this is actually not really how a researcher would frame the question, as it is too specific to your case.  It doesn’t tell us much about the world at large, even if it does tell us something about you and your relationship with your mother.  A social science researcher might ask, “do mothers love their children?”  Or maybe they would be more interested in how this loving relationship might change over time (e.g., “do mothers love their children more now than they did in the 18th century when so many children died before reaching adulthood?”) or perhaps they might be interested in measuring quality of love across cultures or time periods, or even establishing “what love looks like” using the mother/child relationship as a site of exploration.  All of these make good research questions because we can use observable data to answer them.

What is Qualitative Research?

“All we know is how to learn. How to study, how to listen, how to talk, how to tell.  If we don’t tell the world, we don’t know the world.  We’re lost in it, we die.” -Ursula LeGuin, The Telling

At its simplest, qualitative research is research about the social world that does not use numbers in its analyses.  All those who fear statistics can breathe a sigh of relief – there are no mathematical formulae or regression models in this book! But this definition is less about what qualitative research can be and more about what it is not.  To be honest, any simple statement will fail to capture the power and depth of qualitative research.  One way of contrasting qualitative research to quantitative research is to note that the focus of qualitative research is less about explaining and predicting relationships between variables and more about understanding the social world.  To use our mother love example, the question about “what love looks like” is a good question for the qualitative researcher while all questions measuring love or comparing incidences of love (both of which require measurement) are good questions for quantitative researchers. Patton writes,

Qualitative data describe.  They take us, as readers, into the time and place of the observation so that we know what it was like to have been there.  They capture and communicate someone else’s experience of the world in his or her own words.  Qualitative data tell a story. ( Patton 2002:47 )

Qualitative researchers are asking different questions about the world than their quantitative colleagues.  Even when researchers are employed in “mixed methods” research ( both quantitative and qualitative), they are using different methods to address different questions of the study.  I do a lot of research about first-generation and working-college college students.  Where a quantitative researcher might ask, how many first-generation college students graduate from college within four years? Or does first-generation college status predict high student debt loads?  A qualitative researcher might ask, how does the college experience differ for first-generation college students?  What is it like to carry a lot of debt, and how does this impact the ability to complete college on time?  Both sets of questions are important, but they can only be answered using specific tools tailored to those questions.  For the former, you need large numbers to make adequate comparisons.  For the latter, you need to talk to people, find out what they are thinking and feeling, and try to inhabit their shoes for a little while so you can make sense of their experiences and beliefs.

Examples of Qualitative Research

You have probably seen examples of qualitative research before, but you might not have paid particular attention to how they were produced or realized that the accounts you were reading were the result of hours, months, even years of research “in the field.”  A good qualitative researcher will present the product of their hours of work in such a way that it seems natural, even obvious, to the reader.  Because we are trying to convey what it is like answers, qualitative research is often presented as stories – stories about how people live their lives, go to work, raise their children, interact with one another.  In some ways, this can seem like reading particularly insightful novels.  But, unlike novels, there are very specific rules and guidelines that qualitative researchers follow to ensure that the “story” they are telling is accurate , a truthful rendition of what life is like for the people being studied.  Most of this textbook will be spent conveying those rules and guidelines.  Let’s take a look, first, however, at three examples of what the end product looks like.  I have chosen these three examples to showcase very different approaches to qualitative research, and I will return to these five examples throughout the book.  They were all published as whole books (not chapters or articles), and they are worth the long read, if you have the time.  I will also provide some information on how these books came to be and the length of time it takes to get them into book version.  It is important you know about this process, and the rest of this textbook will help explain why it takes so long to conduct good qualitative research!

Example 1 : The End Game (ethnography + interviews)

Corey Abramson is a sociologist who teaches at the University of Arizona.   In 2015 he published The End Game: How Inequality Shapes our Final Years ( 2015 ). This book was based on the research he did for his dissertation at the University of California-Berkeley in 2012.  Actually, the dissertation was completed in 2012 but the work that was produced that took several years.  The dissertation was entitled, “This is How We Live, This is How We Die: Social Stratification, Aging, and Health in Urban America” ( 2012 ).  You can see how the book version, which was written for a more general audience, has a more engaging sound to it, but that the dissertation version, which is what academic faculty read and evaluate, has a more descriptive title.  You can read the title and know that this is a study about aging and health and that the focus is going to be inequality and that the context (place) is going to be “urban America.”  It’s a study about “how” people do something – in this case, how they deal with aging and death.  This is the very first sentence of the dissertation, “From our first breath in the hospital to the day we die, we live in a society characterized by unequal opportunities for maintaining health and taking care of ourselves when ill.  These disparities reflect persistent racial, socio-economic, and gender-based inequalities and contribute to their persistence over time” ( 1 ).  What follows is a truthful account of how that is so.

Cory Abramson spent three years conducting his research in four different urban neighborhoods.  We call the type of research he conducted “comparative ethnographic” because he designed his study to compare groups of seniors as they went about their everyday business.  It’s comparative because he is comparing different groups (based on race, class, gender) and ethnographic because he is studying the culture/way of life of a group. [4]   He had an educated guess, rooted in what previous research had shown and what social theory would suggest, that people’s experiences of aging differ by race, class, and gender.  So, he set up a research design that would allow him to observe differences.  He chose two primarily middle-class (one was racially diverse and the other was predominantly White) and two primarily poor neighborhoods (one was racially diverse and the other was predominantly African American).  He hung out in senior centers and other places seniors congregated, watched them as they took the bus to get prescriptions filled, sat in doctor’s offices with them, and listened to their conversations with each other.  He also conducted more formal conversations, what we call in-depth interviews, with sixty seniors from each of the four neighborhoods.  As with a lot of fieldwork , as he got closer to the people involved, he both expanded and deepened his reach –

By the end of the project, I expanded my pool of general observations to include various settings frequented by seniors: apartment building common rooms, doctors’ offices, emergency rooms, pharmacies, senior centers, bars, parks, corner stores, shopping centers, pool halls, hair salons, coffee shops, and discount stores. Over the course of the three years of fieldwork, I observed hundreds of elders, and developed close relationships with a number of them. ( 2012:10 )

When Abramson rewrote the dissertation for a general audience and published his book in 2015, it got a lot of attention.  It is a beautifully written book and it provided insight into a common human experience that we surprisingly know very little about.  It won the Outstanding Publication Award by the American Sociological Association Section on Aging and the Life Course and was featured in the New York Times .  The book was about aging, and specifically how inequality shapes the aging process, but it was also about much more than that.  It helped show how inequality affects people’s everyday lives.  For example, by observing the difficulties the poor had in setting up appointments and getting to them using public transportation and then being made to wait to see a doctor, sometimes in standing-room-only situations, when they are unwell, and then being treated dismissively by hospital staff, Abramson allowed readers to feel the material reality of being poor in the US.  Comparing these examples with seniors with adequate supplemental insurance who have the resources to hire car services or have others assist them in arranging care when they need it, jolts the reader to understand and appreciate the difference money makes in the lives and circumstances of us all, and in a way that is different than simply reading a statistic (“80% of the poor do not keep regular doctor’s appointments”) does.  Qualitative research can reach into spaces and places that often go unexamined and then reports back to the rest of us what it is like in those spaces and places.

Example 2: Racing for Innocence (Interviews + Content Analysis + Fictional Stories)

Jennifer Pierce is a Professor of American Studies at the University of Minnesota.  Trained as a sociologist, she has written a number of books about gender, race, and power.  Her very first book, Gender Trials: Emotional Lives in Contemporary Law Firms, published in 1995, is a brilliant look at gender dynamics within two law firms.  Pierce was a participant observer, working as a paralegal, and she observed how female lawyers and female paralegals struggled to obtain parity with their male colleagues.

Fifteen years later, she reexamined the context of the law firm to include an examination of racial dynamics, particularly how elite white men working in these spaces created and maintained a culture that made it difficult for both female attorneys and attorneys of color to thrive. Her book, Racing for Innocence: Whiteness, Gender, and the Backlash Against Affirmative Action , published in 2012, is an interesting and creative blending of interviews with attorneys, content analyses of popular films during this period, and fictional accounts of racial discrimination and sexual harassment.  The law firm she chose to study had come under an affirmative action order and was in the process of implementing equitable policies and programs.  She wanted to understand how recipients of white privilege (the elite white male attorneys) come to deny the role they play in reproducing inequality.  Through interviews with attorneys who were present both before and during the affirmative action order, she creates a historical record of the “bad behavior” that necessitated new policies and procedures, but also, and more importantly , probed the participants ’ understanding of this behavior.  It should come as no surprise that most (but not all) of the white male attorneys saw little need for change, and that almost everyone else had accounts that were different if not sometimes downright harrowing.

I’ve used Pierce’s book in my qualitative research methods courses as an example of an interesting blend of techniques and presentation styles.  My students often have a very difficult time with the fictional accounts she includes.  But they serve an important communicative purpose here.  They are her attempts at presenting “both sides” to an objective reality – something happens (Pierce writes this something so it is very clear what it is), and the two participants to the thing that happened have very different understandings of what this means.  By including these stories, Pierce presents one of her key findings – people remember things differently and these different memories tend to support their own ideological positions.  I wonder what Pierce would have written had she studied the murder of George Floyd or the storming of the US Capitol on January 6 or any number of other historic events whose observers and participants record very different happenings.

This is not to say that qualitative researchers write fictional accounts.  In fact, the use of fiction in our work remains controversial.  When used, it must be clearly identified as a presentation device, as Pierce did.  I include Racing for Innocence here as an example of the multiple uses of methods and techniques and the way that these work together to produce better understandings by us, the readers, of what Pierce studied.  We readers come away with a better grasp of how and why advantaged people understate their own involvement in situations and structures that advantage them.  This is normal human behavior , in other words.  This case may have been about elite white men in law firms, but the general insights here can be transposed to other settings.  Indeed, Pierce argues that more research needs to be done about the role elites play in the reproduction of inequality in the workplace in general.

Example 3: Amplified Advantage (Mixed Methods: Survey Interviews + Focus Groups + Archives)

The final example comes from my own work with college students, particularly the ways in which class background affects the experience of college and outcomes for graduates.  I include it here as an example of mixed methods, and for the use of supplementary archival research.  I’ve done a lot of research over the years on first-generation, low-income, and working-class college students.  I am curious (and skeptical) about the possibility of social mobility today, particularly with the rising cost of college and growing inequality in general.  As one of the few people in my family to go to college, I didn’t grow up with a lot of examples of what college was like or how to make the most of it.  And when I entered graduate school, I realized with dismay that there were very few people like me there.  I worried about becoming too different from my family and friends back home.  And I wasn’t at all sure that I would ever be able to pay back the huge load of debt I was taking on.  And so I wrote my dissertation and first two books about working-class college students.  These books focused on experiences in college and the difficulties of navigating between family and school ( Hurst 2010a, 2012 ).  But even after all that research, I kept coming back to wondering if working-class students who made it through college had an equal chance at finding good jobs and happy lives,

What happens to students after college?  Do working-class students fare as well as their peers?  I knew from my own experience that barriers continued through graduate school and beyond, and that my debtload was higher than that of my peers, constraining some of the choices I made when I graduated.  To answer these questions, I designed a study of students attending small liberal arts colleges, the type of college that tried to equalize the experience of students by requiring all students to live on campus and offering small classes with lots of interaction with faculty.  These private colleges tend to have more money and resources so they can provide financial aid to low-income students.  They also attract some very wealthy students.  Because they enroll students across the class spectrum, I would be able to draw comparisons.  I ended up spending about four years collecting data, both a survey of more than 2000 students (which formed the basis for quantitative analyses) and qualitative data collection (interviews, focus groups, archival research, and participant observation).  This is what we call a “mixed methods” approach because we use both quantitative and qualitative data.  The survey gave me a large enough number of students that I could make comparisons of the how many kind, and to be able to say with some authority that there were in fact significant differences in experience and outcome by class (e.g., wealthier students earned more money and had little debt; working-class students often found jobs that were not in their chosen careers and were very affected by debt, upper-middle-class students were more likely to go to graduate school).  But the survey analyses could not explain why these differences existed.  For that, I needed to talk to people and ask them about their motivations and aspirations.  I needed to understand their perceptions of the world, and it is very hard to do this through a survey.

By interviewing students and recent graduates, I was able to discern particular patterns and pathways through college and beyond.  Specifically, I identified three versions of gameplay.  Upper-middle-class students, whose parents were themselves professionals (academics, lawyers, managers of non-profits), saw college as the first stage of their education and took classes and declared majors that would prepare them for graduate school.  They also spent a lot of time building their resumes, taking advantage of opportunities to help professors with their research, or study abroad.  This helped them gain admission to highly-ranked graduate schools and interesting jobs in the public sector.  In contrast, upper-class students, whose parents were wealthy and more likely to be engaged in business (as CEOs or other high-level directors), prioritized building social capital.  They did this by joining fraternities and sororities and playing club sports.  This helped them when they graduated as they called on friends and parents of friends to find them well-paying jobs.  Finally, low-income, first-generation, and working-class students were often adrift.  They took the classes that were recommended to them but without the knowledge of how to connect them to life beyond college.  They spent time working and studying rather than partying or building their resumes.  All three sets of students thought they were “doing college” the right way, the way that one was supposed to do college.   But these three versions of gameplay led to distinct outcomes that advantaged some students over others.  I titled my work “Amplified Advantage” to highlight this process.

These three examples, Cory Abramson’s The End Game , Jennifer Peirce’s Racing for Innocence, and my own Amplified Advantage, demonstrate the range of approaches and tools available to the qualitative researcher.  They also help explain why qualitative research is so important.  Numbers can tell us some things about the world, but they cannot get at the hearts and minds, motivations and beliefs of the people who make up the social worlds we inhabit.  For that, we need tools that allow us to listen and make sense of what people tell us and show us.  That is what good qualitative research offers us.

How Is This Book Organized?

This textbook is organized as a comprehensive introduction to the use of qualitative research methods.  The first half covers general topics (e.g., approaches to qualitative research, ethics) and research design (necessary steps for building a successful qualitative research study).  The second half reviews various data collection and data analysis techniques.  Of course, building a successful qualitative research study requires some knowledge of data collection and data analysis so the chapters in the first half and the chapters in the second half should be read in conversation with each other.  That said, each chapter can be read on its own for assistance with a particular narrow topic.  In addition to the chapters, a helpful glossary can be found in the back of the book.  Rummage around in the text as needed.

Chapter Descriptions

Chapter 2 provides an overview of the Research Design Process.  How does one begin a study? What is an appropriate research question?  How is the study to be done – with what methods ?  Involving what people and sites?  Although qualitative research studies can and often do change and develop over the course of data collection, it is important to have a good idea of what the aims and goals of your study are at the outset and a good plan of how to achieve those aims and goals.  Chapter 2 provides a road map of the process.

Chapter 3 describes and explains various ways of knowing the (social) world.  What is it possible for us to know about how other people think or why they behave the way they do?  What does it mean to say something is a “fact” or that it is “well-known” and understood?  Qualitative researchers are particularly interested in these questions because of the types of research questions we are interested in answering (the how questions rather than the how many questions of quantitative research).  Qualitative researchers have adopted various epistemological approaches.  Chapter 3 will explore these approaches, highlighting interpretivist approaches that acknowledge the subjective aspect of reality – in other words, reality and knowledge are not objective but rather influenced by (interpreted through) people.

Chapter 4 focuses on the practical matter of developing a research question and finding the right approach to data collection.  In any given study (think of Cory Abramson’s study of aging, for example), there may be years of collected data, thousands of observations , hundreds of pages of notes to read and review and make sense of.  If all you had was a general interest area (“aging”), it would be very difficult, nearly impossible, to make sense of all of that data.  The research question provides a helpful lens to refine and clarify (and simplify) everything you find and collect.  For that reason, it is important to pull out that lens (articulate the research question) before you get started.  In the case of the aging study, Cory Abramson was interested in how inequalities affected understandings and responses to aging.  It is for this reason he designed a study that would allow him to compare different groups of seniors (some middle-class, some poor).  Inevitably, he saw much more in the three years in the field than what made it into his book (or dissertation), but he was able to narrow down the complexity of the social world to provide us with this rich account linked to the original research question.  Developing a good research question is thus crucial to effective design and a successful outcome.  Chapter 4 will provide pointers on how to do this.  Chapter 4 also provides an overview of general approaches taken to doing qualitative research and various “traditions of inquiry.”

Chapter 5 explores sampling .  After you have developed a research question and have a general idea of how you will collect data (Observations?  Interviews?), how do you go about actually finding people and sites to study?  Although there is no “correct number” of people to interview , the sample should follow the research question and research design.  Unlike quantitative research, qualitative research involves nonprobability sampling.  Chapter 5 explains why this is so and what qualities instead make a good sample for qualitative research.

Chapter 6 addresses the importance of reflexivity in qualitative research.  Related to epistemological issues of how we know anything about the social world, qualitative researchers understand that we the researchers can never be truly neutral or outside the study we are conducting.  As observers, we see things that make sense to us and may entirely miss what is either too obvious to note or too different to comprehend.  As interviewers, as much as we would like to ask questions neutrally and remain in the background, interviews are a form of conversation, and the persons we interview are responding to us .  Therefore, it is important to reflect upon our social positions and the knowledges and expectations we bring to our work and to work through any blind spots that we may have.  Chapter 6 provides some examples of reflexivity in practice and exercises for thinking through one’s own biases.

Chapter 7 is a very important chapter and should not be overlooked.  As a practical matter, it should also be read closely with chapters 6 and 8.  Because qualitative researchers deal with people and the social world, it is imperative they develop and adhere to a strong ethical code for conducting research in a way that does not harm.  There are legal requirements and guidelines for doing so (see chapter 8), but these requirements should not be considered synonymous with the ethical code required of us.   Each researcher must constantly interrogate every aspect of their research, from research question to design to sample through analysis and presentation, to ensure that a minimum of harm (ideally, zero harm) is caused.  Because each research project is unique, the standards of care for each study are unique.  Part of being a professional researcher is carrying this code in one’s heart, being constantly attentive to what is required under particular circumstances.  Chapter 7 provides various research scenarios and asks readers to weigh in on the suitability and appropriateness of the research.  If done in a class setting, it will become obvious fairly quickly that there are often no absolutely correct answers, as different people find different aspects of the scenarios of greatest importance.  Minimizing the harm in one area may require possible harm in another.  Being attentive to all the ethical aspects of one’s research and making the best judgments one can, clearly and consciously, is an integral part of being a good researcher.

Chapter 8 , best to be read in conjunction with chapter 7, explains the role and importance of Institutional Review Boards (IRBs) .  Under federal guidelines, an IRB is an appropriately constituted group that has been formally designated to review and monitor research involving human subjects .  Every institution that receives funding from the federal government has an IRB.  IRBs have the authority to approve, require modifications to (to secure approval), or disapprove research.  This group review serves an important role in the protection of the rights and welfare of human research subjects.  Chapter 8 reviews the history of IRBs and the work they do but also argues that IRBs’ review of qualitative research is often both over-inclusive and under-inclusive.  Some aspects of qualitative research are not well understood by IRBs, given that they were developed to prevent abuses in biomedical research.  Thus, it is important not to rely on IRBs to identify all the potential ethical issues that emerge in our research (see chapter 7).

Chapter 9 provides help for getting started on formulating a research question based on gaps in the pre-existing literature.  Research is conducted as part of a community, even if particular studies are done by single individuals (or small teams).  What any of us finds and reports back becomes part of a much larger body of knowledge.  Thus, it is important that we look at the larger body of knowledge before we actually start our bit to see how we can best contribute.  When I first began interviewing working-class college students, there was only one other similar study I could find, and it hadn’t been published (it was a dissertation of students from poor backgrounds).  But there had been a lot published by professors who had grown up working class and made it through college despite the odds.  These accounts by “working-class academics” became an important inspiration for my study and helped me frame the questions I asked the students I interviewed.  Chapter 9 will provide some pointers on how to search for relevant literature and how to use this to refine your research question.

Chapter 10 serves as a bridge between the two parts of the textbook, by introducing techniques of data collection.  Qualitative research is often characterized by the form of data collection – for example, an ethnographic study is one that employs primarily observational data collection for the purpose of documenting and presenting a particular culture or ethnos.  Techniques can be effectively combined, depending on the research question and the aims and goals of the study.   Chapter 10 provides a general overview of all the various techniques and how they can be combined.

The second part of the textbook moves into the doing part of qualitative research once the research question has been articulated and the study designed.  Chapters 11 through 17 cover various data collection techniques and approaches.  Chapters 18 and 19 provide a very simple overview of basic data analysis.  Chapter 20 covers communication of the data to various audiences, and in various formats.

Chapter 11 begins our overview of data collection techniques with a focus on interviewing , the true heart of qualitative research.  This technique can serve as the primary and exclusive form of data collection, or it can be used to supplement other forms (observation, archival).  An interview is distinct from a survey, where questions are asked in a specific order and often with a range of predetermined responses available.  Interviews can be conversational and unstructured or, more conventionally, semistructured , where a general set of interview questions “guides” the conversation.  Chapter 11 covers the basics of interviews: how to create interview guides, how many people to interview, where to conduct the interview, what to watch out for (how to prepare against things going wrong), and how to get the most out of your interviews.

Chapter 12 covers an important variant of interviewing, the focus group.  Focus groups are semistructured interviews with a group of people moderated by a facilitator (the researcher or researcher’s assistant).  Focus groups explicitly use group interaction to assist in the data collection.  They are best used to collect data on a specific topic that is non-personal and shared among the group.  For example, asking a group of college students about a common experience such as taking classes by remote delivery during the pandemic year of 2020.  Chapter 12 covers the basics of focus groups: when to use them, how to create interview guides for them, and how to run them effectively.

Chapter 13 moves away from interviewing to the second major form of data collection unique to qualitative researchers – observation .  Qualitative research that employs observation can best be understood as falling on a continuum of “fly on the wall” observation (e.g., observing how strangers interact in a doctor’s waiting room) to “participant” observation, where the researcher is also an active participant of the activity being observed.  For example, an activist in the Black Lives Matter movement might want to study the movement, using her inside position to gain access to observe key meetings and interactions.  Chapter  13 covers the basics of participant observation studies: advantages and disadvantages, gaining access, ethical concerns related to insider/outsider status and entanglement, and recording techniques.

Chapter 14 takes a closer look at “deep ethnography” – immersion in the field of a particularly long duration for the purpose of gaining a deeper understanding and appreciation of a particular culture or social world.  Clifford Geertz called this “deep hanging out.”  Whereas participant observation is often combined with semistructured interview techniques, deep ethnography’s commitment to “living the life” or experiencing the situation as it really is demands more conversational and natural interactions with people.  These interactions and conversations may take place over months or even years.  As can be expected, there are some costs to this technique, as well as some very large rewards when done competently.  Chapter 14 provides some examples of deep ethnographies that will inspire some beginning researchers and intimidate others.

Chapter 15 moves in the opposite direction of deep ethnography, a technique that is the least positivist of all those discussed here, to mixed methods , a set of techniques that is arguably the most positivist .  A mixed methods approach combines both qualitative data collection and quantitative data collection, commonly by combining a survey that is analyzed statistically (e.g., cross-tabs or regression analyses of large number probability samples) with semi-structured interviews.  Although it is somewhat unconventional to discuss mixed methods in textbooks on qualitative research, I think it is important to recognize this often-employed approach here.  There are several advantages and some disadvantages to taking this route.  Chapter 16 will describe those advantages and disadvantages and provide some particular guidance on how to design a mixed methods study for maximum effectiveness.

Chapter 16 covers data collection that does not involve live human subjects at all – archival and historical research (chapter 17 will also cover data that does not involve interacting with human subjects).  Sometimes people are unavailable to us, either because they do not wish to be interviewed or observed (as is the case with many “elites”) or because they are too far away, in both place and time.  Fortunately, humans leave many traces and we can often answer questions we have by examining those traces.  Special collections and archives can be goldmines for social science research.  This chapter will explain how to access these places, for what purposes, and how to begin to make sense of what you find.

Chapter 17 covers another data collection area that does not involve face-to-face interaction with humans: content analysis .  Although content analysis may be understood more properly as a data analysis technique, the term is often used for the entire approach, which will be the case here.  Content analysis involves interpreting meaning from a body of text.  This body of text might be something found in historical records (see chapter 16) or something collected by the researcher, as in the case of comment posts on a popular blog post.  I once used the stories told by student loan debtors on the website studentloanjustice.org as the content I analyzed.  Content analysis is particularly useful when attempting to define and understand prevalent stories or communication about a topic of interest.  In other words, when we are less interested in what particular people (our defined sample) are doing or believing and more interested in what general narratives exist about a particular topic or issue.  This chapter will explore different approaches to content analysis and provide helpful tips on how to collect data, how to turn that data into codes for analysis, and how to go about presenting what is found through analysis.

Where chapter 17 has pushed us towards data analysis, chapters 18 and 19 are all about what to do with the data collected, whether that data be in the form of interview transcripts or fieldnotes from observations.  Chapter 18 introduces the basics of coding , the iterative process of assigning meaning to the data in order to both simplify and identify patterns.  What is a code and how does it work?  What are the different ways of coding data, and when should you use them?  What is a codebook, and why do you need one?  What does the process of data analysis look like?

Chapter 19 goes further into detail on codes and how to use them, particularly the later stages of coding in which our codes are refined, simplified, combined, and organized.  These later rounds of coding are essential to getting the most out of the data we’ve collected.  As students are often overwhelmed with the amount of data (a corpus of interview transcripts typically runs into the hundreds of pages; fieldnotes can easily top that), this chapter will also address time management and provide suggestions for dealing with chaos and reminders that feeling overwhelmed at the analysis stage is part of the process.  By the end of the chapter, you should understand how “findings” are actually found.

The book concludes with a chapter dedicated to the effective presentation of data results.  Chapter 20 covers the many ways that researchers communicate their studies to various audiences (academic, personal, political), what elements must be included in these various publications, and the hallmarks of excellent qualitative research that various audiences will be expecting.  Because qualitative researchers are motivated by understanding and conveying meaning , effective communication is not only an essential skill but a fundamental facet of the entire research project.  Ethnographers must be able to convey a certain sense of verisimilitude , the appearance of true reality.  Those employing interviews must faithfully depict the key meanings of the people they interviewed in a way that rings true to those people, even if the end result surprises them.  And all researchers must strive for clarity in their publications so that various audiences can understand what was found and why it is important.

The book concludes with a short chapter ( chapter 21 ) discussing the value of qualitative research. At the very end of this book, you will find a glossary of terms. I recommend you make frequent use of the glossary and add to each entry as you find examples. Although the entries are meant to be simple and clear, you may also want to paraphrase the definition—make it “make sense” to you, in other words. In addition to the standard reference list (all works cited here), you will find various recommendations for further reading at the end of many chapters. Some of these recommendations will be examples of excellent qualitative research, indicated with an asterisk (*) at the end of the entry. As they say, a picture is worth a thousand words. A good example of qualitative research can teach you more about conducting research than any textbook can (this one included). I highly recommend you select one to three examples from these lists and read them along with the textbook.

A final note on the choice of examples – you will note that many of the examples used in the text come from research on college students.  This is for two reasons.  First, as most of my research falls in this area, I am most familiar with this literature and have contacts with those who do research here and can call upon them to share their stories with you.  Second, and more importantly, my hope is that this textbook reaches a wide audience of beginning researchers who study widely and deeply across the range of what can be known about the social world (from marine resources management to public policy to nursing to political science to sexuality studies and beyond).  It is sometimes difficult to find examples that speak to all those research interests, however. A focus on college students is something that all readers can understand and, hopefully, appreciate, as we are all now or have been at some point a college student.

Recommended Reading: Other Qualitative Research Textbooks

I’ve included a brief list of some of my favorite qualitative research textbooks and guidebooks if you need more than what you will find in this introductory text.  For each, I’ve also indicated if these are for “beginning” or “advanced” (graduate-level) readers.  Many of these books have several editions that do not significantly vary; the edition recommended is merely the edition I have used in teaching and to whose page numbers any specific references made in the text agree.

Barbour, Rosaline. 2014. Introducing Qualitative Research: A Student’s Guide. Thousand Oaks, CA: SAGE.  A good introduction to qualitative research, with abundant examples (often from the discipline of health care) and clear definitions.  Includes quick summaries at the ends of each chapter.  However, some US students might find the British context distracting and can be a bit advanced in some places.  Beginning .

Bloomberg, Linda Dale, and Marie F. Volpe. 2012. Completing Your Qualitative Dissertation . 2nd ed. Thousand Oaks, CA: SAGE.  Specifically designed to guide graduate students through the research process. Advanced .

Creswell, John W., and Cheryl Poth. 2018 Qualitative Inquiry and Research Design: Choosing among Five Traditions .  4th ed. Thousand Oaks, CA: SAGE.  This is a classic and one of the go-to books I used myself as a graduate student.  One of the best things about this text is its clear presentation of five distinct traditions in qualitative research.  Despite the title, this reasonably sized book is about more than research design, including both data analysis and how to write about qualitative research.  Advanced .

Lareau, Annette. 2021. Listening to People: A Practical Guide to Interviewing, Participant Observation, Data Analysis, and Writing It All Up .  Chicago: University of Chicago Press. A readable and personal account of conducting qualitative research by an eminent sociologist, with a heavy emphasis on the kinds of participant-observation research conducted by the author.  Despite its reader-friendliness, this is really a book targeted to graduate students learning the craft.  Advanced .

Lune, Howard, and Bruce L. Berg. 2018. 9th edition.  Qualitative Research Methods for the Social Sciences.  Pearson . Although a good introduction to qualitative methods, the authors favor symbolic interactionist and dramaturgical approaches, which limits the appeal primarily to sociologists.  Beginning .

Marshall, Catherine, and Gretchen B. Rossman. 2016. 6th edition. Designing Qualitative Research. Thousand Oaks, CA: SAGE.  Very readable and accessible guide to research design by two educational scholars.  Although the presentation is sometimes fairly dry, personal vignettes and illustrations enliven the text.  Beginning .

Maxwell, Joseph A. 2013. Qualitative Research Design: An Interactive Approach .  3rd ed. Thousand Oaks, CA: SAGE. A short and accessible introduction to qualitative research design, particularly helpful for graduate students contemplating theses and dissertations. This has been a standard textbook in my graduate-level courses for years.  Advanced .

Patton, Michael Quinn. 2002. Qualitative Research and Evaluation Methods . Thousand Oaks, CA: SAGE.  This is a comprehensive text that served as my “go-to” reference when I was a graduate student.  It is particularly helpful for those involved in program evaluation and other forms of evaluation studies and uses examples from a wide range of disciplines.  Advanced .

Rubin, Ashley T. 2021. Rocking Qualitative Social Science: An Irreverent Guide to Rigorous Research. Stanford : Stanford University Press.  A delightful and personal read.  Rubin uses rock climbing as an extended metaphor for learning how to conduct qualitative research.  A bit slanted toward ethnographic and archival methods of data collection, with frequent examples from her own studies in criminology. Beginning .

Weis, Lois, and Michelle Fine. 2000. Speed Bumps: A Student-Friendly Guide to Qualitative Research . New York: Teachers College Press.  Readable and accessibly written in a quasi-conversational style.  Particularly strong in its discussion of ethical issues throughout the qualitative research process.  Not comprehensive, however, and very much tied to ethnographic research.  Although designed for graduate students, this is a recommended read for students of all levels.  Beginning .

Patton’s Ten Suggestions for Doing Qualitative Research

The following ten suggestions were made by Michael Quinn Patton in his massive textbooks Qualitative Research and Evaluations Methods . This book is highly recommended for those of you who want more than an introduction to qualitative methods. It is the book I relied on heavily when I was a graduate student, although it is much easier to “dip into” when necessary than to read through as a whole. Patton is asked for “just one bit of advice” for a graduate student considering using qualitative research methods for their dissertation.  Here are his top ten responses, in short form, heavily paraphrased, and with additional comments and emphases from me:

• Make sure that a qualitative approach fits the research question. The following are the kinds of questions that call out for qualitative methods or where qualitative methods are particularly appropriate: questions about people’s experiences or how they make sense of those experiences; studying a person in their natural environment; researching a phenomenon so unknown that it would be impossible to study it with standardized instruments or other forms of quantitative data collection.
• Study qualitative research by going to the original sources for the design and analysis appropriate to the particular approach you want to take (e.g., read Glaser and Straus if you are using grounded theory )
• Find a dissertation adviser who understands or at least who will support your use of qualitative research methods. You are asking for trouble if your entire committee is populated by quantitative researchers, even if they are all very knowledgeable about the subject or focus of your study (maybe even more so if they are!)
• Really work on design. Doing qualitative research effectively takes a lot of planning.  Even if things are more flexible than in quantitative research, a good design is absolutely essential when starting out.
• Practice data collection techniques, particularly interviewing and observing. There is definitely a set of learned skills here!  Do not expect your first interview to be perfect.  You will continue to grow as a researcher the more interviews you conduct, and you will probably come to understand yourself a bit more in the process, too.  This is not easy, despite what others who don’t work with qualitative methods may assume (and tell you!)
• Have a plan for analysis before you begin data collection. This is often a requirement in IRB protocols , although you can get away with writing something fairly simple.  And even if you are taking an approach, such as grounded theory, that pushes you to remain fairly open-minded during the data collection process, you still want to know what you will be doing with all the data collected – creating a codebook? Writing analytical memos? Comparing cases?  Having a plan in hand will also help prevent you from collecting too much extraneous data.
• Be prepared to confront controversies both within the qualitative research community and between qualitative research and quantitative research. Don’t be naïve about this – qualitative research, particularly some approaches, will be derided by many more “positivist” researchers and audiences.  For example, is an “n” of 1 really sufficient?  Yes!  But not everyone will agree.
• Do not make the mistake of using qualitative research methods because someone told you it was easier, or because you are intimidated by the math required of statistical analyses. Qualitative research is difficult in its own way (and many would claim much more time-consuming than quantitative research).  Do it because you are convinced it is right for your goals, aims, and research questions.
• Find a good support network. This could be a research mentor, or it could be a group of friends or colleagues who are also using qualitative research, or it could be just someone who will listen to you work through all of the issues you will confront out in the field and during the writing process.  Even though qualitative research often involves human subjects, it can be pretty lonely.  A lot of times you will feel like you are working without a net.  You have to create one for yourself.  Take care of yourself.
• And, finally, in the words of Patton, “Prepare to be changed. Looking deeply at other people’s lives will force you to look deeply at yourself.”
• We will actually spend an entire chapter ( chapter 3 ) looking at this question in much more detail! ↵
• Note that this might have been news to Europeans at the time, but many other societies around the world had also come to this conclusion through observation.  There is often a tendency to equate “the scientific revolution” with the European world in which it took place, but this is somewhat misleading. ↵
• Historians are a special case here.  Historians have scrupulously and rigorously investigated the social world, but not for the purpose of understanding general laws about how things work, which is the point of scientific empirical research.  History is often referred to as an idiographic field of study, meaning that it studies things that happened or are happening in themselves and not for general observations or conclusions. ↵
• Don’t worry, we’ll spend more time later in this book unpacking the meaning of ethnography and other terms that are important here.  Note the available glossary ↵

An approach to research that is “multimethod in focus, involving an interpretative, naturalistic approach to its subject matter.  This means that qualitative researchers study things in their natural settings, attempting to make sense of, or interpret, phenomena in terms of the meanings people bring to them.  Qualitative research involves the studied use and collection of a variety of empirical materials – case study, personal experience, introspective, life story, interview, observational, historical, interactional, and visual texts – that describe routine and problematic moments and meanings in individuals’ lives." ( Denzin and Lincoln 2005:2 ). Contrast with quantitative research .

In contrast to methodology, methods are more simply the practices and tools used to collect and analyze data.  Examples of common methods in qualitative research are interviews , observations , and documentary analysis .  One’s methodology should connect to one’s choice of methods, of course, but they are distinguishable terms.  See also methodology .

A proposed explanation for an observation, phenomenon, or scientific problem that can be tested by further investigation.  The positing of a hypothesis is often the first step in quantitative research but not in qualitative research.  Even when qualitative researchers offer possible explanations in advance of conducting research, they will tend to not use the word “hypothesis” as it conjures up the kind of positivist research they are not conducting.

The foundational question to be addressed by the research study.  This will form the anchor of the research design, collection, and analysis.  Note that in qualitative research, the research question may, and probably will, alter or develop during the course of the research.

An approach to research that collects and analyzes numerical data for the purpose of finding patterns and averages, making predictions, testing causal relationships, and generalizing results to wider populations.  Contrast with qualitative research .

Data collection that takes place in real-world settings, referred to as “the field;” a key component of much Grounded Theory and ethnographic research.  Patton ( 2002 ) calls fieldwork “the central activity of qualitative inquiry” where “‘going into the field’ means having direct and personal contact with people under study in their own environments – getting close to people and situations being studied to personally understand the realities of minutiae of daily life” (48).

The people who are the subjects of a qualitative study.  In interview-based studies, they may be the respondents to the interviewer; for purposes of IRBs, they are often referred to as the human subjects of the research.

The branch of philosophy concerned with knowledge.  For researchers, it is important to recognize and adopt one of the many distinguishing epistemological perspectives as part of our understanding of what questions research can address or fully answer.  See, e.g., constructivism , subjectivism, and  objectivism .

An approach that refutes the possibility of neutrality in social science research.  All research is “guided by a set of beliefs and feelings about the world and how it should be understood and studied” (Denzin and Lincoln 2005: 13).  In contrast to positivism , interpretivism recognizes the social constructedness of reality, and researchers adopting this approach focus on capturing interpretations and understandings people have about the world rather than “the world” as it is (which is a chimera).

The cluster of data-collection tools and techniques that involve observing interactions between people, the behaviors, and practices of individuals (sometimes in contrast to what they say about how they act and behave), and cultures in context.  Observational methods are the key tools employed by ethnographers and Grounded Theory .

Research based on data collected and analyzed by the research (in contrast to secondary “library” research).

The process of selecting people or other units of analysis to represent a larger population. In quantitative research, this representation is taken quite literally, as statistically representative.  In qualitative research, in contrast, sample selection is often made based on potential to generate insight about a particular topic or phenomenon.

A method of data collection in which the researcher asks the participant questions; the answers to these questions are often recorded and transcribed verbatim. There are many different kinds of interviews - see also semistructured interview , structured interview , and unstructured interview .

The specific group of individuals that you will collect data from.  Contrast population.

The practice of being conscious of and reflective upon one’s own social location and presence when conducting research.  Because qualitative research often requires interaction with live humans, failing to take into account how one’s presence and prior expectations and social location affect the data collected and how analyzed may limit the reliability of the findings.  This remains true even when dealing with historical archives and other content.  Who we are matters when asking questions about how people experience the world because we, too, are a part of that world.

The science and practice of right conduct; in research, it is also the delineation of moral obligations towards research participants, communities to which we belong, and communities in which we conduct our research.

An administrative body established to protect the rights and welfare of human research subjects recruited to participate in research activities conducted under the auspices of the institution with which it is affiliated. The IRB is charged with the responsibility of reviewing all research involving human participants. The IRB is concerned with protecting the welfare, rights, and privacy of human subjects. The IRB has the authority to approve, disapprove, monitor, and require modifications in all research activities that fall within its jurisdiction as specified by both the federal regulations and institutional policy.

Research, according to US federal guidelines, that involves “a living individual about whom an investigator (whether professional or student) conducting research:  (1) Obtains information or biospecimens through intervention or interaction with the individual, and uses, studies, or analyzes the information or biospecimens; or  (2) Obtains, uses, studies, analyzes, or generates identifiable private information or identifiable biospecimens.”

One of the primary methodological traditions of inquiry in qualitative research, ethnography is the study of a group or group culture, largely through observational fieldwork supplemented by interviews. It is a form of fieldwork that may include participant-observation data collection. See chapter 14 for a discussion of deep ethnography. 

A form of interview that follows a standard guide of questions asked, although the order of the questions may change to match the particular needs of each individual interview subject, and probing “follow-up” questions are often added during the course of the interview.  The semi-structured interview is the primary form of interviewing used by qualitative researchers in the social sciences.  It is sometimes referred to as an “in-depth” interview.  See also interview and  interview guide .

A method of observational data collection taking place in a natural setting; a form of fieldwork .  The term encompasses a continuum of relative participation by the researcher (from full participant to “fly-on-the-wall” observer).  This is also sometimes referred to as ethnography , although the latter is characterized by a greater focus on the culture under observation.

A research design that employs both quantitative and qualitative methods, as in the case of a survey supplemented by interviews.

An epistemological perspective that posits the existence of reality through sensory experience similar to empiricism but goes further in denying any non-sensory basis of thought or consciousness.  In the social sciences, the term has roots in the proto-sociologist August Comte, who believed he could discern “laws” of society similar to the laws of natural science (e.g., gravity).  The term has come to mean the kinds of measurable and verifiable science conducted by quantitative researchers and is thus used pejoratively by some qualitative researchers interested in interpretation, consciousness, and human understanding.  Calling someone a “positivist” is often intended as an insult.  See also empiricism and objectivism.

A place or collection containing records, documents, or other materials of historical interest; most universities have an archive of material related to the university’s history, as well as other “special collections” that may be of interest to members of the community.

A method of both data collection and data analysis in which a given content (textual, visual, graphic) is examined systematically and rigorously to identify meanings, themes, patterns and assumptions.  Qualitative content analysis (QCA) is concerned with gathering and interpreting an existing body of material.    

A word or short phrase that symbolically assigns a summative, salient, essence-capturing, and/or evocative attribute for a portion of language-based or visual data (Saldaña 2021:5).

Usually a verbatim written record of an interview or focus group discussion.

The primary form of data for fieldwork , participant observation , and ethnography .  These notes, taken by the researcher either during the course of fieldwork or at day’s end, should include as many details as possible on what was observed and what was said.  They should include clear identifiers of date, time, setting, and names (or identifying characteristics) of participants.

The process of labeling and organizing qualitative data to identify different themes and the relationships between them; a way of simplifying data to allow better management and retrieval of key themes and illustrative passages.  See coding frame and  codebook.

A methodological tradition of inquiry and approach to analyzing qualitative data in which theories emerge from a rigorous and systematic process of induction.  This approach was pioneered by the sociologists Glaser and Strauss (1967).  The elements of theory generated from comparative analysis of data are, first, conceptual categories and their properties and, second, hypotheses or generalized relations among the categories and their properties – “The constant comparing of many groups draws the [researcher’s] attention to their many similarities and differences.  Considering these leads [the researcher] to generate abstract categories and their properties, which, since they emerge from the data, will clearly be important to a theory explaining the kind of behavior under observation.” (36).

A detailed description of any proposed research that involves human subjects for review by IRB.  The protocol serves as the recipe for the conduct of the research activity.  It includes the scientific rationale to justify the conduct of the study, the information necessary to conduct the study, the plan for managing and analyzing the data, and a discussion of the research ethical issues relevant to the research.  Protocols for qualitative research often include interview guides, all documents related to recruitment, informed consent forms, very clear guidelines on the safekeeping of materials collected, and plans for de-identifying transcripts or other data that include personal identifying information.

Introduction to Qualitative Research Methods Copyright © 2023 by Allison Hurst is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License , except where otherwise noted.

Log in using your username and password

• Search More Search for this keyword Advanced search
• Latest content
• Current issue
• Write for Us
• BMJ Journals More You are viewing from: Google Indexer

You are here

• Volume 18, Issue 2
• Issues of validity and reliability in qualitative research
• Article Text
• Article info
• Citation Tools
• Rapid Responses
• Article metrics

• Helen Noble 1 ,
• Joanna Smith 2
• 1 School of Nursing and Midwifery, Queens's University Belfast , Belfast , UK
• 2 School of Human and Health Sciences, University of Huddersfield , Huddersfield , UK
• Correspondence to Dr Helen Noble School of Nursing and Midwifery, Queens's University Belfast, Medical Biology Centre, 97 Lisburn Rd, Belfast BT9 7BL, UK; helen.noble{at}qub.ac.uk

https://doi.org/10.1136/eb-2015-102054

Statistics from Altmetric.com

Request permissions.

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Evaluating the quality of research is essential if findings are to be utilised in practice and incorporated into care delivery. In a previous article we explored ‘bias’ across research designs and outlined strategies to minimise bias. 1 The aim of this article is to further outline rigour, or the integrity in which a study is conducted, and ensure the credibility of findings in relation to qualitative research. Concepts such as reliability, validity and generalisability typically associated with quantitative research and alternative terminology will be compared in relation to their application to qualitative research. In addition, some of the strategies adopted by qualitative researchers to enhance the credibility of their research are outlined.

Are the terms reliability and validity relevant to ensuring credibility in qualitative research?

Although the tests and measures used to establish the validity and reliability of quantitative research cannot be applied to qualitative research, there are ongoing debates about whether terms such as validity, reliability and generalisability are appropriate to evaluate qualitative research. 2–4 In the broadest context these terms are applicable, with validity referring to the integrity and application of the methods undertaken and the precision in which the findings accurately reflect the data, while reliability describes consistency within the employed analytical procedures. 4 However, if qualitative methods are inherently different from quantitative methods in terms of philosophical positions and purpose, then alterative frameworks for establishing rigour are appropriate. 3 Lincoln and Guba 5 offer alternative criteria for demonstrating rigour within qualitative research namely truth value, consistency and neutrality and applicability. Table 1 outlines the differences in terminology and criteria used to evaluate qualitative research.

• View inline

Terminology and criteria used to evaluate the credibility of research findings

What strategies can qualitative researchers adopt to ensure the credibility of the study findings?

Unlike quantitative researchers, who apply statistical methods for establishing validity and reliability of research findings, qualitative researchers aim to design and incorporate methodological strategies to ensure the ‘trustworthiness’ of the findings. Such strategies include:

Accounting for personal biases which may have influenced findings; 6

Acknowledging biases in sampling and ongoing critical reflection of methods to ensure sufficient depth and relevance of data collection and analysis; 3

Meticulous record keeping, demonstrating a clear decision trail and ensuring interpretations of data are consistent and transparent; 3 , 4

Establishing a comparison case/seeking out similarities and differences across accounts to ensure different perspectives are represented; 6 , 7

Including rich and thick verbatim descriptions of participants’ accounts to support findings; 7

Demonstrating clarity in terms of thought processes during data analysis and subsequent interpretations 3 ;

Engaging with other researchers to reduce research bias; 3

Respondent validation: includes inviting participants to comment on the interview transcript and whether the final themes and concepts created adequately reflect the phenomena being investigated; 4

Data triangulation, 3 , 4 whereby different methods and perspectives help produce a more comprehensive set of findings. 8 , 9

Table 2 provides some specific examples of how some of these strategies were utilised to ensure rigour in a study that explored the impact of being a family carer to patients with stage 5 chronic kidney disease managed without dialysis. 10

Strategies for enhancing the credibility of qualitative research

In summary, it is imperative that all qualitative researchers incorporate strategies to enhance the credibility of a study during research design and implementation. Although there is no universally accepted terminology and criteria used to evaluate qualitative research, we have briefly outlined some of the strategies that can enhance the credibility of study findings.

• Sandelowski M
• Lincoln YS ,
• Barrett M ,
• Mayan M , et al
• Greenhalgh T
• Lingard L ,

Twitter Follow Joanna Smith at @josmith175 and Helen Noble at @helnoble

Competing interests None.

Read the full text or download the PDF:

Structuring a qualitative findings section

Reporting the findings from a qualitative study in a way that is interesting, meaningful, and trustworthy can be a struggle. Those new to qualitative research often find themselves trying to quantify everything to make it seem more “rigorous,” or asking themselves, “Do I really need this much data to support my findings?” Length requirements and word limits imposed by academic journals can also make the process difficult because qualitative data takes up a lot of room! In this post, I’m going to outline a few ways to structure qualitative findings, and a few tips and tricks to develop a strong findings section.

There are A LOT of different ways to structure a qualitative findings section. I’m going to focus on the following:

Tables (but not ONLY tables)

Themes/Findings as Headings

Research Questions as Headings

Anchoring Quotations

Anchoring Excerpts from Field Notes

Before I get into each of those, however, here is a bit of general guidance. First, make sure that you are providing adequate direct evidence for your findings. Second, be sure to integrate that direct evidence into the narrative. In other words, if for example, you were using quotes from a participant to support one of your themes, you should present and explain the theme (akin to a thesis statement), introduce the supporting quote, present it, explain the quote, and connect it to your finding. Below is an example of what I mean from one of my articles on implementation challenges in personalized learning ( Bingham, Pane, Steiner, & Hamilton, 2018 ). The finding supported by this paragraph was: “Inadequate Teacher Preparation, Development, and Support”

To mitigate the difficulties of enacting personalized learning in their classrooms, teachers wanted a model from which they could extrapolate practices that might serve them well in their own classrooms. As one teacher explained, “the ideas and the implementation is what’s lacking I think. I don’t feel like I know what I’m doing. I need to see things modeled and I need to know what it is. I need to be able to touch it. Show me a model, model for me.” Unfortunately, teachers had little to draw on for effective practices. Professional development was not as helpful as teachers had hoped, outside training on using the digital content or learning platforms fell short, and few examples or best practices existed for teachers to use in their own classrooms. As a result, teachers had to work harder to address gaps in their own knowledge. 

Finally, you should not leave quotations to speak for themselves and you should not have quotations as standalone paragraphs or sentences, with no introduction or explanation. Don’t make the reader do the analytic work for you.

Now, on to some specific ways to structure your findings section.

Tables can be used to give an overview of what you’re about to present in your findings, including the themes, some supporting evidence, and the meaning/explanation of the theme. Tables can be a useful way to give readers a quick reference for what your findings are. However, tables should not be used as your ONLY means of presenting those findings.

If you are choosing to use a table to present qualitative findings, you must also describe the findings in context, and provide supporting evidence in a narrative format (as in the paragraph outlined in the previous section).

2). Themes/Findings as Headings

Another option is to present your themes/findings as general or specific headings in your findings section. Here are some examples of findings as general headings:

Importance of Data Utilization and Analysis in the Classroom  The Role of Student Discipline and Accountability Differences in the Experiences of Teachers 

As you can see these headings do not describe precisely what the finding is, but they give the general idea/subject of the finding. You can have sub-headings within these findings that are more specific if you would like.

Another way to do this would be to be a bit more specific. For example:

School Infrastructure and Available Technology Do Not yet Fully Align with Teachers’ Needs 

Structural support for high levels of technology use is not fully developed 

Using multiple sources of digital content led to alignment issues 

Measures of School and Student Success are Misaligned

Traditional methods of measuring student progress conflict with personalized learning

Difficulties communicating new measures of student success to colleges and universities.

As you can see, here the findings are shown as headings, but are structured as specific sentences, with sub-themes included as well.

3). Research Questions as Headings

You can also present your findings using your research questions as the headings in the findings section. This is a useful strategy that ensures you’re answering your research questions and also allows the reader to quickly ascertain where the answers to your research questions are. Often, you will also need to present themes within each research question to keep yourself organized and to adequately flesh out your findings. The example below presents a research question from my study of blended learning at a charter high school (Bingham, 2016) , and an excerpt from my findings that answered that research question. I have also included the associated theme.

Research Question 1: What challenges, if any, do teachers face in implementing a blended model in a school’s first year? Theme: TROUBLESHOOTING AND TASK-MANAGING: TECHNOLOGY USE IN THE CLASSROOM In the original vision for instruction at Blended Academy, technology was to be an integral part of students’ learning, meant to allow students to find their own answers to their questions, to explore their personal interests, and to provide multiple opportunities for learning. The use of iPods in the classroom was partially intended to serve the social-emotional component of the model, allowing students to enjoy music and to “tune out” from other classroom activities when working on Digital X. Further, the iPods would allow stu- dents to listen to podcasts or teacher-created content at any time, in any location. However, prior to the school’s opening, little attention was paid to the management of these devices, and their potential for misuse. As a result, teachers spent much of their time managing students’ technology use, troubleshooting, and developing classroom procedures to ensure that technology use was relevant to learning. For example, in Ms. L’s classroom, she attempted to ensure learning was happening by instituting “Technology-Free” periods in the classroom. When students had to be working on their laptops in order to complete lessons or quizzes, the majority of her time was spent walking from student to student, watching for off-task behavior, and calling out students for how long they were “logged in” to the digital curriculum. In one typical interaction, Ms. L admonished one student, saying “It says you only logged in for one minute . . . when are you going to finish your English if you only logged in one minute today?” The difficulties around ensuring students were using technology productively resulted in teachers “hovering” over students, making it difficult to provide targeted instructional help. Teachers often responded to off-task behavior/ technology use by confiscating computers and devices or restricting their use, in order to ensure that students were working. However, because the majority of tasks were meant to be delivered online or through technological devices, this was not a productive or effective solution.

4). Vignettes

Vignettes can be a strategy to spark interest in your study, add narrative context, and provide a descriptive overview of your study/site/participants. They can also be used as a strategy to introduce themes. You can place them at the beginning of a paper, or at the start of the findings section, or in your discussion of each theme. They wouldn’t typically be the only representation of your findings that you present, but you can use them to hook the reader and provide a story that exemplifies findings, themes, contexts, participants, etc. Below is an example from one of my recent studies.

The Role of Pilot Teachers in Schoolwide Technology Integration Blended High School is a lot like many other charter schools. Students wear uniforms, and as you walk through the halls, there is almost always a teacher issuing a demerit to a student who is not wearing the right shoes, or who hasn’t tucked in their shirt. In this school, however, teachers use technology in almost every facet of their instruction, operating in a school model that blends face-to-face and online learning in the classroom in order to personalize students’ learning experiences. It has, however, been a long road to this level of technology use. BHS’s first year of operation was, arguably, disastrous. Teachers were overwhelmed and students didn’t progress as expected. In one staff meeting toward the end of the schools’ first year, teachers and administrators expressed frustration with each other and with the school model, with several teachers arguing that technology was hurting, not helping. The atmosphere was tense, with one teacher finally shrugging anxiously and saying “Maybe need to ask ourselves, ‘Is this the best model to use with some of our kids?’” Ultimately, by the end of the first year, technology was not a regular classroom practice. In BHS’s second year, the administration again pushed for full technology integration, but they wanted to start slow. In a fall semester staff meeting, the principal and the assistant principal ran what the principal referred to as a “technology therapy session,” where teachers could share their struggles with using technology to engage in PL. During the session, one of the new teachers mentions that she is having a difficult time letting go – changing her focus from lecturing to computer-based work. Another teacher worries about finding good online resources. Most of the teachers, new and veteran, are alarmed by the time it is taking for them design lessons that integrate technology. Some admit only engaging in technology use in a shallow way – uploading worksheets to Google Docs, recording Powerpoints, etc.  A few months after the discussion in which teachers aired their fears and struggles, the principal leads the teachers in analyzing student data from that week and spends a bit of time highlighting the work of a few teachers whose students are doing particularly well and who have been able to use technology in everyday classroom practice. Those teachers are part of a small group of “pilot teachers,” each of whom have been experimenting with various technology-based practices, including testing new learning management systems, designing their own online modules with personalized student objectives, providing students with technology-facilitated immediate feedback, and using up-to-the-minute data to develop technology-guided small-group instruction.  Over the course of the next several months, administrators encouraged teachers to continue to be transparent about their concerns and share those concerns in regular staff meetings. Administrators conferred with the pilot teachers and administrators and teachers together set incremental goals based on the pilot teachers’ recommendations. In weekly staff meetings, the pilot teachers shared their progress, including concerns and challenges. They collaborated with the other teachers to find solutions and worked with the administration to get what they needed to enact those solutions. For example, after a push from the pilot teachers, administration increased funding for technology purchases and introduced shifts in the school schedule to allow for planning in order to help teachers manage the demands of a high-tech classroom. Because the pilot teachers emphasized how much time meaningful technology integration took, and knew what worked and what didn’t, they were able to train other teachers in high-tech practices and to make the case to administration for needed changes.  By BHS’s third year, teachers schoolwide were able to fully integrate technology in their classrooms. All teachers were using the same learning management system, which had been initially chosen and tested by a pilot teacher. In every classroom, teachers were also engaging online modules, technology-facilitated breakout groups, and real time technology-based data analysis – all of which were practices the pilot teachers had tested and shared in the second year. The consistent collaboration between administration and pilot teachers and pilot teachers and other teachers helped calibrate classroom changes to manage the conflict between existing practices and new high-tech practices. By focusing on student learning data, creating the room for experimentation, collaborating consistently, and distributing the leadership for technology integration, teachers and administrators felt comfortable with the increasing reliance on tech-heavy practices.

I developed this vignette as a composite from my field notes and interviews and used it to set the stage for the rest of the findings section.

4). Anchoring Quotes

Using exemplar quotes from your participants is another way to structure your findings. In the following, which also comes from Bingham et al. (2018) , the finding itself is used as the heading, and the anchoring quotes come directly after the heading, prior to the rest of the narrative discussion of the finding. These quotations help provide some initial evidence and set the stage for what’s to come.

School Infrastructure and Available Technology Do Not Yet Fully Align With Teachers’ Needs  “I know that computer problems are an issue almost daily.” (Middle school personalized learning teacher)  “If the data was exactly what we needed, it would be easier. I think a lot of times we’re not using it enough because the way we’re using the data is not as effective as it should be.” (High school personalized learning teacher) 

You can note the source next to or after the quote. This can be done with your chosen pseudonyms, or with a general description, as I've done above.

5). Anchoring Excerpts from Field Notes

Similarly, excerpts from field notes can be used to start your discussion of a finding. Again, the finding itself is used as the heading, and the excerpt from field notes supporting that finding comes directly after the heading, prior to the rest of the narrative discussion of the finding. The example below comes from a study in which I explored how a personalized learning model evolved over the course of three years (Bingham, 2017) . I used excerpts from my field notes to open the discussion of each year.

Year 1: Navigating the disconnect between vision and practice  Walking into the large classroom space shared by Ms. Z and Ms. H, it is not immediately evident that these are high-tech PL classrooms. At first, there are no laptops out in either class. Both Ms. Z’s and Ms. H’s students are completing warm-up activities that are projected on each teacher’s white board. After a few minutes, Ms. Z’s students get up and get laptops. Ms. Z walks around to students and asks them what lesson from the digital curriculum they will be working on today. As Ms. Z speaks to a table of students, other students in the room listen to their iPods, sometimes singing loudly. Some students are on YouTube, watching music videos; others are messaging friends on GChat or Facebook. As Ms. Z makes her way around, students toggle back to the screen devoted to the digital curriculum. Sometimes, Ms. Z notices that students are off-task and she redirects them. Other times, she is too busy unlocking an online quiz for a student, or confiscating a student’s iPod. 

This excerpt from my field notes provided an overview of what teacher practice looked like in the first year of the school, so that I could then discuss several themes that were representative of how practice evolved over that first year.

The key takeaway here is that there are many ways to structure your findings section. You have to choose the method that best supports your study, and best represents your data and participants. No matter what you choose, the findings section itself should be constructed to answer your research questions, while also providing context and thick description, and, of course, telling a story.

Writing a discussion section

Some tips for academic writing.

• Privacy Policy

Home » Qualitative Research – Methods, Analysis Types and Guide

Qualitative Research – Methods, Analysis Types and Guide

Table of Contents

Qualitative Research

Qualitative research is a type of research methodology that focuses on exploring and understanding people’s beliefs, attitudes, behaviors, and experiences through the collection and analysis of non-numerical data. It seeks to answer research questions through the examination of subjective data, such as interviews, focus groups, observations, and textual analysis.

Qualitative research aims to uncover the meaning and significance of social phenomena, and it typically involves a more flexible and iterative approach to data collection and analysis compared to quantitative research. Qualitative research is often used in fields such as sociology, anthropology, psychology, and education.

Qualitative Research Methods

Qualitative Research Methods are as follows:

One-to-One Interview

This method involves conducting an interview with a single participant to gain a detailed understanding of their experiences, attitudes, and beliefs. One-to-one interviews can be conducted in-person, over the phone, or through video conferencing. The interviewer typically uses open-ended questions to encourage the participant to share their thoughts and feelings. One-to-one interviews are useful for gaining detailed insights into individual experiences.

Focus Groups

This method involves bringing together a group of people to discuss a specific topic in a structured setting. The focus group is led by a moderator who guides the discussion and encourages participants to share their thoughts and opinions. Focus groups are useful for generating ideas and insights, exploring social norms and attitudes, and understanding group dynamics.

Ethnographic Studies

This method involves immersing oneself in a culture or community to gain a deep understanding of its norms, beliefs, and practices. Ethnographic studies typically involve long-term fieldwork and observation, as well as interviews and document analysis. Ethnographic studies are useful for understanding the cultural context of social phenomena and for gaining a holistic understanding of complex social processes.

Text Analysis

This method involves analyzing written or spoken language to identify patterns and themes. Text analysis can be quantitative or qualitative. Qualitative text analysis involves close reading and interpretation of texts to identify recurring themes, concepts, and patterns. Text analysis is useful for understanding media messages, public discourse, and cultural trends.

This method involves an in-depth examination of a single person, group, or event to gain an understanding of complex phenomena. Case studies typically involve a combination of data collection methods, such as interviews, observations, and document analysis, to provide a comprehensive understanding of the case. Case studies are useful for exploring unique or rare cases, and for generating hypotheses for further research.

Process of Observation

This method involves systematically observing and recording behaviors and interactions in natural settings. The observer may take notes, use audio or video recordings, or use other methods to document what they see. Process of observation is useful for understanding social interactions, cultural practices, and the context in which behaviors occur.

Record Keeping

This method involves keeping detailed records of observations, interviews, and other data collected during the research process. Record keeping is essential for ensuring the accuracy and reliability of the data, and for providing a basis for analysis and interpretation.

This method involves collecting data from a large sample of participants through a structured questionnaire. Surveys can be conducted in person, over the phone, through mail, or online. Surveys are useful for collecting data on attitudes, beliefs, and behaviors, and for identifying patterns and trends in a population.

Qualitative data analysis is a process of turning unstructured data into meaningful insights. It involves extracting and organizing information from sources like interviews, focus groups, and surveys. The goal is to understand people’s attitudes, behaviors, and motivations

Qualitative Research Analysis Methods

Qualitative Research analysis methods involve a systematic approach to interpreting and making sense of the data collected in qualitative research. Here are some common qualitative data analysis methods:

Thematic Analysis

This method involves identifying patterns or themes in the data that are relevant to the research question. The researcher reviews the data, identifies keywords or phrases, and groups them into categories or themes. Thematic analysis is useful for identifying patterns across multiple data sources and for generating new insights into the research topic.

Content Analysis

This method involves analyzing the content of written or spoken language to identify key themes or concepts. Content analysis can be quantitative or qualitative. Qualitative content analysis involves close reading and interpretation of texts to identify recurring themes, concepts, and patterns. Content analysis is useful for identifying patterns in media messages, public discourse, and cultural trends.

Discourse Analysis

This method involves analyzing language to understand how it constructs meaning and shapes social interactions. Discourse analysis can involve a variety of methods, such as conversation analysis, critical discourse analysis, and narrative analysis. Discourse analysis is useful for understanding how language shapes social interactions, cultural norms, and power relationships.

Grounded Theory Analysis

This method involves developing a theory or explanation based on the data collected. Grounded theory analysis starts with the data and uses an iterative process of coding and analysis to identify patterns and themes in the data. The theory or explanation that emerges is grounded in the data, rather than preconceived hypotheses. Grounded theory analysis is useful for understanding complex social phenomena and for generating new theoretical insights.

Narrative Analysis

This method involves analyzing the stories or narratives that participants share to gain insights into their experiences, attitudes, and beliefs. Narrative analysis can involve a variety of methods, such as structural analysis, thematic analysis, and discourse analysis. Narrative analysis is useful for understanding how individuals construct their identities, make sense of their experiences, and communicate their values and beliefs.

Phenomenological Analysis

This method involves analyzing how individuals make sense of their experiences and the meanings they attach to them. Phenomenological analysis typically involves in-depth interviews with participants to explore their experiences in detail. Phenomenological analysis is useful for understanding subjective experiences and for developing a rich understanding of human consciousness.

Comparative Analysis

This method involves comparing and contrasting data across different cases or groups to identify similarities and differences. Comparative analysis can be used to identify patterns or themes that are common across multiple cases, as well as to identify unique or distinctive features of individual cases. Comparative analysis is useful for understanding how social phenomena vary across different contexts and groups.

Applications of Qualitative Research

Qualitative research has many applications across different fields and industries. Here are some examples of how qualitative research is used:

• Market Research: Qualitative research is often used in market research to understand consumer attitudes, behaviors, and preferences. Researchers conduct focus groups and one-on-one interviews with consumers to gather insights into their experiences and perceptions of products and services.
• Health Care: Qualitative research is used in health care to explore patient experiences and perspectives on health and illness. Researchers conduct in-depth interviews with patients and their families to gather information on their experiences with different health care providers and treatments.
• Education: Qualitative research is used in education to understand student experiences and to develop effective teaching strategies. Researchers conduct classroom observations and interviews with students and teachers to gather insights into classroom dynamics and instructional practices.
• Social Work : Qualitative research is used in social work to explore social problems and to develop interventions to address them. Researchers conduct in-depth interviews with individuals and families to understand their experiences with poverty, discrimination, and other social problems.
• Anthropology : Qualitative research is used in anthropology to understand different cultures and societies. Researchers conduct ethnographic studies and observe and interview members of different cultural groups to gain insights into their beliefs, practices, and social structures.
• Psychology : Qualitative research is used in psychology to understand human behavior and mental processes. Researchers conduct in-depth interviews with individuals to explore their thoughts, feelings, and experiences.
• Public Policy : Qualitative research is used in public policy to explore public attitudes and to inform policy decisions. Researchers conduct focus groups and one-on-one interviews with members of the public to gather insights into their perspectives on different policy issues.

How to Conduct Qualitative Research

Here are some general steps for conducting qualitative research:

• Identify your research question: Qualitative research starts with a research question or set of questions that you want to explore. This question should be focused and specific, but also broad enough to allow for exploration and discovery.
• Select your research design: There are different types of qualitative research designs, including ethnography, case study, grounded theory, and phenomenology. You should select a design that aligns with your research question and that will allow you to gather the data you need to answer your research question.
• Recruit participants: Once you have your research question and design, you need to recruit participants. The number of participants you need will depend on your research design and the scope of your research. You can recruit participants through advertisements, social media, or through personal networks.
• Collect data: There are different methods for collecting qualitative data, including interviews, focus groups, observation, and document analysis. You should select the method or methods that align with your research design and that will allow you to gather the data you need to answer your research question.
• Analyze data: Once you have collected your data, you need to analyze it. This involves reviewing your data, identifying patterns and themes, and developing codes to organize your data. You can use different software programs to help you analyze your data, or you can do it manually.
• Interpret data: Once you have analyzed your data, you need to interpret it. This involves making sense of the patterns and themes you have identified, and developing insights and conclusions that answer your research question. You should be guided by your research question and use your data to support your conclusions.
• Communicate results: Once you have interpreted your data, you need to communicate your results. This can be done through academic papers, presentations, or reports. You should be clear and concise in your communication, and use examples and quotes from your data to support your findings.

Examples of Qualitative Research

Here are some real-time examples of qualitative research:

• Customer Feedback: A company may conduct qualitative research to understand the feedback and experiences of its customers. This may involve conducting focus groups or one-on-one interviews with customers to gather insights into their attitudes, behaviors, and preferences.
• Healthcare : A healthcare provider may conduct qualitative research to explore patient experiences and perspectives on health and illness. This may involve conducting in-depth interviews with patients and their families to gather information on their experiences with different health care providers and treatments.
• Education : An educational institution may conduct qualitative research to understand student experiences and to develop effective teaching strategies. This may involve conducting classroom observations and interviews with students and teachers to gather insights into classroom dynamics and instructional practices.
• Social Work: A social worker may conduct qualitative research to explore social problems and to develop interventions to address them. This may involve conducting in-depth interviews with individuals and families to understand their experiences with poverty, discrimination, and other social problems.
• Anthropology : An anthropologist may conduct qualitative research to understand different cultures and societies. This may involve conducting ethnographic studies and observing and interviewing members of different cultural groups to gain insights into their beliefs, practices, and social structures.
• Psychology : A psychologist may conduct qualitative research to understand human behavior and mental processes. This may involve conducting in-depth interviews with individuals to explore their thoughts, feelings, and experiences.
• Public Policy: A government agency or non-profit organization may conduct qualitative research to explore public attitudes and to inform policy decisions. This may involve conducting focus groups and one-on-one interviews with members of the public to gather insights into their perspectives on different policy issues.

Purpose of Qualitative Research

The purpose of qualitative research is to explore and understand the subjective experiences, behaviors, and perspectives of individuals or groups in a particular context. Unlike quantitative research, which focuses on numerical data and statistical analysis, qualitative research aims to provide in-depth, descriptive information that can help researchers develop insights and theories about complex social phenomena.

Qualitative research can serve multiple purposes, including:

• Exploring new or emerging phenomena : Qualitative research can be useful for exploring new or emerging phenomena, such as new technologies or social trends. This type of research can help researchers develop a deeper understanding of these phenomena and identify potential areas for further study.
• Understanding complex social phenomena : Qualitative research can be useful for exploring complex social phenomena, such as cultural beliefs, social norms, or political processes. This type of research can help researchers develop a more nuanced understanding of these phenomena and identify factors that may influence them.
• Generating new theories or hypotheses: Qualitative research can be useful for generating new theories or hypotheses about social phenomena. By gathering rich, detailed data about individuals’ experiences and perspectives, researchers can develop insights that may challenge existing theories or lead to new lines of inquiry.
• Providing context for quantitative data: Qualitative research can be useful for providing context for quantitative data. By gathering qualitative data alongside quantitative data, researchers can develop a more complete understanding of complex social phenomena and identify potential explanations for quantitative findings.

When to use Qualitative Research

Here are some situations where qualitative research may be appropriate:

• Exploring a new area: If little is known about a particular topic, qualitative research can help to identify key issues, generate hypotheses, and develop new theories.
• Understanding complex phenomena: Qualitative research can be used to investigate complex social, cultural, or organizational phenomena that are difficult to measure quantitatively.
• Investigating subjective experiences: Qualitative research is particularly useful for investigating the subjective experiences of individuals or groups, such as their attitudes, beliefs, values, or emotions.
• Conducting formative research: Qualitative research can be used in the early stages of a research project to develop research questions, identify potential research participants, and refine research methods.
• Evaluating interventions or programs: Qualitative research can be used to evaluate the effectiveness of interventions or programs by collecting data on participants’ experiences, attitudes, and behaviors.

Characteristics of Qualitative Research

Qualitative research is characterized by several key features, including:

• Focus on subjective experience: Qualitative research is concerned with understanding the subjective experiences, beliefs, and perspectives of individuals or groups in a particular context. Researchers aim to explore the meanings that people attach to their experiences and to understand the social and cultural factors that shape these meanings.
• Use of open-ended questions: Qualitative research relies on open-ended questions that allow participants to provide detailed, in-depth responses. Researchers seek to elicit rich, descriptive data that can provide insights into participants’ experiences and perspectives.
• Sampling-based on purpose and diversity: Qualitative research often involves purposive sampling, in which participants are selected based on specific criteria related to the research question. Researchers may also seek to include participants with diverse experiences and perspectives to capture a range of viewpoints.
• Data collection through multiple methods: Qualitative research typically involves the use of multiple data collection methods, such as in-depth interviews, focus groups, and observation. This allows researchers to gather rich, detailed data from multiple sources, which can provide a more complete picture of participants’ experiences and perspectives.
• Inductive data analysis: Qualitative research relies on inductive data analysis, in which researchers develop theories and insights based on the data rather than testing pre-existing hypotheses. Researchers use coding and thematic analysis to identify patterns and themes in the data and to develop theories and explanations based on these patterns.
• Emphasis on researcher reflexivity: Qualitative research recognizes the importance of the researcher’s role in shaping the research process and outcomes. Researchers are encouraged to reflect on their own biases and assumptions and to be transparent about their role in the research process.

Advantages of Qualitative Research

Qualitative research offers several advantages over other research methods, including:

• Depth and detail: Qualitative research allows researchers to gather rich, detailed data that provides a deeper understanding of complex social phenomena. Through in-depth interviews, focus groups, and observation, researchers can gather detailed information about participants’ experiences and perspectives that may be missed by other research methods.
• Flexibility : Qualitative research is a flexible approach that allows researchers to adapt their methods to the research question and context. Researchers can adjust their research methods in real-time to gather more information or explore unexpected findings.
• Contextual understanding: Qualitative research is well-suited to exploring the social and cultural context in which individuals or groups are situated. Researchers can gather information about cultural norms, social structures, and historical events that may influence participants’ experiences and perspectives.
• Participant perspective : Qualitative research prioritizes the perspective of participants, allowing researchers to explore subjective experiences and understand the meanings that participants attach to their experiences.
• Theory development: Qualitative research can contribute to the development of new theories and insights about complex social phenomena. By gathering rich, detailed data and using inductive data analysis, researchers can develop new theories and explanations that may challenge existing understandings.
• Validity : Qualitative research can offer high validity by using multiple data collection methods, purposive and diverse sampling, and researcher reflexivity. This can help ensure that findings are credible and trustworthy.

Limitations of Qualitative Research

Qualitative research also has some limitations, including:

• Subjectivity : Qualitative research relies on the subjective interpretation of researchers, which can introduce bias into the research process. The researcher’s perspective, beliefs, and experiences can influence the way data is collected, analyzed, and interpreted.
• Limited generalizability: Qualitative research typically involves small, purposive samples that may not be representative of larger populations. This limits the generalizability of findings to other contexts or populations.
• Time-consuming: Qualitative research can be a time-consuming process, requiring significant resources for data collection, analysis, and interpretation.
• Resource-intensive: Qualitative research may require more resources than other research methods, including specialized training for researchers, specialized software for data analysis, and transcription services.
• Limited reliability: Qualitative research may be less reliable than quantitative research, as it relies on the subjective interpretation of researchers. This can make it difficult to replicate findings or compare results across different studies.
• Ethics and confidentiality: Qualitative research involves collecting sensitive information from participants, which raises ethical concerns about confidentiality and informed consent. Researchers must take care to protect the privacy and confidentiality of participants and obtain informed consent.

Also see Research Methods

About the author

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Questionnaire – Definition, Types, and Examples

Case Study – Methods, Examples and Guide

Observational Research – Methods and Guide

Quantitative Research – Methods, Types and...

Qualitative Research Methods

Explanatory Research – Types, Methods, Guide

Research Design Review

A discussion of qualitative & quantitative research design, verification: looking beyond the data in qualitative data analysis.

Yet looking outside the data we gather in in-depth interviews (IDIs), group discussions, or observations is important to the integrity of our qualitative research designs. The consideration of alternative sources of information serves to verify the study data while giving the researcher a different, more enriched perspective on study outcomes.  It is not important whether this additional input supports the researcher’s conclusions from the primary data; and, indeed, contradictions in the verification process do not necessarily invalidate the study’s findings. What is important, however, is that the researcher recognizes how other points of view can contribute to a more balanced as well as more robust and meaningful analysis rather than relying on study data alone.

There are many proposed approaches to the verification of qualitative research data. Three of the most useful are:

• Triangulation : The use of multiple sources to contrast and compare study data to establish supporting and/or contradictory information. A few common forms of triangulation are those that compare study data with data obtained from other sources (e.g., comparing the IDI transcripts from interviews with environmental activists with those from conservationists), a different method (e.g., comparing results from an IDI study to focus group results on the same subject matter), and another researcher (e.g., using multiple researchers in the analysis phase to compare interpretations of the data).
• Negative case (or “deviant”) analysis : The researcher actively seeks instances in the study data that contradict or otherwise conflict with the prevailing evidence in the data, i.e., looks for outliers. This analysis compels the researcher to develop an understanding about why outliers exist, leading to a greater comprehension as to the strengths and limits of the research data.
• Reflexive journal : A diary kept by the researcher to provide personal thoughts and insights on what happened during the study. It is an invaluable resource that the researcher can use to review and judge the quality of data collection as well as the soundness of the researcher’s interpretations during the analysis phase. This blog has discussed reflexive journals in many posts, including “Reflections from the Field: Questions to Stimulate Reflexivity Among Qualitative Researchers.”

Image captured from: http://executivecoachdaveschoenbeck.com/2013/03/11/11-tips-to-help-you-get-promoted/

Share this:

• Click to share on Reddit (Opens in new window)
• Click to share on Twitter (Opens in new window)
• Click to share on LinkedIn (Opens in new window)
• Click to share on Facebook (Opens in new window)
• Click to share on Tumblr (Opens in new window)
• Click to email a link to a friend (Opens in new window)
• Click to print (Opens in new window)
• Pingback: Qualitative Data: Achieving Accuracy in the Absence of “Truth” | Research Design Review
• Pingback: Reflexivity: 10 Articles on the Role of Reflection in Qualitative Research | Research Design Review
• Pingback: Supporting Observational Research | Research Design Review
• Pingback: Analyzable Qualitative Research: The Total Quality Framework Analyzability Component | Research Design Review
• Pingback: Finding Connections & Making Sense of Qualitative Data | Research Design Review
• Pingback: 25 Ingredients to “Thicken” Description & Enrich Transparency in Ethnography | Research Design Review

Leave a comment Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed .

• Already have a WordPress.com account? Log in now.
• Subscribe Subscribed
• Copy shortlink
• Report this content
• View post in Reader
• Manage subscriptions
• Collapse this bar

CRO Platform

Test your insights. Run experiments. Win. Or learn. And then win.

eCommerce Customer Analytics Platform

Acquisition matters. But retention matters more. Understand, monitor & nurture the best customers.

• Case Studies
• Ebooks, Tools, Templates
• Digital Marketing Glossary
• eCommerce Growth Stories
• eCommerce Growth Show
• Help & Technical Documentation

CRO Guide   >  Chapter 3.1

Qualitative Research: Definition, Methodology, Limitation & Examples

Qualitative research is a method focused on understanding human behavior and experiences through non-numerical data. Examples of qualitative research include:

• One-on-one interviews,
• Focus groups, Ethnographic research,
• Case studies,
• Record keeping,
• Qualitative observations

In this article, we’ll provide tips and tricks on how to use qualitative research to better understand your audience through real world examples and improve your ROI. We’ll also learn the difference between qualitative and quantitative data.

Table of Contents

Marketers often seek to understand their customers deeply. Qualitative research methods such as face-to-face interviews, focus groups, and qualitative observations can provide valuable insights into your products, your market, and your customers’ opinions and motivations. Understanding these nuances can significantly enhance marketing strategies and overall customer satisfaction.

What is Qualitative Research

Qualitative research is a market research method that focuses on obtaining data through open-ended and conversational communication. This method focuses on the “why” rather than the “what” people think about you. Thus, qualitative research seeks to uncover the underlying motivations, attitudes, and beliefs that drive people’s actions. 

Let’s say you have an online shop catering to a general audience. You do a demographic analysis and you find out that most of your customers are male. Naturally, you will want to find out why women are not buying from you. And that’s what qualitative research will help you find out.

In the case of your online shop, qualitative research would involve reaching out to female non-customers through methods such as in-depth interviews or focus groups. These interactions provide a platform for women to express their thoughts, feelings, and concerns regarding your products or brand. Through qualitative analysis, you can uncover valuable insights into factors such as product preferences, user experience, brand perception, and barriers to purchase.

Types of Qualitative Research Methods

Qualitative research methods are designed in a manner that helps reveal the behavior and perception of a target audience regarding a particular topic.

The most frequently used qualitative analysis methods are one-on-one interviews, focus groups, ethnographic research, case study research, record keeping, and qualitative observation.

1. One-on-one interviews

Conducting one-on-one interviews is one of the most common qualitative research methods. One of the advantages of this method is that it provides a great opportunity to gather precise data about what people think and their motivations.

Spending time talking to customers not only helps marketers understand who their clients are, but also helps with customer care: clients love hearing from brands. This strengthens the relationship between a brand and its clients and paves the way for customer testimonials.

• A company might conduct interviews to understand why a product failed to meet sales expectations.
• A researcher might use interviews to gather personal stories about experiences with healthcare.

These interviews can be performed face-to-face or on the phone and usually last between half an hour to over two hours. 

When a one-on-one interview is conducted face-to-face, it also gives the marketer the opportunity to read the body language of the respondent and match the responses.

2. Focus groups

Focus groups gather a small number of people to discuss and provide feedback on a particular subject. The ideal size of a focus group is usually between five and eight participants. The size of focus groups should reflect the participants’ familiarity with the topic. For less important topics or when participants have little experience, a group of 10 can be effective. For more critical topics or when participants are more knowledgeable, a smaller group of five to six is preferable for deeper discussions.

The main goal of a focus group is to find answers to the “why”, “what”, and “how” questions. This method is highly effective in exploring people’s feelings and ideas in a social setting, where group dynamics can bring out insights that might not emerge in one-on-one situations.

• A focus group could be used to test reactions to a new product concept.
• Marketers might use focus groups to see how different demographic groups react to an advertising campaign.

One advantage that focus groups have is that the marketer doesn’t necessarily have to interact with the group in person. Nowadays focus groups can be sent as online qualitative surveys on various devices.

Focus groups are an expensive option compared to the other qualitative research methods, which is why they are typically used to explain complex processes.

3. Ethnographic research

Ethnographic research is the most in-depth observational method that studies individuals in their naturally occurring environment.

This method aims at understanding the cultures, challenges, motivations, and settings that occur.

• A study of workplace culture within a tech startup.
• Observational research in a remote village to understand local traditions.

Ethnographic research requires the marketer to adapt to the target audiences’ environments (a different organization, a different city, or even a remote location), which is why geographical constraints can be an issue while collecting data.

This type of research can last from a few days to a few years. It’s challenging and time-consuming and solely depends on the expertise of the marketer to be able to analyze, observe, and infer the data.

4. Case study research

The case study method has grown into a valuable qualitative research method. This type of research method is usually used in education or social sciences. It involves a comprehensive examination of a single instance or event, providing detailed insights into complex issues in real-life contexts.  

• Analyzing a single school’s innovative teaching method.
• A detailed study of a patient’s medical treatment over several years.

Case study research may seem difficult to operate, but it’s actually one of the simplest ways of conducting research as it involves a deep dive and thorough understanding of the data collection methods and inferring the data.

5. Record keeping

Record keeping is similar to going to the library: you go over books or any other reference material to collect relevant data. This method uses already existing reliable documents and similar sources of information as a data source.

• Historical research using old newspapers and letters.
• A study on policy changes over the years by examining government records.

This method is useful for constructing a historical context around a research topic or verifying other findings with documented evidence.

6. Qualitative observation

Qualitative observation is a method that uses subjective methodologies to gather systematic information or data. This method deals with the five major sensory organs and their functioning, sight, smell, touch, taste, and hearing.

• Sight : Observing the way customers visually interact with product displays in a store to understand their browsing behaviors and preferences.
• Smell : Noting reactions of consumers to different scents in a fragrance shop to study the impact of olfactory elements on product preference.
• Touch : Watching how individuals interact with different materials in a clothing store to assess the importance of texture in fabric selection.
• Taste : Evaluating reactions of participants in a taste test to identify flavor profiles that appeal to different demographic groups.
• Hearing : Documenting responses to changes in background music within a retail environment to determine its effect on shopping behavior and mood.

Below we are also providing real-life examples of qualitative research that demonstrate practical applications across various contexts:

Qualitative Research Real World Examples

Let’s explore some examples of how qualitative research can be applied in different contexts.

1. Online grocery shop with a predominantly male audience

Method used: one-on-one interviews.

Let’s go back to one of the previous examples. You have an online grocery shop. By nature, it addresses a general audience, but after you do a demographic analysis you find out that most of your customers are male.

One good method to determine why women are not buying from you is to hold one-on-one interviews with potential customers in the category.

Interviewing a sample of potential female customers should reveal why they don’t find your store appealing. The reasons could range from not stocking enough products for women to perhaps the store’s emphasis on heavy-duty tools and automotive products, for example. These insights can guide adjustments in inventory and marketing strategies.

2. Software company launching a new product

Method used: focus groups.

Focus groups are great for establishing product-market fit.

Let’s assume you are a software company that wants to launch a new product and you hold a focus group with 12 people. Although getting their feedback regarding users’ experience with the product is a good thing, this sample is too small to define how the entire market will react to your product.

So what you can do instead is holding multiple focus groups in 20 different geographic regions. Each region should be hosting a group of 12 for each market segment; you can even segment your audience based on age. This would be a better way to establish credibility in the feedback you receive.

3. Alan Pushkin’s “God’s Choice: The Total World of a Fundamentalist Christian School”

Method used: ethnographic research.

Moving from a fictional example to a real-life one, let’s analyze Alan Peshkin’s 1986 book “God’s Choice: The Total World of a Fundamentalist Christian School”.

Peshkin studied the culture of Bethany Baptist Academy by interviewing the students, parents, teachers, and members of the community alike, and spending eighteen months observing them to provide a comprehensive and in-depth analysis of Christian schooling as an alternative to public education.

The study highlights the school’s unified purpose, rigorous academic environment, and strong community support while also pointing out its lack of cultural diversity and openness to differing viewpoints. These insights are crucial for understanding how such educational settings operate and what they offer to students.

Even after discovering all this, Peshkin still presented the school in a positive light and stated that public schools have much to learn from such schools.

Peshkin’s in-depth research represents a qualitative study that uses observations and unstructured interviews, without any assumptions or hypotheses. He utilizes descriptive or non-quantifiable data on Bethany Baptist Academy specifically, without attempting to generalize the findings to other Christian schools.

4. Understanding buyers’ trends

Method used: record keeping.

Another way marketers can use quality research is to understand buyers’ trends. To do this, marketers need to look at historical data for both their company and their industry and identify where buyers are purchasing items in higher volumes.

For example, electronics distributors know that the holiday season is a peak market for sales while life insurance agents find that spring and summer wedding months are good seasons for targeting new clients.

5. Determining products/services missing from the market

Conducting your own research isn’t always necessary. If there are significant breakthroughs in your industry, you can use industry data and adapt it to your marketing needs.

The influx of hacking and hijacking of cloud-based information has made Internet security a topic of many industry reports lately. A software company could use these reports to better understand the problems its clients are facing.

As a result, the company can provide solutions prospects already know they need.

Real-time Customer Lifetime Value (CLV) Benchmark Report

See where your business stands compared to 1,000+ e-stores in different industries.

Qualitative Research Approaches

Once the marketer has decided that their research questions will provide data that is qualitative in nature, the next step is to choose the appropriate qualitative approach.

The approach chosen will take into account the purpose of the research, the role of the researcher, the data collected, the method of data analysis , and how the results will be presented. The most common approaches include:

• Narrative : This method focuses on individual life stories to understand personal experiences and journeys. It examines how people structure their stories and the themes within them to explore human existence. For example, a narrative study might look at cancer survivors to understand their resilience and coping strategies.
• Phenomenology : attempts to understand or explain life experiences or phenomena; It aims to reveal the depth of human consciousness and perception, such as by studying the daily lives of those with chronic illnesses.
• Grounded theory : investigates the process, action, or interaction with the goal of developing a theory “grounded” in observations and empirical data. 
• Ethnography : describes and interprets an ethnic, cultural, or social group;
• Case study : examines episodic events in a definable framework, develops in-depth analyses of single or multiple cases, and generally explains “how”. An example might be studying a community health program to evaluate its success and impact.

How to Analyze Qualitative Data

Analyzing qualitative data involves interpreting non-numerical data to uncover patterns, themes, and deeper insights. This process is typically more subjective and requires a systematic approach to ensure reliability and validity. 

1. Data Collection

Ensure that your data collection methods (e.g., interviews, focus groups, observations) are well-documented and comprehensive. This step is crucial because the quality and depth of the data collected will significantly influence the analysis.

2. Data Preparation

Once collected, the data needs to be organized. Transcribe audio and video recordings, and gather all notes and documents. Ensure that all data is anonymized to protect participant confidentiality where necessary.

3. Familiarization

Immerse yourself in the data by reading through the materials multiple times. This helps you get a general sense of the information and begin identifying patterns or recurring themes.

Develop a coding system to tag data with labels that summarize and account for each piece of information. Codes can be words, phrases, or acronyms that represent how these segments relate to your research questions.

• Descriptive Coding : Summarize the primary topic of the data.
• In Vivo Coding : Use language and terms used by the participants themselves.
• Process Coding : Use gerunds (“-ing” words) to label the processes at play.
• Emotion Coding : Identify and record the emotions conveyed or experienced.

5. Thematic Development

Group codes into themes that represent larger patterns in the data. These themes should relate directly to the research questions and form a coherent narrative about the findings.

6. Interpreting the Data

Interpret the data by constructing a logical narrative. This involves piecing together the themes to explain larger insights about the data. Link the results back to your research objectives and existing literature to bolster your interpretations.

7. Validation

Check the reliability and validity of your findings by reviewing if the interpretations are supported by the data. This may involve revisiting the data multiple times or discussing the findings with colleagues or participants for validation.

8. Reporting

Finally, present the findings in a clear and organized manner. Use direct quotes and detailed descriptions to illustrate the themes and insights. The report should communicate the narrative you’ve built from your data, clearly linking your findings to your research questions.

Limitations of qualitative research

The disadvantages of qualitative research are quite unique. The techniques of the data collector and their own unique observations can alter the information in subtle ways. That being said, these are the qualitative research’s limitations:

1. It’s a time-consuming process

The main drawback of qualitative study is that the process is time-consuming. Another problem is that the interpretations are limited. Personal experience and knowledge influence observations and conclusions.

Thus, qualitative research might take several weeks or months. Also, since this process delves into personal interaction for data collection, discussions often tend to deviate from the main issue to be studied.

2. You can’t verify the results of qualitative research

Because qualitative research is open-ended, participants have more control over the content of the data collected. So the marketer is not able to verify the results objectively against the scenarios stated by the respondents. For example, in a focus group discussing a new product, participants might express their feelings about the design and functionality. However, these opinions are influenced by individual tastes and experiences, making it difficult to ascertain a universally applicable conclusion from these discussions.

3. It’s a labor-intensive approach

Qualitative research requires a labor-intensive analysis process such as categorization, recording, etc. Similarly, qualitative research requires well-experienced marketers to obtain the needed data from a group of respondents.

4. It’s difficult to investigate causality

Qualitative research requires thoughtful planning to ensure the obtained results are accurate. There is no way to analyze qualitative data mathematically. This type of research is based more on opinion and judgment rather than results. Because all qualitative studies are unique they are difficult to replicate.

5. Qualitative research is not statistically representative

Because qualitative research is a perspective-based method of research, the responses given are not measured.

Comparisons can be made and this can lead toward duplication, but for the most part, quantitative data is required for circumstances that need statistical representation and that is not part of the qualitative research process.

While doing a qualitative study, it’s important to cross-reference the data obtained with the quantitative data. By continuously surveying prospects and customers marketers can build a stronger database of useful information.

Quantitative vs. Qualitative Research

Image source

Quantitative and qualitative research are two distinct methodologies used in the field of market research, each offering unique insights and approaches to understanding consumer behavior and preferences.

As we already defined, qualitative analysis seeks to explore the deeper meanings, perceptions, and motivations behind human behavior through non-numerical data. On the other hand, quantitative research focuses on collecting and analyzing numerical data to identify patterns, trends, and statistical relationships.  

Let’s explore their key differences: 

Nature of Data:

• Quantitative research : Involves numerical data that can be measured and analyzed statistically.
• Qualitative research : Focuses on non-numerical data, such as words, images, and observations, to capture subjective experiences and meanings.

Research Questions:

• Quantitative research : Typically addresses questions related to “how many,” “how much,” or “to what extent,” aiming to quantify relationships and patterns.
• Qualitative research: Explores questions related to “why” and “how,” aiming to understand the underlying motivations, beliefs, and perceptions of individuals.

Data Collection Methods:

• Quantitative research : Relies on structured surveys, experiments, or observations with predefined variables and measures.
• Qualitative research : Utilizes open-ended interviews, focus groups, participant observations, and textual analysis to gather rich, contextually nuanced data.

Analysis Techniques:

• Quantitative research: Involves statistical analysis to identify correlations, associations, or differences between variables.
• Qualitative research: Employs thematic analysis, coding, and interpretation to uncover patterns, themes, and insights within qualitative data.

Do Conversion Rate Optimization the Right way.

Explore helps you make the most out of your CRO efforts through advanced A/B testing, surveys, advanced segmentation and optimised customer journeys.

If you haven’t subscribed yet to our newsletter, now is your chance!

Like what you’re reading?

Join the informed ecommerce crowd.

We will never bug you with irrelevant info.

By clicking the Button, you confirm that you agree with our Terms and Conditions .

Continue your Conversion Rate Optimization Journey

• Last modified: January 3, 2023
• Conversion Rate Optimization , User Research

Valentin Radu

We’re a team of people that want to empower marketers around the world to create marketing campaigns that matter to consumers in a smart way. Meet us at the intersection of creativity, integrity, and development, and let us show you how to optimize your marketing.

Our Software

• > Book a Demo
• > Partner Program
• > Affiliate Program
• Blog Sitemap
• Terms and Conditions
• Privacy & Security
• Cookies Policy
• REVEAL Terms and Conditions

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Am J Pharm Educ
• v.74(8); 2010 Oct 11

Presenting and Evaluating Qualitative Research

The purpose of this paper is to help authors to think about ways to present qualitative research papers in the American Journal of Pharmaceutical Education . It also discusses methods for reviewers to assess the rigour, quality, and usefulness of qualitative research. Examples of different ways to present data from interviews, observations, and focus groups are included. The paper concludes with guidance for publishing qualitative research and a checklist for authors and reviewers.

INTRODUCTION

Policy and practice decisions, including those in education, increasingly are informed by findings from qualitative as well as quantitative research. Qualitative research is useful to policymakers because it often describes the settings in which policies will be implemented. Qualitative research is also useful to both pharmacy practitioners and pharmacy academics who are involved in researching educational issues in both universities and practice and in developing teaching and learning.

Qualitative research involves the collection, analysis, and interpretation of data that are not easily reduced to numbers. These data relate to the social world and the concepts and behaviors of people within it. Qualitative research can be found in all social sciences and in the applied fields that derive from them, for example, research in health services, nursing, and pharmacy. 1 It looks at X in terms of how X varies in different circumstances rather than how big is X or how many Xs are there? 2 Textbooks often subdivide research into qualitative and quantitative approaches, furthering the common assumption that there are fundamental differences between the 2 approaches. With pharmacy educators who have been trained in the natural and clinical sciences, there is often a tendency to embrace quantitative research, perhaps due to familiarity. A growing consensus is emerging that sees both qualitative and quantitative approaches as useful to answering research questions and understanding the world. Increasingly mixed methods research is being carried out where the researcher explicitly combines the quantitative and qualitative aspects of the study. 3 , 4

Like healthcare, education involves complex human interactions that can rarely be studied or explained in simple terms. Complex educational situations demand complex understanding; thus, the scope of educational research can be extended by the use of qualitative methods. Qualitative research can sometimes provide a better understanding of the nature of educational problems and thus add to insights into teaching and learning in a number of contexts. For example, at the University of Nottingham, we conducted in-depth interviews with pharmacists to determine their perceptions of continuing professional development and who had influenced their learning. We also have used a case study approach using observation of practice and in-depth interviews to explore physiotherapists' views of influences on their leaning in practice. We have conducted in-depth interviews with a variety of stakeholders in Malawi, Africa, to explore the issues surrounding pharmacy academic capacity building. A colleague has interviewed and conducted focus groups with students to explore cultural issues as part of a joint Nottingham-Malaysia pharmacy degree program. Another colleague has interviewed pharmacists and patients regarding their expectations before and after clinic appointments and then observed pharmacist-patient communication in clinics and assessed it using the Calgary Cambridge model in order to develop recommendations for communication skills training. 5 We have also performed documentary analysis on curriculum data to compare pharmacist and nurse supplementary prescribing courses in the United Kingdom.

It is important to choose the most appropriate methods for what is being investigated. Qualitative research is not appropriate to answer every research question and researchers need to think carefully about their objectives. Do they wish to study a particular phenomenon in depth (eg, students' perceptions of studying in a different culture)? Or are they more interested in making standardized comparisons and accounting for variance (eg, examining differences in examination grades after changing the way the content of a module is taught). Clearly a quantitative approach would be more appropriate in the last example. As with any research project, a clear research objective has to be identified to know which methods should be applied.

Types of qualitative data include:

• Audio recordings and transcripts from in-depth or semi-structured interviews
• Structured interview questionnaires containing substantial open comments including a substantial number of responses to open comment items.
• Audio recordings and transcripts from focus group sessions.
• Field notes (notes taken by the researcher while in the field [setting] being studied)
• Video recordings (eg, lecture delivery, class assignments, laboratory performance)
• Case study notes
• Documents (reports, meeting minutes, e-mails)
• Diaries, video diaries
• Observation notes
• Press clippings
• Photographs

RIGOUR IN QUALITATIVE RESEARCH

Qualitative research is often criticized as biased, small scale, anecdotal, and/or lacking rigor; however, when it is carried out properly it is unbiased, in depth, valid, reliable, credible and rigorous. In qualitative research, there needs to be a way of assessing the “extent to which claims are supported by convincing evidence.” 1 Although the terms reliability and validity traditionally have been associated with quantitative research, increasingly they are being seen as important concepts in qualitative research as well. Examining the data for reliability and validity assesses both the objectivity and credibility of the research. Validity relates to the honesty and genuineness of the research data, while reliability relates to the reproducibility and stability of the data.

The validity of research findings refers to the extent to which the findings are an accurate representation of the phenomena they are intended to represent. The reliability of a study refers to the reproducibility of the findings. Validity can be substantiated by a number of techniques including triangulation use of contradictory evidence, respondent validation, and constant comparison. Triangulation is using 2 or more methods to study the same phenomenon. Contradictory evidence, often known as deviant cases, must be sought out, examined, and accounted for in the analysis to ensure that researcher bias does not interfere with or alter their perception of the data and any insights offered. Respondent validation, which is allowing participants to read through the data and analyses and provide feedback on the researchers' interpretations of their responses, provides researchers with a method of checking for inconsistencies, challenges the researchers' assumptions, and provides them with an opportunity to re-analyze their data. The use of constant comparison means that one piece of data (for example, an interview) is compared with previous data and not considered on its own, enabling researchers to treat the data as a whole rather than fragmenting it. Constant comparison also enables the researcher to identify emerging/unanticipated themes within the research project.

STRENGTHS AND LIMITATIONS OF QUALITATIVE RESEARCH

Qualitative researchers have been criticized for overusing interviews and focus groups at the expense of other methods such as ethnography, observation, documentary analysis, case studies, and conversational analysis. Qualitative research has numerous strengths when properly conducted.

Strengths of Qualitative Research

• Issues can be examined in detail and in depth.
• Interviews are not restricted to specific questions and can be guided/redirected by the researcher in real time.
• The research framework and direction can be quickly revised as new information emerges.
• The data based on human experience that is obtained is powerful and sometimes more compelling than quantitative data.
• Subtleties and complexities about the research subjects and/or topic are discovered that are often missed by more positivistic enquiries.
• Data usually are collected from a few cases or individuals so findings cannot be generalized to a larger population. Findings can however be transferable to another setting.

Limitations of Qualitative Research

• Research quality is heavily dependent on the individual skills of the researcher and more easily influenced by the researcher's personal biases and idiosyncrasies.
• Rigor is more difficult to maintain, assess, and demonstrate.
• The volume of data makes analysis and interpretation time consuming.
• It is sometimes not as well understood and accepted as quantitative research within the scientific community
• The researcher's presence during data gathering, which is often unavoidable in qualitative research, can affect the subjects' responses.
• Issues of anonymity and confidentiality can present problems when presenting findings
• Findings can be more difficult and time consuming to characterize in a visual way.

PRESENTATION OF QUALITATIVE RESEARCH FINDINGS

The following extracts are examples of how qualitative data might be presented:

Data From an Interview.

The following is an example of how to present and discuss a quote from an interview.

The researcher should select quotes that are poignant and/or most representative of the research findings. Including large portions of an interview in a research paper is not necessary and often tedious for the reader. The setting and speakers should be established in the text at the end of the quote.

The student describes how he had used deep learning in a dispensing module. He was able to draw on learning from a previous module, “I found that while using the e learning programme I was able to apply the knowledge and skills that I had gained in last year's diseases and goals of treatment module.” (interviewee 22, male)

This is an excerpt from an article on curriculum reform that used interviews 5 :

The first question was, “Without the accreditation mandate, how much of this curriculum reform would have been attempted?” According to respondents, accreditation played a significant role in prompting the broad-based curricular change, and their comments revealed a nuanced view. Most indicated that the change would likely have occurred even without the mandate from the accreditation process: “It reflects where the profession wants to be … training a professional who wants to take on more responsibility.” However, they also commented that “if it were not mandated, it could have been a very difficult road.” Or it “would have happened, but much later.” The change would more likely have been incremental, “evolutionary,” or far more limited in its scope. “Accreditation tipped the balance” was the way one person phrased it. “Nobody got serious until the accrediting body said it would no longer accredit programs that did not change.”

Data From Observations

The following example is some data taken from observation of pharmacist patient consultations using the Calgary Cambridge guide. 6 , 7 The data are first presented and a discussion follows:

Pharmacist: We will soon be starting a stop smoking clinic. Patient: Is the interview over now? Pharmacist: No this is part of it. (Laughs) You can't tell me to bog off (sic) yet. (pause) We will be starting a stop smoking service here, Patient: Yes. Pharmacist: with one-to-one and we will be able to help you or try to help you. If you want it. In this example, the pharmacist has picked up from the patient's reaction to the stop smoking clinic that she is not receptive to advice about giving up smoking at this time; in fact she would rather end the consultation. The pharmacist draws on his prior relationship with the patient and makes use of a joke to lighten the tone. He feels his message is important enough to persevere but he presents the information in a succinct and non-pressurised way. His final comment of “If you want it” is important as this makes it clear that he is not putting any pressure on the patient to take up this offer. This extract shows that some patient cues were picked up, and appropriately dealt with, but this was not the case in all examples.

Data From Focus Groups

This excerpt from a study involving 11 focus groups illustrates how findings are presented using representative quotes from focus group participants. 8

Those pharmacists who were initially familiar with CPD endorsed the model for their peers, and suggested it had made a meaningful difference in the way they viewed their own practice. In virtually all focus groups sessions, pharmacists familiar with and supportive of the CPD paradigm had worked in collaborative practice environments such as hospital pharmacy practice. For these pharmacists, the major advantage of CPD was the linking of workplace learning with continuous education. One pharmacist stated, “It's amazing how much I have to learn every day, when I work as a pharmacist. With [the learning portfolio] it helps to show how much learning we all do, every day. It's kind of satisfying to look it over and see how much you accomplish.” Within many of the learning portfolio-sharing sessions, debates emerged regarding the true value of traditional continuing education and its outcome in changing an individual's practice. While participants appreciated the opportunity for social and professional networking inherent in some forms of traditional CE, most eventually conceded that the academic value of most CE programming was limited by the lack of a systematic process for following-up and implementing new learning in the workplace. “Well it's nice to go to these [continuing education] events, but really, I don't know how useful they are. You go, you sit, you listen, but then, well I at least forget.”

The following is an extract from a focus group (conducted by the author) with first-year pharmacy students about community placements. It illustrates how focus groups provide a chance for participants to discuss issues on which they might disagree.

Interviewer: So you are saying that you would prefer health related placements? Student 1: Not exactly so long as I could be developing my communication skill. Student 2: Yes but I still think the more health related the placement is the more I'll gain from it. Student 3: I disagree because other people related skills are useful and you may learn those from taking part in a community project like building a garden. Interviewer: So would you prefer a mixture of health and non health related community placements?

GUIDANCE FOR PUBLISHING QUALITATIVE RESEARCH

Qualitative research is becoming increasingly accepted and published in pharmacy and medical journals. Some journals and publishers have guidelines for presenting qualitative research, for example, the British Medical Journal 9 and Biomedcentral . 10 Medical Education published a useful series of articles on qualitative research. 11 Some of the important issues that should be considered by authors, reviewers and editors when publishing qualitative research are discussed below.

Introduction.

A good introduction provides a brief overview of the manuscript, including the research question and a statement justifying the research question and the reasons for using qualitative research methods. This section also should provide background information, including relevant literature from pharmacy, medicine, and other health professions, as well as literature from the field of education that addresses similar issues. Any specific educational or research terminology used in the manuscript should be defined in the introduction.

The methods section should clearly state and justify why the particular method, for example, face to face semistructured interviews, was chosen. The method should be outlined and illustrated with examples such as the interview questions, focusing exercises, observation criteria, etc. The criteria for selecting the study participants should then be explained and justified. The way in which the participants were recruited and by whom also must be stated. A brief explanation/description should be included of those who were invited to participate but chose not to. It is important to consider “fair dealing,” ie, whether the research design explicitly incorporates a wide range of different perspectives so that the viewpoint of 1 group is never presented as if it represents the sole truth about any situation. The process by which ethical and or research/institutional governance approval was obtained should be described and cited.

The study sample and the research setting should be described. Sampling differs between qualitative and quantitative studies. In quantitative survey studies, it is important to select probability samples so that statistics can be used to provide generalizations to the population from which the sample was drawn. Qualitative research necessitates having a small sample because of the detailed and intensive work required for the study. So sample sizes are not calculated using mathematical rules and probability statistics are not applied. Instead qualitative researchers should describe their sample in terms of characteristics and relevance to the wider population. Purposive sampling is common in qualitative research. Particular individuals are chosen with characteristics relevant to the study who are thought will be most informative. Purposive sampling also may be used to produce maximum variation within a sample. Participants being chosen based for example, on year of study, gender, place of work, etc. Representative samples also may be used, for example, 20 students from each of 6 schools of pharmacy. Convenience samples involve the researcher choosing those who are either most accessible or most willing to take part. This may be fine for exploratory studies; however, this form of sampling may be biased and unrepresentative of the population in question. Theoretical sampling uses insights gained from previous research to inform sample selection for a new study. The method for gaining informed consent from the participants should be described, as well as how anonymity and confidentiality of subjects were guaranteed. The method of recording, eg, audio or video recording, should be noted, along with procedures used for transcribing the data.

Data Analysis.

A description of how the data were analyzed also should be included. Was computer-aided qualitative data analysis software such as NVivo (QSR International, Cambridge, MA) used? Arrival at “data saturation” or the end of data collection should then be described and justified. A good rule when considering how much information to include is that readers should have been given enough information to be able to carry out similar research themselves.

One of the strengths of qualitative research is the recognition that data must always be understood in relation to the context of their production. 1 The analytical approach taken should be described in detail and theoretically justified in light of the research question. If the analysis was repeated by more than 1 researcher to ensure reliability or trustworthiness, this should be stated and methods of resolving any disagreements clearly described. Some researchers ask participants to check the data. If this was done, it should be fully discussed in the paper.

An adequate account of how the findings were produced should be included A description of how the themes and concepts were derived from the data also should be included. Was an inductive or deductive process used? The analysis should not be limited to just those issues that the researcher thinks are important, anticipated themes, but also consider issues that participants raised, ie, emergent themes. Qualitative researchers must be open regarding the data analysis and provide evidence of their thinking, for example, were alternative explanations for the data considered and dismissed, and if so, why were they dismissed? It also is important to present outlying or negative/deviant cases that did not fit with the central interpretation.

The interpretation should usually be grounded in interviewees or respondents' contributions and may be semi-quantified, if this is possible or appropriate, for example, “Half of the respondents said …” “The majority said …” “Three said…” Readers should be presented with data that enable them to “see what the researcher is talking about.” 1 Sufficient data should be presented to allow the reader to clearly see the relationship between the data and the interpretation of the data. Qualitative data conventionally are presented by using illustrative quotes. Quotes are “raw data” and should be compiled and analyzed, not just listed. There should be an explanation of how the quotes were chosen and how they are labeled. For example, have pseudonyms been given to each respondent or are the respondents identified using codes, and if so, how? It is important for the reader to be able to see that a range of participants have contributed to the data and that not all the quotes are drawn from 1 or 2 individuals. There is a tendency for authors to overuse quotes and for papers to be dominated by a series of long quotes with little analysis or discussion. This should be avoided.

Participants do not always state the truth and may say what they think the interviewer wishes to hear. A good qualitative researcher should not only examine what people say but also consider how they structured their responses and how they talked about the subject being discussed, for example, the person's emotions, tone, nonverbal communication, etc. If the research was triangulated with other qualitative or quantitative data, this should be discussed.

Discussion.

The findings should be presented in the context of any similar previous research and or theories. A discussion of the existing literature and how this present research contributes to the area should be included. A consideration must also be made about how transferrable the research would be to other settings. Any particular strengths and limitations of the research also should be discussed. It is common practice to include some discussion within the results section of qualitative research and follow with a concluding discussion.

The author also should reflect on their own influence on the data, including a consideration of how the researcher(s) may have introduced bias to the results. The researcher should critically examine their own influence on the design and development of the research, as well as on data collection and interpretation of the data, eg, were they an experienced teacher who researched teaching methods? If so, they should discuss how this might have influenced their interpretation of the results.

Conclusion.

The conclusion should summarize the main findings from the study and emphasize what the study adds to knowledge in the area being studied. Mays and Pope suggest the researcher ask the following 3 questions to determine whether the conclusions of a qualitative study are valid 12 : How well does this analysis explain why people behave in the way they do? How comprehensible would this explanation be to a thoughtful participant in the setting? How well does the explanation cohere with what we already know?

CHECKLIST FOR QUALITATIVE PAPERS

This paper establishes criteria for judging the quality of qualitative research. It provides guidance for authors and reviewers to prepare and review qualitative research papers for the American Journal of Pharmaceutical Education . A checklist is provided in Appendix 1 to assist both authors and reviewers of qualitative data.

ACKNOWLEDGEMENTS

Thank you to the 3 reviewers whose ideas helped me to shape this paper.

Appendix 1. Checklist for authors and reviewers of qualitative research.

Introduction

• □ Research question is clearly stated.
• □ Research question is justified and related to the existing knowledge base (empirical research, theory, policy).
• □ Any specific research or educational terminology used later in manuscript is defined.
• □ The process by which ethical and or research/institutional governance approval was obtained is described and cited.
• □ Reason for choosing particular research method is stated.
• □ Criteria for selecting study participants are explained and justified.
• □ Recruitment methods are explicitly stated.
• □ Details of who chose not to participate and why are given.
• □ Study sample and research setting used are described.
• □ Method for gaining informed consent from the participants is described.
• □ Maintenance/Preservation of subject anonymity and confidentiality is described.
• □ Method of recording data (eg, audio or video recording) and procedures for transcribing data are described.
• □ Methods are outlined and examples given (eg, interview guide).
• □ Decision to stop data collection is described and justified.
• □ Data analysis and verification are described, including by whom they were performed.
• □ Methods for identifying/extrapolating themes and concepts from the data are discussed.
• □ Sufficient data are presented to allow a reader to assess whether or not the interpretation is supported by the data.
• □ Outlying or negative/deviant cases that do not fit with the central interpretation are presented.
• □ Transferability of research findings to other settings is discussed.
• □ Findings are presented in the context of any similar previous research and social theories.
• □ Discussion often is incorporated into the results in qualitative papers.
• □ A discussion of the existing literature and how this present research contributes to the area is included.
• □ Any particular strengths and limitations of the research are discussed.
• □ Reflection of the influence of the researcher(s) on the data, including a consideration of how the researcher(s) may have introduced bias to the results is included.

Conclusions

• □ The conclusion states the main finings of the study and emphasizes what the study adds to knowledge in the subject area.

• Open access
• Published: 13 May 2024

Patient medication management, understanding and adherence during the transition from hospital to outpatient care - a qualitative longitudinal study in polymorbid patients with type 2 diabetes

• Léa Solh Dost   ORCID: orcid.org/0000-0001-5767-1305 1 , 2 ,
• Giacomo Gastaldi   ORCID: orcid.org/0000-0001-6327-7451 3 &
• Marie P. Schneider   ORCID: orcid.org/0000-0002-7557-9278 1 , 2  

BMC Health Services Research volume  24 , Article number:  620 ( 2024 ) Cite this article

299 Accesses

Metrics details

Continuity of care is under great pressure during the transition from hospital to outpatient care. Medication changes during hospitalization may be poorly communicated and understood, compromising patient safety during the transition from hospital to home. The main aims of this study were to investigate the perspectives of patients with type 2 diabetes and multimorbidities on their medications from hospital discharge to outpatient care, and their healthcare journey through the outpatient healthcare system. In this article, we present the results focusing on patients’ perspectives of their medications from hospital to two months after discharge.

Patients with type 2 diabetes, with at least two comorbidities and who returned home after discharge, were recruited during their hospitalization. A descriptive qualitative longitudinal research approach was adopted, with four in-depth semi-structured interviews per participant over a period of two months after discharge. Interviews were based on semi-structured guides, transcribed verbatim, and a thematic analysis was conducted.

Twenty-one participants were included from October 2020 to July 2021. Seventy-five interviews were conducted. Three main themes were identified: (A) Medication management, (B) Medication understanding, and (C) Medication adherence, during three periods: (1) Hospitalization, (2) Care transition, and (3) Outpatient care. Participants had varying levels of need for medication information and involvement in medication management during hospitalization and in outpatient care. The transition from hospital to autonomous medication management was difficult for most participants, who quickly returned to their routines with some participants experiencing difficulties in medication adherence.

Conclusions

The transition from hospital to outpatient care is a challenging process during which discharged patients are vulnerable and are willing to take steps to better manage, understand, and adhere to their medications. The resulting tension between patients’ difficulties with their medications and lack of standardized healthcare support calls for interprofessional guidelines to better address patients’ needs, increase their safety, and standardize physicians’, pharmacists’, and nurses’ roles and responsibilities.

Peer Review reports

Introduction

Continuity of patient care is characterized as the collaborative engagement between the patient and their physician-led care team in the ongoing management of healthcare, with the mutual objective of delivering high-quality and cost-effective medical care [ 1 ]. Continuity of care is under great pressure during the transition of care from hospital to outpatient care, with a risk of compromising patients’ safety [ 2 , 3 ]. The early post-discharge period is a high-risk and fragile transition: once discharged, one in five patients experience at least one adverse event during the first three weeks following discharge, and more than half of these adverse events are drug-related [ 4 , 5 ]. A retrospective study examining all discharged patients showed that adverse drug events (ADEs) account for up to 20% of 30-day hospital emergency readmissions [ 6 ]. During hospitalization, patients’ medications are generally modified, with an average of nearly four medication changes per patient [ 7 ]. Information regarding medications such as medication changes, the expected effect, side effects, and instructions for use are frequently poorly communicated to patients during hospitalization and at discharge [ 8 , 9 , 10 , 11 ]. Between 20 and 60% of discharged patients lack knowledge of their medications [ 12 , 13 ]. Consideration of patients’ needs and their active engagement in decision-making during hospitalization regarding their medications are often lacking [ 11 , 14 , 15 ]. This can lead to unsafe discharge and contribute to medication adherence difficulties, such as non-implementation of newly prescribed medications [ 16 , 17 ].

Patients with multiple comorbidities and polypharmacy are at higher risk of ADE [ 18 ]. Type 2 diabetes is one of the chronic health conditions most frequently associated with comorbidities and patients with type 2 diabetes often lack care continuum [ 19 , 20 , 21 ]. The prevalence of patients hospitalized with type 2 diabetes can exceed 40% [ 22 ] and these patients are at higher risk for readmission due to their comorbidities and their medications, such as insulin and oral hypoglycemic agents [ 23 , 24 , 25 ].

Interventions and strategies to improve patient care and safety at transition have shown mixed results worldwide in reducing cost, rehospitalization, ADE, and non-adherence [ 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 ]. However, interventions that are patient-centered, with a patient follow-up and led by interprofessional healthcare teams showed promising results [ 34 , 35 , 36 ]. Most of these interventions have not been implemented routinely due to the extensive time to translate research into practice and the lack of hybrid implementation studies [ 37 , 38 , 39 , 40 , 41 ]. In addition, patient-reported outcomes and perspectives have rarely been considered, yet patients’ involvement is essential for seamless and integrated care [ 42 , 43 ]. Interprofessional collaboration in which patients are full members of the interprofessional team, is still in its infancy in outpatient care [ 44 ]. Barriers and facilitators regarding medications at the transition of care have been explored in multiple qualitative studies at one given time in a given setting (e.g., at discharge, one-month post-discharge) [ 8 , 45 , 46 , 47 , 48 ]. However, few studies have adopted a holistic methodology from the hospital to the outpatient setting to explore changes in patients’ perspectives over time [ 49 , 50 , 51 ]. Finally, little is known about whether, how, and when patients return to their daily routine following hospitalization and the impact of hospitalization weeks after discharge.

In Switzerland, continuity of care after hospital discharge is still poorly documented, both in terms of contextual analysis and interventional studies, and is mainly conducted in the hospital setting [ 31 , 35 , 52 , 53 , 54 , 55 , 56 ]. The first step of an implementation science approach is to perform a contextual analysis to set up effective interventions adapted to patients’ needs and aligned to healthcare professionals’ activities in a specific context [ 41 , 57 ]. Therefore, the main aims of this study were to investigate the perspectives of patients with type 2 diabetes and multimorbidities on their medications from hospital discharge to outpatient care, and on their healthcare journey through the outpatient healthcare system. In this article, we present the results focusing on patients’ perspectives of their medications from hospital to two months after discharge.

Study design

This qualitative longitudinal study, conducted from October 2020 to July 2021, used a qualitative descriptive methodology through four consecutive in-depth semi-structured interviews per participant at three, 10-, 30- and 60-days post-discharge, as illustrated in Fig.  1 . Longitudinal qualitative research is characterized by qualitative data collection at different points in time and focuses on temporality, such as time and change [ 58 , 59 ]. Qualitative descriptive studies aim to explore and describe the depth and complexity of human experiences or phenomena [ 60 , 61 , 62 ]. We focused our qualitative study on the 60 first days after discharge as this period is considered highly vulnerable and because studies often use 30- or 60-days readmission as an outcome measure [ 5 , 63 ].

This qualitative study follows the Consolidated Criteria for Reporting Qualitative Research (COREQ). Ethics committee approval was sought and granted by the Cantonal Research Ethics Commission, Geneva (CCER) (2020 − 01779).

Recruitment took place during participants’ hospitalization in the general internal medicine divisions at the Geneva University Hospitals in the canton of Geneva (500 000 inhabitants), Switzerland. Interviews took place at participants’ homes, in a private office at the University of Geneva, by telephone or by secure video call, according to participants’ preference. Informal caregivers could also participate alongside the participants.

Study flowchart

Researcher characteristics

All the researchers were trained in qualitative studies. The diabetologist and researcher (GG) who enrolled the patients in the study was involved directly or indirectly (advice asked to the Geneva University Hospital diabetes team of which he was a part) for most participants’ care during hospitalization. LS (Ph.D. student and community pharmacist) was unknown to participants and presented herself during hospitalization as a “researcher” and not as a healthcare professional to avoid any risk of influencing participants’ answers. This study was not interventional, and the interviewer (LS) invited participants to contact a healthcare professional for any questions related to their medication or medical issues.

Population and sampling strategy

Patients with type 2 diabetes were chosen as an example population to describe polypharmacy patients as these patients usually have several health issues and polypharmacy [ 20 , 22 , 25 ]. Inclusions criteria for the study were: adult patients with type 2 diabetes, with at least two other comorbidities, hospitalized for at least three days in a general internal medicine ward, with a minimum of one medication change during hospital stay, and who self-managed their medications once discharged home. Exclusion criteria were patients not reachable by telephone following discharge, unable to give consent (patients with schizophrenia, dementia, brain damage, or drug/alcohol misuse), and who could not communicate in French. A purposive sampling methodology was applied aiming to include participants with different ages, genders, types, and numbers of health conditions by listing participants’ characteristics in a double-entry table, available in Supplementary Material 1 , until thematic saturation was reached. Thematic saturation was considered achieved when no new code or theme emerged and new data repeated previously coded information [ 64 ]. The participants were identified if they were hospitalized in the ward dedicated to diabetes care or when the diabetes team was contacted for advice. The senior ward physician (GG) screened eligible patients and the interviewer (LS) obtained written consent before hospital discharge.

Data collection and instruments

Sociodemographic (age, gender, educational level, living arrangement) and clinical characteristics (reason for hospitalization, date of admission, health conditions, diabetes diagnosis, medications before and during hospitalization) were collected by interviewing participants before their discharge and by extracting participants’ data from electronic hospital files by GG and LS. Participants’ pharmacies were contacted with the participant’s consent to obtain medication records from the last three months if information regarding medications before hospitalization was missing in the hospital files.

Semi-structured interview guides for each interview (at three, 10-, 30- and 60-days post-discharge) were developed based on different theories and components of health behavior and medication adherence: the World Health Organization’s (WHO) five dimensions for adherence, the Information-Motivation-Behavioral skills model and the Social Cognitive Theory [ 65 , 66 , 67 ]. Each interview explored participants’ itinerary in the healthcare system and their perspectives on their medications. Regarding medications, the following themes were mentioned at each interview: changes in medications, patients’ understanding and implication; information on their medications, self-management of their medications, and patients’ medication adherence. Other aspects were mentioned in specific interviews: patients’ hospitalization and experience on their return home (interview 1), motivation (interviews 2 and 4), and patient’s feedback on the past two months (interview 4). Interview guides translated from French are available in Supplementary Material 2 . The participants completed self-reported and self-administrated questionnaires at different interviews to obtain descriptive information on different factors that may affect medication management and adherence: self-report questionnaires on quality of life (EQ-5D-5 L) [ 68 ], literacy (Schooling-Opinion-Support questionnaire) [ 69 ], medication adherence (Adherence Visual Analogue Scale, A-VAS) [ 70 ] and Belief in Medication Questionnaire (BMQ) [ 71 ] were administered to each participant at the end of selected interviews to address the different factors that may affect medication management and adherence as well as to determine a trend of determinants over time. The BMQ contains two subscores: Specific-Necessity and Specific-Concerns, addressing respectively their perceived needs for their medications, and their concerns about adverse consequences associated with taking their medication [ 72 ].

Data management

Informed consent forms, including consent to obtain health data, were securely stored in a private office at the University of Geneva. The participants’ identification key was protected by a password known only by MS and LS. Confidentiality was guaranteed by pseudonymization of participants’ information and audio-recordings were destroyed once analyzed. Sociodemographic and clinical characteristics, medication changes, and answers to questionnaires were securely collected by electronic case report forms (eCRFs) on RedCap®. Interviews were double audio-recorded and field notes were taken during interviews. Recorded interviews were manually transcribed verbatim in MAXQDA® (2018.2) by research assistants and LS and transcripts were validated for accuracy by LS. A random sample of 20% of questionnaires was checked for accuracy for the transcription from the paper questionnaires to the eCRFs. Recorded sequences with no link to the discussed topics were not transcribed and this was noted in the transcripts.

Data analysis

A descriptive statistical analysis of sociodemographic, clinical characteristics and self-reported questionnaire data was carried out. A thematic analysis of transcripts was performed, as described by Braun and Clarke [ 73 ], by following six steps: raw data was read, text segments related to the study objectives were identified, text segments to create new categories were identified, similar or redundant categories were reduced and a model that integrated all significant categories was created. The analysis was conducted in parallel with patient enrolment to ensure data saturation. To ensure the validity of the coding method, transcripts were double coded independently and discussed by the research team until similar themes were obtained. The research group developed and validated an analysis grid, with which LS coded systematically the transcriptions and met regularly with the research team to discuss questions on data analysis and to ensure the quality of coding. The analysis was carried out in French, and the verbatims of interest cited in the manuscript were translated and validated by a native English-speaking researcher to preserve the meaning.

In this analysis, we used the term “healthcare professionals” when more than one profession could be involved in participants’ medication management. Otherwise, when a specific healthcare professional was involved, we used the designated profession (e.g. physicians, pharmacists).

Patient and public involvement

During the development phase of the study, interview guides and questionnaires were reviewed for clarity and validity and adapted by two patient partners, with multiple health conditions and who experienced previously a hospital discharge. They are part of the HUG Patients Partners + 3P platform for research and patient and public involvement.

Interviews and participants’ descriptions

A total of 75 interviews were conducted with 21 participants. In total, 31 patients were contacted, seven refused to participate (four at the project presentation and three at consent), two did not enter the selection criteria at discharge and one was unreachable after discharge. Among the 21 participants, 15 participated in all interviews, four in three interviews, one in two interviews, and one in one interview, due to scheduling constraints. Details regarding interviews and participants characteristics are presented in Tables  1 and 2 .

The median length of time between hospital discharge and interviews 1,2,3 and 4 was 5 (IQR: 4–7), 14 (13-20), 35 (22-38), and 63 days (61-68), respectively. On average, by comparing medications at hospital admission and discharge, a median of 7 medication changes (IQR: 6–9, range:2;17) occurred per participant during hospitalization and a median of 7 changes (5–12) during the two months following discharge. Details regarding participants’ medications are described in Table  3 .

Patient self-reported adherence over the past week for their three most challenging medications are available in Supplementary Material 3 .

Qualitative analysis

We defined care transition as the period from discharge until the first medical appointment post-discharge, and outpatient care as the period starting after the first medical appointment. Data was organized into three key themes (A. Medication management, B. Medication understanding, and C. Medication adherence) divided into subthemes at three time points (1. Hospitalization, 2. Care transition and 3. Outpatient care). Figure  2 summarizes and illustrates the themes and subthemes with their influencing factors as bullet points.

Participants’ medication management, understanding and adherence during hospitalization, care transition and outpatient care

A. Medication management

A.1 medication management during hospitalization: medication management by hospital staff.

Medications during hospitalization were mainly managed by hospital healthcare professionals (i.e. nurses and physicians) with varying degrees of patient involvement: “At the hospital, they prepared the medications for me. […] I didn’t even know what the packages looked like.” Participant 22; interview 1 (P22.1) Some participants reported having therapeutic education sessions with specialized nurses and physicians, such as the explanation and demonstration of insulin injection and glucose monitoring. A patient reported that he was given the choice of several treatments and was involved in shared decision-making. Other participants had an active role in managing and optimizing dosages, such as rapid insulin, due to prior knowledge and use of medications before hospitalization.

A.2 Medication management at transition: obtaining the medication and initiating self-management

Once discharged, some participants had difficulties obtaining their medications at the pharmacy because some medications were not stored and had to be ordered, delaying medication initiation. To counter this problem upstream, a few participants were provided a 24-to-48-hour supply of medications at discharge. It was sometimes requested by the patient or suggested by the healthcare professionals but was not systematic. The transition from medication management by hospital staff to self-management was exhausting for most participants who were faced with a large amount of new information and changes in their medications: “ When I was in the hospital, I didn’t even realize all the changes. When I came back home, I took away the old medication packages and got out the new ones. And then I thought : « my God, all this…I didn’t know I had all these changes » ” P2.1 Written documentation, such as the discharge prescription or dosage labels on medication packages, was helpful in managing their medication at home. Most participants used weekly pill organizers to manage their medications, which were either already used before hospitalization or were introduced post-discharge. The help of a family caregiver in managing and obtaining medications was reported as a facilitator.

A.3 Medication management in outpatient care: daily self-management and medication burden

A couple of days or weeks after discharge, most participants had acquired a routine so that medication management was less demanding, but the medication burden varied depending on the participants. For some, medication management became a simple action well implemented in their routine (“It has become automatic” , P23.4), while for others, the number of medications and the fact that the medications reminded them of the disease was a heavy burden to bear on a daily basis (“ During the first few days after getting out of the hospital, I thought I was going to do everything right. In the end, well [laughs] it’s complicated. I ended up not always taking the medication, not monitoring the blood sugar” P12.2) To support medication self-management, some participants had written documentation such as treatment plans, medication lists, and pictures of their medication packages on their phones. Some participants had difficulties obtaining medications weeks after discharge as discharge prescriptions were not renewable and participants did not see their physician in time. Others had to visit multiple physicians to have their prescriptions updated. A few participants were faced with prescription or dispensing errors, such as prescribing or dispensing the wrong dosage, which affected medication management and decreased trust in healthcare professionals. In most cases, according to participants, the pharmacy staff worked in an interprofessional collaboration with physicians to provide new and updated prescriptions.

B. Medication understanding

B.1 medication understanding during hospitalization: new information and instructions.

The amount of information received during hospitalization varied considerably among participants with some reporting having received too much, while others saying they received too little information regarding medication changes, the reason for changes, or for introducing new medications: “They told me I had to take this medication all my life, but they didn’t tell me what the effects were or why I was taking it.” P5.3

Hospitalization was seen by some participants as a vulnerable and tiring period during which they were less receptive to information. Information and explanations were generally given verbally, making it complicated for most participants to recall it. Some participants reported that hospital staff was attentive to their needs for information and used communication techniques such as teach-back (a way of checking understanding by asking participants to say in their own words what they need to know or do about their health or medications). Some participants were willing to be proactive in the understanding of their medications while others were more passive, had no specific needs for information, and did not see how they could be engaged more.

B.2 Medication understanding at transition: facing medication changes

At hospital discharge, the most challenging difficulty for participants was to understand the changes made regarding their medications. For newly diagnosed participants, the addition of new medications was more difficult to understand, whereas, for experienced participants, changes in known medications such as dosage modification, changes within a therapeutic class, and generic substitutions were the most difficult to understand. Not having been informed about changes caused confusion and misunderstanding. Therefore, medication reconciliation done by the patient was time-consuming, especially for participants with multiple medications: “ They didn’t tell me at all that they had changed my treatment completely. They just told me : « We’ve changed a few things. But it was the whole treatment ». ” P2.3 Written information, such as the discharge prescription, the discharge report (brief letter summarizing information about the hospitalization, given to the patient at discharge), or the label on the medication box (written by the pharmacist with instructions on dosage) helped them find or recall information about their medications and diagnoses. However, technical terms were used in hospital documentations and were not always understandable. For example, this participant said: “ On the prescription of valsartan, they wrote: ‘resume in the morning once profile…’[once hypertension profile allows]… I don’t know what that means.” P8.1 In addition, some documents were incomplete, as mentioned by a patient who did not have the insulin dosage mentioned on the hospital prescription. Some participants sought help from healthcare professionals, such as pharmacists, hospital physicians, or general practitioners a few days after discharge to review medications, answer questions, or obtain additional information.

B.3 Medication understanding in the outpatient care: concerns and knowledge

Weeks after discharge, most participants had concerns about the long-term use of their medications, their usefulness, and the possible risk of interactions or side effects. Some participants also reported having some lack of knowledge regarding indications, names, or how the medication worked: “I don’t even know what Brilique® [ticagrelor, antiplatelet agent] is for. It’s for blood pressure, isn’t it?. I don’t know.” P11.4 According to participants, the main reasons for the lack of understanding were the lack of information at the time of prescribing and the large number of medications, making it difficult to search for information and remember it. Participants sought information from different healthcare professionals or by themselves, on package inserts, through the internet, or from family and friends. Others reported having had all the information needed or were not interested in having more information. In addition, participants with low medication literacy, such as non-native speakers or elderly people, struggled more with medication understanding and sought help from family caregivers or healthcare professionals, even weeks after discharge: “ I don’t understand French very well […] [The doctor] explained it very quickly…[…] I didn’t understand everything he was saying” P16.2

C. Medication adherence

C.2 medication adherence at transition: adopting new behaviors.

Medication adherence was not mentioned as a concern during hospitalization and a few participants reported difficulties in medication initiation once back home: “I have an injection of Lantus® [insulin] in the morning, but obviously, the first day [after discharge], I forgot to do it because I was not used to it.” P23.1 Participants had to quickly adopt new behaviors in the first few days after discharge, especially for participants with few medications pre-hospitalization. The use of weekly pill organizers, alarms and specific storage space were reported as facilitators to support adherence. One patient did not initiate one of his medications because he did not understand the medication indication, and another patient took her old medications because she was used to them. Moreover, most participants experienced their hospitalization as a turning point, a time when they focused on their health, thought about the importance of their medications, and discussed any new lifestyle or dietary measures that might be implemented.

C.3 Medication adherence in outpatient care: ongoing medication adherence

More medication adherence difficulties appeared a few weeks after hospital discharge when most participants reported nonadherence behaviors, such as difficulties implementing the dosage regimen, or intentionally discontinuing the medication and modifying the medication regimen on their initiative. Determinants positively influencing medication adherence were the establishment of a routine; organizing medications in weekly pill-organizers; organizing pocket doses (medications for a short period that participants take with them when away from home); seeking support from family caregivers; using alarm clocks; and using specific storage places. Reasons for nonadherence were changes in daily routine; intake times that were not convenient for the patient; the large number of medications; and poor knowledge of the medication or side effects. Healthcare professionals’ assistance for medication management, such as the help of home nurses or pharmacists for the preparation of weekly pill-organizers, was requested by participants or offered by healthcare professionals to support medication adherence: “ I needed [a home nurse] to put my pills in the pillbox. […] I felt really weak […] and I was making mistakes. So, I’m very happy [the doctor] offered me [home care]. […] I have so many medications.” P22.3 Some participants who experienced prehospitalization non-adherence were more aware of their non-adherence and implemented strategies, such as modifying the timing of intake: “I said to my doctor : « I forget one time out of two […], can I take them in the morning? » We looked it up and yes, I can take it in the morning.” P11.2 In contrast, some participants were still struggling with adherence difficulties that they had before hospitalization. Motivations for taking medications two months after discharge were to improve health, avoid complications, reduce symptoms, reduce the number of medications in the future or out of obligation: “ I force myself to take them because I want to get to the end of my diabetes, I want to reduce the number of pills as much as possible.” P14.2 After a few weeks post-hospitalization, for some participants, health and illness were no longer the priority because of other life imperatives (e.g., family or financial situation).

This longitudinal study provided a multi-faceted representation of how patients manage, understand, and adhere to their medications from hospital discharge to two months after discharge. Our findings highlighted the varying degree of participants’ involvement in managing their medications during their hospitalization, the individualized needs for information during and after hospitalization, the complicated transition from hospital to autonomous medication management, the adaptation of daily routines around medication once back home, and the adherence difficulties that surfaced in the outpatient care, with nonadherence prior to hospitalization being an indicator of the behavior after discharge. Finally, our results confirmed the lack of continuity in care and showed the lack of patient care standardization experienced by the participants during the transition from hospital to outpatient care.

This in-depth analysis of patients’ experiences reinforces common challenges identified in the existing literature such as the lack of personalized information [ 9 , 10 , 11 ], loss of autonomy during hospitalization [ 14 , 74 , 75 ], difficulties in obtaining medication at discharge [ 11 , 45 , 76 ] and challenges in understanding treatment modifications and generics substitution [ 11 , 32 , 77 , 78 ]. Some of these studies were conducted during patients’ hospitalization [ 10 , 75 , 79 ] or up to 12 months after discharge [ 80 , 81 ], but most studies focused on the few days following hospital discharge [ 9 , 11 , 14 , 82 ]. Qualitative studies on medications at transition often focused on a specific topic, such as medication information, or a specific moment in time, and often included healthcare professionals, which muted patients’ voices [ 9 , 10 , 11 , 47 , 49 ]. Our qualitative longitudinal methodology was interested in capturing the temporal dynamics, in-depth narratives, and contextual nuances of patients’ medication experiences during transitions of care [ 59 , 83 ]. This approach provided a comprehensive understanding of how patients’ perspectives and behaviors evolved over time, offering insights into the complex interactions of medication management, understanding and adherence, and turning points within their medication journeys. A qualitative longitudinal design was used by Fylan et al. to underline patients’ resilience in medication management during and after discharge, by Brandberg et al. to show the dynamic process of self-management during the 4 weeks post-discharge and by Lawton et al. to examine how patients with type 2 diabetes perceived their care after discharge over a period of four years [ 49 , 50 , 51 ]. Our study focused on the first two months following hospitalization and future studies should focus on following discharged and at-risk patients over a longer period, as “transitions of care do not comprise linear trajectories of patients’ movements, with a starting and finishing point. Instead, they are endless loops of movements” [ 47 ].

Our results provide a particularly thorough description of how participants move from a state of total dependency during hospitalization regarding their medication management to a sudden and complete autonomy after hospital discharge impacting medication management, understanding, and adherence in the first days after discharge for some participants. Several qualitative studies have described the lack of shared decision-making and the loss of patient autonomy during hospitalization, which had an impact on self-management and created conflicts with healthcare professionals [ 75 , 81 , 84 ]. Our study also highlights nuanced patient experiences, including varying levels of patient needs, involvement, and proactivity during hospitalization and outpatient care, and our results contribute to capturing different perspectives that contrast with some literature that often portrays patients as more passive recipients of care [ 14 , 15 , 74 , 75 ]. Shared decision-making and proactive medication are key elements as they contribute to a smoother transition and better outcomes for patients post-discharge [ 85 , 86 , 87 ].

Consistent with the literature, the study identifies some challenges in medication initiation post-discharge [ 16 , 17 , 88 ] but our results also describe how daily routine rapidly takes over, either solidifying adherence behavior or generating barriers to medication adherence. Participants’ nonadherence prior to hospitalization was a factor influencing participants’ adherence post-hospitalization and this association should be further investigated, as literature showed that hospitalized patients have high scores of non-adherence [ 89 ]. Mortel et al. showed that more than 20% of discharged patients stopped their medications earlier than agreed with the physician and 25% adapted their medication intake [ 90 ]. Furthermore, patients who self-managed their medications had a lower perception of the necessity of their medication than patients who received help, which could negatively impact medication adherence [ 91 ]. Although participants in our study had high BMQ scores for necessity and lower scores for concerns, some participants expressed doubts about the need for their medications and a lack of motivation a few weeks after discharge. Targeted pharmacy interventions for newly prescribed medications have been shown to improve medication adherence, and hospital discharge is an opportune moment to implement this service [ 92 , 93 ].

Many medication changes were made during the transition of care (a median number of 7 changes during hospitalization and 7 changes during the two months after discharge), especially medication additions during hospitalization and interruptions after hospitalization. While medication changes during hospitalization are well described, the many changes following discharge are less discussed [ 7 , 94 ]. A Danish study showed that approximately 65% of changes made during hospitalization were accepted by primary healthcare professionals but only 43% of new medications initiated during hospitalization were continued after discharge [ 95 ]. The numerous changes after discharge may be caused by unnecessary intensification of medications during hospitalization, delayed discharge letters, lack of standardized procedures, miscommunication, patient self-management difficulties, or in response to an acute situation [ 96 , 97 , 98 ]. During the transition of care, in our study, both new and experienced participants were faced with difficulties in managing and understanding medication changes, either for newly prescribed medication or changes in previous medications. Such difficulties corroborate the findings of the literature [ 9 , 10 , 47 ] and our results showed that the lack of understanding during hospitalization led to participants having questions about their medications, even weeks after discharge. Particular attention should be given to patients’ understanding of medication changes jointly by physicians, nurses and pharmacists during the transition of care and in the months that follow as medications are likely to undergo as many changes as during hospitalization.

Implication for practice and future research

The patients’ perspectives in this study showed, at a system level, that there was a lack of standardization in healthcare professional practices regarding medication dispensing and follow-up. For now, in Switzerland, there are no official guidelines on medication prescription and dispensation during the transition of care although some international guidelines have been developed for outpatient healthcare professionals [ 3 , 99 , 100 , 101 , 102 ]. Here are some suggestions for improvement arising from our results. Patients should be included as partners and healthcare professionals should systematically assess (i) previous medication adherence, (ii) patients’ desired level of involvement and (iii) their needs for information during hospitalization. Hospital discharge processes should be routinely implemented to standardize hospital discharge preparation, medication prescribing, and dispensing. Discharge from the hospital should be planned with community pharmacies to ensure that all medications are available and, if necessary, doses of medications should be supplied by the hospital to bridge the gap. A partnership with outpatient healthcare professionals, such as general practitioners, community pharmacists, and homecare nurses, should be set up for effective asynchronous interprofessional collaboration to consolidate patients’ medication management, knowledge, and adherence, as well as to monitor signs of deterioration or adverse drug events.

Future research should consolidate our first attempt to develop a framework to better characterize medication at the transition of care, using Fig. 2   as a starting point. Contextualized interventions, co-designed by health professionals, patients and stakeholders, should be tested in a hybrid implementation study to test the implementation and effectiveness of the intervention for the health system [ 103 ].

Limitations

This study has some limitations. First, the transcripts were validated for accuracy by the interviewer but not by a third party, which could have increased the robustness of the transcription. Nevertheless, the interviewer followed all methodological recommendations for transcription. Second, patient inclusion took place during the COVID-19 pandemic, which may have had an impact on patient care and the availability of healthcare professionals. Third, we cannot guarantee the accuracy of some participants’ medication history before hospitalization, even though we contacted the participants’ main pharmacy, as participants could have gone to different pharmacies to obtain their medications. Fourth, our findings may not be generalizable to other populations and other healthcare systems because some issues may be specific to multimorbid patients with type 2 diabetes or to the Swiss healthcare setting. Nevertheless, issues encountered by our participants regarding their medications correlate with findings in the literature. Fifth, only 15 out of 21 participants took part in all the interviews, but most participants took part in at least three interviews and data saturation was reached. Lastly, by its qualitative and longitudinal design, it is possible that the discussion during interviews and participants’ reflections between interviews influenced participants’ management, knowledge, and adherence, even though this study was observational, and no advice or recommendations were given by the interviewer during interviews.

Discharged patients are willing to take steps to better manage, understand, and adhere to their medications, yet they are also faced with difficulties in the hospital and outpatient care. Furthermore, extensive changes in medications not only occur during hospitalization but also during the two months following hospital discharge, for which healthcare professionals should give particular attention. The different degrees of patients’ involvement, needs and resources should be carefully considered to enable them to better manage, understand and adhere to their medications. At a system level, patients’ experiences revealed a lack of standardization of medication practices during the transition of care. The healthcare system should provide the ecosystem needed for healthcare professionals responsible for or involved in the management of patients’ medications during the hospital stay, discharge, and outpatient care to standardize their practices while considering the patient as an active partner.

Data availability

The anonymized quantitative survey datasets and the qualitative codes are available in French from the corresponding author on reasonable request.

Abbreviations

adverse drug events

Adherence Visual Analogue Scale

Belief in Medication Questionnaire

Consolidated Criteria for Reporting Qualitative Research

case report form

standard deviation

World Health Organization

American Academy of Family Physician. Continuity of Care, Definition of 2020. Accessed 10 July 2022 https://www.aafp.org/about/policies/all/continuity-of-care-definition.html

Kripalani S, LeFevre F, Phillips CO, Williams MV, Basaviah P, Baker DW. Deficits in communication and information transfer between hospital-based and primary care physicians: implications for patient safety and continuity of care. JAMA. 2007;297(8):831–41.

Article   CAS   PubMed   Google Scholar  

World Health Organization (WHO). Medication Safety in Transitions of Care. 2019.

Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. The incidence and severity of adverse events affecting patients after discharge from the hospital. Ann Intern Med. 2003;138(3):161–7.

Article   PubMed   Google Scholar  

Krumholz HM. Post-hospital syndrome–an acquired, transient condition of generalized risk. N Engl J Med. 2013;368(2):100–2.

Article   CAS   PubMed   PubMed Central   Google Scholar  

Banholzer S, Dunkelmann L, Haschke M, Derungs A, Exadaktylos A, Krähenbühl S, et al. Retrospective analysis of adverse drug reactions leading to short-term emergency hospital readmission. Swiss Med Wkly. 2021;151:w20400.

Blozik E, Signorell A, Reich O. How does hospitalization affect continuity of drug therapy: an exploratory study. Ther Clin Risk Manag. 2016;12:1277–83.

Article   PubMed   PubMed Central   Google Scholar  

Allen J, Hutchinson AM, Brown R, Livingston PM. User experience and care for older people transitioning from hospital to home: patients’ and carers’ perspectives. Health Expect. 2018;21(2):518–27.

Daliri S, Bekker CL, Buurman BM, Scholte Op Reimer WJM, van den Bemt BJF, Karapinar-Çarkit F. Barriers and facilitators with medication use during the transition from hospital to home: a qualitative study among patients. BMC Health Serv Res. 2019;19(1):204.

Bekker CL, Mohsenian Naghani S, Natsch S, Wartenberg NS, van den Bemt BJF. Information needs and patient perceptions of the quality of medication information available in hospitals: a mixed method study. Int J Clin Pharm. 2020;42(6):1396–404.

Foulon V, Wuyts J, Desplenter F, Spinewine A, Lacour V, Paulus D, et al. Problems in continuity of medication management upon transition between primary and secondary care: patients’ and professionals’ experiences. Acta Clin Belgica: Int J Clin Lab Med. 2019;74(4):263–71.

Article   Google Scholar  

Micheli P, Kossovsky MP, Gerstel E, Louis-Simonet M, Sigaud P, Perneger TV, et al. Patients’ knowledge of drug treatments after hospitalisation: the key role of information. Swiss Med Wkly. 2007;137(43–44):614–20.

PubMed   Google Scholar  

Ziaeian B, Araujo KL, Van Ness PH, Horwitz LI. Medication reconciliation accuracy and patient understanding of intended medication changes on hospital discharge. J Gen Intern Med. 2012;27(11):1513–20.

Allen J, Hutchinson AM, Brown R, Livingston PM. User experience and care integration in Transitional Care for older people from hospital to home: a Meta-synthesis. Qual Health Res. 2016;27(1):24–36.

Mackridge AJ, Rodgers R, Lee D, Morecroft CW, Krska J. Cross-sectional survey of patients’ need for information and support with medicines after discharge from hospital. Int J Pharm Pract. 2018;26(5):433–41.

Mulhem E, Lick D, Varughese J, Barton E, Ripley T, Haveman J. Adherence to medications after hospital discharge in the elderly. Int J Family Med. 2013;2013:901845.

Fallis BA, Dhalla IA, Klemensberg J, Bell CM. Primary medication non-adherence after discharge from a general internal medicine service. PLoS ONE. 2013;8(5):e61735.

Zhou L, Rupa AP. Categorization and association analysis of risk factors for adverse drug events. Eur J Clin Pharmacol. 2018;74(4):389–404.

Moreau-Gruet F. La multimorbidité chez les personnes de 50 ans et plus. Résultats basés sur l’enqête SHARE (Survey of Health, Ageing and Retirement in Europe. Obsan Bulletin 4/2013. 2013(Neuchâtel: OBservatoire suisse de la santé).

Iglay K, Hannachi H, Joseph Howie P, Xu J, Li X, Engel SS, et al. Prevalence and co-prevalence of comorbidities among patients with type 2 diabetes mellitus. Curr Med Res Opin. 2016;32(7):1243–52.

Sibounheuang P, Olson PS, Kittiboonyakun P. Patients’ and healthcare providers’ perspectives on diabetes management: a systematic review of qualitative studies. Res Social Adm Pharm. 2020;16(7):854–74.

Müller-Wieland D, Merkel M, Hamann A, Siegel E, Ottillinger B, Woker R, et al. Survey to estimate the prevalence of type 2 diabetes mellitus in hospital patients in Germany by systematic HbA1c measurement upon admission. Int J Clin Pract. 2018;72(12):e13273.

Blanc AL, Fumeaux T, Stirnemann J, Dupuis Lozeron E, Ourhamoune A, Desmeules J, et al. Development of a predictive score for potentially avoidable hospital readmissions for general internal medicine patients. PLoS ONE. 2019;14(7):e0219348.

Hansen LO, Greenwald JL, Budnitz T, Howell E, Halasyamani L, Maynard G, et al. Project BOOST: effectiveness of a multihospital effort to reduce rehospitalization. J Hosp Med. 2013;8(8):421–7.

Khalid JM, Raluy-Callado M, Curtis BH, Boye KS, Maguire A, Reaney M. Rates and risk of hospitalisation among patients with type 2 diabetes: retrospective cohort study using the UK General Practice Research Database linked to English Hospital Episode statistics. Int J Clin Pract. 2014;68(1):40–8.

Lussier ME, Evans HJ, Wright EA, Gionfriddo MR. The impact of community pharmacist involvement on transitions of care: a systematic review and meta-analysis. J Am Pharm Assoc. 2020;60(1):153–.

van der Heijden A, de Bruijne MC, Nijpels G, Hugtenburg JG. Cost-effectiveness of a clinical medication review in vulnerable older patients at hospital discharge, a randomized controlled trial. Int J Clin Pharm. 2019;41(4):963–71.

Bingham J, Campbell P, Schussel K, Taylor AM, Boesen K, Harrington A, et al. The Discharge Companion Program: an interprofessional collaboration in Transitional Care Model Delivery. Pharm (Basel). 2019;7(2):68.

Google Scholar  

Farris KB, Carter BL, Xu Y, Dawson JD, Shelsky C, Weetman DB, et al. Effect of a care transition intervention by pharmacists: an RCT. BMC Health Serv Res. 2014;14:406.

Meslot C, Gauchet A, Hagger MS, Chatzisarantis N, Lehmann A, Allenet B. A Randomised Controlled Trial to test the effectiveness of planning strategies to improve Medication Adherence in patients with Cardiovascular Disease. Appl Psychol Health Well Being. 2017;9(1):106–29.

Garnier A, Rouiller N, Gachoud D, Nachar C, Voirol P, Griesser AC, et al. Effectiveness of a transition plan at discharge of patients hospitalized with heart failure: a before-and-after study. ESC Heart Fail. 2018;5(4):657–67.

Daliri S, Bekker CL, Buurman BM, Scholte Op Reimer WJM, van den Bemt BJF, Karapinar-Çarkit F. Medication management during transitions from hospital to home: a focus group study with hospital and primary healthcare providers in the Netherlands. Int J Clin Pharm. 2020.

Hansen LO, Young RS, Hinami K, Leung A, Williams MV. Interventions to reduce 30-day rehospitalization: a systematic review. Ann Intern Med. 2011;155(8):520–8.

Leppin AL, Gionfriddo MR, Kessler M, Brito JP, Mair FS, Gallacher K, et al. Preventing 30-day hospital readmissions: a systematic review and meta-analysis of randomized trials. JAMA Intern Med. 2014;174(7):1095–107.

Donzé J, John G, Genné D, Mancinetti M, Gouveia A, Méan M et al. Effects of a Multimodal Transitional Care Intervention in patients at high risk of readmission: the TARGET-READ Randomized Clinical Trial. JAMA Intern Med. 2023.

Rodrigues CR, Harrington AR, Murdock N, Holmes JT, Borzadek EZ, Calabro K, et al. Effect of pharmacy-supported transition-of-care interventions on 30-Day readmissions: a systematic review and Meta-analysis. Ann Pharmacother. 2017;51(10):866–89.

Lam MYY, Dodds LJ, Corlett SA. Engaging patients to access the community pharmacy medicine review service after discharge from hospital: a cross-sectional study in England. Int J Clin Pharm. 2019;41(4):1110–7.

Hossain LN, Fernandez-Llimos F, Luckett T, Moullin JC, Durks D, Franco-Trigo L, et al. Qualitative meta-synthesis of barriers and facilitators that influence the implementation of community pharmacy services: perspectives of patients, nurses and general medical practitioners. BMJ Open. 2017;7(9):e015471.

En-Nasery-de Heer S, Uitvlugt EB, Bet PM, van den Bemt BJF, Alai A, van den Bemt P et al. Implementation of a pharmacist-led transitional pharmaceutical care programme: process evaluation of medication actions to reduce hospital admissions through a collaboration between Community and Hospital pharmacists (MARCH). J Clin Pharm Ther. 2022.

Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med. 2011;104(12):510–20.

De Geest S, Zúñiga F, Brunkert T, Deschodt M, Zullig LL, Wyss K, et al. Powering Swiss health care for the future: implementation science to bridge the valley of death. Swiss Med Wkly. 2020;150:w20323.

Noonan VK, Lyddiatt A, Ware P, Jaglal SB, Riopelle RJ, Bingham CO 3, et al. Montreal Accord on patient-reported outcomes (PROs) use series - paper 3: patient-reported outcomes can facilitate shared decision-making and guide self-management. J Clin Epidemiol. 2017;89:125–35.

Hesselink G, Schoonhoven L, Barach P, Spijker A, Gademan P, Kalkman C, et al. Improving patient handovers from hospital to primary care: a systematic review. Ann Intern Med. 2012;157(6):417–28.

(OFSP) Interprofessionnalité dans le domaine de la santé Soins ambulatoire. Accessed 4 January 2024. https://www.bag.admin.ch/bag/fr/home/strategie-und-politik/nationale-gesundheitspolitik/foerderprogramme-der-fachkraefteinitiative-plus/foerderprogramme-interprofessionalitaet.html

Mitchell SE, Laurens V, Weigel GM, Hirschman KB, Scott AM, Nguyen HQ, et al. Care transitions from patient and caregiver perspectives. Ann Fam Med. 2018;16(3):225–31.

Davoody N, Koch S, Krakau I, Hägglund M. Post-discharge stroke patients’ information needs as input to proposing patient-centred eHealth services. BMC Med Inf Decis Mak. 2016;16:66.

Ozavci G, Bucknall T, Woodward-Kron R, Hughes C, Jorm C, Joseph K, et al. A systematic review of older patients’ experiences and perceptions of communication about managing medication across transitions of care. Res Social Adm Pharm. 2021;17(2):273–91.

Fylan B, Armitage G, Naylor D, Blenkinsopp A. A qualitative study of patient involvement in medicines management after hospital discharge: an under-recognised source of systems resilience. BMJ Qual Saf. 2018;27(7):539–46.

Fylan B, Marques I, Ismail H, Breen L, Gardner P, Armitage G, et al. Gaps, traps, bridges and props: a mixed-methods study of resilience in the medicines management system for patients with heart failure at hospital discharge. BMJ Open. 2019;9(2):e023440.

Brandberg C, Ekstedt M, Flink M. Self-management challenges following hospital discharge for patients with multimorbidity: a longitudinal qualitative study of a motivational interviewing intervention. BMJ Open. 2021;11(7):e046896.

Lawton J, Rankin D, Peel E, Douglas M. Patients’ perceptions and experiences of transitions in diabetes care: a longitudinal qualitative study. Health Expect. 2009;12(2):138–48.

Mabire C, Bachnick S, Ausserhofer D, Simon M. Patient readiness for hospital discharge and its relationship to discharge preparation and structural factors: a cross-sectional study. Int J Nurs Stud. 2019;90:13–20.

Meyers DC, Durlak JA, Wandersman A. The quality implementation framework: a synthesis of critical steps in the implementation process. Am J Community Psychol. 2012;50(3–4):462–80.

Meyer-Massetti C, Hofstetter V, Hedinger-Grogg B, Meier CR, Guglielmo BJ. Medication-related problems during transfer from hospital to home care: baseline data from Switzerland. Int J Clin Pharm. 2018;40(6):1614–20.

Neeman M, Dobrinas M, Maurer S, Tagan D, Sautebin A, Blanc AL, et al. Transition of care: a set of pharmaceutical interventions improves hospital discharge prescriptions from an internal medicine ward. Eur J Intern Med. 2017;38:30–7.

Geese F, Schmitt KU. Interprofessional Collaboration in Complex Patient Care Transition: a qualitative multi-perspective analysis. Healthc (Basel). 2023;11(3).

Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. Int J Nurs Stud. 2013;50(5):587–92.

Thomson R, Plumridge L, Holland J, Editorial. Int J Soc Res Methodol. 2003;6(3):185–7.

Audulv Å, Hall EOC, Kneck Å, Westergren T, Fegran L, Pedersen MK, et al. Qualitative longitudinal research in health research: a method study. BMC Med Res Methodol. 2022;22(1):255.

Kim H, Sefcik JS, Bradway C. Characteristics of qualitative descriptive studies: a systematic review. Res Nurs Health. 2017;40(1):23–42.

Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334–40.

Bradshaw C, Atkinson S, Doody O. Employing a qualitative description Approach in Health Care Research. Glob Qual Nurs Res. 2017;4:2333393617742282.

PubMed   PubMed Central   Google Scholar  

Bellone JM, Barner JC, Lopez DA. Postdischarge interventions by pharmacists and impact on hospital readmission rates. J Am Pharm Assoc (2003). 2012;52(3):358–62.

Hennink MM, Kaiser BN, Marconi VC. Code saturation versus meaning saturation: how many interviews are Enough? Qual Health Res. 2016;27(4):591–608.

World Health Organization. Adherence to long-term therapies: evidence for action. 2003.

Fisher JD, Fisher WA, Amico KR, Harman JJ. An information-motivation-behavioral skills model of adherence to antiretroviral therapy. Health Psychol. 2006;25(4):462–73.

Bandura A. Health promotion from the perspective of social cognitive theory. Psychol Health. 1998;13(4):623–49.

ShiftEUROQOL Research FOndation EQ 5D Instruments. Accessed 30 July 2022 https://euroqol.org/eq-5d-instruments/sample-demo/

Jeppesen KM, Coyle JD, Miser WF. Screening questions to predict limited health literacy: a cross-sectional study of patients with diabetes mellitus. Ann Fam Med. 2009;7(1):24–31.

Giordano TP, Guzman D, Clark R, Charlebois ED, Bangsberg DR. Measuring adherence to antiretroviral therapy in a diverse population using a visual analogue scale. HIV Clin Trials. 2004;5(2):74–9.

Horne R, Weinman J, Hankins M. The beliefs about medicines questionnaire: the development and evaluation of a new method for assessing the cognitive representation of medication. Psychol Health. 1999;14(1):1–24.

Horne R, Chapman SC, Parham R, Freemantle N, Forbes A, Cooper V. Understanding patients’ adherence-related beliefs about medicines prescribed for long-term conditions: a meta-analytic review of the necessity-concerns Framework. PLoS ONE. 2013;8(12):e80633.

Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Res Psychol. 2006;3(2):77–101.

Waibel S, Henao D, Aller M-B, Vargas I, Vázquez M-L. What do we know about patients’ perceptions of continuity of care? A meta-synthesis of qualitative studies. Int J Qual Health Care. 2011;24(1):39–48.

Rognan SE, Jørgensen MJ, Mathiesen L, Druedahl LC, Lie HB, Bengtsson K, et al. The way you talk, do I have a choice?’ Patient narratives of medication decision-making during hospitalization. Int J Qualitative Stud Health Well-being. 2023;18(1):2250084.

Michel B, Hemery M, Rybarczyk-Vigouret MC, Wehrle P, Beck M. Drug-dispensing problems community pharmacists face when patients are discharged from hospitals: a study about 537 prescriptions in Alsace. Int J Qual Health Care. 2016;28(6):779–84.

Bruhwiler LD, Hersberger KE, Lutters M. Hospital discharge: what are the problems, information needs and objectives of community pharmacists? A mixed method approach. Pharm Pract (Granada). 2017;15(3):1046.

Knight DA, Thompson D, Mathie E, Dickinson A. Seamless care? Just a list would have helped!’ Older people and their carer’s experiences of support with medication on discharge home from hospital. Health Expect. 2013;16(3):277–91.

Gualandi R, Masella C, Viglione D, Tartaglini D. Exploring the hospital patient journey: what does the patient experience? PLoS ONE. 2019;14(12):e0224899.

Norberg H, Håkansson Lindqvist M, Gustafsson M. Older individuals’ experiences of Medication Management and Care after Discharge from Hospital: an interview study. Patient Prefer Adherence. 2023;17:781–92.

Jones KC, Austad K, Silver S, Cordova-Ramos EG, Fantasia KL, Perez DC, et al. Patient perspectives of the hospital discharge process: a qualitative study. J Patient Exp. 2023;10:23743735231171564.

Hesselink G, Flink M, Olsson M, Barach P, Dudzik-Urbaniak E, Orrego C, et al. Are patients discharged with care? A qualitative study of perceptions and experiences of patients, family members and care providers. BMJ Qual Saf. 2012;21(Suppl 1):i39–49.

Murray SA, Kendall M, Carduff E, Worth A, Harris FM, Lloyd A, et al. Use of serial qualitative interviews to understand patients’ evolving experiences and needs. BMJ. 2009;339:b3702.

Berger ZD, Boss EF, Beach MC. Communication behaviors and patient autonomy in hospital care: a qualitative study. Patient Educ Couns. 2017;100(8):1473–81.

Davis RE, Jacklin R, Sevdalis N, Vincent CA. Patient involvement in patient safety: what factors influence patient participation and engagement? Health Expect. 2007;10(3):259–67.

Greene J, Hibbard JH. Why does patient activation matter? An examination of the relationships between patient activation and health-related outcomes. J Gen Intern Med. 2012;27(5):520–6.

Mitchell SE, Gardiner PM, Sadikova E, Martin JM, Jack BW, Hibbard JH, et al. Patient activation and 30-day post-discharge hospital utilization. J Gen Intern Med. 2014;29(2):349–55.

Weir DL, Motulsky A, Abrahamowicz M, Lee TC, Morgan S, Buckeridge DL, et al. Failure to follow medication changes made at hospital discharge is associated with adverse events in 30 days. Health Serv Res. 2020;55(4):512–23.

Kripalani S, Goggins K, Nwosu S, Schildcrout J, Mixon AS, McNaughton C, et al. Medication nonadherence before hospitalization for Acute Cardiac events. J Health Commun. 2015;20(Suppl 2):34–42.

Mortelmans L, De Baetselier E, Goossens E, Dilles T. What happens after Hospital Discharge? Deficiencies in Medication Management encountered by geriatric patients with polypharmacy. Int J Environ Res Public Health. 2021;18(13).

Mortelmans L, Goossens E, Dilles T. Beliefs about medication after hospital discharge in geriatric patients with polypharmacy. Geriatr Nurs. 2022;43:280–7.

Bandiera C, Ribaut J, Dima AL, Allemann SS, Molesworth K, Kalumiya K et al. Swiss Priority setting on implementing Medication Adherence interventions as Part of the European ENABLE COST action. Int J Public Health. 2022;67.

Elliott R, Boyd M, Nde S. at e. Supporting adherence for people starting a new medication for a long-term condition through community pharmacies: a pragmaticrandomised controlled trial of the New Medicine Service. 2015.

Grimmsmann T, Schwabe U, Himmel W. The influence of hospitalisation on drug prescription in primary care–a large-scale follow-up study. Eur J Clin Pharmacol. 2007;63(8):783–90.

Larsen MD, Rosholm JU, Hallas J. The influence of comprehensive geriatric assessment on drug therapy in elderly patients. Eur J Clin Pharmacol. 2014;70(2):233–9.

Viktil KK, Blix HS, Eek AK, Davies MN, Moger TA, Reikvam A. How are drug regimen changes during hospitalisation handled after discharge: a cohort study. BMJ Open. 2012;2(6):e001461.

Strehlau AG, Larsen MD, Søndergaard J, Almarsdóttir AB, Rosholm J-U. General practitioners’ continuation and acceptance of medication changes at sectorial transitions of geriatric patients - a qualitative interview study. BMC Fam Pract. 2018;19(1):168.

Anderson TS, Lee S, Jing B, Fung K, Ngo S, Silvestrini M, et al. Prevalence of diabetes medication intensifications in older adults discharged from US Veterans Health Administration Hospitals. JAMA Netw Open. 2020;3(3):e201511.

Royal Pharmaceutical Society. Keeping patients safewhen they transfer between care providers– getting the medicines right June 2012. Accessed 27 October 2023 https://www.rpharms.com/Portals/0/RPS%20document%20library/Open%20access/Publications/Keeping%20patients%20safe%20transfer%20of%20care%20report.pdf

International Pharmaceutical Federation (FIP). Medicines reconciliation: A toolkit for pharmacists. Accessed 23 September 2023 https://www.fip.org/file/4949

Californian Pharmacist Assiociation Transitions of Care Resource Guide. https://cdn.ymaws.com/www.cshp.org/resource/resmgr/Files/Practice-Policy/For_Pharmacists/transitions_of_care_final_10.pdf

Royal Collegue of Physicians. Medication safety at hospital discharge: Improvement guide and resource. Accessed 18 September 2023 https://www.rcplondon.ac.uk/file/33421/download

Douglas N, Campbell W, Hinckley J. Implementation science: buzzword or game changer. J Speech Lang Hear Res. 2015;58.

Download references

Acknowledgements

The authors would like to thank all the patients who took part in this study. We would also like to thank the Geneva University Hospitals Patients Partners + 3P platform as well as Mrs. Tourane Corbière and Mr. Joël Mermoud, patient partners, who reviewed interview guides for clarity and significance. We would like to thank Samuel Fabbi, Vitcoryavarman Koh, and Pierre Repiton for the transcriptions of the audio recordings.

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Open access funding provided by University of Geneva

Author information

Authors and affiliations.

School of Pharmaceutical Sciences, University of Geneva, Geneva, Switzerland

Léa Solh Dost & Marie P. Schneider

Institute of Pharmaceutical Sciences of Western Switzerland, University of Geneva, Geneva, Switzerland

Division of Endocrinology, Diabetes, Hypertension and Nutrition, Department of Medicine, Geneva University Hospitals, Geneva, Switzerland

Giacomo Gastaldi

You can also search for this author in PubMed   Google Scholar

Contributions

LS, GG, and MS conceptualized and designed the study. LS and GG screened and recruited participants. LS conducted the interviews. LS, GG, and MS performed data analysis and interpretation. LS drafted the manuscript and LS and MS worked on the different versions. MS and GG approved the final manuscript.

Corresponding authors

Correspondence to Léa Solh Dost or Marie P. Schneider .

Ethics declarations

Ethics approval and consent to participate.

Ethics approval was sought and granted by the Cantonal Research Ethics Commission, Geneva (CCER) (2020 − 01779), and informed consent to participate was obtained from all participants.

Consent for publication

Informed consent for publication was obtained from all participants.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Supplementary material 2, supplementary material 3, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Solh Dost, L., Gastaldi, G. & Schneider, M. Patient medication management, understanding and adherence during the transition from hospital to outpatient care - a qualitative longitudinal study in polymorbid patients with type 2 diabetes. BMC Health Serv Res 24 , 620 (2024). https://doi.org/10.1186/s12913-024-10784-9

Download citation

Received : 28 June 2023

Accepted : 26 February 2024

Published : 13 May 2024

DOI : https://doi.org/10.1186/s12913-024-10784-9

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Continuity of care
• Transition of care
• Patient discharge
• Medication management
• Medication adherence
• Qualitative research
• Longitudinal studies
• Patient-centered care
• Interprofessional collaboration
• Type 2 diabetes

BMC Health Services Research

ISSN: 1472-6963

• General enquiries: [email protected]

• Open access
• Published: 17 May 2024

Towards inclusive learning environments in post-graduate medical education: stakeholder-driven strategies in Dutch GP-specialty training

• N.M. van Moppes   ORCID: orcid.org/0000-0003-3457-7724 1 ,
• M. Nasori   ORCID: orcid.org/0000-0001-8559-1791 1 ,
• J. Bont   ORCID: orcid.org/0000-0002-5358-0235 1 ,
• J.M. van Es 1 ,
• M.R.M. Visser 1 &
• M.E.T.C. van den Muijsenbergh   ORCID: orcid.org/0000-0002-4994-4008 2 , 3  

BMC Medical Education volume  24 , Article number:  550 ( 2024 ) Cite this article

148 Accesses

Metrics details

A recent study found that ethnic minority General Practice (GP)-trainees receive more negative assessments than their majority peers. Previous qualitative research suggested that learning climate-related factors play a pivotal role in unequal opportunities for trainees in post-graduate medical settings, indicating that insufficient inclusivity had put minority students at risk of failure and dropout.

Study objectives

We aimed to develop broadly supported strategies for an inclusive learning climate in Dutch GP-specialty training.

We employed Participatory Action Research (PAR)-methods, incorporating Participatory Learning and Action (PLA)-techniques to ensure equal voices for all stakeholders in shaping Diversity, Equity, and Inclusion (DEI)-strategies for GP-specialty training. Our approach engaged stakeholders within two pilot GP-specialty training institutes across diverse roles, including management, support staff, in-faculty teachers, in-clinic supervisors, and trainees, representing ethnic minorities and the majority population. Purposeful convenience sampling formed stakeholder- and co-reader groups in two Dutch GP-specialty training institutes. Stakeholder discussion sessions were based on experiences and literature, including two relevant frameworks, and explored perspectives on the dynamics of potential ethnic minority trainees’ disadvantages and opportunities for inclusive strategies. A co-reader group commented on discussion outcomes. Consequently, a management group prioritized suggested strategies based on expected feasibility and compatibility.

Input from twelve stakeholder group sessions and thirteen co-readers led to implementation guidance for seven inclusive learning environment strategies, of which the management group prioritized three:

• Provide DEI-relevant training programs to all GP-specialty training stakeholders;

• Appoint DEI ambassadors in all layers of GP-specialty training;

• Give a significant voice to minority GP-trainees in their education.

The study’s participatory approach engaged representatives of all GP-specialty training stakeholders and identified seven inclusive learning climate strategies, of which three were prioritized for implementation in two training institutions.

Peer Review reports

Introduction

Following international migration trends [ 1 , 2 ], diversity among students and trainees is growing [ 3 , 4 ], with each of them bringing their specific cultural values, family- and migration histories [ 5 ]. However, postgraduate medical ethnic minority GP-trainees still face underrepresentation [ 3 , 4 ] and may encounter unequal opportunities for success compared to their majority peers [ 6 , 7 , 8 , 9 ]. Learning climate-related factors, notably those related to lacking inclusiveness, likely play a pivotal role in this discrepancy [ 10 , 11 , 12 ].

Educational opportunities in GP-specialty training primarily rely on in-clinic learning, encompassing formal and informal contexts. Formal learning, characterized by structured, planned, and accredited activities within educational institutions, coexists with less structured informal learning, which is self-directed and arises from in-clinic everyday experiences and interactions, often susceptible to unspoken norms. While both approaches complement each other in providing a well-rounded education, the informal context might inadvertently reflect dominant cultural values and attitudes, potentially affecting in-classroom learning [ 13 , 14 , 15 ]. Particularly for ethnic minority GP-trainees, this lacking transparency may contribute to an increased risk of facing underperformance assessments, as these unspoken norms and values may not be self-evidently familiar to them [ 10 , 11 , 12 ].

Learning environments are subject to complex dynamics. Understanding the interconnected constructs of these dynamics is crucial for implementing transformative changes [ 16 ]. Accordingly, changes for inclusive learning opportunities require input from all organizational layers [ 17 ].

With this study, we aimed to develop broadly supported recommendations for an inclusive learning climate in Dutch GP-specialty training.

We used a qualitative Participatory Action Research (PAR) approach [ 18 , 19 ], applying Participatory Learning and Action (PLA) techniques in stakeholder groups combined with insights from literature (Appendix) along with GP-trainees’ experiences related to inclusive education, to actively engage stakeholders in an inclusive dialogue [ 20 , 21 , 22 ]. This approach supported co-ownership, promoted compatibility with the organization’s actual needs, and facilitated successful implementation [ 23 ].

We employed two conceptual frameworks to shape the topic lists for stakeholder groups and guide result analysis.

The Building Equity Taxonomy (BET) framework for Diversity, Equity, and Inclusion (DEI), addressing students’ needs for equal educational opportunities, and covering the areas of physical integration, social-emotional engagement, equal learning opportunities, instructional excellence, and fostering inspired learners [ 24 , 25 ] (Fig.  1 ). This framework is relevant to various educational settings, including GP-specialty training [ 12 , 26 , 27 , 28 , 29 ].

Building Equity Taxonomy [ 24 ] compared to Maslow’s hierarchy of needs [ 25 ]

The Wensing & Grol framework implementation guidance, equivalent to the internationally recognized Consolidated Framework for Implementation Research (CFIR) [ 30 ]. It provides implementation guidance for complex organizations, including clinical healthcare and educational settings [ 30 , 31 ] (Fig.  2 ). This framework underpinned our implementation guidance, which the management team used for prioritization.

The Wensing & Groll model for implementation guidance [ 30 ]

This study took place at Amsterdam UMC’s two GP-specialty training institutes (AMC and VUmc). These institutes have demonstrated commitment to inclusiveness in their 2020–2022 annual reports, and they collaborate with the six other Dutch GP-specialty training institutes under GP-specialty Training Netherlands (HN).

One in three medical graduates in the Netherlands aims to enter GP-specialty training. In response to national medical demands, HN annually expands its acceptance of new trainees, projecting 921 in 2023 and an anticipated 1,190 in 2024, distributed across eight training institutes. About 17% of these trainees belong to ethnic minority groups, with most having completed pre-training at Dutch Medical Schools and a smaller group having graduated abroad [ 7 ]. Due to General Data Protection Regulation (GDPR) restrictions, the precise distribution of minority trainees across the eight national institutes remains undisclosed. However, a prior quantitative study indicated that by 2023, our pilot institutes showed a relatively proportional representation of Dutch GP-specialty training [ 7 ]. However, it is essential to note that qualitative research emphasizes a thorough description of the setting to enrich readers’ contextual understanding rather than strict representativeness.

The Dutch GP-specialty training program is a three-year dual-track program, supporting professional growth by combining in-clinic experience learning with one-day-a-week in-faculty education. Entry assessments aspire to guarantee the applicants’ knowledge, motivation, and Dutch proficiency. The program includes protocolled assessments, such as practical observations, systematic testing, and reviews of learning objectives.

Study population

Acknowledging the essential need of broad support for inclusive organizational changes, we engaged participants from all backgrounds represented within the organization. Our study population encompassed the ethnic majority background as well as diverse ethnic backgrounds across all organizational layers (ranging from support personnel, management, educational staff (comprising both faculty and clinical educators), and trainees themselves), divided into two stakeholder groups, one co-reader group, and a management team group (Fig.  3 ).

Participant groups

Aiming to prevent eligible participants from experiencing researchers’ pressure, researchers sent information letters to team leaders, requesting them to forward in-faculty teachers, in-clinic supervisors, supporting bureau and management personnel, and trainees. From those interested, we purposefully selected twelve participants (six in each stakeholder group), striving for diversity regarding the position in the institute, age, gender, and ethnicity [ 32 ]. Stakeholders ranged from supporting bureau and management personnel (further in this text referred to as ‘staff’) to trainees, in-faculty teachers, and in-clinic supervisors representing diverse minority backgrounds as well as the majority background.

Stakeholder groups, each representing one GP-specialty training institute, provided input for inclusive strategies. Additionally, a co-reader group comprising interested individuals not in the stakeholder groups provided further insights through written comments. These groups represented diverse organizational layers, cultural backgrounds, ages, and gender. Representatives from management teams then evaluated and prioritized the suggested strategies.

Data collection

Data collection and analysis took place from January 2021 to December 2022. Two researchers (MN, NvM) familiar with PLA-techniques facilitated six 90-minute PLA-based sessions for each stakeholder group. The sessions focused on inclusive learning environments and GP-specialty training’s inclusivity. In a cyclical process [ 33 ](Fig.  4 ), participants engaged in PLA techniques such as ice-breaking, flexible brainstorming, free-associating, direct ranking, mind-mapping, and visual evaluation. These methods facilitated sharing experiences and opinions and aligning these with relevant literature (Appendix, Table  1 ) to identify suitable inclusive strategies. After each stakeholder group session, the facilitator-researchers held debriefing sessions to reflect on their roles and identify areas for improvement. Independently, they summarized the key findings from each session and reached consensus through discussions. They presented these summaries in subsequent sessions for a member check and made adjustments based on participants’ feedback. To ensure a broader perspective, the co-reader group commented anonymously on these approved summaries, allowing them to contribute their personal perspectives, opinions, and experiences freely. Stakeholder groups then discussed and implemented these comments in their final session (Fig.  3 ).

Cyclic phases until consensus of stakeholder groups’ processes [ 33 ]

The stakeholder group topic list focused on:

Exploring :

The initial educational context;

Potential learning climate-related disparities;

Out-of-the-box wishes and key elements for an inclusive learning climate;

Strategy developing and preparing for implementation:

Recommendations for inclusive GP-specialty training;

Mapping onto the BET framework’s hierarchical levels of DEI [ 24 ](Fig.  1 );

Translating recommendations into actionable strategies.

Identifying Wensing & Grol conditions and requirements for implementation [ 30 ](Fig.  2 ).

Due to the Covid-19 pandemic, we adapted the study’s in-person design to online methods for creative brainstorming. In these virtual sessions, physical distance and potential distractions of personal environments challenged trust and commitment, especially for GP-trainees who felt vulnerable sharing ideas with in-faculty teachers, in-clinic supervisors, and staff, who might also be their assessors in daily educational contexts [ 34 ]. To address this risk, we dedicated extra time, and utilized online tools: Zoom 5.13.11 for breakout rooms, Padlet 200.0.0 for visualizing PLA techniques, and concise PowerPoint presentations for member check summaries and goal-setting [ 35 ].

The facilitator-researchers (NvM, MN) collected audio recordings and written co-reader comments. An external bureau transcribed audio-recordings verbatim.

One researcher (NvM) regularly presented our findings during periodic staff meetings. These presentations not only aimed to keep the entire team informed but also played a crucial role in garnering broader support and incorporating diverse opinions for our project.

Data analysis

Within three days after each session, we (NvM, MN, and MV) analyzed the transcribed audio recordings and written co-readers’ comments, and discussed our analyses until consensus.

To provide actionable qualitative insights while responding to ongoing participant feedback, we adopted an inductive rapid qualitative data analysis approach inspired by Hamilton’s model [ 36 , 37 , 38 , 39 ]. This method prioritizes identifying key elements and mechanisms over extensive theoretical insights. Through structured data collection using topic lists and Participatory Learning and Action (PLA) techniques, along with expedited transcription, we efficiently analyzed ideas and condensed findings into concise formats like post-interview notes and matrix summaries. Although not a traditional thematic or framework analysis, we employed theme-informed and framework-informed codes to organize data, considering context and group dynamics, which allowed us to explore interactional group dynamics and communication styles in the participants’ discourse and its points of consensus or contention within specific statements [ 40 ]. We anticipated this method, aligned with the literature, to yield qualitative outcomes as consistent and rich as traditional in-depth transcription coding while facilitating the analysis of interconnected sessions [ 36 , 41 , 42 ].

We analyzed the stakeholders’ ideas, recommendations, and their identifyed Wensing & Grol conditions and requirements for implementation to create implementation guidance [ 30 ]. This guidance encompassed analyzing organizational structure, identifying change potential and barriers, defining the target population, describing tailored DEI-strategies, estimating timelines for internalization processes and implementation, and designing evaluation methods (Fig.  2 ). Subsequently, we invited management group participants for hybrid (online and in-person) meetings, where they engaged in substantive discussions to evaluate this guidance and prioritize recommended strategies, based on the expected feasibility and compatibility with their setting.

Reflexivity and ethics

Two authors, NM and MN, identify as minority females. While their unique backgrounds enhance sensitivity towards minority peers’ experiences, a potential challenge arises where these experiences resonating with them might be more salient. To mitigate this, we organized reflective debriefing sessions addressing diverse viewpoints and emphasizing the researchers’ roles as instruments in data collection and analysis. During these sessions, we engaged in candid discussions probing our experiences, expectations, preoccupations, and opinions that could have influenced our approach to data collection and analysis.

Also, the roles of participating stakeholders may have influenced views they shared in this research process. They spanned all organizational positions, ranging from department heads to trainees, in-faculty teachers, and in-clinic supervisors, representing both, majority and minority backgrounds. While deliberately seeking these varied insights, we remained mindful of potential power dynamics influenced by different positions or ethnic backgrounds. To foster a safe space and address these dynamics, facilitators employed PLA-techniques, such as ice-breakers. Also, they established clear agreements with all stakeholder group members regarding privacy, openness to differing views, and ensuring safety. Should any commitments be breached, facilitators were trained to address them promptly. In fact, stakeholders demonstrated remarkable respect and curiosity towards understanding each other’s perspectives throughout the process.

Participant characteristics

Table  1 presents participant characteristics for the stakeholder, co-reader, and management groups. In total, 31 stakeholders participated, aged 24 to 60, including eight males, 24 staff members from diverse organizational positions, seven trainees, and 12 ethnic minority participants.

The stakeholder group sessions had an attendance rate of 97%. All co-readers responded to the request for comments. During the hybrid management group session, 40% of participants attended in-person, while 60% joined online.

Stakeholder group sessions

In line with the topic list, we organized the results into two sections: [ 1 ]Exploring and [ 2 ] Strategy developing and preparing for implementation. In Sect. 2, the stakeholders aligned their results with the BET framework and structured them according to the Wensing & Grol framework.

The initial educational context

Stakeholders defined inclusiveness in the GP-specialty training as collective curiosity and support for trainees’ unique professional identities, regardless of their characteristics or backgrounds. As preconditions for in-faculty teachers, in-clinic supervisors, and staff, participants mentioned [ 1 ] willingness to encounter emotional discomfort [ 2 ], embracing failures in order to learn, and [ 3 ] acknowledgement of unconscious bias.

‘… we will not always succeed to be without prejudice, that is allowed as long as we will put the effort in gaining awareness’ (participant 2, group 1).

Participants emphasized creating a safe learning environment where all voices, including minority voices, can be heard. They suggested reflective questions starting with:

‘ Could you imagine that…’.

Participants highlighted parallel processes whereby educators foster trainees’ personal and professional development, and GPs support patients’ individual coping styles. Such an inclusive and safe learning environment would act as a flywheel, enhancing the institute’s inclusive image and attracting prospective minority trainees, teachers, and in-clinic supervisors.

Co-readers confirmed these view points and they added their concerns regarding prioritization by some staff members:

‘I have nothing to add. I think it is essential that diversity is given a priority, that we as staff all agree that this is important. The pitfall is that some of them might not see the importance’. (co-reader 2)

Potential learning climate-related disparities

Stakeholders from ethnic minority groups expressed distress experiences in a dominant white world:

‘The GP-specialty training population is predominantly white and female; trainees, in-faculty teachers, and in-clinic supervisors even seem to resemble one another. Without them saying or acting, I continuously feel the stress of having to adapt to them, which I will never be able to’ (participant 2, group 1).

Stakeholders discussed the majority’s naivety in understanding the experience of belonging to a minority and expressed concerns about some DEI programs potentially leading to paradoxical stigmatization. They noted instances where in-faculty teachers appointed minority trainees as representatives for their cultural groups, ignoring the vast diversity within these groups. Also, participants reported stereotyping case reports:

‘They always use the example of the non-Dutch speaking overweight Moroccan mother of seven children, not engaged in any sports, who favors sweet and fatty food, and suffers from diabetes’ (participant 3, group 2).

Co-readers added that this one-sided picture made minority trainees uneasy, feeling discussed rather than equal partners in GP-training. Additionally, they emphasized that presenting DEI programs as non-mandatory, implied that diversity and inclusiveness were not necessarily integral to GP-skills requirements.

‘Mandatory inclusive training for mentors, staff, and teachers holds significant importance, signifying our commitment. Participation in these courses should be integrated into evaluations and annual interviews’. (co-reader 4)

Out-of-the-box wishes and key elements for an inclusive learning climate

Upon the invitation to make a wish:

‘Wouldn’t it be wonderful if….‘ ,

stakeholders wished for diverse staff as role models, willing to learn from each other, normalizing various meaningful insights, and embracing diverse worldviews:

‘By using these differences, we keep each other awake and open-minded in exploring possibilities; thus, we allow ourselves to grow without assuming that our paved path is always the best way at the time’ (participant 3, group 1).

Stakeholders indicated the institute’s responsibility to educate GP-trainees for a diverse patient population as an essential component of an inclusive learning environment. Key elements related to such inclusiveness were:

The GP-specialty training should represent society in all its diversity:

‘It’s been a few years since I started GP-specialty training, of course, but… I’m just digging whether I had a feeling of: “I fit in there” or: “I recognize my roots there”. These are important feelings to me to feel safe at my work- and study place’ (participant 7, group 1);

A diverse GP workforce meets patients’ appreciation for GPs they can identify with:

‘Regarding this cultural background or ethnicity, I have the impression that patients from ethnic minorities often liked that I obviously am not Dutch, they said, “oh, you are not Dutch, are you?“, it led to recognition, a little laugh, and connected us. Having a doctor just like them helped my patients to share their concerns.’ (participant 2, group 2);

GP-trainees need identifiable and diverse educational role models:

‘The moment you sit down together and see that diversity, …brings different working styles, learning styles, or communication styles… that you realize we have to do it together, the greater the diversity, the more we learn from one another, the higher we rise, the more fun and creative ideas…’ (participant 4, group 2);

Diverse GP-trainee cohorts improve mutual learning processes:

‘To me, utilizing diversity means that there’s always someone in the classroom who says, “Okay, so what if we look at it from that perspective or through those glasses?’ (participant 1, group 1).

Co-readers agreed and added that GP-specialty training already utilized diversity among in-faculty teachers to some extent:

‘Great idea! Diversity among teachers is already being leveraged to some extent. Trainees can synthesize a blend of styles and insights from different teachers and mentors. Expanding on this concept could help cultivate a more inclusive learning environment’ . (co-reader 1)

Strategy developing and preparing for implementation

Recommendations for an inclusive gp-specialty training.

Participants (stakeholders in collaboration with co-readers) made six fundamental recommendations and mapped these onto the BET framework levels to ensure all aspects of inclusive education would be covered [ 24 ] (Table  2 ).

Actionable strategies

From these recommendations, participants derived seven actionable strategies for promoting inclusive GP-specialty training (Table  3 ).

Provide a clear message of inclusiveness in all internal and external communications .

Participants explored various means and media platforms for promoting the GP-specialty training’s DEI core values (websites, ads, social media, podcasts), focusing on design, content, and appeal to the target group. They recommended involving trainees with media experience rather than exclusively hiring specialized communication consultants.

Appoint DEI ambassadors in all layers of the organization .

Participants suggested involving employees as DEI ambassadors to effectively spread DEI core values in the organization. Ambassadors would undergo comprehensive training in DEI, reflective skills, leadership, and change management. They would also attend conferences, masterclasses, join knowledge networks, and contribute to think tank initiatives as part of their preparation.

Facilitate procedures for secure incident reporting .

Participants highlighting the significant impact of unintentional discriminatory behavior, often resulting in experiencing barriers to reporting such incidents. They proposed implementing low-threshold and secure reporting procedures with targeted questions on DEI and (micro)aggression. Regular team sessions would enable open discussions based on anonymous reports, fostering inclusive education, uncovering organizational trends, and providing support for trainees who faced discrimination, microaggression, or exclusion. Confidential advisors would receive training in DEI, reflective skills, and relevant legislation.

Give a significant voice to minority trainees in ongoing program development .

Participants advised inviting minority trainees to round table discussions, fostering insider perspective exchange with mutual respect, critical reflection, and empathy. Including these diverse voices would promote resilience and professional growth and attract eligible trainees and staff from diverse backgrounds.

Assign more than one in-faculty teacher per group / in-clinic training .

GP-trainees - like all individuals - naturally mirror the behavior of significant others, such as teachers, in-clinic supervisors, or peers. Participants believed that trainees with multiple role models would outperform those with single role models. They suggested introducing dual in-faculty teachers and dual in-clinic supervisors as additional role models and an extra pair of eyes during education. To ensure success, participants recommended training programs for optimum role model utilization.

Offer ‘just-in-time’ learning .

Participants agreed that effective learning is closely related to immediate learning needs. For GP-trainees, such learning needs often arise from societal encounters in the consultation room, e.g., guiding Muslims during Ramadan while simultaneously managing diabetes or comprehending increasing PTSD symptoms around Keti Koti (Afro-Surinamese Emancipation Day). Timely incorporating these contextual factors into training programs could provide directly applicable knowledge.

Provide mandatory DEI relevant training programs for professional development .

Participants emphasized the necessity of new knowledge, skills, and attitudes. They considered within-group differences valuable learning tools for diverse personal and professional development paths. Well-trained staff and trainees could drive inclusive knowledge networks, empower the organization, and positively influence external perceptions. Thus, they recommended mandatory and tailored training programs aligned with the anticipated learning needs from the suggested strategies. Where applicable, they advised considering outsourcing.

Conditions and requirements for implementation

Participants indicated the importance of in-faculty teachers, in-clinic supervisors, and staff having the courage to be vulnerable. They emphasized the essence of transparent norms and values and a welcoming learning environment, and they highlighted an attitude of:

‘… genuinely enjoying to support a diverse population in their growth towards their professional identities’ (participant 6, group 2).

‘Implementing these ideas demands courage and vulnerability, particularly as their execution could inadvertently carry stigmatizing effects’. (co-reader 6)

In this context, they mentioned the risk of unconscious bias, which could require external expert trainers at certain stages:

‘Well, you know, I had a trainee of Moroccan descent, and it shocked me that, while I always thought to be very open, diversity-minded, and curious for everything and everyone, I found it way more difficult to connect than I’d admit. I wonder what would have helped me unveil this blind spot in an earlier stage…’ (participant 5, group 1).

‘… allow and embrace the differences, see them as opportunities that actually add learning qualities, and not take them away? So, professionalism will become more colorful, and it can be viewed from different points of view, not just the traditional, established perspectives and routes’ (participant 1, group 1).

Ultimately, we provided the management group with implementation guidance for these seven strategies, along with an analysis of the target group and context, and summaries of relevant literature on DEI best practices in educational settings (Appendix). The management team agreed that enhancing DEI should have priority in Dutch GP-specialty training:

‘We should acknowledge that we are trailing behind societal advancements in diversity. Therefore, maintaining a strong focus on this topic must stay a priority’ (participant 5, management group).

Based on these comprehensive data, the management group prioritized strategies that covered the overarching recommendations and BET-levels (detailed in Table  3 ; Fig.  1 ), which aided in selecting strategies with anticipated effectiveness. To enhance alignment with the organizational requirements and feasibility, they considered implementation requirements, staff feedback from our presentations during periodic meetings, and opportunities for synergy with existing projects in other Amsterdam UMC departments.

‘We can see that literature describes these strategies as effective and we assume that stakeholders meticulously aligned them with the institute’s needs. Let us not repeat that process but rather look into strategies that can be implemented effectively in our setting’ (participant 1, management group).

‘For each suggested strategy, this guidance envisions its coverage and practical implications. Now, it is up to us to consider how far we are willing to commit. This process prompts pertinent questions on specific effective actions’ (participant 2, management group).

The management group prioritized three strategies:

Appoint DEI ambassadors in all organizational levels,

Give a significant voice to minority trainees in ongoing program development,

Provide mandatory DEI-relevant training programs for professional development to all involved in GP-specialty training.

Summary of findings

In twelve PLA-based stakeholder sessions, participants explored perspectives on potential disparities, underlying causes, and aspirations for an inclusive learning climate in the Dutch GP-specialty training. They suggested seven strategies based on six overarching recommendations, which they presented embedded in an implementation guidance to the management group:

Provide a clear message of inclusiveness in all internal and external communications.

Appoint DEI ambassadors Footnote 1 in all layers of the organization

Facilitate procedures for secure incident reporting.

Give a significant voice to minority trainees in ongoing program development.

Assign more than one in-faculty teacher per group / in-clinic supervisor per trainee.

Offer ‘just-in-time’ learning.

Provide mandatory DEI relevant training programs for professional development.

The management team selected strategies 2, 4, and 7, deeming them most effective, feasible, and aligned with the organization’s requirements.

Comparison to existing literature

Worldwide attention to inclusive learning climates in postgraduate medical education revealed the complexity and multidimensionality of educational constructs and institutes [ 29 , 43 ]. Interpretations of formal and informal learning contexts within these environments depend on the perspectives of various stakeholders [ 15 ]. Consequently, unconsciously normalized rules and codes across all layers may implicitly exclude ethnic minority professionals and -trainees in many ways throughout their careers [ 44 ].

This paper extends the literature on inclusive GP-specialty training [ 15 , 43 , 44 ], detailing the efforts to design- and create broad support for inclusive training strategies. Like most organizational changes, implementing inclusive strategies in GP-specialty training posed challenges and demanded a focus on building confidence and trust in novel approaches [ 45 ]. Hence, understanding the values and expectations of target groups and tailoring strategies to meet their needs and aspirations was crucial. Our study involved representatives from all key stakeholders, including ethnic minority trainees, aiming to address critical research gaps and enhance knowledge quality, relevance, and impact [ 46 ]. Collaborative decisions, rooted in an equal and reciprocal partnership, empowered stakeholders, raised management team awareness and inspired the research team [ 47 ]. These effects mirror findings in previous PAR studies on inclusive primary healthcare [ 48 ] and highlight PAR’s role as a catalyst for transformative change in GP-specialty training [ 33 ].

Stakeholder insights, combined with DEI-strategy literature, underscored the need for a gradual, committed cultural shift towards inclusivity in the learning environment. Based on these insights, the management group recognized that this transformation would necessitate a set of strategies addressing inclusiveness at various levels rather than relying on one single intervention [ 26 , 28 , 49 , 50 ]. They employed our Wensing and Grol-based implementation guidance to select the following feasible strategies aligned with the GP-specialty training context as a first step in an ongoing process:

Providing mandatory DEI-relevant training programs to all stakeholders supports cultural responsiveness within all strategies to be implemented. It facilitates understanding how cultural backgrounds and experiences influence teaching and learning [ 49 ]. Ultimately, it fosters engagement and motivation to create collaborative learning environments and accommodate learners’ needs based on their diverse backgrounds [ 26 ].

Appointing DEI ambassadors in all layers of the organization has in other contexts proven to enhance the effectiveness of DEI-related strategic initiatives [ 51 ]. DEI ambassadors engage change agents within their teams, foster collaboration and effective communication, facilitate diversity goals, and involve key stakeholders in sustainable, inclusive changes [ 50 ].

Giving a significant voice to minority trainees empowers and amplifies their agency. Including their experiences and perspectives in staff meetings and brainstorming sessions is a crucial first step toward an open and innovative culture. Prior research indicated that promoting minority trainees’ participation requires supportive supervision, encouraging them to share transformative ideas [ 28 ].

Strengths and limitations

Our participatory approach fostered broad support across all organizational levels. PLA-based stakeholder discussions facilitated open dialogue, refined ideas, and sparked valuable insights. Co-reader feedback prompted stakeholder group participants to reevaluate their interpretation of specific experiences. This approach allowed diverse perspectives and theoretical idea saturation, aiding participants in identifying seven actionable strategies with high potential for effective implementation. In turn, these results allowed the management group to leverage their organizational expertise and prioritize three strategies they considered feasible and compatible with the organization’s requirements.

While most post-graduate medical education settings share similarities, contextual variations, such as educational emphasis and cultural factors, may exist, leading to potential limitations in the transferability of our findings. Nonetheless, the dynamics between informal and formal in-classroom learning remain pertinent across various postgraduate medical contexts, where in-clinic learning, shaped by day-to-day experiences and supervisor-trainee dynamics, inevitably influences formal learning objectives and settings. Also, our study’s confinement to two Dutch GP-specialty training institutes and its relatively modest participant count may require caution in the transferability of our findings to other similar settings. In light of this, it is noteworthy that statistics from a previous quantitative study suggest that by 2023, our pilot institutes closely mirrored Dutch GP-specialty training in terms of minority trainee [ 7 ]. Moreover, we provided meticulous descriptions of our setting to enhance contextual understanding, aiding in assessing transferability to similar settings. Additionally, the explicit commitment to inclusiveness by the participating GP-specialty training institutions, which could be instrumental in promoting successful implementation, could pose challenges when transferring the results to less DEI-focused settings.

Still, employing multiple sources by connecting stakeholder perspectives to relevant literature and two frameworks enabled participants to structure their thoughts and opinions on the organization’s DEI strengths and limitations, along with the opportunities and challenges for implementation. For future researchers, this approach may prove valuable in identifying overarching concepts and theories that transcend specific individuals or contexts and facilitate the assessment of the transferability of our findings to similar educational settings [ 52 , 53 , 54 , 55 ].

Implications for further research and practice

Fostering a DEI-minded culture in post-graduate medical training calls for a multifaceted strategy. As training institutes diversify and curricula address nuanced topics, skills for adeptly navigating complex conversations become increasingly critical for educational staff. The ongoing process of promoting inclusive teaching, assessment, and curriculum design abilities will necessitate the inclusion of a wide range of perspectives. Consequently, we recommend involving stakeholders from the most diverse backgrounds possible. Also, the explicit commitment to inclusiveness by the participating GP-specialty training institutions may pose challenges when transferring the results to less DEI-focused settings. Therefore, we suggest further investigation in such contexts to better understand the transferability of our results.

Ensuring high-quality, inclusive learning environments in postgraduate medical education is crucial for educational opportunities and the overall quality of healthcare [ 56 ]. However, this inclusiveness is not solely shaped by the beliefs and values of teachers; it is also intricately influenced by the complex social and cultural dynamics within educational institutions [ 29 ]. Inclusiveness strategies are catalysts for enduring cultural transformation, demanding the consistent integration of multiple strategies through incremental steps over an extended period [ 43 ]. The three strategies identified in our study, which were prioritized for implementation, represent initial strides toward instigating this cultural transformation. Subsequent phases involving evaluation, adaptation, and implementation of additional strategies are imperative for sustaining engagement in a culture of inclusive postgraduate medical education. All Dutch GP-specialty training institutes closely monitor our findings and have committed to implementing mandatory DEI-relevant training programs for their staff and trainees.

Additional research on the impact of the implemented strategies and the level of stakeholder engagement throughout the implementation phase is needed. This follow-up research should encompass inclusive teaching methods, assessment strategies, curriculum design, attitudes, and the ethnic minority trainees’ experienced inclusion aligned with the BET framework.

Engaging stakeholders in PLA-based sessions at two Dutch GP-specialty training institutes proved instrumental in identifying recommendations for an inclusive learning climate. Stakeholders identified seven tangible DEI-strategies, addressing all five BET aspects:

Provide a clear message of inclusiveness in all internal and external communications: enhances inclusive accessibility and a diverse learning community;

Appoint DEI ambassadors in all layers of the organization: promotes knowledge exchange, reflection on potential biases, and active engagement in DEI networks;

Facilitate secure DEI-incident reporting procedures;

Give a significant voice to minority trainees in ongoing program development: empowers them and creates reciprocal learning;

Assign more than one teacher per group / in-clinic training: creates multiple role models and perspectives;

Offer ‘just-in-time’ learning: fosters social and educational engagement;

Provide mandatory DEI-relevant training programs for professional development: promotes DEI-expertise and awareness among all involved.

Based on anticipated feasibility and effectiveness, the management group prioritized strategy numbers 2, 4, and 7 for implementation.

Our integrative approach supported collaborative, context-specific strategy development and prioritization, effectively balancing anticipated effectiveness and compatibility. As such, this approach will prove valuable in identifying widely supported DEI strategies within varying and complex post-graduate medical educational contexts.

Data availability

The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.

Ambassadors actively promote DEI values within teams by exchanging knowledge and experiences, enhancing expertise through training and literature, and addressing diversity cases through consultancy roles.

Abel GJ, Cohen JE. Bilateral international migration flow estimates for 200 countries. Sci Data. 2019;6(1):82.

Article   Google Scholar  

Netherlands S. How many people immigrate to the Netherlands? Web page. The Hague, the Netherlands: Statistics Netherlands; 2022. 25/03/2022.

Google Scholar  

Jabbarpour Y, Westfall J. Diversity in the Family Medicine workforce. Fam Med. 2021;53(7):640–3.

Wusu MH, Tepperberg S, Weinberg JM, Saper RB. Matching our mission: a Strategic Plan to create a Diverse Family Medicine Residency. Fam Med. 2019;51(1):31–6.

Dinos S, Ascoli M, Owiti JA, Bhui K. Assessing explanatory models and health beliefs: an essential but overlooked competency for clinicians. BJPsych Adv. 2017;23(2):106–14.

Stegers-Jager K, Steyerberg E, Cohen-Schotanus J, Themmen A. Ethnic disparities in undergraduate pre-clinical and clinical performance. Med Educ. 2012;46:575–85.

van Moppes NM, Willems S, Nasori M, Bont J, Akkermans R, van Dijk N et al. Ethnic minority GP trainees at risk for underperformance assessments: a quantitative cohort study. BJGP Open. 2023;7(1).

Esmail A, Roberts C. Academic performance of ethnic minority candidates and discrimination in the MRCGP examinations between 2010 and 2012: analysis of data. BMJ (Clinical Res ed). 2013;347:f5662.

Jones AC, Nichols AC, McNicholas CM, Stanford FC. Admissions is not enough: the racial achievement gap in Medical Education. Acad Med. 2021;96(2):176–81.

Bullock JL, Lockspeiser T, Del Pino-Jones A, Richards R, Teherani A, Hauer KE. They Don’t See a Lot of People My Color: A Mixed Methods Study of Racial/Ethnic Stereotype Threat Among Medical Students on Core Clerkships. Acad Med. 2020;95(11S Association of American Medical Colleges Learn Serve Lead: Proceedings of the 59th Annual Research in Medical Education Presentations):S58-s66.

Diaz T, Navarro JR, Chen EH. An Institutional Approach to fostering inclusion and addressing racial Bias: implications for diversity in Academic Medicine. Teach Learn Med. 2020;32(1):110–6.

Roberts L, Belonging R, Inclusion, Diversity in Medical Education. Acad Medicine: J Association Am Med Colleges. 2020;95:661–4.

Karnieli-Miller O, Vu TR, Holtman MC, Clyman SG, Inui TS. Medical students’ professionalism narratives: a window on the informal and hidden curriculum. Acad Med. 2010;85(1):124–33.

Sagasser M, Kramer A, Fluit L, Weel C, Van der Vleuten C. Self-entrustment: how trainees’ self-regulated learning supports participation in the workplace. Adv Health Sci Education: Theory Pract. 2017;22.

Schönrock-Adema J, Bouwkamp-Timmer T, Hell E, Cohen-Schotanus J. Key elements in assessing the educational environment: Where is the theory? Advances in health sciences education: theory and practice. 2012;17.

Goodyear P, Carvalho L. The Analysis of Complex Learning Environments. 2019. pp. 49–65.

Kumagai AK, Lypson ML. Beyond cultural competence: critical consciousness, social justice, and multicultural education. Acad Med. 2009;84(6):782–7.

Brydon-Miller M, Maguire P. Participatory action research: contributions to the development of practitioner inquiry in education. Educational Action Res. 2009;17(1):79–93.

Chevalier J, Buckles D. Participatory Action Research: Theory and Methods for Engaged Inquiry2019.

Bozalek V, Biersteker L. Exploring power and privilege using participatory learning and action techniques. Social Work Educ. 2010;29(5):551–72.

de Brún T, Brún M, Weel-Baumgarten E, Burns N, Dowrick C, Lionis C et al. Using Participatory Learning & Action (PLA) research techniques for inter-stakeholder dialogue in primary healthcare: an analysis of stakeholders’ experiences. Res Involv Engagem. 2017;3.

Allaham S, Kumar A, Morriss F, Lakhanpaul M, Wilson E, Sikorski C, et al. Participatory learning and action (PLA) to improve health outcomes in high-income settings: a systematic review protocol. BMJ Open. 2022;12:e050784.

Ukowitz M. Who defines innovation in education? Participatory action research and organisational learning. Educational Action Res. 2023;31(2):366–83.

Smith D, Frey N, Pumpian I, Fisher D. Building equity: policies and practices to empower all learners. ASCD; 2017.

Maslow AH. Motivation and personality. Harper & Row; 1970.

Carter P, Darling-Hammond L. Teaching diverse learners. Handbook of research on teaching. 2016:593–638.

Severiens S, Wolff R. Study success of students from ethnic minority backgrounds: an overview of explanations for differences in study careers. Routledge Int Handb High Educ. 2009:61–72.

Voogt J, Taris T, van Rensen E, Schneider M, Noordegraaf M, Schaaf MF. Speaking up, support, control and work engagement of medical residents. A structural equation modelling analysis. Med Educ. 2019;53.

Gay G. Culturally responsive teaching: theory, research, and practice. teachers college; 2018.

Wensing M, Grol R. Knowledge translation in health: how implementation science could contribute more. BMC Med. 2019;17(1):88.

Fernandez ME, Ten Hoor GA, van Lieshout S, Rodriguez SA, Beidas RS, Parcel G, et al. Implementation mapping: using intervention mapping to develop implementation strategies. Front Public Health. 2019;7:158.

Mays N, Pope C. Qualitative research in health care. Assessing quality in qualitative research. BMJ. 2000;320(7226):50–2.

Cordeiro L, Rittenmeyer L, Soares CB. Action research methodology in the health care field: a scoping review protocol. JBI Database Syst Rev Implement Rep. 2015;13(8):70–8.

Akman H, Plewa C, Conduit J. Co-creating Value in Online Innovation communities. Eur J Mark. 2018;53.

Fernandez A, Shaw G. Academic Leadership in a time of Crisis: the coronavirus and COVID-19: academic leadership in a time of crisis. J Leadersh Stud. 2020;14.

Taylor B, Henshall C, Kenyon S, Litchfield I, Greenfield S. Can rapid approaches to qualitative analysis deliver timely, valid findings to clinical leaders? A mixed methods study comparing rapid and thematic analysis. BMJ Open. 2018;8:e019993.

Brown-Johnson C, Safaeinili N, Zionts D, Holdsworth LM, Shaw JG, Asch SM, et al. The Stanford Lightning Report Method: a comparison of rapid qualitative synthesis results across four implementation evaluations. Learn Health Syst. 2020;4(2):e10210.

Lewinski AA, Crowley MJ, Miller C, Bosworth HB, Jackson GL, Steinhauser K, et al. Applied Rapid Qualitative Analysis to develop a contextually appropriate intervention and increase the likelihood of Uptake. Med Care. 2021;59:S242–51.

Nevedal A, Reardon C, Opra Widerquist M, Jackson G, Cutrona S, White B, Damschroder L. Rapid versus traditional qualitative analysis using the Consolidated Framework for Implementation Research (CFIR). Implement Sci. 2021;16.

Vicsek L. A Scheme for analyzing the results of Focus Groups. Int J Qualitative Methods. 2007;6(4):20–34.

Vindrola-Padros C, Johnson G. Rapid Techniques in Qualitative Research: a critical review of the literature. Qual Health Res. 2020;30:1596–604.

Gale R, Wu J, Erhardt T, Bounthavong M, Reardon C, Damschroder L, Midboe A. Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration. Implement Sci. 2019;14.

Miles S, Ahuja A. Learning from difference: Sharing international experiences of developments in inclusive education. The SAGE handbook of special education. 2007:131 – 45.

Waldring IE. The fine art of boundary sensitivity: second-generation professionals engaging with social boundaries in the workplace. University of Antwerp; 2018.

May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: normalization process theory. Implement Sci. 2009;4(1):29.

O’Reilly-de Brún M, de Brún T, Okonkwo E, Bonsenge-Bokanga J-S, De Almeida Silva MM, Ogbebor F, et al. Using Participatory Learning & Action research to access and engage with ‘hard to reach’ migrants in primary healthcare research. BMC Health Serv Res. 2016;16(1):25.

Weis L, Fine M. Working Method: Research and Social Justice. Working Method: Research and Social Justice. 2004:1-186.

O’Reilly-de Brún M, De Brún T. The use of Participatory Learning & Action (PLA) research in intercultural health: some examples and some questions. Engaging service-users in co-designing primary health care. 2010:27.

Lupton KL, O’Sullivan PS. How Medical Educators Can Foster Equity and Inclusion in Their Teaching: A Faculty Development Workshop Series. Acad Med. 2020;95(12S Addressing Harmful Bias and Eliminating Discrimination in Health Professions Learning Environments):S71-s6.

Kolluru S, Wanat MA, Ficzere CH, Akiyode O, Haber SL, Hayatshahi A, et al. Review of Best practices for Diversity, Equity, and inclusion committees within Colleges of Pharmacy. Am J Pharm Educ. 2023;87(4):ajpe9043.

Miguel A, Sloughter JM, Dorsey JM, Hartley R, Shih FJ, Crevier J, editors. What’s Next? From Analysis to Action. 2021 CoNECD; 2021.

Carminati L. Generalizability in qualitative research: a tale of two traditions. Qual Health Res. 2018;28(13):2094–101.

Shenton A. Strategies for ensuring trustworthiness in qualitative Research projects. Educ Inform. 2004;22:63–75.

Maxwell J. Why qualitative methods are necessary for generalization. Qualitative Psychol. 2020;8.

Polit D, Beck C. Generalization in quantitative and qualitative research: myths and strategies. Int J Nurs Stud. 2010;47:1451–8.

Brown J, Chapman T, Graham D. Becoming a new doctor: a learning or survival exercise? Med Educ. 2007;41:653–60.

Download references

Acknowledgements

We affirm that no individuals other than the listed authors provided professional writing or analysis services. Still, we thank all anonymous participants whose contributions enriched this study.

We declare that the authors have no external funding to report.

Author information

Authors and affiliations.

Amsterdam UMC location University of Amsterdam, Department of General Practice and Public Health Research Institute, Meibergdreef 9, Amsterdam, 1105 AZ, The Netherlands

N.M. van Moppes, M. Nasori, J. Bont, J.M. van Es & M.R.M. Visser

Department of General Practice, Radboud University Medical Center, Nijmegen, The Netherlands

M.E.T.C. van den Muijsenbergh

Pharos, centre of expertise on health disparities, Utrecht, The Netherlands

You can also search for this author in PubMed   Google Scholar

Contributions

All authors have made substantial contributions to the conception OR design of the work; OR the acquisition, analysis, OR interpretation of data; OR have drafted the work or substantively revised it. All authors have approved the submitted version (and any substantially modified version that involves the author’s contribution to the study); and have agreed both to be personally accountable for the author’s own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature. Contributions per author: N.M. van Moppes: Conception, Design of the work, Acquisition, Analysis and interpretation of data, Drafted the work and integrated all revisions; M. Nasori: Conception, Design of the work, Acquisition, Analysis and interpretation of data, Substantively revised the work; J. Bont: Substantively revised the work; J.M. van Es: Substantively revised the work; M.R.M. Visser: Conception, Design of the work, Substantively revised the work; M.E.T.C. van den Muijsenbergh: Conception, Design of the work, Substantively revised the work.

Corresponding author

Correspondence to N.M. van Moppes .

Ethics declarations

Ethics approval and consent for participate.

Participation in the study was voluntary, with informed consent for participation and publication obtained from all participants. The Dutch Association for Medical Training’s Ethical Review Board approved the study (file number 2020.6.1). Data handling adhered to the General Data Protection Regulation and Amsterdam UMC Clinical Research Unit procedures, and we shared the study results with all participants.

Competing interests

We declare that the authors have no competing interests as defined by BMC Medical Education or any other interests that might be perceived to influence the results and/or discussion reported in this paper.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

van Moppes, N., Nasori, M., Bont, J. et al. Towards inclusive learning environments in post-graduate medical education: stakeholder-driven strategies in Dutch GP-specialty training. BMC Med Educ 24 , 550 (2024). https://doi.org/10.1186/s12909-024-05521-z

Download citation

Received : 12 December 2023

Accepted : 06 May 2024

Published : 17 May 2024

DOI : https://doi.org/10.1186/s12909-024-05521-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Inclusive Medical Education
• Stakeholder-driven Strategies
• GP-specialty Training

BMC Medical Education

ISSN: 1472-6920

• Submission enquiries: [email protected]
• General enquiries: [email protected]