Interpreting a Qualitative Research Paper

Original Editor - Mariam Hashem

Top Contributors - Mariam Hashem, Kim Jackson, Ewa Jaraczewska, Mandy Roscher and Tarina van der Stockt  

Introduction

Qualitative research aims to study things in their natural setting to make sense of a phenomenon in terms of meanings people bring to them. This type of research "seeks to understand and explore rather than to explain and manipulate variables". Qualitative research involves the studied use of a variety of methods – case study, personal experience, introspective, life story, interview, observational, historical, interactional, and visual texts.

Interpreting a qualitative research paper is an analysis of the quality of the material. It allows you to understand the reliability of the research and the construction of the paper.

Characteristics of qualitative research:

• Explores meanings
• Acknowledges the researcher’s point of view (reflexivity)
• Uses interpretative methods of analysis
• Iterative process
• Contextual: concerned with the individual's perspective
• Inductive

Critical Appraisal of Qualitative Research

The qualitative researcher must:

• Eliminate subjectivity
• Acknowledge their relationship with the study/participants/data and question implications on study findings
• Discuss varied viewpoints to gain a greater range of perspectives
• Examine deviant participants and multiple coding that challenge assumptions

Trustworthiness or rigour of a study refers to the degree of confidence in data, interpretation, and methods used to ensure the quality of a study. Researchers should discuss the methods and procedures necessary for a study to be considered credible

Credibility is how confident we are in the truth of a particulars studies findings. Lincoln and Guba suggested that the trustworthiness of a study depends on 4 factors: credibility, transferability, dependability, and confirmability. These four criteria are used to appraise the accuracy of qualitative research.

This table was adopted from Cochrane library supplemental handbook guidance

Aspect	Qualitative Term	Quantitative Term
Truth value	Credibility Internal	Validity
Applicability	Transferability	External Validity or generalisability
Consistency	Dependability	Reliability
Neutrality	Confirmability	Objectivity

Techniques for imposing rigour

• Triangulation: is defined as the use of varied methods, data sources, and multiple researchers
• Reflexivity: refers to the position of the researchers in relation to the research and their interaction with the participants
• Multiple coding: refers to the use of independent researchers, calculate inter-rater reliability and idea generation
• Respondent validation: involving participants to give their opinion and interpretations to provide an overview and generate further data
• Deviant case analysis: exploring participants who might seem to be deviant from the norm and involve them in the study

Step by Step Guide to Interpreting A Qualitative Research Paper

The CASP is the Critical Appraisal Skills Programme checklists which are often used in health research. They cover many research methods, including qualitative research. They are designed to prompt the reader to reflect on different aspects of a research paper and are typically structured around three core domains:

1. The validity of the results
2. The findings of the study
3. The transferability

Analyzing the Introduction

The introduction to a research paper should give the context and reflect the importance of the research question leading up to the rationale of the research. It should also discuss the gap in the area that's been researched as well as the angle of focus.

Previous research should also be discussed and highlight similarities and limitations to explain why this research should take place and it's significance to find answers.

When interpreting the introduction, a good question to ask is whether the use of qualitative research was appropriate for this type of study or not? Qualitative methods are typically used for illuminating the actions, or subjective experiences, of participants or when looking to gain an in-depth understanding of a phenomenon.

Questions to ask when interpreting the research question:

• Is there a clear statement of the aims of the study?
• What are the goals of the study?
• What was the rationale for this research?
• How relevant is this?
• Is the research question clearly formulated? Is it important?

Sample size and participants

The norm for the sample size should not only be judged by data saturation or a rule-of-thumb, but rather their extensiveness and appropriateness for a specific qualitative research goals. When assessing the quality of research, it is important to check for the following:

• Was the sample used appropriately for its research questions?
• What were the methods of the participants' selection and recruitment?
• Was the recruitment strategy relevant to the research question?
• Was the sampling strategy justified?
• Was the sampling purposive/ theoretical?
• Was it a convenience sample?
• What were the inclusion and exclusion criteria of the study?

Data Collection

It is important to analyse whether the data collection methods were appropriate for the research objectives and settings? This involves an in-depth analysis of the methods and how did the methods influence the findings?

The study should justify the data collection method used to meet the criteria of the research question.

Data saturation is the point at which new information or themes stop to emerge. This is often under-reported by researchers in qualitative research.

Data Analysis

Characteristics of proper data analysis:

• Transparency in the analysis and interpretations
• Uses a systematic approach
• Discusses contradicted data and divergent findings
• Multiple coding
• Credibility of results
• Justified conclusion

Reflexivity

Reflexivity is an additional marker of quality. It is a self-awareness of one’s role in the research process when a researcher reflects on their own position within the research and they consider their own biases. The Consolidate Criteria for Reporting Qualitative Research( COREQ) is a checklist of the criteria for authors which contains a whole section dedicated to reflexivity.

It is unlikely that a researcher would remain completely neutral towards a topic with no opinion or viewpoint towards it at all. Reflexivity is sometimes confused with reflection. Hibbert et al offer a useful distinction between the two terms, suggesting that reflection is like a mirror image that gives the opportunity to observe and examine our ways of doing. Reflexivity, on the other hand, involves thinking about our experiences and questioning our ways of doing.

Transferability

Can the results of the study be transferred or applied to the practice?

Transferability refers to the extent that the findings of a particular qualitative study can be applied to other situations. This should be reflected in the large and variant sample size, depending on the research question.Researchers should include sufficient information about the study setting and participant characteristics. They ought to compare findings to other studies conducted in different populations. This approach allows other researchers to judge whether the findings can be applicable to their own setting.

Clarity and transparency of data analysis

Taking the following steps will ensure the study is clear of bias:

• The in-depth description and the type of analysis
• How the data were selected from the original sample?
• Is there enough data to support the findings? In qualitative research that might be in the form of quotes

The main findings should be discussed clearly in the discussion section with evidence both for and against their argument agreeing or contradicting previous literature .

Ethics

Components of the ethical research relationship

• Acknowledgement of bias
• Rigour
• Rapport and managing distress
• Respect for autonomy
• Confidentiality
• Avoidance of exploitation (being aware of power relationships

Other Checklists:

QARI software developed by the Joanna Briggs Institute,

Quality Framework UK Cabinet Office

Evaluation Tool for Qualitative Studies by Salford University