Quantitative Vs Qualitative Research Methods
Quantitative Vs Qualitative Research Methods
Quantitative Vs Qualitative Research Methods
of the complexity of natural events (e.g. chemical and physical reactions, inheritance of characteristics, growth and development) a dominant method in the quest for objectivity was reductionism 3. Reductionism seeks, by reducing the number of reactants of variables in a study to the minimum to obtain incontrovertible information about a given material or interaction, and hence achieve objectivity. These approaches have come to be known as quantitative research. As scientific inquiry became more widely valued, it was applied outside natural science to important social, cultural, psychological and economic issues 1. Quantitative methods examine the effects of specified circumstances (independent variable) on an outcome of interest (dependent variable) in ways that can be expressed numerically. In these settings, causal inferences are drawn either from direct observation, as in true experiments, or from associations established through statistical analysis. They are most effective when the content is so constrained or controlled that the study events are free of any undefined influence. Under those circumstances, reproducibility is high and the results are likely to predict, reliably, the outcome of the same event in future. There should be no doubt about the enormous accomplishments of reductionist strategies and methods penetrating i n f o r m a t i o n about the f u n d a m e n t a l components of biological systems and their functional potentials. They have also yielded important diagnostic and therapeutic tools. But it is also undeniable that conventional biomedical research has not provided decisive information about the origins or management of the most prevalent contemporary medical problems, namely,
369
M. Lakshman et aL
chronic illnesses. Chronic illness, which consists Of the chronic biological abnormality (the disease) and its consequences (discomfort, disability, emotional distress, limited social function) unfolds over time. The extent of the biological abnormality and of the various consequences determines the severity and impact of the illness which quantitative research alone cannot satisfactorily capture and answer 1. Survey research now dominates socioeconomic investigations for national p l a n n i n g and program evaluation in the developing countries. Data can be quantified and aggregate results presented concisely. Sophisticated statistical methods can be used to assess relationships between the variables measured. In addition, surveys are fairly easy to design and quick to implement. Questionnaire forms are often standardized, thereby increasing the reliability, comparability, and precision of data from one region or time frame to another 4"s. Nevertheless, some of the scholars are quite open in their criticism of the use of surveys in the third world. Chen and Murray6 have devised the following descriptive definition "A rural third world survey is the careful collection, tabulation, and analysis of wild guesses, halftruths, and outright lies meticulously recorded by gullible outsiders during interviews with suspicious, intimidated, but outwardly compliant villagers". Another instance is chronic illness creating disabilities, discomforts and accumulating costs. Because it cannot be cured, it must be managed, and most management practices have both benefits and flaws.The study of chronic disease is replete with issues for which qualitative methods are pertinent. In chronic illness patient's understanding of the illness can be a crucial determinant to the designing of a treatment program and its success7. In these diverse settings, an explanation of events can almost certainly not be obtained without inquiry into the perceptions, attitudes and behaviors of those who are involved.
Quantitative Research C a n n o t A n s w e r A l l Problems! In relation to medicine, the results pertaining to an individual in even the best controlled therapeutic trial may be quite different from the average results pertaining to the group. This truism simply reflects the commonly recognized error of attributing to an individual, those properties which apply collectively to a group, and its relevance is pervasive in medical research. Yet the truism does not accurately characterize the complexity of either medical research or practice. Medicine is also concerned with group results. Clinicians know that one cannot understand a patient without knowing both the general attributes of the disease state (e.g. cancer, obstructive lung disease) and the particulars of the patient's disease and illness. The critical need is to understand where generality ends and individuality begins, and that requires merging the two types of knowledge. However, only general knowledge is revealed by randomized clinical trials, and then also in aggregate form, devoid of the informative clinical richness of a mosaic of individual patternsk
370
What is Qualitative Research? Qualitative inquiry applies to situations where relevant variables producing an outcome are not apparent or where the number of subjects or outcomes under study are insufficient for statistical analysis 15'Is. Subjects may vary in size from an individual to large groups, and the focus
Indian Joumal of Pediatrics, 2000; 67 (5)
S y n t h e s i s of Q u a n t i t a t i v e and Q u a l i t a t i v e Research Methods We can benefit enormously from the quantification of many aspects of the physical, social and psychological worlds. Indeed, it is the undeniable importance of quantitative enquiry that makes the need for improvements in its conduct so crucial. This can be achieved in three ways. First, by the development of more sophisticated statistical methods for handling quantitative data. Second, by using quantitative and qualitative methods in combination. And third, by acknowledging that some situations are inevitably beyond the scope of quantitative methods but could be investigated more appropriately by qualitative methods 2.
371
M. Lakshman et al.
In the last few years there has been considerable interest in encouraging doctors to audit their work. To promote this, many quantitative surveys were carried out to find out the views of doctors. Needless to say, when confronted with close ended questions on audit, most responded in the politically correct way and stated that they were in favour of peer review and other such noble ideals. Meanwhile, observational reports showed that little or no audit was taking place. The apparent contradiction between intent and action was explained by a qualitative enquiry involving detailed interviews with doctors of all grades and observations of clinical meetingsz~ This revealed 19 reasons why doctors were uncertain or unsupportive of audit, most of which had not been addressed in the previous quantitative studies. It suggested that unless the underlying anxieties and concerns were addressed, the introduction and acceptance of audit would continue to be unsuccessful2. Quantitative methods work best when there is a minimum of dependent variables, all under the control of the investigator, and w h e n the subjects are b o t h homogenous and passive. The problems we have been discussing in medicine arise when circumstances are different e.g. variables are diverse, only some variables are known to the investigator or are measurable, and heterogenous subjects are actively pursuing their lives in a changing environment while the study proceeds. Here, understanding the nature, strengths and interactions of the variables is usually essential. Qualitative research methods, by providing access to potentially crucial information which otherwise must be surmised by the investigator, can yield the essential understanding. They are, therefore, central and complementary components in the investigator's arsenal of toolsk Quantitative and qualitative methods can be employed sequentially or simultaneously in a single study. As an example of sequential use - when an unexplained quantitative outcome is obtained from a study, the participants can be approached to elicit an explanation and an instrument designed to test the stated reasons. Application of the instrument yields another set of quantitative data which may affirm or refute the accuracy of the reasons for the group as a whole. Current trends in clinical social science and in medical anthropolgy argue for the relevance of ethnographic research methods in the study of problems presented in primary care settings. Grounded in the experience of everyday life, qualitative methods are suited to interpreting
372
the semantics of h u m a n experience 2''22, the social determinants of cultural meanings 7, and the processes of individual and social change ~3. In addition, the qualitative methods also permit the research to be data backed, particularly with regard to bodily and health related experiences and to the natural history of illness, health and disease experiences24. Quantitative results can be misleading because insufficient attention might be paid to the way" the data were created e.g. how variables were defined, the extent of adherence to those definitions, and how the data were collected. Used in combination, qualitative methods can help to improve the accuracy and relevance of quantitative studies by increasing our understanding of the creation of quantitative data, an activity known as ethnostatistics 2. Qualitative methods supplement and complement the understandings revealed by quantitative methods and are also a fertile source of hypotheses for future inquiries of both types. Despite the distinctions between the two methodological approaches, both possess structures and means of evaluating results which, when applied correctly, are rigorous 15'25~6.In recent years, the discipline of clinical epidemiology has established the decisive importance of analyzing and evaluating clinical practice. Appropriate inclusion of qualitative modes of enquiry will greatly enhance the process. True understanding in medicine cannot be achieved without adding qualitative methods to the research arsenal. And it reiterates a canon of sound investigation, i.e. the methods employed should befit the question asked and not vice versa. Following a decline in the prevalence of breast feeding in the 1950s and 1960s (to 50-60% of mothers), Australia experienced an increase in the 1970s and 1980s, so that recent studies claim prevalence of 80% or more of breast feeding amongst mothers leaving hospitals.The incidence and duration of breast feeding in Australia are amongst the highest for western industrialized nations and higher than many developing countries. However, there is concern at current levels of cessation of breast feeding; only about 50% of Australian women are still breast feeding at 3 months. This pattern of high incidence of breast feeding in hospitals, followed by a rather dramatic decline in the first three months of the babies' lives, has been revealed by a series of quantitative studies ~7. However, ethnographic studies were conducted subsequently, looking at the issue from a cultural perspective. These revealed that the experience of
Methods of Qualitative Research Qualitative sociocultural field methods provide the "emic' observations (an insider's view) because of the sustained interaction of the researcher with the people being studied in their own language and in their own territory. Objective descriptions are drawn t h r o u g h m e t h o d s such as participant observation, life histories, content analysis and open-ended interviews. Qualitative methods also offer strong validity checks regarding the knowledge, beliefs, practices and life events of people. Some commonly used qualitative methods are listed in Table 1 along with their characteristic features. Ensuring Quality in Qualitative Research Qualitative or quantitative research methods are not complete in themselves and cannot answer the questions fully. However, there should be quality checks which would make the data valid as well as reliable. The following quality checks must be incorporated in qualitative studies.
Reason for the research and clearly formulated questions should be stated before starting a study: This needs to be taken care of in qualitative studies as well
Indian Joumal of Pediatrics, 2000; 67 (5)
M. Lakshman et al. TABLE 1. Common Qualitative Research Methods with their Characteristic Features Participant observation 9 Method where investigator is not merely a detached observer of the lives and activities of the
people under study but is also a participant in their round of daily activities. It is a key method by which the researcher can discover the relationship between knowledge, attitude and practices (KAP). Interviews and self adntniste~d ~ only providethe researcher with information about what pesple say they do, which has a variable rs4alJomhip to what they may
actually do.
9 The researcher may also have a small number of individuals from whom he/she can obtain a large amount of detailed information about particular topics or the general life of the community. 9 It is used to best advantage when it is closely linked with participant observation or other methods. The researcher needs to be able to assess the informant's status within the group under study. 9 It reveals what people think and feel, how they see events and the world around them. Interviews are type of conversations that are used to check data obtained from participant observation, to gather information about a community, and to obtain specific information about beliefs and behavior. 9 During informal interviews, the questions are usually open-ended, allowing the respondent to speak hisiher mind on the subject under discussion. 9 Advantage of informal interview techniques are when we are initiating a study and trying to learn about the behavior, beliefs and attitudes of people in a community. 9 The disadvantage of informal interview is that if the informant is not responding to set questions, it is difficult to compare and evaluate answers given by other informants. 9 The questions should be carefully tested and screened in advance followed by rewording or dropping the questions that bring ambiguous responses. 9 With constraints on time and budget resources for developing community programs it is necessary to gather qualitative data in a relatively rapid manner. 9 It may not provide a thorough analysis of local socio~ultural systems but gives the basic information about attitudes and approaches to health care services. 9 Focus group discussion is one of the methods where the participants talk with each other under the guidance of a facilitator. The purpose is to obtain in-depth information on concepts, perceptions and ideas of the group on specific topics. 9 The confidence, credibility, generalisability and degree of causal inference associated with findings from qualitative methods can be increased, and at the same time the validity and understanding of experimental methods can be enhanced if beth approaches are combined in the same study. 9 e.g. integrating the subject selection criteria of a case-control design with qualitative inquiry techniques for illuminating risk factors is referred to as "qualitative case-control". In this design the researcher selects subjects from opposing and extreme groups based on their scores on a behavioral continuum heavy drinkers of alcohol and those who abstain from drinking. This extreme or deviant case sampling technique constructs two groups quantitatively to represent contrasting characteristics on the outcome variable. 9 There have been calls for studies to expand existing understanding by identifying the underlying social and cultural determinants of the maintenance of different social behaviors. 9 An understanding of the socially and culturally determined assumptions and expectations surrounding such issues would seem to have the potential to further our understanding on them, in the context of changing social, economic and technological environment. 9 A cross sectional study is usually a simple description of the prevalence of demographic characteristics as well as health behaviom and attitudes or experiences with health services. Such studies are also known as prevalence studies or surveys. 9 The objective is usually to estimate the magnitude of a problem in a defined "target' population. 9 Cross sectional studies may provide etiologic clues' or generate etiologic hypothesis, and more complex studies will have to be pedormed to test such hypothesis. Thus the survey may be used to obtain cases and controls for case control studies. 9 Cross sectional studies have the advantage of being carried out in relatively shnrt duration. Indian Journal of Pediatrics, 2000; 67 (5)
374
shorthand or be referred to someone else's research technique. It is usually lengthy and discursive and in its absence the results cannot be interpreted. To standardize the methodology a practical manual may be developed. This minimizes the chances of some field workers resorting to short cuts in some of the recommended field work procedures like recruiting the subjects. It is essential to understand what methods were used by the researcher to analyze the data and the quality assurance measures applied. The data analysis section of qualitative research readily distinguishes sense from non-senseaS. It is not enough to present some quotes but the researcher must find a systematic way of analyzing the data and seek examples of cases which appear to contradict or challenge the theories derived from majority. In theory, data needs to be analyzed by more than one researcher to confirm that they are assigning the same meaning to the data. To increase the reliability of the analysis and to ensure accountability of the data, common procedures are to be followed during analysis as during field work. For interpreting transcripts and comparing results with external evidence, team approach is better than using some special computer sofrware. The transcripts need to be monitored for completeness from the tape recorded version for minimizing the loss of valuable data. The credibility and the clinical importance of the results needs to be established. Credibility cannot be assessed through precision and accuracy of measuring devices, nor can the significance of results via confidence intervals and numbers needed to treat, but a little more than c o m m o n sense is required to understand that the results are sensible and believable, and they actually matter in practice. Another aspect of such results is to check whether authors cite actual data or not.To improve the credibilit~ verbatim quotes are reproduced which are indexed and can be traced back to an identifiable source. The verification process is greatly facilitated by code mapping and retrieval. 'Code mapping' is the process of reading through the transcripts and m a r k i n g segments o f text corresponding to the issues of interest and any related concepts. The reliability of analysis can be improved by two or more researchers going through the same transcript and resolving the differences, if any. Most team members may u n d e r e s t i m a t e how demanding the data analysis would be in terms of time and also because of unfamiliarity with the procedures.
Indian Journal of Pediatrics, 2000; 67 (5)
So they should ideally be involved at the data analysis stage as well. The conclusions drawn from the data and the interpretation of results differ according to the research approach adopted. Quantitative research clearly distinguishes the study results so that the reader can easily differentiate between what the researcher found and what they think it means while such a distinction is rarely possible in qualitative research where results are, by definition an interpretation of the data. Thus, when assessing the validity of qualitative research it is necessary to understand whether the interpretation of data accords with the common sense and personal or cultural perspective although it is difficult because the language we use to describe things sometimes tends to assign meanings and motives which the subjects may not share. To prove that results of the research are "grounded in ev/dence" the following questions may be useful:
How well does this analysis explain why people behave in the way they do? How comprehensible would this explanation be to a though~eulparticipant in the setting? How well does the explanation cohere with what we already know?
Future Strategies
As health cape providers are increasingly expected to provide health promotion advice, not simply disease prevention counsel 29, it will be necessary for them to understand the meaning and social significance of their patients' life styles. Frequent use of qualitative methods will greatly enhance both aetiological and health services research. Failure to use has curbed the advance in medical knowledge and at times led to false trails being followed partly because of scepticism on the part of quantitative scientists about the objectivity and rigor of qualitative methods. While this view may be justified occasionally its is not a valid reason for ignoring the potential use of qualitative methods. As the statistician Turkey~~ pointed out, "far better an approximate answer to the right question than an exact answer to the wrong question". If such advice is ignored we run the risk of pursuing the measurable rather than the relevant. This would have consequences on our understanding of both the causes of diseases and how to improve health services. Good clinical thought requires recognition of the coexistence of generality and individuality. Similarly, good medical research requires recognizing the complementarity
375
M. Lakshman et al.
and inter-penetration of quantitative and qualitative methods of inquiry. When qualitative methods are clearly established in our research repertoire, the advance of medical knowledge will be greatly acceleratedL Human beings live in complex socio-cultural and religious environments. The intentions and behavior of individuals are further influenced by the economic consequences of the behavior. Hence health care practices, compliance to short or long term therapies and to existing and new technology will all be complex decisions which cannot be assessed through quantitative questionnaire or survey methodology alone. The key questions in all these situations are "why" and "how". Thus if we are interested to know why a mother does not start weaning her child by 6 months of age, how family planning services can be made more acceptable, and why a tuberculosis patient becomes irregular with his treatment in 6-12 weeks time, then the answer qualitative methodolog~ Similarl)~ the determinants of client Utilization behavior for various public health programs should preferably be investigated in depth through qualitative appraisal techniques. In this way, workable hypotheses that explain the client behavior are generated. These can be field tested through quantitative methods with adequate sample of respondents. It is deplorable that poor quality qualitative papers now appear regularly in some medical journals whose editors have climbed on the qualitative bandwagon without gaining an ability to appraise such papers 2s. Methods like focus groups should not be added as a mere sideline to a comparative basic research project simply because it has become a la mode to include a qualitative data collection component3].
REFERENCES
Carolina at Chapel Hill 1976; pp 241-262. 7. KleinmanA. The lUnestNarratives: Healing and the Human Condition. New York; Basic Books 1988. 8. Stehbens WE. Imprecision of the clinical diagnosis of coronary heart disease in epidemiology studies and atherogenesis.J Clin Epidemio11991; 41 : 999-1006. 9. Burnaud B, Feinstein AR. The r01e of diagnostic inconsistency in changing rates of occurrence for coronary heart disease.J Clin Epidemio11992; 42:929-940. 10. Mitchell R. Survey materials collected in developing countries: Sampling, measurement and interviewing obstacles in intro and international comparisons. Intern Social ScienceJournaL i965; 17 : 665-685. 11. Campbell GJ, Shrestha R, Stone L. The ~lseandMisuse of SocialScienceResearchin Nepal Centre for Nepal and Asian Studies. Kathmandu: His Majesty's Government Press 1979. 12. Stone L, Campbell GH. The use and misuse of surveys in international development: An experiment from Nepal. Human Organization 1984; 43(1) : 27-37. 13. Stone L. Cultural Repercussions of Childlessness and Low Fertility in Nepal Contributions to Nepalese Studies 1978; 5 : 7-36. 14. Bennett L. Sex and Motherhood Among the Brahmans and Chetries of East Central Nepal Contributions to Nepalese Studies. 1976; 3 : 1-52. (Speical issue:An~thropology,Health and Development) 15. SmelserNJ, The methodology of comparative analysis. In: Warwick DP, Oshermn S (eels) ComparativeResearchMethods. New Jersy: Prentice-Hall. 1973; 42-86. 16. Patton MQ. Qua~tative Evaluation and Research Methods. Newbury Park: Sage Publications 1990. 17. StraussA, Corbin J. Basicsof Qualitative Research. Newbury Park: Sage Publications, 1990. 18. Crabtree BJ, Miller WL. Doing Qualitative Research. Newbury Park: Sage Publications 1992. 19. Strong PM. The case for qualitative research. International Journal of Pharmacy Practice 1992; 1: 185-486. 20. BlackNA, Thompson E. Attitudes to medical audit: British doctors speak. Soc Sci Med 1993; 36: 849-856. 21. Good BJ, Good MD.The meaningofsymptoms:Acultural hermeneutic model for clinical practice. In: Leon Eisenberg and Arthur Kleinman eds The Relevance of Social Sciencefor Medicine Dordrecht: Rediel, 198!; 165-196. 22. Nichter M. Idioms of distress: Alternatives in the expression of psychological distress. A case study from South India. Culture Med Povhiat 1981;5(4): 379-408. 23. Wicker AW. Getting out of our conceptual ruts. American Psychologist 1985; 40(10) : 1094-1103.
Indian Journal of Pediatrics, 2000; 67 (5)
1. Holman HR. Qualitative inquiry in medical research.J C/in Epidemiol 1993; 46(1) : 29-36. 2. BlackN. Why we need qualitative research. J Epidemiol Community Health 1994; 18 : 125-126. 3. KoestlerA, Smythies JR (eds). Beyond Reductionism, New Perspectivesin the Life Sciences.New York: Hutchinson 1969. 4. Blalock HM. Social Statistics. Second Edition Tokyo: McGraw-Hill, Kogakusha 1972. 5. Johnson AW. Quantification in Cultural Anthropology: An Introduction to Research Design. Stanford: Stanford University Press 1978. 6. Chen K, Murray GE Truths and untruths in village Haiti: An experiment in third world survey research. In: John F Marshal & Steven Polgar eels. Culture, Natality and Family Planning. Carolina Population Centre, University of North
376
T H E M I I I F N N I U M A N D M E D I C I N E : T H E 1 0 M O S T I N F L U E N T I A L PERSONS No. 10: Sigmund Freud ( 1 8 5 6 - 1 9 3 9 ) - considered the founder of psychoanalysis he believed that a complex of repressed and forgotten expressions underlies all abnormal mental states and that infantile mental processes are important in later development. No. 9: Wilhelm Rontgen ( 1 8 4 5 - 1 9 2 3 ) - discoverer of X-rays in 1895 and Nobel Prize winner in physics in 1901. The value of X-rays in the diagnosis and treatment was recognised and accepted almost from the outset of their discovery. No. 8: Karl Landsteiner ( 1 8 6 8 - 1 9 4 3 ) - called the "father of blood grouping" - a concept without which blood transfusion would not be possible. In 1901, he showed that there are at IGast 3 major types of blood. Landsteiner was awarded the Noble Prize for his work in 1930. No. 7: Edward J e n n e r ( 1 7 4 9 - 1 8 2 3 ) - introduced the inoculation for smallpox at the end of the 18th century which is considered one of the greatest triumphs in the history of medicine. No. 6: Marie Curie ( 1 8 6 7 - 1 9 3 4 ) -discovered radioactivity and was given the Nobel Prize in 1903. The discovery formed the basis of radiation therapy. In 1911, she was again conferred the Nobel Prize in chemistry for her discovery of radium and polonium. No. 5: Francis Crick ( 1 9 1 6 - ) and J a m e s Watson ( 1 9 2 8 - ) - accredited with determining the molecular structure of DNA, the chemical substrate of heredity, which is regarded as the most important discovery of the 20th century in Medicine and Science. They were awarded the Nobel Prize in 1962 sharing it with Maurice Wilkins (1916). Currently, Crick is associated with the Salk Institute for Biological Studies in San Diego while Watson is the director of the Cold Spring Harbor lab in southeastern New York. No. 4: G r e g o r Mendel ( 1 8 2 2 - 1 8 4 4 ) - formulated the laws of heredity. Mendel's work laid the mathematical foundation of the science of genetics. No. 3: Rudolf Virchow ( 1 8 2 1 - 1 9 0 2 ) - founded Cellular pathology. His concept that the basis of disease is the cell, the essential functional and structural unit of the body, was of monumental importance as a basis for understanding the cause, the process and the results of the disease. No. 2: Robert Koch ( 1 8 4 3 - 1 9 1 0 ) - the first to isolate the anthrax bacillus (1876). In 1883, he published a method of preventive inoculation against this disease, in 1882 he announced the discovery of tubercle bacillus and in 1883, he discovered the cause of cholera. He was awarded the Nobel Prize in physiology or medicine in 1905. No. 1: Louis Pasteur ( 1 8 2 2 - 1 8 9 5 ) - proposed the "germ theory". He first associated a specific microorganism (bacillus) with a specific disease (anthrax). He developed the method of pasteurisation - a heating process that kills bacteria in milk, wine and other liquids. He was also a pioneer in stereochemistry. Abstracted from: Mayo Clin Proc 2000; Vol. 7 5 : 1 1 9 - 1 2 1
Indian Journal of Pediatrics, 2000; 67 (5) 377