Critical Review of Quantitative and Qualitative Research in Intelligence Quotient (I.Q.) and Cognitive Ability.
The assessment of a person’s psychological aspects such as knowledge, skills and abilities has become a central component of Psychometrics (Gavin, 2008). Early research within the psychometrics domain had as it main aim to measure intelligence (Gavin, 2008). However, subsequent developments within psychometrics have led to implementation of other measurements such as personality, academic achievement, beliefs, attitudes and quality of life (Petrides & Furnham, 2001; Gavin, 2008; Raykov & Marcoulides, 2011). Psychometric tests usually conform to a certain type of frequency distribution commonly known as normal or Gaussian distribution (Gavin, 2008). Given that researchers within the psychometric testing domain are interested in measures of central tendency (i.e. mean), this makes standard deviation an equally important measure, as it shows how data is dispersed.
Psychometric research adopting quantitative methods make use of hypothesis testing in order to measure differences between scores (Cohen, 1992). First of all researchers must find an operational definition of variables such as intelligence and then create a suitable instrument for measuring it. In this way, through hypothesis testing, a causal relationship can be established between say IQ scores and for example academic achievement (Bellinger et al, 1992). In this particular scenario IQ scores would be considered the independent variable and academic achievement the dependent one ( Gavin, 2008).Hypothesis testing looks at the probability of an event occurring within a selected population that is beyond mere chance (Gavin, 2008). For instance, when using the example of high IQ causing high academic achievement, it would imply that high academic achievement is caused by IQ and no other variable. Here the null hypothesis would be that there is no relationship between the two variables and the alternative hypothesis would postulate that there is indeed a causal relationship between the two aforementioned variables.
It is also interesting to recognise that in hypothesis testing criterion α (alpha) level for statistical significance is normally set at p≤ 0.05 (Cohen, 1995). This is thought to be the level at which the null hypothesis is rejected (5 or fewer times out of 100). This level is also described as the percentage 5%, or sometimes as the proportion 0.05. It should be noted that, although this value was historically an arbitrary choice, it has been accepted and established as a reasonably good choice (Cohen, 1990).This approach to Intelligence also paved the way for the computer/information-processing paradigm in cognitive psychology, and cognitive neuroscience and associated disciplines (Boake, 2002). Proponents of this approach postulate that the mind, brain, and cognitive ability are composed of basic quantitative structures and operations which form part of the inborn of core cognition (Plomin et al, 1994; Rowe, 1997; Nisbett et al, 2012).
However there are some fundamental flaws with the hypothesis testing as one of the most common quantitative methods for establishing causal inferences. For instance sometimes an association between two variables does not necessarily imply a causal relationship (Cohen, 1995). Moreover there can also be concurrent variables which can help explain IQ scores among individuals. For instance early childhood relational traumas are thought to hinder brain and cognitive development (Chong, 2015). More specifically early relational traumas act as yet another variable which could provide an alternative explanation for the apparent association between IQ scores and academic achievement (Nelson, 2015). Another issue could be the fact that criterion α (alpha) level 0.05 may not always be an indicative probability of an event repeating itself (Cohen, 1995). It can also indicate the probability of finding the exact same population in which the studied event could repeat itself (Cohen, 1990).
Criticisms of the Quantitative Approach to IQ Research
It has been argued that psychometrics definitions and quantification of unobservable phenomena such as knowledge, skills, abilities and personality is particularly problematic ( Gavin, 2008). For instance proponents defending a qualitative approach to studying intelligence argue that its quantification can be rather problematic (Cernovsky, 1994). Researchers favouring qualitative methods to study intelligence may also regard intelligence as socially constructed as opposed to possessing a ‘real’ ontological status (Parker, 1994). This epistemological stance informs the adoption of a very common qualitative method known as Discourse Analysis (Winter et al,2015).
Discourse Analysis is a methodology which falls within the postmodern tradition (Gavin, 2008). It is thought that this method implicitly subscribes to a relativist ontology, whilst its epistemological underpinnings are social constructionist (Pereira, 2008).This method would pay careful attention to language and power relations and more specifically to the ways in which language operates to legitimise scientific discourses and empower a particular social group (Gavin, 2008). Thus, when conceptualising IQ through the lens of Discourse Analysis, qualitative researchers ( Pereira, 2008; Fox, Prilleltensky & Austin, 2009) would argue that IQ as a concept is socially constructed and that its construction is rooted in language. More specifically careful analysis of language through deconstructing discourses and uncovering hidden and inexplicit meaning in text, it appears that intelligence as a concept rests heavily on social consensus.
In a study conducted by Pereira (2008) Discourse Analysis was used as a method for ‘dissecting’ hidden power relations that favour men as ‘cleverer’ than women. In this respect Pereira (2008) analysed an article from the BBC news website which reported a study from The British Journal of Psychology. This article used key language and reference to authoritative figures in organizational psychology. When language and argument is used in such ways it simply puts forward discourses which legitimise a male dominated society. Here, Pereira pays careful attention to hidden and inexplicit discourses concerned with power relations that inevitably end up justifying unequal pay and job opportunity within organizational settings. In his paper Pereira concluded by arguing that so long as psychometric science disregards the moral and socio-political repercussions, its own scientific credibility will remain questionable.
However qualitative and constructionist approaches such as discourse analysis have also been criticised for culminating in a nihilistic relativism (Raskin, 2001), given that it provides little or no practical application to real life social situations. In contrast there are some advantages of conceptualising cognitive ability through an objectively measurable concept such as IQ. For instance, IQ measures foster the understanding of cognitive performance associated with normal and abnormal neurological development (Kline, 2013).
In conclusion, it should be noted that both quantitative and qualitative approaches to study IQ provide useful insights into understanding cognitive ability. Measuring IQ can be useful in determining fitness for carrying out certain roles within working and organizational settings. It can also enable government, health professionals, policy makers and key stakeholders to identify individuals who may require key support due to cognitive deficits or other cognitive-based disabilities which may affect quality of life. However qualitative methods such as Discourse Analysis provide useful insights into understanding how some scientific discourses are legitimised more through argument than credible evidence.
Bellinger, D. C., Stiles, K. M., & Needleman, H. L. (1992). Low-level lead exposure, intelligence and academic achievement: a long-term follow-up study. Paediatrics, 90(6), 855-861.
Boake, C. (2002). From the Binet–Simon to the Wechsler–Bellevue: Tracing the history of intelligence testing. Journal of Clinical and Experimental Neuropsychology, 24(3), 383-405.
Chong, C. Y. J. (2015). Why art psychotherapy? Through the lens of interpersonal neurobiology: The distinctive role of art psychotherapy intervention for clients with early relational trauma. International Journal of Art Therapy, 20(3), 118-126.
Cohen, J. (1990). Things I have learned (so far). American psychologist, 45(12), 1304.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155.
Cohen, Jacob. (1995) The earth is round (p<. 05): Rejoinder. p.1103.
Fox, D., Prilleltensky, I., & Austin, S. (Eds.). (2009). Critical psychology: An introduction. Sage.
Galton F (1969) Hereditary Genius. Macmillan, London
Gavin, H. (2008). Understanding research methods and statistics in psychology. Sage.
Gray, G., McGuinness, C., & Owende, P. (2013). An investigation of psychometric measures for modelling academic performance in tertiary education. In Educational Data Mining 2013.
Kline, P. (2013) Intelligence: The psychometric View. London: Routledge
Moore D.S. (2015) The developing genome: an introduction to behavioral genetics. Oxford University Press, New York
Nelson, K. (2015). Quantitative and qualitative research in psychological science. Biological Theory, 10(3), 263-272.
Nisbett, R. E., Aronson, J., Blair, C., Dickens, W., Flynn, J., Halpern, D. F., & Turkheimer, E. (2012). Intelligence: new findings and theoretical developments. American Psychologist, 67(2), 130-159.
Parker, I. (1994) Reflexive research and the grounding of analysis: Social psychology and psy-complex. Journal of Community and Applied social Psychology,4(4),239-52
Pereira, M. R. D. J. (2008) Are men ‘cleverer’ than women? Deconstructing the dogma of female intellectual inferiority. Journal of Social & Psychological Sciences1 (1): 4- 23
Plomin, R., & Deary, I. J. (2015). Genetics and intelligence differences: five special findings. Molecular Psychiatry, 20(1), 98-108.
Plomin, R., McClearn, G. E., Smith, D. L., Vignetti, S., Chorney, M. J., Chorney, K. & Daniels, J. (1994). DNA markers associated with high versus low IQ: the IQ quantitative trait loci (QTL) project. Behavior genetics, 24(2), 107-118.
Raskin, J. D. (2001) On Relativism in Constructivist Psychology. Journal of Constructivist Psychology.14 (4), 285-313
Rowe, D. C. (1997)A place at the policy table? Behavior genetics and estimates of family environmental effects on IQ. Intelligence, 24,133-158.
Winter, H., Moncrieff, J. & Speed, E. (2015). “Because You’re Worth It”: A Discourse Analysis of the Gendered Rhetoric of the ADHD Woman. Qualitative Research in Psychology, 12(4), 415-434.
© Copyright Ivory Research Co Ltd. All rights reserved.
You may not copy, modify, publish, transmit, transfer or sell, reproduce, create derivative works from, distribute, perform, display, or in any way exploit any of the content of this report, in whole or in part, save as hereinafter provided. You may download or copy one copy of the report you have purchased only for your own personal use for academic study purposes only, however, you may not submit this document under your own name for academic assessment.
This also applies to any sections we add to the work that you have completed however; it does not apply to sections completed solely by you.
The statements contained herein are statements of opinion of the writer only and not the statements of Ivory Research Ltd, its officers, employees or agents. To the fullest extent permissible by law, Ivory Research Ltd hereby excludes liability for the truth or accuracy of any information provided herein, your statutory rights as a customer are not affected.