Fact or Fake Discussion Paper
Fact or Fake Discussion Paper
Fact or Fake Discussion Paper
Fact or Fake?
Tackling Science
Disinformation
May 2021
About this Series
May 2021
Citation
Licence
The text of this work is licensed under the terms of the Creative
Commons Attribution licence which permits unrestricted use,
provided the original author and source are credited. The
licence is available at: https://creativecommons.org/licenses/
by/4.0
1 Cf. Wardle, C. et al (2018). Information Disorder: The Essential Glossary. Harvard Kennedy School. Online Source: https://
firstdraftnews.org/wp-content/uploads/2018/07/infoDisorder_glossary.pdf (accessed 07/04/2021)
» ALLEA Discussion Paper #1: Loss of Trust? Loss of Trustworthiness? Truth and Expertise Today (2018)
» ALLEA Discussion Paper #2: Trust Within Science - Dynamics and Norms of Knowledge Production (2019)
» ALLEA Discussion Paper #3: Trust in Science and Changing Landscapes of Communication (2019)
» Conference Report: Democracy in a Digital Society - Trust, Evidence and Public Discourse (2019)
2 We use the words ‘science’ and ‘scientist’ to cover academic research in general, regardless of discipline, and thus explicitly
include the humanities and social sciences. ‘Science’ is used here in the wider sense of the German term Wissenschaft.
3 For a comprehensive guide on conspiracy theories see Lewandowsky, S., & Cook, J. (2020). The Conspiracy Theory Handbook. Online
Source: http://sks.to/conspiracy (accessed 14/04/2021)
4 Research integrity and other ‘ internal’ factors within the scientific community play an important role for trust in science and
expertise and have been discussed elsewhere (see box).
5 For examples of continuously high and even growing levels of trust in science and scientists see, for instance, Wissenschaft im
Dialog (2020). Science Barometer 2020. Online Source: https://www.wissenschaft-im-dialog.de/en/our-projects/science-barometer/science-
barometer-2020/ (accessed 06/04/2021)
Generating disinformation can be incited by different We humans are generally prone to absorbing
motivations in different actors and in numerous information that supports our established personal
combinations. The most apparent motivations are beliefs and opinions based on previous information
financial profit and ideological conviction. Both can or emotional appeal, an effect known as 'biased
at times deviate from norms of rationality and moral assimilation'8 that often leads to ‘motivated
standards when individuals ignore or are unable to reasoning’9 and may even result in self-deception.
recognise harmful consequences for others. In other This often leads to counterarguing or finding reasons
instances, the aim of disinformation is to deliberately to disparage sources of evidence. It can be both
cause confusion, instability, or mistrust for political value-based and identity-protective. Opinions can
purposes. also rely on misplaced trust, i.e., trust in authorities
Deliberate construction of false information is very that turn out to be unreliable sources of information,
difficult to prevent. When lies are generated wilfully, which may be unpleasant to admit.
the responsible individuals have already committed
themselves to fraud. Likewise, it may also be hard to We filter out information that contradicts personal
convince those who knowingly disseminate existing views with such ease that we hardly notice it. Once
misinformation to change their behaviour. In open information that we judge to be likable or convincing
societies with strong protective individual rights has been established in our minds, it becomes
and freedom of expression, it is difficult to stop difficult to replace it with diverging information, even
disinformation at its roots, except by appealing to if this new information is more accurate. Hence, we
humanitarian values and hoping that those who are by nature prone to confirmation bias. Resistance
produce and spread disinformation will consider with to new knowledge may prevail because of the
empathy the consequences for other people and then cognitive dissonance that may arise when novel facts
stop themselves and change their behaviour. contradict previous notions.10 However, bias is not the
only mechanism; it has also been proposed that a lack
Instead of finding ways to prevent disinformation of reasoning or lack of thinking in an analytic way,
from being generated in the first place, efforts will described as ‘lazy thinking’, leads to susceptibility to
have to focus on limiting the spread of disinformation disinformation.11
and minimising the damage it may cause.
By explaining and informing people that it is normal
to automatically reject new facts that contradict
8 Biased assimilation: Tendency to interpret information in a way that supports a desired conclusion. Cf. Greitemeyer, T. et al (2009).
Biased assimilation: the role of source position. Eur. J. Soc. Psychol., 39, 22–39.
9 Motivated reasoning: Constructing seemingly reasonable justifications to arrive at conclusions that you want to arrive at. Cf. Kunda,
Z. (1990). The case for motivated reasoning. Psychological Bulletin, 108(3), 480–498.
10 Cf. Wikforss, Å. (2019). Critical thinking in the post-truth era. In: Kendeou, P. et al. Misinformation and Fake News in Education,
279–304.
11 Cf. Pennycook, G., & Rand, D. G. (2019). Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning
than by motivated reasoning. Cognition, 188, 39–50.
Many misconceptions resulting from misinformation The impact of the Dunning-Kruger effect on the spread
have become established as common beliefs because of misinformation may be reduced by increased
they have a certain appeal. They are stories that appear awareness of the level of personal knowledge. The
to make sense. Knowledge gaps are challenging to aforementioned study by Kruger and Dunning shows
most people, which is why we tend to fill missing links that fact checking provides people with insights
in our chains of knowledge with invented explanations into their personal level of knowledge and can lead
rather than the acceptance that our knowledge is to a reassessment of the degree of comprehension
temporarily incomplete.12 Stories without knowledge in relation to the complexity of the matter. It also
gaps are easier to remember because they offer provides opportunities to upgrade and increase
continuous chains of explanations. Made-up stories personal knowledge. The major challenge here is to be
can usually be recognized because they are typically able to judge what is a reliable source of information.
vague about the sources of information, for instance This can be done by comparing different sources of
so-called ‘urban myths’. Furthermore, personal information and checking if these sources may have
anecdotal episodes or testimonies may have a specific underlying motivations, for example if they
strong emotional appeal. However, anecdotes cannot are run by certain interest groups, have commercial
be compared with the explanatory power of large interests or ideological agendas.
scientific investigations when it comes to determining
whether a correlation between observations also has Psychological Awareness
a causal relationship.
These features of human behaviour are well known Critical thinking skills help people evaluate premises
to many who plant and disseminate disinformation. and tackle intellectual blind spots caused by often
One countermeasure is therefore to inform potential unreliable, intuitive methods. To fight the spread of
recipients of misinformation about these human disinformation and limit its impact, we need to know
inclinations and how they are being exploited how to test the validity of information, identify, assess
by disinformers. By raising awareness of human and reconstruct arguments, and distinguish between
vulnerability, we can strive to handle these fallacies of causal and probabilistic drawing of conclusions
the human mind more efficiently and thereby protect (‘inference’).15 Teaching such skills is essential to
ourselves and others from misinformation. combat science disinformation, especially at times
of changing communication patterns and growing
Media Literacy polarisation.
A viable first step would thus be to make common New tasks for education in order to prevent the
human predispositions to being seduced by certain spread of disinformation must therefore also consider
types of information or communication strategies education about new (digital) media. One reason
known to the public and especially to young people. behind the spread of misinformation is the lack of
The psychology of information processing and experience with digital media and their underlying
behaviour should be taught in schools and discussed mechanisms and dynamics. Education programmes
in public. Special attention both in education and should focus more on (digital) media literacy.
public discussion should also be paid to the media
and recurring structural patterns of misinformation. Efforts to raise the general public's awareness and
Increased awareness may strengthen abilities to competence regarding media and information already
resist the temptation to embrace unfounded claims exist. In 2013, UNESCO initiated a global alliance
and thereby serve as consumer protection. encompassing more than 500 organizations called
the Global Alliance for Partnerships on Media and
15 Cf. Lyons, J., & Ward, B. (2017). The New Critical Thinking: An Empirically Informed Introduction. Routledge.
Information Literacy (GAPMIL). The alliance aims to disinformation, it has the potential to limit its spread
enable people to "access, find, evaluate, [and] use the in social media and elsewhere.19
information they need in ethical and effective ways;
understand the role and functions of media and other Debunking
information providers such as libraries, museums
and archives, including those on the Internet […];
Another major strategy is to respond to misinformation
understand the conditions under which media and
by explaining why it is incorrect, and to provide correct
information providers can fulfil their functions; [and]
information after this misinformation has been
critically evaluate information and media content".16
exposed and explained. If it is a case of deliberate
disinformation, it is also relevant to uncover the
Inoculation tactics and potential intentions of its sender. For
debunking to have the intended effect, it is important
To limit the harm caused by disinformation, it has to carry it out in a pedagogical way so that the correct
been shown that it is "better to prevent than to cure".17 information is not confused with the misinformation
This strategy aims to provide protection against it is intended to debunk. It is essential both to explain
falsehoods by informing people beforehand about why the misinformation is false and to provide the
misinformation tactics and presenting its contents in true information instead (see box). As mentioned
weakened form. This approach has been given a term above, the fact-based explanation should ideally
borrowed from immunology: ‘inoculation’. It is also replace the myth entirely. Naturally, the explanation
known as ‘pre-bunking’. Pre-exposure is intended to should be intelligible, i.e., it should avoid unfamiliar
trigger a cognitive process that generates counter- terms and can be aided by diagrams as a pedagogical
arguments to disinformation like a form of "cognitive tool. Multiple arguments against the misinformation
antibodies".18 The method has been shown to work in may weaken it further.20
different contexts. As it makes it possible to recognise
16 Cf. UNESCO (2021) UNESCO MIL Alliance. Online Source: https://en.unesco.org/themes/media-and-information-literacy/gapmil
(accessed 07/04/2021)
17 Cf. Van Der Linden, S. et al (2017). Inoculating against misinformation. Science, 358(6367), 1141–1142.
18 Cf. Van der Linden, S., & Roozenbeek, J. (2020). Psychological inoculation against fake news. In: Greifeneder et al. The Psychology of
Fake News: Accepting, Sharing, and Correcting Misinformation.
19 Cf. Lewandowsky, S. et al (2017). Beyond misinformation: Understanding and coping with the ‘post-truth’ era. Journal of applied
research in memory and cognition, 6(4), 353–369.
20 Cf. Lewandowsky, S. et al (2020). The Debunking Handbook 2020. Online Source: https://sks.to/db2020 (accessed 07/04/2021)
21 Cf. Pennycook G. et al (2015). On the reception and detection of pseudo-profound bullshit. Judgment and Decision Making, 10,
549–563.
22 Cf. Smith, M. & Ballard, J. (2021) Scientists and doctors are the most respected professions worldwide. Online Source: https://today.
yougov.com/topics/economy/articles-reports/2021/02/08/international-profession-perception-poll-data (accessed 07/04/2021)
23 Cf. Oreskes, N. & Conway, E. (2010) Defeating the merchants of doubt. Nature 465, 686–687.
Science’s great achievements build upon its Time is also a precious commodity for communication
ability to self-correct. This may occasionally be an professionals, e.g. for journalists and science
irritatingly slow process, and can be delayed further communicators. Nevertheless, it is essential for them
by personal and commercial interests. There is to take the time needed to check claims and sources.
usually a sufficient number of scientists who are For communicators, transmission of misinformation
eager to challenge prevailing views and question can have serious consequences for reputation and
common claims. This constant challenge ensures the trust.
progress of science. Moreover, science is a collective
enterprise, encompassing an ever growing number Biased Information and Filter Bubbles
of collaborators who not only contribute to new
discoveries and ideas, but also are a safeguard and
Social media companies have constructed algorithms
corrective measure against error and fraud. These
that constantly feed consumers with information
features of science - its continuous questioning and
similar to what they have shown interest in the past.
pursuit of new knowledge and its reliance on other
This can lead to the consolidation and amplification
scientists to confirm or refute their findings - make
of already established ideas and opinions, even if they
accusations against scientists as members of a united
are incorrect.25 Similarly, the internet offers excellent
powerful secretive conspiracy highly implausible.
opportunities for people with similar interests to
congregate and interact. Sometimes such interest
Speed of Communication in a Digital World groups meet in closed fora where content moderators
decide which information is allowed. People who ask
In our societies today, information transfer takes critical questions are blocked and discharged. When
place to an increasing extent via digital social media, repeated exposure to similar types of information
especially among younger generations. Digital is combined with filter bubbles in closed groups,
media offer excellent opportunities to disseminate confirmation bias may intensify and result in
information about science, including popular science. knowledge resistance. Thus digital media and its
Thanks to the internet, reliable and intelligible algorithms may feed a spiral of echo-chambers, filter
information is more readily available than ever before bubbles and confirmation bias, thereby facilitating
from a variety of sources, including open access yet further transmission of misinformation. Social
scientific journals and numerous popular-science media platforms may have subordinated expertise
websites and lectures (provided they are not censored to a logic of likability, leaving institutional experts
by governments). However, digital media are a mixed trailing behind.26
blessing, as they make it just as easy to propagate
false information. There is still much ongoing debate in the research
literature about how accurate the described
The speed of communication in social media means mechanisms actually are. What is clear, however, is
that little time and effort is spent on checking the that the algorithms are not under public scrutiny
quality of information and the trustworthiness of its or control, and that the platforms can change the
sources. Although it would require just a few extra world over night by changing their algorithms. That
clicks, it takes time to read, contemplate and evaluate is undeniable and should be sufficient cause for
the plausibility and reliability of the claims, and a concern.
24 For the question of how the changing media landscape affects communication patterns and trust in science see All European
Academies (2019). Trust in Science and Changing Landscapes of Communication. ALLEA Discussion Papers, 3. Berlin.
25 Cf. Lewandowsky, S. et al (2020). Technology and Democracy: Understanding the influence of online technologies on political
behaviour and decision-making. Publications Office of the European Union, Luxembourg.
26 See O’Callaghan et al (2015). Down the (white) rabbit hole: The extreme right and online recommender systems. Social Science
Computer Review, 33(4), 459–478. See also Marchal, N. & Au, H. (2020). Coronavirus EXPLAINED: YouTube, COVID-19, and the Socio-Technical
Mediation of Expertise. Social Media + Society, 6(3).
27 Cf. Serrano, W. & Gelenbe, E. (2018), The Random Neural Network in a neurocomputing application for Web search. Neurocomputing,
280, 123–134.
Science Communication and Public Communication with the public must be open and
Engagement inclusive. Open conversations on an equal footing
between scientists and nonscientists, with room
Trust in science, the recognition of trustworthy scientific for uncertainties, assumptions, values and social
information and its distinction from misinformation questions, could lead to greater mutual understanding
is always mediated. The communication practices and trust. For instance, the model of citizen assemblies
of researchers and journalists thus play a central on science based policy is designed to bring science
role in tackling science disinformation. Like any part closer to the people and engage the public, e.g.
of the media landscape, science communication on climate science.32 The virtues of openness and
is also heavily affected by the transformation intellectual humility allow for a plurality of voices
into a globalised, technologically mediated and and apply to experts even more than to the end users
commoditised environment. This transformation of information.33 However, openness and humility
provides opportunities to reach new audiences should not lead to an attitude of ‘anything goes’
with new methods, but also paves the way for the which neglects certain aforementioned (scientific)
problematic mechanisms described above and puts standards and methods.
even more financial and time pressure on science
communicators.
31 Cf. Lorenz-Spreen, P. et al (2020) How behavioural sciences can promote truth and autonomy and democratic discourse online.
Nature Human Behaviour, 4, 1102–1109.
32 See Suiter, J. et al (2016). When do deliberative citizens change their opinions? Evidence from the Irish Citizens’ Assembly.
International Political Science Review, 37(2), 198–212.
33 See Alfano, M. et al (eds.). The Routledge Handbook of Philosophy of Humility. Routledge.
34 Cf. Lewandowsky, S. et al (2015), Seepage. Climate change Denial and its Effect on the Scientific Community. Global Environmental
Change, 33, 1–13.
35 STS, Science and Technology Studies, are the study of how society, politics, and culture affect scientific research and technological
innovation, and how these, in turn, affect society, politics and culture.
36 Cf. Hansson, S. O. (2020). Social constructionism and climate science denial. European Journal for Philosophy of Science, 10(3), 1–27.
37 Cf. United Nations (2014). Human cause of global warming is near certainty, UN reports. Online Source: https://news.un.org/en/
story/2014/01/460872 (accessed 07/04/2021)
38 See, for instance, Johns Hopkins University (2021). KAP COVID. Vaccine Acceptance Around the World. Online Source: https://public.
tableau.com/views/JHUCOVID-19KAPVaccineAcceptance/VaccineAcceptanceStory (accessed 14/04/2021)
39 Cf. World Health Organization (2019). Ten threats to global health in 2019. Online Source: https://www.who.int/vietnam/news/
feature-stories/detail/ten-threats-to-global-health-in-2019 (accessed 07/04/2021)
40 Cf. Callaghan, T. et al (2021). Correlates and disparities of intention to vaccinate against COVID-19. Social science & medicine, 272,
1136–42.
41 Cf. Hornsey M. J. et al (2018). The Psychological Roots of Anti-Vaccination Attitudes: A 24-Nation Investigation. Health Psychology
37, 307–315.
42 See Lewandowsky, S. et al (2021). The COVID-19 Vaccine Communication Handbook. A practical guide for improving vaccine
communication and fighting misinformation. Online Source: https://sks.to/c19vax (accessed 14/04/2021). See also Goldenberg, M. J. (2021).
Vaccine Hesitancy: Public Trust, Expertise, and the War on Science. University of Pittsburgh Press.
43 See Leibovits T. et al (2021). COVID-19 conspiracy beliefs: Relations with anxiety, quality of life, and schemas. Personality and
Individual Differences, 175.
44 See WHO (2021). Coronavirus disease (COVID-19) advice for the public: Mythbusters. Online Source: https://www.who.int/
emergencies/diseases/novel-coronavirus-2019/advice-for-public/myth-busters. (accessed 07/04/2021). See also Lewis, T. (2020). Eight
Persistent COVID-19 Myths and Why People Believe Them. Scientific American. Online Source: https://www.scientificamerican.com/article/
eight-persistent-covid-19-myths-and-why-people-believe-them (accessed 07/04/2021)
45 See All European Academies (2017). The European Code of Conduct for Research Integrity. Online Source: https://www.allea.org/
wp-content/uploads/2017/05/ALLEA-European-Code-of-Conduct-for-Research-Integrity-2017.pdf (accessed 06/04/2021)
Naturally, policymakers may need to consider a range For policymakers it seems especially important to
of considerations, including scientific, economic, check if the sources of information have specific
cultural and social. But it should nevertheless be commercial interests or ideological agendas that
emphasized that decisions must be made on the basis may conflict with the best available evidence. Such
of the most reliable information. The negation test special interests are known for all three topics in this
proves the applicability of this concept: Who would discussion paper. For instance, conspiracy theories
dare to make decisions based on misinformation? are nurtured by stakeholders in debates about climate
change, vaccines, and Covid-19. All three matters also
High-ranking policymakers do not have expert involve commercial interests.
knowledge about all topics relevant to their
46 See the work of SAPEA and the European Commission’s Science Advice Mechanism as a prominent example: https://www.sapea.
info/. For a concise analysis of science advisory ecosystems and the science–policy interface see Gluckman, P.D. et al (2021). Brokerage at the
science–policy interface: from conceptual framework to practical guidance. Humanit Soc Sci Commun 8(84).
Member Affiliation
Jointly with its members, ALLEA seeks to improve the conditions for research,
to provide the best independent and interdisciplinary science advice available,
and to strengthen the role of science in society. In doing so, ALLEA channels the
expertise of European academies for the benefit of the research community,
decision-makers and the public. Outputs include science-based advice in
response to societally relevant topics, as well as activities to encourage scientific
cooperation, scientific reasoning and values through public engagement.
CONTACT US
+49 (0)30-3259873-72
[email protected]
www.allea.org
@ALLEA_academies