{"id":271582,"date":"2025-03-27T09:39:00","date_gmt":"2025-03-27T14:39:00","guid":{"rendered":"https:\/\/mathewingram.com\/work\/?p=271582"},"modified":"2025-03-26T19:14:00","modified_gmt":"2025-03-27T00:14:00","slug":"disinformation-isnt-a-supply-problem-its-a-demand-problem","status":"publish","type":"post","link":"https:\/\/mathewingram.com\/work\/2025\/03\/27\/disinformation-isnt-a-supply-problem-its-a-demand-problem\/","title":{"rendered":"Disinformation isn’t a supply problem it’s a demand problem"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n\n

Until a couple of years ago, you couldn\u2019t turn around without running into an academic article, university department, or even an entire nonprofit organization devoted to the evils of misinformation and its more sinister cousin, disinformation. Over the past decade or so, Facebook and YouTube have both been accused of distributing massive quantities<\/a> of both misinformation (accidentally false facts) and disinformation (deliberately false facts), that some say have played a key role in a host of different problems, from the Rohingya genocide in Myanmar or the election of Donald Trump<\/a> to anti-vaccine hysteria. YouTube in particular has been accused of \u201cradicalizing\u201d the vulnerable by sending them down disinfo \u201crabbit holes\u201d about everything from 9\/11 to the pyramids. And Facebook was widely criticized for saying in 2020 that it didn\u2019t want to become an \u201carbiter of truth\u201d<\/a> by taking down posts with misinformation.<\/p>\n\n\n\n

The amount of research in this area has declined of late, in part because of the chilling effect from lawsuits and threats issued by members of the Trump administration, who see the topic of disinformation as a cover for censorship of conservative views. Academic entities \u2014 including the Stanford Internet Observatory<\/a> \u2014 have either been shut down or dramatically downsized as a result. This is obviously bad, but I think in some ways it represents the chickens coming home to roost, after years of focusing on the sources of disinformation rather than trying to think about the root cause \u2014 in other words, seeing it primarily as a supply issue rather than a demand issue. This results in everyone spending most of their time beating up on suppliers like X and Facebook and YouTube, none of which helps to solve the underlying problems.<\/p>\n\n\n\n

As Trump and his right-wing acolytes gained traction, they reversed the polarity on the disinformation debate: instead of a well-intentioned attempt to convince Facebook and X and other platforms that they should care about the spread of false information about important topics like COVID, it became about a “woke” mob \u2014 including the Biden administration \u2014 that was forcing Facebook and the other platforms to censor free speech (I’ve written about the lawsuits launched by the Trump government and Republicans in Congress over the First Amendment implications of what is known as “jawboning,”<\/a> or attempts by officials to influence the decisions made by platforms). And once Trump was elected, companies like Meta and Google have shown that they are more than happy to jump on that bandwagon and apologize for their prior behavior.<\/p>\n\n\n\n

Note<\/strong>: This is a version of my Torment Nexus newsletter, which I send out via Ghost, the open-source publishing platform. You can see other issues and sign up here<\/a>.<\/em><\/p>\n\n\n\n\n\n\n\n

I wrote recently for The Torment Nexus about the rise of dedicated fact-checking entities, which paralleled the growing concern about misinformation and disinformation leading up to and following the 2016 election. The question I asked was<\/a> \u201cDoes fact-checking even work?\u201d and by work I mean: Can it actually change people\u2019s minds? Scientific research on this question shows that for the most part fact-checking does not do this. People believe and say and share things for a host of reasons, but a critical appraisal of all the relevant facts is pretty low on the list. This is not to say that checking facts has no impact, or that we shouldn\u2019t do it \u2014 just that we shouldn\u2019t get our hopes up too high about its effectiveness on people\u2019s desire to believe certain kinds of misinformation.<\/p>\n\n\n\n

Note<\/strong><\/em>: In case you are a first-time reader, or you forgot that you signed up for this newsletter, this is The Torment Nexus. You can find out more about me and this newsletter in <\/em>this post.<\/em><\/a> This newsletter survives solely on your contributions, so please sign up for a paying subscription or visit my Patreon, which you can <\/em>find here<\/em><\/a>. I also publish a daily email newsletter of odd or interesting links called When The Going Gets Weird, <\/em>which is here<\/em><\/a>.<\/em><\/p>\n\n\n\n

Why do people share false information?<\/h2>\n\n\n\n
\"\"<\/figure>\n\n\n\n

This is just one of the problems with mis- or disinformation: Since believing it is rarely based on the facts, correcting those facts doesn\u2019t really do much to counteract it. Why do people believe and say and share things that aren\u2019t true? In some cases, they may not know the actual facts, and these are the easiest kinds to counteract. But in plenty of cases \u2014 including some of the most powerful kinds of mis- and disinformation \u2014 people believe or say or share this kind of content because they want<\/em> to believe it, either because they see some personal benefit, or (more likely) because it conforms to some pre-existing belief, and that belief makes them a) angry; b) sad; c) happy; or d) feel smart \u2014 in other words, it makes them feel that they know something that other people don\u2019t.<\/p>\n\n\n\n

In a piece I wrote for the Columbia Journalism Review \u2014 where I was the chief digital writer \u2014 I talked about how disinformation works<\/a>, and also how politically-motivated campaigns work. It\u2019s not as simple as \u201cRussian troll farm creates fake posts on Facebook and then people vote for Trump.\u201d I wish it was that simple (and I\u2019m sure the Russians do too) because it would make the solutions easier. In some cases, the disinformation is designed without any specific political purpose \u2014 it is simply designed to cause information chaos, or to get people to mistrust the mainstream news they are getting from traditional sources. But as Carl Miller of the Centre for the Analysis of Social Media in the UK explained<\/a>, it is rarely just a stream of fake facts designed to persuade:<\/p>\n\n\n\n

\n

Many of us have \u201ca fairly naive idea about how influence operations actually work,\u201d Miller said. People may imagine that bad actors will spread convincing yet untrue images about the world to get them to change their minds, but In reality, influence operations are primarily designed to \u201cagree with people\u2019s worldviews, flatter them, confirm them, and then try to harness that.\u201d That\u2019s why, according to Ren\u00e9e DiResta, the most common type of fake account on X is what is known as a \u201creply guy\u201d \u2014 a persona with no thoughts or opinions that simply shows up to echo a post. Such accounts AI can create a \u201cmajority illusion,\u201d DiResta explained, giving the impression that a certain view is more common than it really is.<\/p>\n<\/blockquote>\n\n\n\n

In a piece for Harper’s about what he called Big Disinfo, Joe Bernstein wrote that<\/a> the most comprehensive survey of the field to date \u2014 a 2018 scientific literature review titled Social Media, Political Polarization, and Political Disinformation<\/em> \u2014 pointed out that disinformation research has to date “mostly failed to explain why opinions change, lacks solid data on the prevalence and reach of disinformation, and declines to establish common definitions for the most important terms in the field, including disinformation, misinformation, online propaganda, hyperpartisan news, fake news, clickbait, rumors, and conspiracy theories.\u201d There is a sense, Bernstein goes on to say<\/a>, that \u201cno two people who research disinformation are talking about quite the same thing.\u201d<\/p>\n\n\n\n

How do you correct a belief?<\/h2>\n\n\n\n
\"\"<\/figure>\n\n\n\n

In some cases, incorrect beliefs don’t even start with false facts, but instead an incorrect interpretation of accurate ones. Adam Kucharski wrote in The Guardian<\/a> recently that a study last year found that only 0.3% of the vaccine-related links that were viewed on Facebook in 2021 were flagged as false, and “the posts that had the biggest overall impact on vaccine confidence were factually accurate, but open to misinterpretation.” In talking to conspiracy theorists, he noted<\/a>, one of the surprising things was “how much of the evidence they have to hand is technically true. In other words, it\u2019s not always the underlying facts that are false, but the beliefs that have been derived from them.” And checking facts is child’s play compared to correcting someone’s beliefs.<\/p>\n\n\n\n

Speaking of beliefs, many people seem to believe that misinformation or disinformation can have a significant impact on elections, but as Cambridge researcher Magda Osman pointed out in a piece for<\/a> The Conversation, most academic studies don’t support this conclusion. A study published in 2023 looked at the role of misinformation in the Italian general elections in 2013 and 2018, and found that it had only a small effect on voting patterns, and mostly confirmed voters’ intentions. Similar studies of the effect of Twitter misinformation on the 2016 election in the US also showed only a small effect. Osman notes that other studies have looked at the potential influence of disinformation on elections in the Czech Republic in 2021, Kenya in 2017, South Korea in 2017, Indonesia in 2019, Malaysia in 2018, and the Philippines in 2022, and found that “it is hard to establish a reliable causal influence of fake news on voting.”<\/p>\n\n\n\n

To get back to the supply vs. demand problem, a report from the Aspen Institute\u2019s Commission on Information Disorder made what I think is a strong point<\/a>, namely that disinformation is not the root cause of society\u2019s ills but rather, \u201cexpose society\u2019s failures to overcome systemic problems, such as income inequality, racism, and corruption.\u201d Tom Rosenstiel of the University of Maryland has said that<\/a> misinformation is “not like plumbing, a problem you fix. It is a social condition, like crime.” Deutsche Welle calls disinformation<\/a> a \u201cwicked problem,\u201d meaning a problem that can’t be clearly defined or definitively solved due to its interrelated or interdependent factors. And in a 2022 piece for the Carnegie Endowment, Gavin Wilde said disinformation is<\/a> “deeply entangled with other systemic issues, where causal relationships are poorly understood, and where interventions to correct one harmful aspect create unwanted ripple effects.\u201d<\/p>\n\n\n\n

As Wilde notes, there are many tools that can be applied to the supply-side of false information, to quantify them, to measure the speed with which they spread, etc. But as they “encounter the demand-side \u2014 the behavioral economics, political psychology, cognitive science, and other drivers of human susceptibility to untruth \u2014 prevailing notions about countering disinformation tend to lose steam.” Policymakers often have reductive solutions, he says, and these often wind up<\/a> “colliding with systems that are complex by nature.” Bellingcat<\/em> founder Eliot Higgins says the biggest failure in countering disinformation is the idea that “it\u2019s the result of outside actors influencing communities, when it\u2019s really about the communities that form organically.” It’s easier to blame Russia, he said, than to “address the fundamental social issues that lead to this, especially when a lot of it is caused by real betrayals of the public trust.”<\/p>\n\n\n\n

As I tried to point out in my CJR piece<\/a>, the most difficult part about fighting disinformation is that its not really about facts, or the truth, or anything like that. As Wilde points out, researchers at Cambridge University recently\u00a0concluded<\/a>\u00a0that in many cases, people find that ignorance and self-deception have what psychologists and sociologists like to call \u201cgreater subjective utility than an accurate understanding of the world.\u201d In other words, for a variety of reasons, people often prefer things that aren’t true \u2014 even if they are presented with the actual facts. This is fairly depressing, but it suggests that focusing solely on the supply<\/em> of inaccurate information is a mistake, and that what people describe as a marketplace of ideas is often just a<\/a> \u201cmarket for rationalizations, a social structure in which agents compete to produce justifications of widely desired beliefs in exchange for money and social rewards such as attention and status.\u201d<\/p>\n\n\n\n

Got any thoughts or comments? Feel free to either leave them here, or post them on <\/em>Substack<\/em><\/a> or on my <\/em>website<\/em><\/a>, or you can also reach me on <\/em>Twitter<\/em><\/a>, <\/em>Threads<\/em><\/a>, <\/em>BlueSky<\/em><\/a> or <\/em>Mastodon<\/em><\/a>. And thanks for being a reader.<\/em><\/p>\n

<\/div>","protected":false},"excerpt":{"rendered":"

Until a couple of years ago, you couldn\u2019t turn around without running into an academic article, university department, or even an entire nonprofit organization devoted to the evils of misinformation and its more sinister cousin, disinformation. Over the past decade or so, Facebook and YouTube have both been accused of distributing massive quantities of both … <\/p>\n

Continue reading “Disinformation isn’t a supply problem it’s a demand problem”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_crsspst_to_mathewingramblogwordpresscom":true,"mf2_syndication":[],"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[20],"tags":[],"class_list":["post-271582","post","type-post","status-publish","format-standard","hentry","category-newsletters"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/posts\/271582","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/comments?post=271582"}],"version-history":[{"count":4,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/posts\/271582\/revisions"}],"predecessor-version":[{"id":271598,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/posts\/271582\/revisions\/271598"}],"wp:attachment":[{"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/media?parent=271582"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/categories?post=271582"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/tags?post=271582"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}