{"id":257839,"date":"2024-04-29T05:09:00","date_gmt":"2024-04-29T10:09:00","guid":{"rendered":"https:\/\/mathewingram.com\/work\/?p=257839"},"modified":"2024-11-01T13:54:30","modified_gmt":"2024-11-01T18:54:30","slug":"ai-generated-deepfakes-are-not-the-problem","status":"publish","type":"post","link":"https:\/\/mathewingram.com\/work\/2024\/04\/29\/ai-generated-deepfakes-are-not-the-problem\/","title":{"rendered":"AI-generated deepfakes are not the problem"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n\n

In December, the Financial Times<\/em> described<\/a> how a video that was posted on X in September by BD Politico, a pro-government news site in Bangladesh, showed a news anchor for something called \u201cWorld News\u201d accusing US diplomats of interfering in Bangladesh elections; the video was later shown to have been fabricated. According to the FT<\/em>, it was made using HeyGen, a video generator that can create news-style video clips featuring AI-generated avatars for as little as twenty-four dollars a month. <\/p>\n\n\n\n

It\u2019s unclear whether this deepfake or any other misinformation\u2014AI generated or otherwise\u2014had an impact on the Bangladesh election. Prime Minister Sheikh Hasina and her party were re-elected<\/a> and won an overwhelming majority of the seats in parliament, although voter turnout was also reported to be lower than in previous elections.<\/p>\n\n\n\n

Whether it\u2019s fabricated news clips like the one in Bangladesh, or fake audio clips like the one in January where a fake Joe Biden told Democrats not to vote<\/a>, deepfakes and hoaxes continue to draw a lot of attention, as does the use of AI in creating them. But there are good reasons to be skeptical\u2014not just about the amount of AI-generated deepfakes, but about the impact they are having on people\u2019s beliefs, voting behavior, etc.\u2014and some experts say that focusing on the role of AI is a mistake.<\/p>\n\n\n\n

In much of the media coverage of these deepfakes, there’s an undercurrent of fear — in some cases expressed outright and in other cases implied<\/a>. The fear seems to be that AI-generated deepfakes and hoaxes are so realistic and convincing (or soon will be) that they will distort the way that people think about elections\u2014or just about anything else. But fake photos and videos have been around for a while, long before AI came along, and it’s not clear that any of them have had much of an impact (although they have had an effect on the individuals involved in some cases<\/a>, such as revenge porn.)<\/p>\n\n\n\n

Note<\/strong>: this post was\u00a0originally published as<\/a>\u00a0the daily newsletter for the Columbia Journalism Review, where I am the chief digital writer<\/em><\/p>\n\n\n\n\n\n\n\n

Experts like Adam Thierer, a senior research fellow at George Mason University, argue that some of our fears about this kind of technology making things dramatically worse are a \u201ctechno-panic,\u201d<\/a> in the same way that parents used to be afraid that playing video games would turn their children into degenerates, and some believe that<\/a> smartphones are making teenagers depressed. Fears about what AI research could lead to\u2014including a discussion of how it might become smarter than us and decide to destroy the human race\u2014could also be playing into some of the concern<\/a>, along with skepticism about technology companies and whether they have our wellbeing in mind.<\/p>\n\n\n\n

Renee DiResta of the Stanford Internet Observatory told me there is no question that ubiquitous and cheap AI tools have made it easier than ever to create misinformation, whether it\u2019s photos or video or audio, although whether this has actually increased the overall supply of misinformation is the subject of some debate even among experts. In that sense, DiResta says, AI definitely \u201cincreases the scale of the problem, and decreases the cost, and therefore increases the number of actors\u201d who will try to create this kind of disinformation for a variety of reasons. But she and other disinformation experts don\u2019t feel that scale or volume is the main problem we should be focused on.<\/p>\n\n\n\n

Carl Miller, research director at the Centre for the Analysis of Social Media at Demos, a UK political think tank, told me that for the most part, there hasn\u2019t been an explosion of AI-generated fakes trying to change people\u2019s political views. And that\u2019s because most people have \u201ca fairly naive idea about how inference operations actually work,\u201d he said. Many people imagine that bad actors will spread \u201cconvincing yet untrue images about the world to get them to change their minds,\u201d Miller said, but in reality, influence operations don’t lie about the world to get people to change their minds, they \u201cagree with people’s worldviews, flatter them, confirm them, and then try to harness that.\u201d<\/p>\n\n\n\n

That\u2019s why, DiResta says, the most common type of AI-generated \u201cchatbot\u201d or fake Twitter account is what is known as a \u201creply guy\u201d\u2014someone who has no real thoughts or opinions of their own, but merely shows up to agree with someone else\u2019s post. DiResta says that this allows the AI chatbots to create a \u201cmajority illusion\u201d in some cases, giving the impression that a certain view is more common than it really is. Modern social media, she said, is a blend of the old broadcast model and the personal gossip networks that people have always belonged to, combining the reach of broadcast and the social power of gossip via sources that are seen as \u201cinfluencers.\u201d<\/p>\n\n\n\n

Because of what DiResta calls the \u201cmechanics of influence,\u201d how realistic a deepfake might be isn\u2019t the most critical part of what makes it convincing. The more important aspects of a given piece of disinformation are who it comes from, and how it makes people feel<\/a>, and whether this plays into their pre-existing beliefs. Influence of this kind, Miller says, is not about truth or facts, but is far more likely to talk to people \u201cat the level of kinship and belonging and friendship. It’s going to talk to them about meaning in their lives, where they fit in the world. It’s going to confirm the grievances they have [and] it\u2019s all to do with identity and emotion and social links.\u201d<\/p>\n\n\n\n

Other experts agree that even with the help of AI, creating high-quality video deepfakes is going to be the exception rather than the norm, for the simple reason that even low-quality imagery and other types of content will often work on the right audience. Henry Ajder, an expert on synthetic media and AI, told The Atlantic<\/em><\/a> that it\u2019s \u201cfar more effective to use a cruder form of media manipulation, which can be done quickly and by less sophisticated actors, than to release an expensive, hard-to-create deepfake, which actually isn\u2019t going to be as good a quality as you had hoped.\u201d<\/p>\n\n\n\n

Meta and other platforms have taken action against large networks of fake accounts, some of which appear to<\/a> come from China, which seem to be aimed at influencing people\u2019s feelings about issues. But Miller says this is not what he is worried about with AI. While AI could make it faster and easier to create these kinds of fake networks, a more powerful kind of influence will be largely unseen (and therefore difficult to moderate) because it will take place in private groups and one-on-one chats. Says Miller: \u201cMaybe you’d recruit friendships on Facebook groups, but you could easily move that to direct chat, whether on WhatsApp or Instagram or Signal.\u201d<\/p>\n\n\n\n

Some AI experts argue that AI may actually help <\/em>in the fight against disinformation rather than contribute to it. Yann LeCun, a leading thinker in modern AI and a chief scientist at Meta, made that argument in<\/a> Wired<\/em> recently; five years ago, he says, about one quarter of all the hate speech and other content\u2014including disinformation\u2014 that Facebook removed was identified by AI, and last year it was closer to 95 percent. But Miller is not as confident that AI will help fix the problems it is creating: given what he has seen in the field so far, Miller said he has virtually no confidence that \u201cany kind of automated model we can deploy would reliably spot either generated imagery or text.\u201d<\/p>\n\n\n\n

In terms of tangible steps that might reduce the amount and\/or impact of AI-generated misinformation, even some of those who are skeptical about the dangers believe that transparency rules around the use of the technology\u2014which Meta and some other platforms have recently instituted<\/a>\u2014are a good idea. If a political candidate or a supporter uses AI to create a video or audio message, that content must be labeled as such. Given the sheer quantity of content that gets uploaded to Facebook, however\u2014billions of videos and photos every day\u2014this could be difficult to enforce. And of course, this wouldn\u2019t impact the kind of one-to-one influence operations Miller describes.<\/p>\n\n\n\n

A related problem is what some call<\/a> \u201cthe liar\u2019s dividend,\u201d in which politicians and other bad actors benefit by claiming that something is a deepfake even if they know that it isn\u2019t, gambling on the public\u2019s general mistrust of online content. Miller told me that in contrast to what seems to be a growing concern that \u201ceveryone’s going to spend the next year having their worldview warped and destroyed by this avalanche of fake imagery,\u201d what is more likely is that people\u2019s trust in almost any source of information\u2014apart from a few trusted sources, friends, conspiracy theorists, etc. \u2014 will disappear.<\/p>\n\n\n\n

In other words, the real risk is not that Americans will view a growing tsunami of convincing AI-created deepfakes without knowing that they\u2019re fake and therefore be more likely to believe and share them, it’s that they may know (or suspect) that they are fake but they won\u2019t care, and will decide to share them anyway, because the message is just too funny, or rage-inducing, not to\u2014and others they are connected to via their social networks will feel similarly, and do the same. In other words, this is fundamentally a human problem rather than a technological one.<\/p>\n

<\/div>","protected":false},"excerpt":{"rendered":"

In December, the Financial Times described how a video that was posted on X in September by BD Politico, a pro-government news site in Bangladesh, showed a news anchor for something called \u201cWorld News\u201d accusing US diplomats of interfering in Bangladesh elections; the video was later shown to have been fabricated. According to the FT, … <\/p>\n

Continue reading “AI-generated deepfakes are not the problem”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_crsspst_to_mathewingramblogwordpresscom":true,"mf2_syndication":[],"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[22],"tags":[],"class_list":["post-257839","post","type-post","status-publish","format-standard","hentry","category-misc"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/posts\/257839","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/comments?post=257839"}],"version-history":[{"count":11,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/posts\/257839\/revisions"}],"predecessor-version":[{"id":266943,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/posts\/257839\/revisions\/266943"}],"wp:attachment":[{"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/media?parent=257839"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/categories?post=257839"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mathewingram.com\/work\/wp-json\/wp\/v2\/tags?post=257839"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}