{"id":22293,"date":"2023-01-10T08:00:19","date_gmt":"2023-01-10T07:00:19","guid":{"rendered":"https:\/\/www.sciencefocus.com\/?p=134658"},"modified":"2023-01-10T09:35:11","modified_gmt":"2023-01-10T08:35:11","slug":"stop-blaming-avatar-generating-ai-for-needlessly-sexualised-images-fault-the-creators-instead","status":"publish","type":"rss_feed","link":"https:\/\/c01.purpledshub.com\/bbcsciencefocus\/rss_feed\/stop-blaming-avatar-generating-ai-for-needlessly-sexualised-images-fault-the-creators-instead\/","title":{"rendered":"Stop blaming Avatar-generating AI for needlessly sexualised images \u2013 fault the creators instead"},"content":{"rendered":"

<\/p>

By Dr Kate Darling\n \t\t<\/p>

Published: Tuesday, 10 January 2023 at 12:00 am<\/p>

\n\n

In December 2022, the Internet was abuzz with a new app. For \u00a31.79, Lensa AI would generate 50 artistic portraits based on uploaded headshots, quickly topping the download charts as users shared the pictures on social media. When some people complained of sexualised and disturbing body modifications, the app creators put up a note that they couldn\u2019t guarantee non-offensive content. But when artificial intelligence<\/a> (AI) makes blunders, this type of disclaimer isn\u2019t enough.<\/p>\n

When I tried Lensa AI\u2019s magic avatar feature for myself, I selected my gender and uploaded 10-20 headshots. It quickly returned flowered fairies, fantasy warriors, and other creative figures, all with recognisable features. Magical, indeed, except two of my images were nude, and oddly, sporting giant breasts. Other female-identifying users also reported being portrayed naked, despite uploading only professional headshots.<\/p>\n

Aside from undressing women, the app also appears to \u2018beautify\u2019 their faces and slim down their bodies. Other users reported that their dark skin was lightened, and an Asian journalist discovered that her images were overly sexualised compared to her white colleagues\u2019. From a technical perspective, it\u2019s sadly not surprising that these AI portraits incorporate harmful stereotypes, including fetishising Asian women.<\/p>\n

The reason is \u2018garbage in, garbage out\u2019, a saying that applies to most of today\u2019s AI systems. The output isn\u2019t magical, it depends mainly on what we feed into them. Lensa AI uses Stable Diffusion, a model that was trained on 5.85 billion pictures scraped from the internet. If you indiscriminately grab material from the web, you invariably wind up with an app that likes to draw big boobs on my small, perfectly fine chest.<\/p>\n

Generative AI models need such massive amounts of training data that it\u2019s difficult to curate. And while it\u2019s possible to add certain safeguards, it\u2019s impossible to anticipate everything the AI will create. In order to release these tools at all, it makes sense that companies want people to use them at their own risk. For example, Open AI\u2019s ChatGPT<\/a> website warns users that their chat tool may generate incorrect information, harmful instructions, or biased content.<\/p>\n

But these companies are also benefitting from our willingness to view the AI systems as the culprits. Because autonomous systems can make their own content and decisions, people project a lot of agency onto them. The smarter a system seems, the more we\u2019re willing to view it as an actor on its own. As a result, companies can slap a disclaimer on the front, and a lot of users will accept that it\u2019s the AI\u2019s fault when a tool creates offensive or harmful output.<\/p>\n

The issue goes well beyond \u2018magical\u2019 body edits. Chatbots, for example, have improved since Microsoft\u2019s infamous Tay began spewing racist responses within a few hours of its launch, but they still surprise users with toxic language and dangerous prompts. We know that image generators and hiring algorithms suffer from gender biases, and that the AI used in facial recognition and the criminal justice system is racist. In short, algorithms can cause real harm to people.<\/p>\n

Imagine if a zoo let a tiger loose in the city and said \u201cwe did our best to train it, but we can\u2019t guarantee the tiger won\u2019t do anything offensive.\u201d We wouldn\u2019t let them off the hook. And even more so than the tiger, an AI system doesn\u2019t make autonomous decisions in a vacuum. Humans decide how and for what purpose to design it, select its training data and parameters, and choose when to let it loose on an unsuspecting population.<\/p>\n

Companies may not be able to anticipate every outcome. But their claims that the output is simply a reflection of reality is a deflection. Lensa AI\u2019s creators say that \u201cthe man-made unfiltered data sourced online introduced the model to the existing biases of humankind. Essentially, AI is holding a mirror to our society.\u201d But is the app a reflection of society, or is it a reflection of historical bias and injustice that a company is choosing to entrench and amplify?<\/p>\n

The persistent claim that AI is neutral is not only incorrect, it obscures the fact that the above choice is not neutral, either. It\u2019s nifty to get new profile pics, and there are many more valuable and important applications for generative AI. But we don\u2019t need to shield companies from moral or legal responsibility in order to get there. In fact, it would be easier for society to lean into AI\u2019s potential if creators were accountable. So, let\u2019s stop pointing our fingers at AI and talk about who really generates the outcomes of our technological future.<\/p>\n