Skip to content
Search AI Powered

Latest Stories

A.I.s Tend to Be Racist and Sexist For Exactly the Reason You Think, but Now There May Be a Way to Change That

A.I.s Tend to Be Racist and Sexist For Exactly the Reason You Think, but Now There May Be a Way to Change That
Credit: Pixabay

German researchers may have a fix.

Make us preferred on Google

Artificial intelligence technology has made great strides of late, showing it can perform not just credit worthiness and shopping-behavior algorithms, but interpret what animals are saying, create nude art and even write the next installment of Game of Thrones.

However, it turns out machine learning is missing a critical component of human thought: the ability to not be sexist and racist.


Artificial intelligence has been a boon for industries such as insurance, banking and criminal justice, allowing companies and organizations to quickly and efficiently synthesize large amounts of data to determine who’s most likely to file a claim or default on a loan or in which neighborhoods a crime is more likely to occur.

However, biased results have been a growing problem. For instance, a ProPublica investigation of COMPAS (Correctional Offender Management Profiling for Alternative Sanctions), an AI algorithm frequently used in the U.S., found that the algorithm thought black people posed a higher recidivism risk than has been the case. In a different investigation by the Human Rights Data Analysis Group, crime-predicting software was found frequently sending police to low-income neighborhoods regardless of the actual rate of crime.

Many claim the problem is with the input data, not the AI itself.

“In machine learning, we have this problem of racism in and racism out,” says Chris Russell of the Alan Turing Institute in London.

A group of German researchers hopes to change that, with a new approach to keep bias out of the process of training algorithms. Niki Kilbertus of the Max Planck Institute for Intelligent Systems, and lead researcher for the project, points out that AI learns through patterns, without taking into account sensitive information such as the color of someone’s skin making them more likely to be arrested in the first place, or denied a job that could make them more credit-worthy.

“Loan decisions, risk assessments in criminal justice, insurance premiums, and more are being made in a way that disproportionately affects sex and race,” Kilbertus told New Scientist.

Due to discrimination laws and/or individuals’ reluctance to reveal their sex, race or sexuality, companies in the past have faced barriers to looking at such sensitive data, so Kilbertus’ group’s fix includes privately encrypting this information for companies using AI software. An independent regulator would then be able to check the sensitive information against the AI outputs and, if determined to be unbiased, issue a fairness certificate indicating all variables have been considered.

While the results of Kilbertus’ group’s proposal have yet to be seen, few would argue that there’s still much work to be done in adapting artificial intelligence to our increasingly complicated world.

“What’s at stake when we don’t have a greater understanding of racist and sexist disparities goes far beyond public relations snafus and occasional headlines,” Safiya Noble, author of Algorithms of Oppression, told Canadian newsmagazine The Walrus. “It means not only are companies missing out on new possibilities for deeper and more diverse consumer engagements, but they’re also likely to not recognize how their products and services are part of systems of power that can be socially damaging.”

More from News

Jensen Huang
Soeren Stache/picture alliance via Getty Images

People Are Debating Whether They Could Be Seduced By A Spy—And Their Hot Takes Are Hilariously On Point

Could you ever be seduced by a spy?

That's the question many are asking after the latest bonkers thing to hit the news: that ousted Nvidia CEO Jensen Huang had an affair with a Chinese spy—ALLEGEDLY.

Keep ReadingShow less
Tom Carney; Ron DeSantis
Mayor Tom Carney/Facebook; Tasos Katopodis/Getty Images for SiriusXM

Florida Mayor Rages After St. Patrick's Day Parade Is Canceled Thanks To DeSantis' Anti-'DEI' Law

In April of 2026, Florida MAGA Republican Governor Ron DeSantis signed the GOP authored and backed SB 1134 to take effect in January of 2027.

Dubbed the anti-DEI law, it bans Florida counties and municipalities from "funding, promoting, or taking official action" related to diversity, equity, and inclusion, which the law defines as: "with reference to race, color, sex, ethnicity, gender identity, or sexual orientation."

Keep ReadingShow less
Shakira; Abdul El-Sayed
Michael Loccisano/Getty Images; Finn Gomez/Getty Images

Shakira Just Responded To Abdul El-Sayed's Quip About 'Shakira Law'—And Fans Are Obsessed

Pop star Shakira had social media users cackling after finally responding to then-Senate candidate Abdul El-Sayed's joke about Michiganders who fear "Shakira Law" back in October.

El-Sayed was able to fend off Islamophobic attacks against him over many months, actions that culminated in his historic defeat of Michigan Republican Mike Rogers in the state's U.S. Senate race. He repeatedly faced accusations that he is a member of the Muslim Brotherhood and wants to impose Sharia law nationwide.

Keep ReadingShow less
Gerrymandered North Carolina map
Win McNamee/Getty Images

North Carolina Is Now The Textbook Definition Of A 'Dummymander' After Their Gerrymandering Efforts Backfired Massively

North Carolina Republicans are making waves on Wikipedia after the site used them as a prime example of "dummymandering" now that Democrats made historic wins in last week's midterm elections.

Before the elections, Republicans held 10 of the state's 14 U.S. House seats. However, Democrats have now flipped most of those despite the GOP's decision to redraw congressional districts in an attempt to hold onto more seats.

Keep ReadingShow less
Andrew Rannells attends the Television Academy's Inaugural Televerse Festival in Los Angeles.
Chris Delmas / AFP via Getty Images

Andrew Rannells Calls Out Theatergoer Who Chastized Him For Not Showing Up At Stage Door After Broadway Show

For Broadway fans, the final curtain call doesn't always mean the night's over. There's still the stage door, where a little patience and a Sharpie might score an autograph, a selfie, or a few unforgettable seconds with an iconic performer.

Of course, some theatergoers seem to have confused a Broadway ticket with an all-access backstage pass.

Keep ReadingShow less