Skip to content
Search AI Powered

Latest Stories

A.I.s Tend to Be Racist and Sexist For Exactly the Reason You Think, but Now There May Be a Way to Change That

A.I.s Tend to Be Racist and Sexist For Exactly the Reason You Think, but Now There May Be a Way to Change That
Credit: Pixabay

German researchers may have a fix.

Artificial intelligence technology has made great strides of late, showing it can perform not just credit worthiness and shopping-behavior algorithms, but interpret what animals are saying, create nude art and even write the next installment of Game of Thrones.

However, it turns out machine learning is missing a critical component of human thought: the ability to not be sexist and racist.


Artificial intelligence has been a boon for industries such as insurance, banking and criminal justice, allowing companies and organizations to quickly and efficiently synthesize large amounts of data to determine who’s most likely to file a claim or default on a loan or in which neighborhoods a crime is more likely to occur.

However, biased results have been a growing problem. For instance, a ProPublica investigation of COMPAS (Correctional Offender Management Profiling for Alternative Sanctions), an AI algorithm frequently used in the U.S., found that the algorithm thought black people posed a higher recidivism risk than has been the case. In a different investigation by the Human Rights Data Analysis Group, crime-predicting software was found frequently sending police to low-income neighborhoods regardless of the actual rate of crime.

Many claim the problem is with the input data, not the AI itself.

“In machine learning, we have this problem of racism in and racism out,”saysChris Russell of the Alan Turing Institute in London.

A group of German researchers hopes to change that, with a new approach to keep bias out of the process of training algorithms. Niki Kilbertus of the Max Planck Institute for Intelligent Systems, and lead researcher for the project, points out that AI learns through patterns, without taking into account sensitive information such as the color of someone’s skin making them more likely to be arrested in the first place, or denied a job that could make them more credit-worthy.

“Loan decisions, risk assessments in criminal justice, insurance premiums, and more are being made in a way that disproportionately affects sex and race,” Kilbertus told New Scientist.

Due to discrimination laws and/or individuals’ reluctance to reveal their sex, race or sexuality, companies in the past have faced barriers to looking at such sensitive data, so Kilbertus’ group’s fix includes privately encrypting this information for companies using AI software. An independent regulator would then be able to check the sensitive information against the AI outputs and, if determined to be unbiased, issue a fairness certificate indicating all variables have been considered.

While the results of Kilbertus’ group’s proposal have yet to be seen, few would argue that there’s still much work to be done in adapting artificial intelligence to our increasingly complicated world.

“What’s at stake when we don’t have a greater understanding of racist and sexist disparities goes far beyond public relations snafus and occasional headlines,” Safiya Noble, author of Algorithms of Oppression, told Canadian newsmagazine The Walrus. “It means not only are companies missing out on new possibilities for deeper and more diverse consumer engagements, but they’re also likely to not recognize how their products and services are part of systems of power that can be socially damaging.”

More from News

Ed Helms; Donald Trump
Forbes Breaking News/YouTube; Alex Wong/Getty Images

Ed Helms Rips Trump With Hilariously Brutal Comparison To His Character From 'The Office'

Actor Ed Helms recently shared some of the "valuable lessons" he's learned during his long career in show business, including a few that apply to former President Donald Trump.

During his speech at a recent campaign rally for Kamala Harris and Tim Walz in Reno, Nevada, reminisced about a certain moment from The Office that reminds him of the Republican candidate.

Keep ReadingShow less
Mike Duggan; Screenshot of Donald Trump
Adam J. Dewey/Anadolu via Getty Images; @Acyn/X

Trump Just Insulted Detroit While Speaking In Detroit—And The Mayor Fired Back

Detroit Mayor Mike Duggan fired back at former President Donald Trump after Trump insulted his home city by saying Vice President Kamala Harris would make the U.S. "like Detroit"—while speaking in Detroit.

Trump made the remark during a rambling speech at the Detroit Economic Club, saying:

Keep ReadingShow less
Two people on coffee date
Priscilla Du Preez 🇨🇦/Unsplash

People Divulge The Worst Things A Date Ever Said To Them

It's not a huge revelation that the people you meet online through various dating apps can be very different in person.

Corresponding with a person that strikes your fancy on apps allows time to process and generate engaging conversation to keep a potential date interested.

Keep ReadingShow less
Kourtney Kardashian
Neilson Barnard/Getty Images

Kourtney Kardashian Hit With Backlash Over NSFW Inflatable Skeleton Halloween Display

Reality TV star Kourtney Kardashian sparked backlash with a photo of her NSFW Halloween decoration that appeared to be taken outside her home.

The oldest Kardashian arranged two inflatable skeletons in a position with one atop the other.

Keep ReadingShow less
Image of flooding amidst Hurricane Milton; @BrianBowman2334's Tweet
Joe Raedle/Getty Images; @BrianBowman2334

Viral Photo Of Florida Man's House Strapped To The Ground Ahead Of Hurricane Milton Sparks Debate

Just days ago, right after people started to return to their homes from Hurricane Helene, Florida residents were warned of the eminent arrival of Hurricane Milton, then charted as a Category Five and potentially unprecedented hurricane.

Because of the projected severity of the storm, many evacuated from their homes, navigating inland or out of the state entirely.

Keep ReadingShow less