EletiofeRE:WIRED 2021: Timnit Gebru Says Artificial Intelligence Needs to...

RE:WIRED 2021: Timnit Gebru Says Artificial Intelligence Needs to Slow Down

-

- Advertisment -

Artificial intelligence researchers are facing a problem of accountability: How do you try to ensure decisions are responsible when the decision maker is not a responsible person, but rather an algorithm? Right now, only a handful of people and organizations have the power—and resources—to automate decision-making.

Organizations rely on AI to approve a loan or shape a defendant’s sentence. But the foundations upon which these intelligent systems are built are susceptible to bias. Bias from the data, from the programmer, and from a powerful company’s bottom line can snowball into unintended consequences. This is the reality AI researcher Timnit Gebru cautioned against at a RE:WIRED talk on Tuesday.

“There were companies purporting [to assess] someone’s likelihood of determining a crime again,” Gebru said. “That was terrifying for me.”

Gebru was a star engineer at Google who specialized in AI ethics. She co-led a team tasked with standing guard against algorithmic racism, sexism, and other bias. Gebru also cofounded the nonprofit Black in AI, which seeks to improve inclusion, visibility, and health of Black people in her field.

Last year, Google forced her out. But she hasn’t given up her fight to prevent unintended damage from machine learning algorithms.

Tuesday, Gebru spoke with WIRED senior writer Tom Simonite about incentives in AI research, the role of worker protections, and the vision for her planned independent institute for AI ethics and accountability. Her central point: AI needs to slow down.

“We haven’t had the time to think about how it should even be built because we’re always just putting out fires,” she said.

As an Ethiopian refugee attending public school in the Boston suburbs, Gebru was quick to pick up on America’s racial dissonance. Lectures referred to racism in the past tense, but that didn’t jibe with what she saw, Gebru told Simonite earlier this year. She has found a similar misalignment repeatedly in her tech career.

Gebru’s professional career began in hardware. But she changed course when she saw barriers to diversity and began to suspect that most AI research had the potential to bring harm to already marginalized groups.

“The confluence of that got me going in a different direction, which is to try to understand and try to limit the negative societal impacts of AI,” she said.

For two years, Gebru co-led Google’s Ethical AI team with computer scientist Margaret Mitchell. The team created tools to protect against AI mishaps for Google’s product teams. Over time, though, Gebru and Mitchell realized they were being left out of meetings and email threads.

In June 2020, the GPT-3 language model was released and displayed an ability to sometimes craft coherent prose. But Gebru’s team worried about the excitement around it.

“Let’s build larger and larger and larger language models,” said Gebru, recalling the popular sentiment. “We had to be like, ‘Let’s please just stop and calm down for a second so that we can think about the pros and cons and maybe alternative ways of doing this.’”

Her team helped write a paper about the ethical implications of language models, called “On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?”

Others at Google were not happy. Gebru was asked to retract the paper or remove Google employees’ names. She countered with an ask for transparency: Who had requested such harsh action and why? Neither side budged. Gebru found out from one of her direct reports that she “had resigned.”

Latest news

Red Stars’ Bianca St. Georges ejected after flipping double birds at referee

Chicago Red Stars defender Bianca St. Georges received a red card and was ejected from their 3-0 loss to...

Growing Old Online

Sometimes when I can’t sleep, I put the Twitter app back on my phone and scroll aimlessly. I’m trying...

How to Switch iPhones Without Losing a Thing

Losing all the stuff on your phone was no big deal before the smartphone age. These days, it's practically...

How to Upload Custom Emoji in Slack

I used to work for a company that had a few thousand custom emoji in Slack, which I admit...
- Advertisement -

A Wheel Made of ‘Odd Matter’ Spontaneously Rolls Uphill

In a physics lab in Amsterdam, there’s a wheel that can spontaneously roll uphill by wiggling.This “odd wheel” looks...

VPN Providers Flee India as a New Data Law Takes Hold

Ahead of the deadline to comply with the Indian government’s new data-collection rules, VPN companies from across the globe...

Must read

Red Stars’ Bianca St. Georges ejected after flipping double birds at referee

Chicago Red Stars defender Bianca St. Georges received a...

Growing Old Online

Sometimes when I can’t sleep, I put the Twitter...
- Advertisement -

You might also likeRELATED
Recommended to you