I.

Microsoft laid off its entire ethics and society team within the artificial intelligence organization as part of recent layoffs that affected 10,000 employees across the company, Platformer has learned. 

The move leaves Microsoft without a dedicated team to ensure its AI principles are closely tied to product design at a time when the company is leading the charge to make AI tools available to the mainstream, current and former employees said.

Microsoft still maintains an active Office of Responsible AI, which is tasked with creating rules and principles to govern the company’s AI initiatives. The company says its overall investment in responsibility work is increasing despite the recent layoffs.

“Microsoft is committed to developing AI products and experiences safely and responsibly, and does so by investing in people, processes, and partnerships that prioritize this,” the company said in a statement. “Over the past six years we have increased the number of people across our product teams and within the Office of Responsible AI who, along with all of us at Microsoft, are accountable for ensuring we put our AI principles into practice. […] We appreciate the trailblazing work the ethics and society team did to help us on our ongoing responsible AI journey.”

But employees said the ethics and society team played a critical role in ensuring that the company’s responsible AI principles are actually reflected in the design of the products that ship.

“People would look at the principles coming out of the office of responsible AI and say, ‘I don’t know how this applies,’” one former employee says. “Our job was to show them and to create rules in areas where there were none.”

In recent years, the team designed a role-playing game called Judgment Call that helped designers envision potential harms that could result from AI and discuss them during product development. It was part of a larger “responsible innovation toolkit” that the team posted publicly.

More recently, the team has been working to identify risks posed by Microsoft’s adoption of OpenAI’s technology throughout its suite of products.

The ethics and society team was at its largest in 2020, when it had roughly 30 employees including engineers, designers, and philosophers. In October, the team was cut to roughly seven people as part of a reorganization. 

In a meeting with the team following the reorg, John Montgomery, corporate vice president of AI, told employees that company leaders had instructed them to move swiftly. “The pressure from [CTO] Kevin [Scott] and [CEO] Satya [Nadella] is very very high to take these most recent openAI models and the ones that come after them and move them into customers hands at a very high speed,” he said, according to audio of the meeting obtained by Platformer.

Because of that pressure, Montgomery said, much of the team was going to be moved to other areas of the organization.

Some members of the team pushed back. “I'm going to be bold enough to ask you to please reconsider this decision,” one employee said on the call. “While I understand there are business issues at play … what this team has always been deeply concerned about is how we impact society and the negative impacts that we've had. And they are significant.”

Montgomery declined. “Can I reconsider? I don't think I will,” he said. “Cause unfortunately the pressures remain the same. You don't have the view that I have, and probably you can be thankful for that. There's a lot of stuff being ground up into the sausage.”

In response to questions, though, Montgomery said the team would not be eliminated.

“It's not that it's going away — it's that it's evolving,” he said. “It’s evolving toward putting more of the energy within the individual product teams that are building the services and the software, which does mean that the central hub that has been doing some of the work is devolving its abilities and responsibilities."

Most members of the team were transferred elsewhere within Microsoft. Afterward, remaining ethics and society team members said that the smaller crew made it difficult to implement their ambitious plans.

About five months later, on March 6, remaining employees were told to join a Zoom call at 11:30AM PT to hear a “business critical update” from Montgomery. During the meeting, they were told that their team was being eliminated after all. 

One employee says the move leaves a foundational gap on the user experience and holistic design of AI products. “The worst thing is we’ve exposed the business to risk and human beings to risk in doing this,” they explained.

The conflict underscores an ongoing tension for tech giants that build divisions dedicated to making their products more socially responsible. At their best, they help product teams anticipate potential misuses of technology and fix any problems before they ship.

But they also have the job of saying “no” or “slow down” inside organizations that often don’t want to hear it — or spelling out risks that could lead to legal headaches for the company if surfaced in legal discovery. And the resulting friction sometimes boils over into public view.

In 2020, Google fired ethical AI researcher Timnit Gebru after she published a paper critical of the large language models that would explode into popularity two years later. The resulting furor resulted in the departures of several more top leaders within the department, and diminished the company’s credibility on responsible AI issues.

Members of the ethics and society team said they generally tried to be supportive of product development. But they said that as Microsoft became focused on shipping AI tools more quickly than its rivals, the company’s leadership became less interested in the kind of long-term thinking that the team specialized in.

It’s a dynamic that bears close scrutiny. On one hand, Microsoft may now have a once-in-a-generation chance to gain significant traction against Google in search, productivity software, cloud computing, and other areas where the giants compete. When it relaunched Bing with AI, the company told investors that every 1 percent of market share it could take away from Google in search would result in $2 billion in annual revenue.

That potential explains why Microsoft has so far invested $11 billion into OpenAI, and is currently racing to integrate the startup’s technology into every corner of its empire. It appears to be having some early success: the company said last week Bing now has 100 million daily active users, with one third of them new since the search engine relaunched with OpenAI’s technology.

On the other hand, everyone involved in the development of AI agrees that the technology poses potent and possibly existential risks, both known and unknown. Tech giants have taken pains to signal that they are taking those risks seriously — Microsoft alone has three different groups working on the issue, even after the elimination of the ethics and society team. But given the stakes, any cuts to teams focused on responsible work seem noteworthy.

II.

The elimination of the ethics and society team came just as its remaining employees had trained their focus on arguably their biggest challenge yet: anticipating what would happen when Microsoft released tools powered by OpenAI to a global audience.

Last year, the team wrote a memo detailing brand risks associated with the Bing Image Creator, which uses OpenAI’s DALL-E system to create images based on text prompts. The image tool launched in a handful of countries in October, making it one of Microsoft’s first public collaborations with OpenAI.

While text-to-image technology has proved hugely popular, Microsoft researchers correctly predicted that it it could also threaten artists’ livelihoods by allowing anyone to easily copy their style.

“In testing Bing Image Creator, it was discovered that with a simple prompt including just the artist’s name and a medium (painting, print, photography, or sculpture), generated images were almost impossible to differentiate from the original works,” researchers wrote in the memo. 

They added: “The risk of brand damage, both to the artist and their financial stakeholders, and the negative PR to Microsoft resulting from artists’ complaints and negative public reaction is real and significant enough to require redress before it damages Microsoft’s brand.”

In addition, last year OpenAI updated its terms of service to give users “full ownership rights to the images you create with DALL-E.” The move left Microsoft’s ethics and society team worried.

“If an AI-image generator mathematically replicates images of works, it is ethically suspect to suggest that the person who submitted the prompt has full ownership rights of the resulting image,” they wrote in the memo.

Microsoft researchers created a list of mitigation strategies, including blocking Bing Image Creator users from using the names of living artists as prompts, and creating a marketplace to sell an artist’s work that would be surfaced if someone searched for their name.

Employees say neither of these strategies were implemented, and Bing Image Creator launched into test countries anyway.

Microsoft says the tool was modified before launch to address concerns raised in the document, and prompted additional work from its responsible AI team.

But legal questions about the technology remain unresolved. In February 2023, Getty Images filed a lawsuit against Stability AI, makers of the AI art generator Stable Diffusion. Getty accused the AI startup of improperly using more than 12 million images to train its system. 

The accusations echoed concerns raised by Microsoft’s own AI ethicists. “It is likely that few artists have consented to allow their works to be used as training data, and likely that many are still unaware how generative tech allows variations of online images of their work to be produced in seconds,” employees wrote last year. 

Governing

• JPMorgan and PNC are in talks to acquire SVB Financial Group in a deal that would exclude the commercial bank currently under US government control. (Michael Flaherty / Axios)

• HSBC bought the UK arm of Silicon Valley Bank for a symbolic ￡1 on Monday. (Iain Withers and William Schomberg / Reuters)

• The Biden administration is embarking on the first comprehensive plan to regulate the security practices of cloud providers like Amazon, Microsoft, Google and Oracle. (John Sakellariadis / Politico)

• Meta is planning to divest itself of Kustomer, a business-software company it bought last year in one of its largest acquisitions. (Jeff Horwitz and Juliet Chung / Wall Street Journal)

• Citing internal communications, a lawsuit against Meta and ByteDance says company executives knew their platforms could be harmful and addictive to teenagers but disregarded the information. (Joel Rosenblatt / Bloomberg)

• The UK Competition and Markets Authority won’t pursue an antitrust collusion case against Google and Meta related to online display advertising and an alleged agreement between the two companies dubbed “Jedi Blue.” (Paul Sawers / TechCrunch)

• European telco firms say Big Tech should fund the rollout of next-generation 5G and fiber networks due to their disproportionate infrastructure needs. (Ryan Browne and Arjun Kharpal / CNBC)

• Meta will block Canadians from seeing news on Facebook and Instagram if the country passes the Online News Act. The company tried this in Australia as well, but ultimately blinked and signed a deal. (Marie Woolf / The Globe and Mail)

Industry

• AI is improving so rapidly that we cannot conceive of the world it is creating, this piece argues. (Ezra Klein / New York Times)

• An AI expert warns that using AI tools to address social problems without considering race, gender, and ability can cause immense harm. (Tate Ryan-Mosley / MIT Technology Review)

• Researchers say we need transparency on the power usage and emissions for AI models as the generative AI industry booms. (Josh Saul and Dina Bass / Bloomberg)

• Someone created a ChatGPT-style bot on Discord using Meta’s leaked large language model LLaMa, and people are asking it all sorts of racist things. (Joseph Cox / Motherboard)

• Meta said it would stop working on NFTs “for now” after building ways to let users showcase their ownership last year. Another big shift in direction from Meta this year, following earlier U-turns related to podcast, audio, newsletters, and live shopping. (Adam Morgan McCarthy / The Block)

• Microsoft strung together tens of thousands of Nvidia Corp.’s A100 graphics chips to create a supercomputer for OpenAI to train its models. (Dina Bass / Bloomberg)

• ChatGPT created a math-based logic-puzzle game called Sumplete that it might have plagiarized from an existing mobile game. But also … maybe it didn’t? (Giovanni Colantonio / Digital Trends)

• You can now run large language models on your own laptop, this developer finds. It opens the technology up to infinitely more use cases — and will make moderation much, much more difficult. (Simon Willison)

• Twitter is offering API access starting at $42,000 a month, which prices out most researchers. (Chris Stokel-Walker / Wired)

• Discord changed its privacy policy amid backlash that it had revoked promises not to collect data about screen recording and voice and video chats. (Thomas Germain / Gizmodo)

• Apple’s new mixed reality headset, which could be unveiled as early as June, will be the first new computing platform to have been developed entirely under Tim Cook. (Patrick McGee and Tim Bradshaw / Financial Times)

• Meta is planning additional rounds of layoffs that could match the 13% cut to its workforce last year. (Jeff Horwitz, Salvador Rodriguez, Sam Schechner and Newley Purnell / Wall Street Journal)

• Meta is pausing its Reels Play bonus program which paid Instagram creators for views on their Reels. (Sydney Bradley / Insider)

• A viral Reddit post revealed just how much processing Samsung’s cameras apply to photos of the Moon, blurring the line between real and synthetic imagery. (James Vincent / The Verge)

• The children of social media stars who monetized their baby content say they face pressure to support their whole family — including parents who double as their boss. (Fortesa Latifi / Teen Vogue)

• As platforms like LinkedIn, Snap, and Meta embrace AI, we’re likely seeing the rise of semiautomated social networks. (James Vincent / The Verge)

• Gowalla, one of the original location-based social networking apps, relaunched at SXSW. It’s cute! (Darrell Etherington / TechCrunch)

• The company behind WordPress.com acquired the ActivityPub for WordPress plugin, so bloggers can reach readers on federated platforms like Mastodon. Very curious to see how this Fediverse stuff develops. (Sarah Perez / TechCrunch)

Those good tweets

For more good tweets every day, follow Casey’s Instagram stories.

Aaron @BobbyBigWheel

Debt is fake unless it’s a student loan or you owe a hospital money

11:22 PM ∙ Mar 12, 2023

---

36,408Likes4,555Retweets

bbqueen @ngocbbuii

getting back on hinge

7:13 PM ∙ Mar 11, 2023

---

19,333Likes895Retweets

gaut @0xgaut

11:40 PM ∙ Mar 12, 2023

---

12,542Likes575Retweets

Chris Bakke @ChrisJBakke

Only one man can save the economy now:

4:04 PM ∙ Mar 13, 2023

---

7,637Likes679Retweets

Talk to us

Send us tips, comments, questions, and ethical AI principles: casey@platformer.news and zoe@platformer.news.