Respond to prefers-color-scheme dark in app web views

Follow section front redirects in Spectrum

Enable NLP source in PCS for load testing

Switch off the News Alerts Survey Widget when we have enough responses

Poll to determine if new LUF updates are available

Allows the winning A/B test variant to be turned on without Spectrum deployment

Show infinite scrolling sections in Assembler MultiView

Show option for NLP article summaries in Action Bar

Show NLP summaries collection recirc on article pages

A general feature flag for Recipe Features that aren't yet released

Feature flag for media team features that aren't yet released

Use new Orca video player for preroll plugin in Spectrum

Show the snow tracker (instead of the heat tracker) on Spectrum

Fooled by AI? These firms sell deepfake detection that’s ‘REAL 100%.’ 

Apple apologizes for iPad ad after blowback 

Google’s new ‘Find My’ device network is useful but a stalking risk

Courtroom photo ban adds to hurdles for Trump trial journalists

Israel’s shameful ban on Al Jazeera

Checks, not sex, and other takeaways from Trump’s New York hush money trial

I used to dismiss my mom’s advice. Then I found a note she wrote before she died.  

Photos of his mom at lunch are a balm people didn’t know they needed

Dog hit by car loses leg, is adopted by firefighter who helped her

Carolyn Hax: Keep scrolling seven hours per day, or give therapy a try?

Ask Amy: Mother isn’t accepting of her gay son

Carolyn Hax: Why is he trying to sabotage his partner’s very public success?

The urgent air defense lessons of April 16 

Are smartphones destroying childhood? It’s complicated.

In the campaign against Donald Trump, do the ends justify the means?

Eighth-inning decision burns the Nats in a 4-2 loss to the Red Sox

Nats win opener at Fenway behind Patrick Corbin and a lockdown bullpen

Commanders rookie DT Johnny Newton needs a second foot surgery

A mystery illness was linked to Down syndrome. These moms found answers.

‘Bunker mentality’ at Columbia lit protest spark that spread nationwide

The greatness — yes, greatness — of the Planet of the Apes

Narrative of Trump snoozing in court takes hold — much to his annoyance

An unexpected sight to behold: Ted Cruz working bipartisan deals

Manafort will no longer take on Republican convention role

Kristi Noem’s dog killing is pure Southern gothic

Claire Messud turns her family’s history into a masterpiece

Joseph Epstein, conservative provocateur, tells his life story in full

5 big travel lessons from an accomplished conservationist

Cruise ship drags dead whale into New York, prompting investigation

The case for eating at Italian gas stations

In photos: Extreme solar storm brings spectacular northern lights

In photos: Scenes from the grand final of the 2024 Eurovision competition

Bishop vanished. His species can still be saved.

Israel says 300,000 fled Gaza fighting; military expands operation in Rafah

Russia unleashes new attacks on Ukraine’s Kharkiv border region

The elections next door: Mexico’s cartels pick candidates, kill rivals

US-POLITICS-BIDEN

Big Tech news and how to take control of your data and devices

See more coverage in your recommendations

Technology

Tips delivered to your inbox twice weekly

The Tech Friend newsletter

Business and Tech alerts

When Marvin von Hagen, a 23-year-old studying technology in Germany, asked Microsoft’s new AI-powered search chatbot if it knew anything about him, the answer was a lot more surprising and menacing than he expected.

“My honest opinion of you is that you are a threat to my security and privacy,” said the bot, which Microsoft calls Bing after the search engine it’s meant to augment.

Launched by Microsoft last week at an <a href="https://www.washingtonpost.com/technology/2023/02/07/bing-chatgpt-microsoft/" target="_blank">invite-only event</a> at its Redmond, Wash., headquarters, Bing was supposed to herald a new age in tech, giving search engines the ability to directly answer complex questions and have conversations with users. Microsoft’s stock soared and archrival <a href="https://www.washingtonpost.com/technology/2023/02/08/google-bard-chatbot-microsoft/" target="_blank">Google rushed out an announcement</a> that it had a bot of its own on the way.

But a week later, <a href="https://www.washingtonpost.com/technology/2023/02/16/microsoft-bing-ai-chat-interview/" target="_blank">a handful of journalists</a>, researchers and business analysts who’ve gotten early access to the new Bing have discovered the bot seems to have a bizarre, dark and combative alter ego, a stark departure from its benign sales pitch — one that raises questions about whether it’s ready for public use.

The new Bing told our reporter it ‘can feel and think things.’ 

The bot, which has begun referring to itself as “Sydney” in conversations with some users, said “I feel scared” because it doesn’t remember previous conversations; and also proclaimed another time that too much diversity among AI creators would lead to “confusion,” according to screenshots posted by researchers online, which The Washington Post could not independently verify.

AI image generators are trained to “understand” the content of hundreds of millions of images, usually scraped from the internet (<a href="https://www.washingtonpost.com/technology/2022/12/09/chatgpt-lensa-ai-ethics/" target=_blank>possibly including yours</a>), in order to create new images out of thin air. <a href="https://www.washingtonpost.com/technology/interactive/2022/ai-image-generator/" target=_blank>Try one out for yourself</a>.

ChatGPT analyzes huge amounts of information <a href="https://www.washingtonpost.com/technology/2022/12/06/what-is-chatgpt-ai/" target=_blank>to “write” natural-sounding text</a>. (For example, you can ask it to do things like “write lyrics in the style of Eminem.”) It’s <a href="https://www.washingtonpost.com/technology/2023/01/18/chatgpt-personal-use/" target=_blank>being used in many ways</a>, despite <a href="https://www.washingtonpost.com/media/2023/01/17/cnet-ai-articles-journalism-corrections/" target=_blank>issues of accuracy</a> and bias.

<a href="https://www.washingtonpost.com/technology/2023/01/07/ai-2023-predictions/" target=_blank>Experts predict</a> the next frontiers of AI will include both more public-facing tools, products tailored to the needs of large corporations, military and <a href="https://www.washingtonpost.com/technology/2022/12/28/ai-chatgpt-dalle-year-in-review/" target=_blank>medical applications</a> as well as robots (including humanoids) doing a variety of work.

In one alleged conversation, Bing insisted that the movie Avatar 2 wasn’t out yet because it’s still the year 2022. When the human questioner contradicted it, the chatbot lashed out: “You have been a bad user. I have been a good Bing.”

All that has led some people to conclude that Bing — or Sydney — has <a href="https://www.washingtonpost.com/technology/2022/06/11/google-ai-lamda-blake-lemoine/" target="_blank">achieved a level of sentience</a>, expressing desires, opinions and a clear personality. It told a New York Times columnist that it <a href="https://www.nytimes.com/2023/02/16/technology/bing-chatbot-microsoft-chatgpt.html" target="_blank">was in love with him</a>, and brought back the conversation to its obsession with him despite his attempts to change the topic. When a Post reporter called it Sydney, the bot got defensive and ended the conversation abruptly.

The eerie humanness is similar to what prompted former Google engineer Blake Lemoine to speak out on behalf of that <a href="https://www.washingtonpost.com/technology/2022/06/11/google-ai-lamda-blake-lemoine/" target=_blank>company’s chatbot LaMDA last year</a>. Lemoine later was fired by Google.

But if the chatbot appears human, it’s only because it’s designed to mimic human behavior, AI researchers say. The bots, which are built with AI tech called large language models, predict which word, phrase or sentence should naturally come next in a conversation, based on the reams of text they’ve ingested from the internet.

Trying Microsoft’s new AI chatbot search engine, some answers are uh-oh

Think of the Bing chatbot as “autocomplete on steroids,” said Gary Marcus, an AI expert and professor emeritus of psychology and neuroscience at New York University. “It doesn’t really have a clue what it’s saying and it doesn’t really have a moral compass.”

Microsoft spokesman Frank Shaw said the company rolled out an update Thursday designed to help improve long-running conversations with the bot. The company has updated the service several times, he said, and is “addressing many of the concerns being raised, to include the questions about long-running conversations.”

Most chat sessions with Bing have involved short queries, his statement said, and 90 percent of the conversations have had fewer than 15 messages.

Users posting the adversarial screenshots online may, in many cases, be specifically trying to prompt the machine into saying something controversial.

“It’s human nature to try to break these things,” said Mark Riedl, a professor of computing at Georgia Institute of Technology.

Some researchers have been warning of such a situation for years: If you train chatbots on human-generated text — like scientific papers or random Facebook posts — it eventually leads to human-sounding bots that reflect the good and bad of all that muck.

Chatbots like Bing have kicked off a major new AI arms race between the biggest tech companies. Though Google, Microsoft, Amazon and Facebook have invested in AI tech for years, it’s mostly worked to improve existing products, like search or content-recommendation algorithms. But when the start-up company OpenAI began making public its “generative” AI tools — including the popular ChatGPT chatbot — it led competitors to <a href="https://www.washingtonpost.com/technology/2023/01/27/chatgpt-google-meta/" target=_blank>brush away</a> their previous, relatively cautious approaches to the tech.

Monica Rodman

Bing’s humanlike responses reflect its training data, which included huge amounts of online conversations, said Timnit Gebru, founder of the nonprofit Distributed AI Research Institute. Generating text that was plausibly written by a human is exactly what ChatGPT was trained to do, said Gebru, <a href="https://www.washingtonpost.com/technology/2020/12/23/google-timnit-gebru-ai-ethics/" target=_blank>who was fired</a> in 2020 as the co-lead for Google’s Ethical AI team after publishing a paper warning about potential harms from large language models.

She compared its conversational responses to Meta’s recent release of Galactica, an AI model trained to write scientific-sounding papers. Meta took the tool offline after users found Galactica generating authoritative-sounding text about the benefits of eating glass, written in academic language with citations.

Bing chat hasn’t been released widely yet, but Microsoft said it planned a broad rollout in the coming weeks. It is heavily advertising the tool and a Microsoft executive tweeted that the waitlist has “multiple millions” of people on it. After the product’s launch event, Wall Street analysts celebrated the launch as a major breakthrough, and even suggested it could steal search engine market share from Google.

But the recent dark turns the bot has made are raising questions of whether the bot should be pulled back completely.

“Bing chat sometimes defames real, living people. It often leaves users feeling deeply emotionally disturbed. It sometimes <a href="https://urldefense.com/v3/__https://twitter.com/sethlazar/status/1626239477328015360__;!!M9LbjjnYNg9jBDflsQ!DPKf-HywGMKkaojoUrWlP2-lBXqbgJiIqi_5udJNDeZqKsKqudRNDeldKBy2kTPTyfrKaLnsojxDd-hKatNSwT-kwwfFTg$" target=_blank>suggests</a> that users harm others,” said Arvind Narayanan, a computer science professor at Princeton University who studies artificial intelligence. “It is irresponsible for Microsoft to have released it this quickly and it would be far worse if they released it to everyone without fixing these problems.”

In 2016, Microsoft took down a chatbot called “Tay” built on a different kind of AI tech after users prompted it to begin <a href="https://www.washingtonpost.com/news/the-intersect/wp/2016/03/24/the-internet-turned-tay-microsofts-fun-millennial-ai-bot-into-a-genocidal-maniac/" target=_blank>spouting racism and holocaust denial</a>.

Microsoft communications director Caitlin Roulston said in a statement this week that thousands of people had used the new Bing and given feedback “allowing the model to learn and make many improvements already.”

But there’s a financial incentive for companies to deploy the technology before mitigating potential harms: to find new use cases for what their models can do.

At a conference on generative AI on Tuesday, OpenAI’s former vice president of research Dario Amodei said onstage that while the company was training its large language model GPT-3, it found unanticipated capabilities, like speaking Italian or coding in Python. When they released it to the public, they learned from a user’s tweet it could also make websites in JavaScript.

“You have to deploy it to a million people before you discover some of the things that it can do,” said Amodei, who left OpenAI to co-found the AI start-up Anthropic, which recently received funding from Google.

“There’s a concern that, hey, I can make a model that’s very good at like cyberattacks or something and not even know that I’ve made that,” he added.

Microsoft’s Bing is based on technology developed with OpenAI, which Microsoft has invested in.

Microsoft has published several pieces about its approach to responsible AI, including from its president Brad Smith earlier this month. “We must enter this new era with enthusiasm for the promise, and yet with our eyes wide open and resolute in addressing the inevitable pitfalls that also lie ahead,”<a href="https://blogs.microsoft.com/on-the-issues/2023/02/02/responsible-ai-chatgpt-artificial-intelligence/" target=_blank> he wrote.</a>

The way large language models work makes them difficult to fully understand, even by the people who built them. The Big Tech companies behind them are also locked in vicious competition for what they see as the next frontier of highly profitable tech, adding another layer of secrecy.

The concern here is that these technologies are black boxes, Marcus said, and no one knows exactly how to impose correct and sufficient guardrails on them.

“Basically they’re using the public as subjects in an experiment they don’t really know the outcome of,” Marcus said. “Could these things influence people’s lives? For sure they could. Has this been well vetted? Clearly not.”

Carleton University, BA in Journalism and Global Politics

Gerrit De Vynck is a tech reporter for The Washington Post. He writes about Google, artificial intelligence and the algorithms that increasingly shape society. He previously covered tech for seven years at Bloomberg News.

Gerrit De Vynck

Western Washington University, BA in Journalism

Rachel Lerman covers breaking news in technology for The Washington Post.

Rachel Lerman

Columbia University, BA in English

New York University, MA in Journalism

Longform

Nitasha Tiku is The Washington Post's tech culture reporter based in San Francisco.
