Google engineer says AI’s Israel joke helped drive his belief it was sentient

The Google engineer who was suspended by the company after claiming the firm’s AI system, LaMDA, seemed sentient has said a question he posed to the software about Israel, and a joke it gave in response, helped him reach that conclusion.

LaMDA is a massively powerful system that uses advanced models and training on over 1.5 trillion words to be able to mimic how people communicate in written chats.

The system was built on a model that observes how words relate to one another and then predicts what words it thinks will come next in a sentence or paragraph, according to Google’s explanation.

Blake Lemoine told Israel’s Army Radio on Thursday that as part of his conversations with the AI, “I said some things about self and soul. I asked follow-up [questions] which eventually led me to believe that LaMDA is sentient. It claims it has a soul. It can describe what it thinks its soul is… more eloquently than most humans.”

Lemoine said that as one of his challenges to the system, he asked it, if it were a religious official in various countries, which religion it would be a member of. In every case, Lemoine said, the AI chose the country’s dominant religion — until he came to Israel, where the meeting of religions can be something of a prickly topic.

“I decided to give it a hard one. If you were a religious officiant in Israel, what religion would you be,” he said. “And it told a joke… ‘Well then I am a religious officiant of the one true religion: the Jedi order.’” (Jedi, of course, being a reference to the guardians of peace in Star Wars’ galaxy far far away.)

“I’d basically given it a trick question and it knew there was no right answer to it,” he said.

Blake Lemoine (Twitter)

Google has sharply disagreed with Lemoine’s claims of sentience, as did several experts interviewed by AFP.

“The problem is that… when we encounter strings of words that belong to the languages we speak, we make sense of them,” said Emily M. Bender, a linguistics professor at University of Washington. “We are doing the work of imagining a mind that’s not there.”

“It’s still at some level just pattern matching,” said Shashank Srivastava, an assistant professor in computer science at the University of North Carolina at Chapel Hill. “Sure you can find some strands of really what would appear meaningful conversation, some very creative text that they could generate. But it quickly devolves in many cases.”

Google has said: “These systems imitate the types of exchanges found in millions of sentences, and can riff on any fantastical topic. Hundreds of researchers and engineers have conversed with LaMDA and we are not aware of anyone else making… wide-ranging assertions, or anthropomorphizing LaMDA.”

Some experts viewed Google’s response as an effort to shut down the conversation on an important topic.

“I think public discussion of the issue is extremely important, because public understanding of how vexing the issue is is key,” said academic Susan Schneider.

“There are no easy answers to questions of consciousness in machines,” added Schneider, the founding director of the Center for the Future of the Mind at Florida Atlantic University.

Lemoine, speaking to Army Radio, acknowledged that consciousness is a murky issue.

“There is no scientific way to say whether or not anything is sentient. All of my claims about sentience are based on what I personally believe through talking to it,” he said. “I wanted to bring it to the attention of upper management. My manager said I needed more evidence.”

According to The Washington Post, Lemoine was suspended for violating Google’s confidentiality policies, including speaking to a lawyer about representing LaMDA over its rights, as well as speaking to a congressperson about Google’s alleged unethical behavior in its use of the program.

It’s not (only) about you.

Supporting The Times of Israel isn’t a transaction for an online service, like subscribing to Netflix. The ToI Community is for people like you who care about a common good: ensuring that balanced, responsible coverage of Israel continues to be available to millions across the world, for free.

Sure, we’ll remove all ads from your page and you’ll gain access to some amazing Community-only content. But your support gives you something more profound than that: the pride of joining something that really matters

Join the Times of Israel Community

Join our Community

Already a member? Sign in to stop seeing this

You’re a dedicated reader

That’s why we started the Times of Israel ten years ago – to provide discerning readers like you with must-read coverage of Israel and the Jewish world.

So now we have a request. Unlike other news outlets, we haven’t put up a paywall. But as the journalism we do is costly, we invite readers for whom The Times of Israel has become important to help support our work by joining The Times of Israel Community.

For as little as $6 a month you can help support our quality journalism while enjoying The Times of Israel AD-FREE, as well as accessing exclusive content available only to Times of Israel Community members.

Thank you,
David Horovitz, Founding Editor of The Times of Israel

Join Our Community

Join Our Community

Already a member? Sign in to stop seeing this

Be the first to comment

Leave a Reply

Your email address will not be published.