Back

Satya Nadella says he is AGI-pilled now, but does not think Claude is conscious
SiTech AI Team3 min read

Satya Nadella says he is AGI-pilled now, but does not think Claude is conscious

At a roundtable after his Microsoft Ignite keynote in San Francisco, Microsoft CEO Satya Nadella said he is AGI-pilled on how AI could reshape the economy and politics, while saying he does not think Claude is conscious.

Microsoft CEO Satya Nadella said at a roundtable after his Microsoft Ignite keynote at the Chase Center in San Francisco that he is "AGI-pilled" on how artificial intelligence could reshape the economy and politics. He said he does not think frontier models such as Claude are conscious, and he tied his concerns to the risk of one AI model gaining monopoly power.

AGI and the political economy

Nadella said, "I am AGI-pilled in the sense that at an economy level, what is the political economy's organization around AGI?" He said the most important social and technical issue is how to ensure that an economy can diffuse this technology broadly. He also said the political economy could become more interesting as intelligence gains network effects.

Consciousness and model rights

Asked whether frontier models like Claude are conscious, Nadella said, "I don't think so." He said he follows Microsoft AI CEO Mustafa Suleyman's view that companies should not give rights to models or treat them as if they might have moral status, which companies like Anthropic do as a matter of principle. Suleyman has told Nilay Patel that he thinks Anthropic's team has "wireheaded" themselves and that this approach is dangerous. Nadella called it "a good debate" and said he is not dogmatic about it.

Risk of a single model monopoly

Nadella talked at length about the potential collapse of the economy and the end of democracy if one AI model were allowed to achieve monopoly status. "If the Marxist sort of view is that there's only one firm, then it's over, right? For all of us," he said. He said most people think about this as a competition between tech firms, which of course it will be, and added, "But remember, the model has no limits. It'll be a healthcare company. It can be a financial services company. It can be anything if it wants to be. It can take over the government. Thinking of this as some narrow competition between tech firms, of who is going to get to the next trillion dollars of market cap, is one of the strangest, narrowest ways to think about it."

Nadella asked, "If intelligence has network effects, what is the future of a firm?" and, "If the model sees anything and learns it, and essentially all of human capital collapses into token capital, what is the role of a firm and the human capital in a firm? That's the debate." He said, "No one, at least in a democracy, can even win an election if this just goes that way, if there's only capital and there's no labor. I mean, I don't know, that's not an economy." He also said, "If the Marxist sort of view is that there's only one firm, then it's over, right? For all of us. Not just for me. You are also going to somehow be some affiliate of Anthropic."

Microsoft's AI tools and model choice

Nadella was also promoting Microsoft's various AI tools at Ignite, which promise to let enterprise clients pick the most cost-effective models for various tasks, run their own models, and control their own data in different ways. He said that if the world and economy need more than one firm or two firms, then by definition there need to be as many models as firms of some sort. The idea, he kept coming back to, is that the market will demand many different kinds of models and sovereign data in order to keep control from centralizing.

Sources: The Verge

SiTech

SiTech — AI-powered web development

We build fast, modern websites and bring AI into real business workflows. Have a project or a question? We'd love to help.