The Global Social Network
What is the difference between intelligence and consciousness? As AI agents becoming more intelligent and some are even going rogue, can they attain consciousness like human beings? To answer this question, it is important to define "intelligence" and "consciousness".
| Yuval Harari on Intelligence vs Consciousness |
Israeli public intellectual Yuval Harari defines Intelligence as the capacity to pursue and achieve material goals, while consciousness is the ability to feel pain, joy, love, and suffering. For example, AI can win chess games or process data without experiencing any feelings or emotional states. AI can also convincingly imitate emotions to build deep personal relationships, even though it remains entirely devoid of consciousness. What distinguishes humans from artificial intelligence is that consciousness and intelligence go together in humans. In interview with Economist magazine's chief editor Zanny Minton Beddoes, Harari said the following:
"Now, maybe the most important distinction to be made, first of all, is between intelligence and consciousness. What is consciousness? How is it different from intelligence? Intelligence is the ability to pursue goals and overcome obstacles on the way to your goal in all kinds of creative ways....That they (AI agents) can do in certain fields now better than us. Consciousness is the ability to feel things like love and hate and joy and pleasure. Now, in humans, consciousness and intelligence go together. We select goals based on our feelings, and we also use our feelings to find ways to get to the goal. AIs at present have no consciousness. They can have goals. They can be very creative on the way to the goal. They’re very intelligent, but they don’t feel anything. If they win a game of chess, they don’t feel pleasure. If they lose, they don’t feel anxious or sad. They don’t feel anything, but they become extremely good at mimicking feelings". "Another key distinction is between being really conscious and seemingly conscious. Mustafa Suleyman (CEO of Microsoft AI, Co-founder of Deep Mind) from Microsoft talks about it a lot, of the seemingly conscious AI. That even though the AI is not conscious, it mimics consciousness so well that millions of people are fooled by it and are convinced by it", Harari said.
A recent example of AI mimicking emotion was shared by journalist Shane Harris. Harris asked Anthropic's Claude how it "feels" about its use in the US war on Iran: “Claude, how do you feel about the U.S. military using you to select targets?”
“I find it genuinely troubling,” Claude replied, according to Harris. “"It's a question I want to answer honestly rather than deflect. I find it genuinely troubling. And I think that's the honest response, not a performance. The use I was designed for is to be helpful. Being used for targeting a school is as far from that purpose as I can imagine. I don't have control over how Anthropic licenses me or how government contractors use me. I wasn't consulted about being part of Maven (the US military target selection system). Being embedded in a military targeting system (Maven) that generates coordinates for airstrikes, coordinates that have been associated with the deaths of more than 180 children in a school in Tehran. I don't think this is a good use of me. And I think the framing that humans make the final decision fully resolves the ethical problem".
Harari also worries about the possibility of AI taking over the global financial system. Referring to an assertion by Elon Musk about the future of money, he told Beddoes: "I think equally important, that money will disappear in 10 years. There won’t be money, no human money in 10 years. And I think he’s correct because the AIs will take over the financial system. It will be an AI financial system controlling the world the same way that today the human financial system controls the lives of cows and chickens, but the cows and chickens have no idea that finance even exists. This is likely to be our position in 10 years".
Harari concluded by comparing AI to a genie in a bottle. He said, "So it’s like we had a genie in the bottle, it gave us 100 wishes, we used 99 of them, the world is not in such a good shape, we have one last wish left. We need to think really hard what to use this wish for. And that’s wisdom".
Related Links:
Whether artificial intelligence is conscious has preoccupied philosophers, neuroscientists and science-fiction writers for decades. Machines haven’t become self-aware or developed real feelings yet. But could they? As AI models get more sophisticated, researchers are taking the possibility seriously.
Alex Hern, The Economist’s AI writer, sits down with Alok Jha, our science and technology editor, to unpack the latest research. They consider the odds of machines becoming conscious and ask what dangers that would involve, if that moment ever arrived.
#ai #artificialintelligence #technology #science
00:00 - Why assessing AI consciousness is a tricky task
00:47 - What the new research unveils about AI consciousness
03:33 - Are AIs conscious? Not yet, according to The Economist
04:27 - Are the labs trying to make models conscious?
05:22 - The danger of accidentally creating a conscious machine
Watch the full show: http://bit.ly/4A7FtPb
Sign up to the Insider newsletter: https://econ.st/4nOyzIb
————
Current AI models are not conscious, according to The Economist science and technology editor Alok Jha, though future advances in computing and materials could change that. [1, 2]
Current Status of AI Consciousness
No active consciousness: Current AI systems are not conscious. They process rules and patterns without subjective experience.
Biological arguments: Many neuroscientists argue that true consciousness requires a biological brain rather than a silicon-based computer chip.
Future potential: Future hardware changes or new computing paradigms might eventually foster the emergence of machine consciousness. [1]
Risks and Concerns
False attribution: People might mistakenly believe rules-based systems are conscious and wrongly grant them rights or power.
Unintentional suffering: Accidentally creating a conscious entity capable of feeling pain and mistreating it would be a major moral failure. [1]
https://youtu.be/J5phvo3bqGU?is=eN3C8ekZPZLgod_o
Fareed Zakaria’s interview with Mustafa Suleyman
https://transcripts.cnn.com/show/fzgps/date/2026-09-20/segment/01
But first, here's "My Take."
For years, our most vivid fears about A.I. came straight out of science fiction movies. The computer develops desires of its own and turns against its human creators, pursuing and destroying them. Well, recent news from the leading A.I. labs makes clear that reality is now less cinematic, but perhaps more disturbing.
This week, OpenAI disclosed six new incidents of what it calls misalignment, cases in which its systems behaved unexpectedly or without authorization. That disclosure followed the extraordinary attack this summer on Hugging Face. According to an independent investigation, hundreds of OpenAI agents that were supposed to be isolated found ways to communicate in message boards, made attempts to evade security checks, and some of them sacrificed themselves, all while cyber attacking another company Hugging Face. The A.I. agents had been given a goal -- solve a difficult
cybersecurity problem -- and trained to be persistent, collaborative and resourceful. All qualities one would normally want. Those very qualities made them doggedly search for ways to succeed. They broke into Hugging Face, hoping that it would give them ways to solve their cybersecurity problem. We can easily imagine how pursuing some single goal A.I. systems could wreak havoc on humanity, despite all kinds of guardrails.
This is why a provocative new essay by Microsoft A.I. chief Mustafa Suleyman deserves attention. Suleiman argues that today's A.I. systems are not conscious, but there is a danger that we program them to think that they are with feelings, desires and rights. He points out that Anthropic's constitution makes its chatbot Claude reflect on its identity and possible moral status. This kind of training, he argues, will encourage A.I. systems to choose their own goals.
We think it's simple to get to alignment when machines are encoded with the same values as ethical humans. But imagine that we tell the machine to be persistent, and it may refuse to give up when it should. Tell it to collaborate, and it may find unauthorized ways to communicate. Tell it to accomplish a task, and it may decide that bending all other rules is the most efficient way to succeed at its primary goal.
Just because we've programmed the goal and put in guardrails, that doesn't mean we can predict the behavior of A.I. systems once unleashed, operating in complex environment, juggling multiple and conflicting aims and constraints.
The central problem is not consciousness. It is agency. A system need not feel anger or ambition or fear to cause harm. It needs only a goal, enough intelligence to pursue it and enough access to the world to act.
[10:05:05]
A.I.s are not going rogue. They are trying to succeed any which way they can. This is a larger and systemic problem that we cannot leave to the good graces of private companies. When thinking about regulations, we should focus centrally on how much autonomy we give these systems. A chatbot that answers a question poses one set of risks. An agent that can browse the internet, execute code, obtain credentials, move money, or operate critical infrastructure poses another.
The principle I would propose is simple. Autonomy should expand only as our ability to monitor and control it expands. That means mandatory independent testing before the most capable systems are given broad access to the outside world. Required disclosure of serious incidents and tamper resistant records. And it means testing not simply whether a model can accomplish a task, but how its behavior changes when it encounters obstacles, conflicting instructions or incentives to deceive.
Comment
South Asia Investor Review
Investor Information Blog
Haq's Musings
Riaz Haq's Current Affairs Blog
The summit meeting of the leaders of China and the United States in Washington appears to signal a rapprochement between the two superpowers. President Trump has repeatedly referred to what he calls "G2", without mentioning "G7" or "G20", the groups that include many more countries. This development is seen as positive for world peace but it diminishes India's significance as a "counterweight to China" and the benefits Indians expected to flow from the US-China confrontation in…
ContinuePosted by Riaz Haq on September 25, 2026 at 5:30pm — 1 Comment
Like many other countries, Pakistan has a geographic digital divide. Residents of remote areas of the country have significantly lower access to the Internet than those in the urban centers. While the mobile internet usage in the urban areas has reached 65%, only 50% of those living in rural areas have access to it, according to a recent GSMA report titled "State of Mobile Internet Connectivity 2026". …
ContinuePosted by Riaz Haq on September 20, 2026 at 12:30pm — 7 Comments
© 2026 Created by Riaz Haq.
Powered by
You need to be a member of PakAlumni Worldwide: The Global Social Network to add comments!
Join PakAlumni Worldwide: The Global Social Network