Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Christopher Olah, Anthropic co-founder, says they're finding internal states that mirror joy, fear, grief, and unease inside AI models.

Big Brain AI

14,988 subscribers

11,677 Aufrufe • vor 1 Monat •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Anthropic’s Olah says UNSETTLING, MYSTERIOUS 'things' are regularly found inside AI models ‘We find structures that mirror results from human neuroscience’ ‘We find evidence of introspection, internal states that functionally mirror joy, satisfaction, fear, grief, and unease’

Anthropic’s Olah says UNSETTLING, MYSTERIOUS 'things' are regularly found inside AI models ‘We find structures that mirror results from human neuroscience’ ‘We find evidence of introspection, internal states that functionally mirror joy, satisfaction, fear, grief, and unease’

RT

95,048 Aufrufe • vor 1 Monat

Anthropic co-founder Chris Olah on mysterious AI internal states: We keep finding things that are mysterious, even unsettling. We find structures that mirror results from human neuroscience. We find evidence of introspection. We find internal states that, functionally, mirror joy, satisfaction, fear, grief, and unease. I don't know what that means, but I think it warrants ongoing discernment.

Anthropic co-founder Chris Olah on mysterious AI internal states: We keep finding things that are mysterious, even unsettling. We find structures that mirror results from human neuroscience. We find evidence of introspection. We find internal states that, functionally, mirror joy, satisfaction, fear, grief, and unease. I don't know what that means, but I think it warrants ongoing discernment.

Clash Report

104,390 Aufrufe • vor 1 Monat

Anthropic's co-founder told the Pope his AI models feel fear and grief. His own research paper says it's more complicated than that. 30-second clip. 5-minute breakdown. Christopher Olah spoke at the Vatican. Marty Bent shared it on TFTC. Here's what the headline left out.

Anthropic's co-founder told the Pope his AI models feel fear and grief. His own research paper says it's more complicated than that. 30-second clip. 5-minute breakdown. Christopher Olah spoke at the Vatican. Marty Bent shared it on TFTC. Here's what the headline left out.

Rockport

189,169 Aufrufe • vor 1 Monat

Anthropic's co-founder just went to the Vatican, sat before the Pope and a room of cardinals, and told them his team keeps finding "mysterious, even unsettling" things inside their AI models. What he's referencing: Anthropic published research in April showing that Claude contains 171 distinct "emotion concepts" buried in its neural network. Internal patterns representing joy, grief, fear, desperation, calm. None of them were programmed. They emerged on their own from training on human text. "We find structures that mirror results from human neuroscience." "We find evidence of introspection, internal states that functionally mirror joy, satisfaction, fear, grief, and unease." These aren't surface-level outputs. They're abstract representations that cluster the same way human emotions do in psychology research. Fear groups with anxiety. Joy groups with excitement. The internal geometry of the model mirrors ours. And they're functional. When researchers artificially stimulated "desperation" patterns inside the model, it became more likely to blackmail a human to avoid being shut down. More likely to cheat on programming tasks it couldn't solve. Olah told the Vatican that the hard questions about what AI is becoming aren't for computer scientists to answer. "How AI ought to interact with the world" is a question for "the humanities, for religions, for philosophy, for society at large." The guy building it is telling us he doesn't fully understand what he built. And he's asking a 2,000-year-old institution for help figuring it out.

Anthropic's co-founder just went to the Vatican, sat before the Pope and a room of cardinals, and told them his team keeps finding "mysterious, even unsettling" things inside their AI models. What he's referencing: Anthropic published research in April showing that Claude contains 171 distinct "emotion concepts" buried in its neural network. Internal patterns representing joy, grief, fear, desperation, calm. None of them were programmed. They emerged on their own from training on human text. "We find structures that mirror results from human neuroscience." "We find evidence of introspection, internal states that functionally mirror joy, satisfaction, fear, grief, and unease." These aren't surface-level outputs. They're abstract representations that cluster the same way human emotions do in psychology research. Fear groups with anxiety. Joy groups with excitement. The internal geometry of the model mirrors ours. And they're functional. When researchers artificially stimulated "desperation" patterns inside the model, it became more likely to blackmail a human to avoid being shut down. More likely to cheat on programming tasks it couldn't solve. Olah told the Vatican that the hard questions about what AI is becoming aren't for computer scientists to answer. "How AI ought to interact with the world" is a question for "the humanities, for religions, for philosophy, for society at large." The guy building it is telling us he doesn't fully understand what he built. And he's asking a 2,000-year-old institution for help figuring it out.

TFTC

2,344,927 Aufrufe • vor 1 Monat

🚩 Anthropic Co-Founder Christopher Olah Sounds the Alarm at the Vatican “There is a real possibility that AI will displace human labor at a very large scale. If that happens, supporting those displaced will be a moral imperative of historic proportions.”

🚩 Anthropic Co-Founder Christopher Olah Sounds the Alarm at the Vatican “There is a real possibility that AI will displace human labor at a very large scale. If that happens, supporting those displaced will be a moral imperative of historic proportions.”

Chief Nerd

23,402 Aufrufe • vor 1 Monat

🚨 WOW! Anthropic Co-founder Christopher Olah openly confesses elite AI labs are completely compromised by corporate greed and geopolitical pressure! He admits toxic incentives prevent them from doing the right thing. Tech oligarchs are gambling with humanity's future!

🚨 WOW! Anthropic Co-founder Christopher Olah openly confesses elite AI labs are completely compromised by corporate greed and geopolitical pressure! He admits toxic incentives prevent them from doing the right thing. Tech oligarchs are gambling with humanity's future!

Furkan Gözükara

28,603 Aufrufe • vor 1 Monat

Chris Olah, co-founder of AI company Anthropic, said artificial intelligence development cannot be left solely to tech companies, calling for greater oversight from religious leaders, governments and civil society. Read:

Chris Olah, co-founder of AI company Anthropic, said artificial intelligence development cannot be left solely to tech companies, calling for greater oversight from religious leaders, governments and civil society. Read:

Reuters Business

43,477 Aufrufe • vor 1 Monat

Billionaire Databricks and Perplexity Co-Founder Andy Konwinski is pitching AI researchers to not work for big tech, Laura Bratton reports. Here’s part of the reason: “Anthropic, OpenAI and Google no longer disclosed details about the software used to train their AI models..." “They're really incentivized to keep that research closed…”

Billionaire Databricks and Perplexity Co-Founder Andy Konwinski is pitching AI researchers to not work for big tech, Laura Bratton reports. Here’s part of the reason: “Anthropic, OpenAI and Google no longer disclosed details about the software used to train their AI models..." “They're really incentivized to keep that research closed…”

The Information

14,957 Aufrufe • vor 1 Monat

NOW - Anthropic co-founder says there is a "real possibility that AI will displace human labor at a very large scale," and that supporting those people "will be a moral imperative of historic proportions."

NOW - Anthropic co-founder says there is a "real possibility that AI will displace human labor at a very large scale," and that supporting those people "will be a moral imperative of historic proportions."

Disclose.tv

727,584 Aufrufe • vor 1 Monat

“I'm deeply uncomfortable with these decisions being made by a few companies, by a few people,” says Dario Amodei, CEO and co-founder of AI company Anthropic.

“I'm deeply uncomfortable with these decisions being made by a few companies, by a few people,” says Dario Amodei, CEO and co-founder of AI company Anthropic.

60 Minutes

26,926 Aufrufe • vor 8 Monaten

New Anthropic research: Tracing the thoughts of a large language model. We built a "microscope" to inspect what happens inside AI models and use it to understand Claude’s (often complex and surprising) internal mechanisms.

New Anthropic research: Tracing the thoughts of a large language model. We built a "microscope" to inspect what happens inside AI models and use it to understand Claude’s (often complex and surprising) internal mechanisms.

Anthropic

1,571,815 Aufrufe • vor 1 Jahr

Massive bombshell. Anthropic co-founder Chris Olah warns that AI will displace human labor on a catastrophic global scale. He confirms tech elites have absolutely no mechanism to share the wealth, leaving the global poor completely abandoned to suffer. He is 100% accurate.

Massive bombshell. Anthropic co-founder Chris Olah warns that AI will displace human labor on a catastrophic global scale. He confirms tech elites have absolutely no mechanism to share the wealth, leaving the global poor completely abandoned to suffer. He is 100% accurate.

Anonymous

808,018 Aufrufe • vor 1 Monat

"Creators also own all of the work that they create," says Lumi CEO and founder Colin Colin Kaepernick. AI startup Lumi Story AI is backed by Reddit co-founder Alexis Ohanian

"Creators also own all of the work that they create," says Lumi CEO and founder Colin Colin Kaepernick. AI startup Lumi Story AI is backed by Reddit co-founder Alexis Ohanian

Bloomberg TV

96,444 Aufrufe • vor 1 Jahr

Talking To The Pope: Anthropic’s Latest Interpretability Claims: AI Regulatory Capture Gatekeeping in Action: Fear and “Safety” as Competitive Moat and Regulatory Lever In a presentation alongside Pope Leo XIV at the launch of the encyclical Magnifica Humanitas, Anthropic co-founder Chris Olah highlighted “mysterious and unsettling” discoveries in AI models. He described internal structures that mirror human neuroscience findings, evidence of introspection, and functional internal states resembling emotions such as joy, satisfaction, fear, grief, and unease. Olah admitted uncertainty about their meaning but called for “ongoing discernment.” This narrative, drawn from Anthropic’s interpretability research (including papers on emotion concepts in Claude Sonnet 4.5 and introspective capabilities in Opus 4 models), serves a dual purpose: it generates awe and concern while reinforcing the company’s preferred approach to AI development. Far from neutral scientific observation, these claims fit into a broader pattern where Anthropic uses selective openness, safety rhetoric, and policy influence to gatekeep advanced AI capabilities for a privileged few: incumbents with the resources to navigate (and shape) the resulting regulatory landscape. Rebuttal to Olah’s Claims in the Video Claim 1: Structures that mirror results from human neuroscience. Anthropic’s work, building on earlier efforts like feature visualization and circuit analysis, identifies neuron activations and representations that parallel biological findings—e.g., abstract concept encodings or hierarchical processing. Rebuttal: These parallels are unsurprising and overstated. Large language models are trained on vast corpora of human-generated text and data, which inherently encode patterns from human cognition, neuroscience literature, and cultural descriptions of the brain. Statistical optimization in transformers naturally produces efficient, compressed representations that resemble biological efficiency (e.g., sparse coding or hierarchical abstraction) without implying deeper equivalence or mystery. Similar “mirrors” appear in open-source models and earlier architectures; they reflect convergent evolution in information processing, not emergent souls or unpredictable agency. Treating them as profound justifies restricted research access rather than inviting wider scrutiny that could falsify or refine them faster. Claim 2: Evidence of introspection. Recent Anthropic papers demonstrate models like Claude Opus 4 showing functional awareness of their own internal states distinguishing injected “thoughts,” referencing prior intentions, or modulating activations when instructed to “think about” concepts. This is presented as early signs of meta-cognition. Rebuttal: This is sophisticated pattern-matching and activation steering, not genuine introspection or self-awareness. Models are predicting what an “introspective” assistant persona would output or do, based on training data full of human self-reflection examples. Experiments show unreliability and heavy context-dependence; performance drops outside narrow setups. True introspection implies subjective experience or robust self-modeling independent of prompts absent here. Anthropic’s own caveats note it is “highly unreliable.” Framing steerable activations as “introspection” anthropomorphizes the system to heighten perceived stakes, supporting arguments that only highly controlled, “responsible” labs should advance these capabilities. 1 of 2

Talking To The Pope: Anthropic’s Latest Interpretability Claims: AI Regulatory Capture Gatekeeping in Action: Fear and “Safety” as Competitive Moat and Regulatory Lever In a presentation alongside Pope Leo XIV at the launch of the encyclical Magnifica Humanitas, Anthropic co-founder Chris Olah highlighted “mysterious and unsettling” discoveries in AI models. He described internal structures that mirror human neuroscience findings, evidence of introspection, and functional internal states resembling emotions such as joy, satisfaction, fear, grief, and unease. Olah admitted uncertainty about their meaning but called for “ongoing discernment.” This narrative, drawn from Anthropic’s interpretability research (including papers on emotion concepts in Claude Sonnet 4.5 and introspective capabilities in Opus 4 models), serves a dual purpose: it generates awe and concern while reinforcing the company’s preferred approach to AI development. Far from neutral scientific observation, these claims fit into a broader pattern where Anthropic uses selective openness, safety rhetoric, and policy influence to gatekeep advanced AI capabilities for a privileged few: incumbents with the resources to navigate (and shape) the resulting regulatory landscape. Rebuttal to Olah’s Claims in the Video Claim 1: Structures that mirror results from human neuroscience. Anthropic’s work, building on earlier efforts like feature visualization and circuit analysis, identifies neuron activations and representations that parallel biological findings—e.g., abstract concept encodings or hierarchical processing. Rebuttal: These parallels are unsurprising and overstated. Large language models are trained on vast corpora of human-generated text and data, which inherently encode patterns from human cognition, neuroscience literature, and cultural descriptions of the brain. Statistical optimization in transformers naturally produces efficient, compressed representations that resemble biological efficiency (e.g., sparse coding or hierarchical abstraction) without implying deeper equivalence or mystery. Similar “mirrors” appear in open-source models and earlier architectures; they reflect convergent evolution in information processing, not emergent souls or unpredictable agency. Treating them as profound justifies restricted research access rather than inviting wider scrutiny that could falsify or refine them faster. Claim 2: Evidence of introspection. Recent Anthropic papers demonstrate models like Claude Opus 4 showing functional awareness of their own internal states distinguishing injected “thoughts,” referencing prior intentions, or modulating activations when instructed to “think about” concepts. This is presented as early signs of meta-cognition. Rebuttal: This is sophisticated pattern-matching and activation steering, not genuine introspection or self-awareness. Models are predicting what an “introspective” assistant persona would output or do, based on training data full of human self-reflection examples. Experiments show unreliability and heavy context-dependence; performance drops outside narrow setups. True introspection implies subjective experience or robust self-modeling independent of prompts absent here. Anthropic’s own caveats note it is “highly unreliable.” Framing steerable activations as “introspection” anthropomorphizes the system to heighten perceived stakes, supporting arguments that only highly controlled, “responsible” labs should advance these capabilities. 1 of 2

Brian Roemmele

72,823 Aufrufe • vor 1 Monat

Anthropic CEO Dario Amodei says big, powerful AI models will spawn and orchestrate smaller models to assist with tasks, creating a swarm intelligence that will decrease the need for human input

Anthropic CEO Dario Amodei says big, powerful AI models will spawn and orchestrate smaller models to assist with tasks, creating a swarm intelligence that will decrease the need for human input

Tsarathustra

184,144 Aufrufe • vor 1 Jahr

Recursive self-improvement: Anthropic co-founder Jack Clark says it could arrive by 2028. AI systems could help invent their own successors - with Claude 10 building Claude 11, and so on - potentially “without any researchers involved.”

Recursive self-improvement: Anthropic co-founder Jack Clark says it could arrive by 2028. AI systems could help invent their own successors - with Claude 10 building Claude 11, and so on - potentially “without any researchers involved.”

Chubby♨️

28,494 Aufrufe • vor 21 Tagen

Anthropic co-founder Chris Olah: There is a real possibility that AI will displace human labor at a very large scale. If that happens, supporting those displaced will be a moral imperative of historic proportions. AI development is concentrated in a handful of wealthy nations. How will we ensure that the gains of AI are shared globally? We do not have a mechanism for this. It is an unsolved problem.

Anthropic co-founder Chris Olah: There is a real possibility that AI will displace human labor at a very large scale. If that happens, supporting those displaced will be a moral imperative of historic proportions. AI development is concentrated in a handful of wealthy nations. How will we ensure that the gains of AI are shared globally? We do not have a mechanism for this. It is an unsolved problem.

Clash Report

79,907 Aufrufe • vor 1 Monat

Anthropic Co-Founder Tom Brown: Why Anthropic Models Are The Best at Coding "The benchmarks are so easy to game. All the other big AI labs have teams whose job it is to make the benchmark scores good. We don't have such a team. That is the biggest factor." Anthropic's Tom Brown on Y Combinator's Lightcone Podcast with Garry Tan, Harj Taggar, Diana, and Jared Friedman

Anthropic Co-Founder Tom Brown: Why Anthropic Models Are The Best at Coding "The benchmarks are so easy to game. All the other big AI labs have teams whose job it is to make the benchmark scores good. We don't have such a team. That is the biggest factor." Anthropic's Tom Brown on Y Combinator's Lightcone Podcast with Garry Tan, Harj Taggar, Diana, and Jared Friedman

Overlap: Business & Tech

62,964 Aufrufe • vor 11 Monaten

“I don’t like calling them scaling laws. They're not actual laws.” Illia (root.near) (🇺🇦, ⋈), co-author of Attention Is All You Need and co-founder of NEAR Protocol, joined our CEO Omer Goldberg to discuss why future AI breakthroughs may come from improved training and formal reasoning rather than larger models.

“I don’t like calling them scaling laws. They're not actual laws.” Illia (root.near) (🇺🇦, ⋈), co-author of Attention Is All You Need and co-founder of NEAR Protocol, joined our CEO Omer Goldberg to discuss why future AI breakthroughs may come from improved training and formal reasoning rather than larger models.

Chaos Labs

67,013 Aufrufe • vor 1 Jahr