Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Multimodal AGI will explain ideas the way humans do. Through video, audio, and real time interaction, instead of long blocks of text. WALL-E imagined this almost 20 years ago.

EthanHe_42's profile picture

Ethan He

37,647 subscribers

49,715 Aufrufe • vor 6 Monaten •via X (Twitter)

BildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

It kinda reminds me of this video from 14 years ago, especially with the way the blocks are rendered
0:58

It kinda reminds me of this video from 14 years ago, especially with the way the blocks are rendered

ARDmation

19,205 Aufrufe • vor 1 Monat

Sam Altman says definitions of AGI from five years ago have already been surpassed the real breakthrough is superintelligence: a system that can discover new science by itself or greatly help humans do it "that would almost define superintelligence"
1:11

Sam Altman says definitions of AGI from five years ago have already been surpassed the real breakthrough is superintelligence: a system that can discover new science by itself or greatly help humans do it "that would almost define superintelligence"

Haider.

55,195 Aufrufe • vor 1 Jahr

Building these mini web-apps and learning things the way you want, with interaction and customization, seems like the future and makes the whole wall-of-text answers (however well formatted) feel old. Multimodality and voice interactions on top of this will make it more fun.
1:01

Building these mini web-apps and learning things the way you want, with interaction and customization, seems like the future and makes the whole wall-of-text answers (however well formatted) feel old. Multimodality and voice interactions on top of this will make it more fun.

Aravind Srinivas

43,252 Aufrufe • vor 1 Jahr

VITA Towards Open-Source Interactive Omni Multimodal LLM discuss: The remarkable multimodal capabilities and interactive experience of GPT-4o underscore their necessity in practical applications, yet open-source models rarely excel in both areas. In this paper, we introduce VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience. Starting from Mixtral 8x7B as a language foundation, we expand its Chinese vocabulary followed by bilingual instruction tuning. We further endow the language model with visual and audio capabilities through two-stage multi-task learning of multimodal alignment and instruction tuning. VITA demonstrates robust foundational capabilities of multilingual, vision, and audio understanding, as evidenced by its strong performance across a range of both unimodal and multimodal benchmarks. Beyond foundational capabilities, we have made considerable progress in enhancing the natural multimodal human-computer interaction experience. To the best of our knowledge, we are the first to exploit non-awakening interaction and audio interrupt in MLLM. VITA is the first step for the open-source community to explore the seamless integration of multimodal understanding and interaction. While there is still lots of work to be done on VITA to get close to close-source counterparts, we hope that its role as a pioneer can serve as a cornerstone for subsequent research.
2:21

VITA Towards Open-Source Interactive Omni Multimodal LLM discuss: The remarkable multimodal capabilities and interactive experience of GPT-4o underscore their necessity in practical applications, yet open-source models rarely excel in both areas. In this paper, we introduce VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience. Starting from Mixtral 8x7B as a language foundation, we expand its Chinese vocabulary followed by bilingual instruction tuning. We further endow the language model with visual and audio capabilities through two-stage multi-task learning of multimodal alignment and instruction tuning. VITA demonstrates robust foundational capabilities of multilingual, vision, and audio understanding, as evidenced by its strong performance across a range of both unimodal and multimodal benchmarks. Beyond foundational capabilities, we have made considerable progress in enhancing the natural multimodal human-computer interaction experience. To the best of our knowledge, we are the first to exploit non-awakening interaction and audio interrupt in MLLM. VITA is the first step for the open-source community to explore the seamless integration of multimodal understanding and interaction. While there is still lots of work to be done on VITA to get close to close-source counterparts, we hope that its role as a pioneer can serve as a cornerstone for subsequent research.

AK

23,958 Aufrufe • vor 1 Jahr

ELON: THE FUTURE OF AI IS REAL-TIME VIDEO COMPREHENSION AND GENERATION Elon said most human-AI interaction will soon happen through real-time video, both in understanding and creating it. He explained that while text carries higher information density, video already dominates the internet in both data generation and compute demand: “Most interaction is going to be real-time video with AI, real-time video comprehension and real-time video generation. That’s going to be most of the load, and that’s how it is for most of the internet right now. Most of the internet is video. Text is a pretty small percentage, but it tends to be higher value or more densely compressed information. If you look at the most bits generated and compute spent, it’s certainly going to be video.” Source: Nikhil Kamath
1:05

ELON: THE FUTURE OF AI IS REAL-TIME VIDEO COMPREHENSION AND GENERATION Elon said most human-AI interaction will soon happen through real-time video, both in understanding and creating it. He explained that while text carries higher information density, video already dominates the internet in both data generation and compute demand: “Most interaction is going to be real-time video with AI, real-time video comprehension and real-time video generation. That’s going to be most of the load, and that’s how it is for most of the internet right now. Most of the internet is video. Text is a pretty small percentage, but it tends to be higher value or more densely compressed information. If you look at the most bits generated and compute spent, it’s certainly going to be video.” Source: Nikhil Kamath

Mario Nawfal

15,670 Aufrufe • vor 7 Monaten

Pretty incredible watching this debate from almost 8 years ago, and realizing that Peter Thiel was just way ahead of his time
4:07

Pretty incredible watching this debate from almost 8 years ago, and realizing that Peter Thiel was just way ahead of his time

Boring_Business

330,495 Aufrufe • vor 6 Monaten

YOUR GRANDCHILDREN WILL BE THE LAST TO READ AND WRITE... Victor Riparbelli, Cofounder and CEO of Synthesia, drops the bombshell - text is dying. Future humans will communicate through audio, video, and immersive tech. No more books, no more writing. Riparbelli: "Future generations will slowly replace text with more intuitive forms of communication" 5,000 years of written civilization ending because TikTok is easier than reading. Welcome to the post-literate future. Source: TEDAI Vienna Oct 2024 @VictorRiparbelli
1:10

YOUR GRANDCHILDREN WILL BE THE LAST TO READ AND WRITE... Victor Riparbelli, Cofounder and CEO of Synthesia, drops the bombshell - text is dying. Future humans will communicate through audio, video, and immersive tech. No more books, no more writing. Riparbelli: "Future generations will slowly replace text with more intuitive forms of communication" 5,000 years of written civilization ending because TikTok is easier than reading. Welcome to the post-literate future. Source: TEDAI Vienna Oct 2024 @VictorRiparbelli

Mario Nawfal

42,397 Aufrufe • vor 11 Monaten

Introducing GPT-4o, our new model which can reason across text, audio, and video in real time. It's extremely versatile, fun to play with, and is a step towards a much more natural form of human-computer interaction (and even human-computer-computer interaction):
5:54

Introducing GPT-4o, our new model which can reason across text, audio, and video in real time. It's extremely versatile, fun to play with, and is a step towards a much more natural form of human-computer interaction (and even human-computer-computer interaction):

Greg Brockman

4,360,347 Aufrufe • vor 2 Jahren

🚨This video was almost 6 years ago now. This was when I confronted Telford police about the grooming scandal and got one of their senior officers to slip up and admit to 40 YEARS of evidence of child grooming in Telford! At the time the media and police had only reported of 20 years of child grooming 😡
0:43

🚨This video was almost 6 years ago now. This was when I confronted Telford police about the grooming scandal and got one of their senior officers to slip up and admit to 40 YEARS of evidence of child grooming in Telford! At the time the media and police had only reported of 20 years of child grooming 😡

Ashlea Simon

351,557 Aufrufe • vor 1 Jahr

CEO OF GOOGLE'S DEEPMIND: AGI IS GOING TO CHANGE EVERYTHING Demis Hassabis: “I think the next steps will bring amazing tools that enhance almost every endeavor we pursue as humans. Then beyond that, when AGI arrives, it's going to change pretty much everything about the way we do things. We’ll need new great philosophers to emerge — hopefully in the next five to ten years — to understand the implications of this.” Source: CBSNews
0:38

CEO OF GOOGLE'S DEEPMIND: AGI IS GOING TO CHANGE EVERYTHING Demis Hassabis: “I think the next steps will bring amazing tools that enhance almost every endeavor we pursue as humans. Then beyond that, when AGI arrives, it's going to change pretty much everything about the way we do things. We’ll need new great philosophers to emerge — hopefully in the next five to ten years — to understand the implications of this.” Source: CBSNews

Mario Nawfal

145,976 Aufrufe • vor 1 Jahr

ELON: GROK 5 WILL UNDERSTAND REAL TIME VIDEO AND CREATE ITS OWN TOOLS “The quality of the data we are training on with Grok 5 is extraordinary. It is inherently multimodal with text, pictures, video, and audio. It is going to be much better at tool use and in fact at creating tools to be more effective at answering questions and understanding the world. Its vision will be extremely good. It will have real time video, which is fundamentally important." Source: Baron Capital
2:10

ELON: GROK 5 WILL UNDERSTAND REAL TIME VIDEO AND CREATE ITS OWN TOOLS “The quality of the data we are training on with Grok 5 is extraordinary. It is inherently multimodal with text, pictures, video, and audio. It is going to be much better at tool use and in fact at creating tools to be more effective at answering questions and understanding the world. Its vision will be extremely good. It will have real time video, which is fundamentally important." Source: Baron Capital

Mario Nawfal

148,015 Aufrufe • vor 8 Monaten

30 years of Never Forget. The last single we released as five. It became the soundtrack to our first goodbye. And not long after, we all said goodbye. But history has a way of circling back. Almost 20 years ago, we found our way to each other again 💙
0:26

30 years of Never Forget. The last single we released as five. It became the soundtrack to our first goodbye. And not long after, we all said goodbye. But history has a way of circling back. Almost 20 years ago, we found our way to each other again 💙

Take That

36,929 Aufrufe • vor 11 Monaten

🚨New Episode Drop!🚨 🧠 AI Research Lab - Explained: The Future is Multimodal You text, share photos, record videos—seamlessly switching between data types. Why can't AI? Our Salesforce AI team builds multimodal systems that understand text, images, audio, and video simultaneously—just like humans. Real applications: ➡️ Visual web interaction (clicking, filling forms) ➡️ Advanced cross-image pattern recognition ➡️ Future robots that see, hear, and communicate Featuring our XGEN-MM (BLIP) model—a breakthrough in visual language understanding. Real intelligence isn't one-dimensional. Neither should AI be. #AIResearch #MultimodalAI #Innovation
4:59

🚨New Episode Drop!🚨 🧠 AI Research Lab - Explained: The Future is Multimodal You text, share photos, record videos—seamlessly switching between data types. Why can't AI? Our Salesforce AI team builds multimodal systems that understand text, images, audio, and video simultaneously—just like humans. Real applications: ➡️ Visual web interaction (clicking, filling forms) ➡️ Advanced cross-image pattern recognition ➡️ Future robots that see, hear, and communicate Featuring our XGEN-MM (BLIP) model—a breakthrough in visual language understanding. Real intelligence isn't one-dimensional. Neither should AI be. #AIResearch #MultimodalAI #Innovation

Salesforce AI Research

13,838 Aufrufe • vor 1 Jahr

Elon Musk on how AGI might actually emerge: “We’re not actually specifically focused on AGI. I’m simply saying that AGI seems likely to be an emergent property of what we’re doing” The reason is the massive real-world data Tesla is generating from autonomous cars and humanoid robots This is not internet data. This is real-world interaction driving on messy roads, navigating unpredictable environments, and interacting with people With tens or hundreds of millions of autonomous vehicles and potentially even more humanoids, the amount of real-world video and data being processed will be enormous From this, cars will become far better than human drivers, and humanoid robots will become increasingly indistinguishable from humans AGI might not come from a lab trying to build it directly. It may simply emerge from building useful robots at massive scale
1:11

Elon Musk on how AGI might actually emerge: “We’re not actually specifically focused on AGI. I’m simply saying that AGI seems likely to be an emergent property of what we’re doing” The reason is the massive real-world data Tesla is generating from autonomous cars and humanoid robots This is not internet data. This is real-world interaction driving on messy roads, navigating unpredictable environments, and interacting with people With tens or hundreds of millions of autonomous vehicles and potentially even more humanoids, the amount of real-world video and data being processed will be enormous From this, cars will become far better than human drivers, and humanoid robots will become increasingly indistinguishable from humans AGI might not come from a lab trying to build it directly. It may simply emerge from building useful robots at massive scale

X Freeze

21,256 Aufrufe • vor 1 Monat

Just two years ago none of us could've imagined that Maryam will be getting this much Praise & Acknowledgement on just 20 months Governance. Unbelievable deliverance in the span of two years, that too in the province of 120 million people. I’am so happy❤️
1:27

Just two years ago none of us could've imagined that Maryam will be getting this much Praise & Acknowledgement on just 20 months Governance. Unbelievable deliverance in the span of two years, that too in the province of 120 million people. I’am so happy❤️

Sardar Hamza Zahid

17,967 Aufrufe • vor 5 Monaten

Watch the historic moment: 58 years ago, IDF paratroopers advanced through the Old City of Jerusalem, reuniting the city and restoring Jewish sovereignty over the Temple Mount and Western Wall for the first time in 2,000 years.
0:31

Watch the historic moment: 58 years ago, IDF paratroopers advanced through the Old City of Jerusalem, reuniting the city and restoring Jewish sovereignty over the Temple Mount and Western Wall for the first time in 2,000 years.

Israel War Room

19,669 Aufrufe • vor 1 Jahr

ELON: AI WILL SOON BE SMARTER THAN HUMANS IN EVERY WAY WITH AGI Elon warned that the age of artificial general intelligence is near, saying humans will soon no longer be the smartest beings on Earth. He said AGI will surpass human capability entirely and could even replicate human thought and behavior: “Well, I mean, humans have been the smartest creature on Earth for a long time, and that is going to change with what’s typically called artificial general intelligence. This is an AI that is smarter than a human in every way and could even simulate a human.” Source: Axel Springer Award
2:04

ELON: AI WILL SOON BE SMARTER THAN HUMANS IN EVERY WAY WITH AGI Elon warned that the age of artificial general intelligence is near, saying humans will soon no longer be the smartest beings on Earth. He said AGI will surpass human capability entirely and could even replicate human thought and behavior: “Well, I mean, humans have been the smartest creature on Earth for a long time, and that is going to change with what’s typically called artificial general intelligence. This is an AI that is smarter than a human in every way and could even simulate a human.” Source: Axel Springer Award

Mario Nawfal

79,118 Aufrufe • vor 7 Monaten

AGI might be the culmination of human purpose. Lomez: "I've been trying to talk myself out of the inevitability of AGI for a while. It's not even my preference, but that doesn't matter." "There's a teleology of humanness that almost is designed to produce AGI. We're fulfilling almost some kind of Calvinist, religious project." "This is the culmination of human intelligence and ingenuity. I just don't see any way around that." "There's something beautiful about it. It fits. There's some harmony in the idea that humans are designed to do this... to produce an intelligence greater than itself."
2:19

AGI might be the culmination of human purpose. Lomez: "I've been trying to talk myself out of the inevitability of AGI for a while. It's not even my preference, but that doesn't matter." "There's a teleology of humanness that almost is designed to produce AGI. We're fulfilling almost some kind of Calvinist, religious project." "This is the culmination of human intelligence and ingenuity. I just don't see any way around that." "There's something beautiful about it. It fits. There's some harmony in the idea that humans are designed to do this... to produce an intelligence greater than itself."

MTS

69,899 Aufrufe • vor 2 Monaten