Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Introducing GPT-4o, our new model which can reason across text, audio, and video in real time. It's extremely versatile, fun to play with, and is a step towards a much more natural form of human-computer interaction (and even human-computer-computer interaction):

Greg Brockman

1,010,536 subscribers

4,360,286 Aufrufe • vor 2 Jahren •via X (Twitter)

Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

9 Kommentare

Profilbild von Greg Brockman

Greg Brockmanvor 2 Jahren

The new Voice Mode will be coming to ChatGPT Plus in upcoming weeks.

Profilbild von Greg Brockman

Greg Brockmanvor 2 Jahren

GPT-4o can also generate any combination of audio, text, and image outputs, which leads to interesting new capabilities we are still exploring. See e.g. the "Explorations of capabilities" section in our launch blog post ( or these generated images:

Profilbild von Greg Brockman

Greg Brockmanvor 2 Jahren

We also have significantly improved non-English language performance quite a lot, including improving the tokenizer to better compress many of them:

Profilbild von Dennis

Dennisvor 2 Jahren

Dozens of startups obliterated

Profilbild von Benjamin BLM

Benjamin BLMvor 2 Jahren

Audio, text and image? What's in the training data? You need literal billions of images and text tokens. Where did you get them, from the internet?

Profilbild von AshutoshShrivastava

AshutoshShrivastavavor 2 Jahren

Desktop app with Vison is the best feature which was launched definitely game changer.

Profilbild von Charlene Wang

Charlene Wangvor 2 Jahren

gpt4-o’s real time translation is gonna go viral & support the best consumer AI hardware. Saw it translate group conversations and respond in different language. It’s super fast and I can’t wait to use it in Japan!

Profilbild von illusion diffusion

illusion diffusionvor 2 Jahren

where?

Profilbild von Alex Sharp

Alex Sharpvor 2 Jahren

now that ai's can talk to each other i can finally delete all in from my podcast player

Ähnliche Videos

Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time: Text and image input rolling out today in API and ChatGPT with voice and video in the coming weeks.

Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time: Text and image input rolling out today in API and ChatGPT with voice and video in the coming weeks.

OpenAI

22,809,777 Aufrufe • vor 2 Jahren

BREAKING: ChatGPT GPT-4o was just announce by OpenAI. It improves on vision, audio and text. The ease of use is incredibly enhanced. It makes interaction with the GPT much more natural, especially with voice. GPT-4o reasons across voice, text and vision. GPT-4 wil be available to everyone.

BREAKING: ChatGPT GPT-4o was just announce by OpenAI. It improves on vision, audio and text. The ease of use is incredibly enhanced. It makes interaction with the GPT much more natural, especially with voice. GPT-4o reasons across voice, text and vision. GPT-4 wil be available to everyone.

Ed Krassenstein

21,605 Aufrufe • vor 2 Jahren

Stop reading the text !!! Have a graphic dialogue with OpenAI’s #GPT4 with #Graphologue. It turns GPT4-generated text into interactive node-link diagrams in real-time. New Human-Computer Interaction #HCI research makes #AI easier to use. More at

Stop reading the text !!! Have a graphic dialogue with OpenAI’s #GPT4 with #Graphologue. It turns GPT4-generated text into interactive node-link diagrams in real-time. New Human-Computer Interaction #HCI research makes #AI easier to use. More at

Haijun Xia

335,423 Aufrufe • vor 3 Jahren

Is GPT-4o the only tool that can reason across audio, vision and text in real time?… No! So can projects powered $KARRAT

Is GPT-4o the only tool that can reason across audio, vision and text in real time?… No! So can projects powered $KARRAT

Karrat

58,910 Aufrufe • vor 2 Jahren

What if #ChatGPT were 3D? Structure #GPT4's responses in 3D with #Sensecape to better understand large amounts of text. New Human-Computer Interaction #HCI research makes #AI easier to use. More at

What if #ChatGPT were 3D? Structure #GPT4's responses in 3D with #Sensecape to better understand large amounts of text. New Human-Computer Interaction #HCI research makes #AI easier to use. More at

Haijun Xia

79,486 Aufrufe • vor 3 Jahren

I teach the computer how to make music, the computer tells me what to play. It's a never-ending duet — a duet for human and machine. 🔊 Sound on!

I teach the computer how to make music, the computer tells me what to play. It's a never-ending duet — a duet for human and machine. 🔊 Sound on!

Andreas Rau

13,281 Aufrufe • vor 2 Jahren

Introducing Orgo, Computers for AI Agents. AI apps today are constrained to a chat interface and text responses. With Orgo, you can give a model like GPT access to a full computer. Orgo provides full desktop environments which can be controlled by AI models like GPT and Claude. Available now for developers.

Introducing Orgo, Computers for AI Agents. AI apps today are constrained to a chat interface and text responses. With Orgo, you can give a model like GPT access to a full computer. Orgo provides full desktop environments which can be controlled by AI models like GPT and Claude. Available now for developers.

Spencer Kinney

279,643 Aufrufe • vor 1 Jahr

GPT-5.5 is here. It’s our smartest frontier model yet, introducing a new class of intelligence for agentic coding, computer use, knowledge work, and scientific research. Rolling out in ChatGPT and Codex today. API is coming soon.

GPT-5.5 is here. It’s our smartest frontier model yet, introducing a new class of intelligence for agentic coding, computer use, knowledge work, and scientific research. Rolling out in ChatGPT and Codex today. API is coming soon.

OpenAI Developers

600,973 Aufrufe • vor 2 Monaten

🚨 BREAKING: Hugging Face just dropped a free AI agent that uses a computer like a human. It’s called Open Computer Agent, and it mimics real computer use. You can run it in your browser no install required. Here's everything you need to know:

🚨 BREAKING: Hugging Face just dropped a free AI agent that uses a computer like a human. It’s called Open Computer Agent, and it mimics real computer use. You can run it in your browser no install required. Here's everything you need to know:

Ihtesham Haider

245,607 Aufrufe • vor 1 Jahr

Today I'm soft launching , the world's first AI computer. Most people could be creating way more with their computers. Instead, they're stuck consuming content made by other people. Zo Computer is a new kind of computer in the cloud, with an AI that "lives" in your computer. You can choose between all the leading models, and just chat (or text) with your new computer to: • write • research • vibe code • generate images and videos • host websites and APIs • save articles • set reminders • automate your life and much more. And because Zo is *your* personal server, everything is stored and hosted on it – your files, your sites, and even the Zo app itself.

Today I'm soft launching , the world's first AI computer. Most people could be creating way more with their computers. Instead, they're stuck consuming content made by other people. Zo Computer is a new kind of computer in the cloud, with an AI that "lives" in your computer. You can choose between all the leading models, and just chat (or text) with your new computer to: • write • research • vibe code • generate images and videos • host websites and APIs • save articles • set reminders • automate your life and much more. And because Zo is your personal server, everything is stored and hosted on it – your files, your sites, and even the Zo app itself.

ben guo 🏇

33,418 Aufrufe • vor 9 Monaten

🚨NEW: CHATGPT LIVE VOICE MODEL NOW DELIVERS REAL-TIME CONVERSATIONAL TRANSLATION Built on a full-duplex architecture, GPT-Live is a new generation of voice models that can listen and speak simultaneously, enabling more natural human-AI interactions. The breakthrough unlocks fluid back-and-forth conversations, real-time translation, and a far more human sense of timing and context.

🚨NEW: CHATGPT LIVE VOICE MODEL NOW DELIVERS REAL-TIME CONVERSATIONAL TRANSLATION Built on a full-duplex architecture, GPT-Live is a new generation of voice models that can listen and speak simultaneously, enabling more natural human-AI interactions. The breakthrough unlocks fluid back-and-forth conversations, real-time translation, and a far more human sense of timing and context.

Coin Bureau

29,085 Aufrufe • vor 8 Tagen

1/7 For the past decade, our team at Meta Reality Labs (previously CTRL-labs) has been dedicated to developing a neuromotor interface. Our goal is to address the Human Computer Interaction challenge of providing effortless, intuitive, and efficient input to computers.

1/7 For the past decade, our team at Meta Reality Labs (previously CTRL-labs) has been dedicated to developing a neuromotor interface. Our goal is to address the Human Computer Interaction challenge of providing effortless, intuitive, and efficient input to computers.

David Sussillo

642,291 Aufrufe • vor 2 Jahren

VITA Towards Open-Source Interactive Omni Multimodal LLM discuss: The remarkable multimodal capabilities and interactive experience of GPT-4o underscore their necessity in practical applications, yet open-source models rarely excel in both areas. In this paper, we introduce VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience. Starting from Mixtral 8x7B as a language foundation, we expand its Chinese vocabulary followed by bilingual instruction tuning. We further endow the language model with visual and audio capabilities through two-stage multi-task learning of multimodal alignment and instruction tuning. VITA demonstrates robust foundational capabilities of multilingual, vision, and audio understanding, as evidenced by its strong performance across a range of both unimodal and multimodal benchmarks. Beyond foundational capabilities, we have made considerable progress in enhancing the natural multimodal human-computer interaction experience. To the best of our knowledge, we are the first to exploit non-awakening interaction and audio interrupt in MLLM. VITA is the first step for the open-source community to explore the seamless integration of multimodal understanding and interaction. While there is still lots of work to be done on VITA to get close to close-source counterparts, we hope that its role as a pioneer can serve as a cornerstone for subsequent research.

VITA Towards Open-Source Interactive Omni Multimodal LLM discuss: The remarkable multimodal capabilities and interactive experience of GPT-4o underscore their necessity in practical applications, yet open-source models rarely excel in both areas. In this paper, we introduce VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience. Starting from Mixtral 8x7B as a language foundation, we expand its Chinese vocabulary followed by bilingual instruction tuning. We further endow the language model with visual and audio capabilities through two-stage multi-task learning of multimodal alignment and instruction tuning. VITA demonstrates robust foundational capabilities of multilingual, vision, and audio understanding, as evidenced by its strong performance across a range of both unimodal and multimodal benchmarks. Beyond foundational capabilities, we have made considerable progress in enhancing the natural multimodal human-computer interaction experience. To the best of our knowledge, we are the first to exploit non-awakening interaction and audio interrupt in MLLM. VITA is the first step for the open-source community to explore the seamless integration of multimodal understanding and interaction. While there is still lots of work to be done on VITA to get close to close-source counterparts, we hope that its role as a pioneer can serve as a cornerstone for subsequent research.

AK

23,958 Aufrufe • vor 1 Jahr

Did you hear? OpenAI's newest model can reason across audio, vision, and text in real time. How does GPT-4o do with math tutoring?🤔 Salman Khan and his son test it on a Khan Academy math problem. You can get AI-powered math tutoring right now with Khanmigo:

Did you hear? OpenAI's newest model can reason across audio, vision, and text in real time. How does GPT-4o do with math tutoring?🤔 Salman Khan and his son test it on a Khan Academy math problem. You can get AI-powered math tutoring right now with Khanmigo:

Khan Academy

283,766 Aufrufe • vor 2 Jahren

Excited to introduce GPT-4o. Language, vision, and sound -- all together and all in real time. This thing has been so much fun to work on. It's been even more fun to play with -- with moments of magic where things feel totally fluid and I forget I'm video chatting with an AI.

Excited to introduce GPT-4o. Language, vision, and sound -- all together and all in real time. This thing has been so much fun to work on. It's been even more fun to play with -- with moments of magic where things feel totally fluid and I forget I'm video chatting with an AI.

Rowan Zellers

128,683 Aufrufe • vor 2 Jahren

🤔Can we assess agents across various apps & OS w.o. crafting new envs? OSWorld🖥️: A unified, real computer env for multimodal agents to evaluate open-ended computer tasks with arbitrary apps and interfaces on Ubuntu, Windows, & macOS. + annotated 369 real-world computer tasks 👇

🤔Can we assess agents across various apps & OS w.o. crafting new envs? OSWorld🖥️: A unified, real computer env for multimodal agents to evaluate open-ended computer tasks with arbitrary apps and interfaces on Ubuntu, Windows, & macOS. + annotated 369 real-world computer tasks 👇

Tianbao Xie

66,610 Aufrufe • vor 2 Jahren

Excited to announce the MouthPad^, a wearable device that enables expressive, discreet, and convenient hands-free control of digital devices through tongue and other mouth gestures! The MouthPad^ reimagines accessibility and pushes the boundaries of human-computer interaction 1/5

Excited to announce the MouthPad^, a wearable device that enables expressive, discreet, and convenient hands-free control of digital devices through tongue and other mouth gestures! The MouthPad^ reimagines accessibility and pushes the boundaries of human-computer interaction 1/5

Tomás Vega

68,546 Aufrufe • vor 3 Jahren

I joined OpenAI at the beginning of the year -- partly because I was excited about the possibility of better voice interaction with computers. So it was *especially* amazing to work with the team here on the gpt-4o model launch. It's hard to grok until you try it how big of a step forward this is for human/computer voice communication. It feels different -- it's obvious that the model understands you better than anything you've used before. This is my favorite demo of gpt-4o, it demonstrates not just good stt/tts, but actual conversational ability over full, realistic phone call. It's so obvious how useful this will be!

I joined OpenAI at the beginning of the year -- partly because I was excited about the possibility of better voice interaction with computers. So it was especially amazing to work with the team here on the gpt-4o model launch. It's hard to grok until you try it how big of a step forward this is for human/computer voice communication. It feels different -- it's obvious that the model understands you better than anything you've used before. This is my favorite demo of gpt-4o, it demonstrates not just good stt/tts, but actual conversational ability over full, realistic phone call. It's so obvious how useful this will be!

Peter Bakkum

144,441 Aufrufe • vor 2 Jahren

Claude computer use is too expensive check out ShowUI Local Run! Now, you can use a lightweight model to power a local GUI Agent. It's compatible with "GPT-4o + ShowUI" and "Qwen2-VL + ShowUI" Each task costs just a few cents—30x cheaper than Claude!

Claude computer use is too expensive check out ShowUI Local Run! Now, you can use a lightweight model to power a local GUI Agent. It's compatible with "GPT-4o + ShowUI" and "Qwen2-VL + ShowUI" Each task costs just a few cents—30x cheaper than Claude!

AK

30,937 Aufrufe • vor 1 Jahr