Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

🚀 ChatGPT Realtime API in ACTION 🌐 Here's the application Integrated with: 🌦️ Realtime Weather 🧠 Ability to Save in Memory 🔧 Uses Function Calling Use this code and extend it from here! 💡👨‍💻

Mervin Praison

11,350 subscribers

42,982 Aufrufe • vor 1 Jahr •via X (Twitter)

Nachrichten & Politik Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

7 Kommentare

Profilbild von Shawn

Shawnvor 1 Jahr

The price is gonna have to come way down and this will be really popular

Profilbild von 🐧 lalo adrian morales 𝕏

🐧 lalo adrian morales 𝕏vor 1 Jahr

heckkkkk yeah!! Its gettin COOOOLER

Profilbild von steve ike

steve ikevor 1 Jahr

Super cool demo. Nice work! Looking forward to playing with the realtime APIs soon.

Profilbild von Dean

Deanvor 1 Jahr

This is brilliant, @MervinPraison. How was the latency between your speech and the response?

Profilbild von Mervin Praison

Mervin Praisonvor 1 Jahr

It was immediate. Didn't notice any lag.

Profilbild von ZAZO

ZAZOvor 1 Jahr

Memory function is killer

Profilbild von Shajeel Afzal

Shajeel Afzalvor 1 Jahr

Is it builtin memory or did you do it yourself?

Ähnliche Videos

I've been having a ton of fun exploring the Realtime API from OpenAI. Today they just launched the ability to connect to it over WebRTC! 🤖🖐️ It supports Tool Calling, so check out what that looks like in Realtime function calling in any browser based app. I built a template that allows for relaying through a Cloudflare Developers Worker so you can do it too! Full 📼 in 🧵

I've been having a ton of fun exploring the Realtime API from OpenAI. Today they just launched the ability to connect to it over WebRTC! 🤖🖐️ It supports Tool Calling, so check out what that looks like in Realtime function calling in any browser based app. I built a template that allows for relaying through a Cloudflare Developers Worker so you can do it too! Full 📼 in 🧵

Craig Dennis

60,091 Aufrufe • vor 1 Jahr

Voice is the OG modality. So excited for image inputs, function calling & MCP support in the Realtime API GA! `gpt-realtime` is a lot more natural and expressive, and every time a SOTA voice model is released, you know what I gotta do... Here is the new voice Marin, on KaraokeBench! scores 3 out of 7 again from me

Voice is the OG modality. So excited for image inputs, function calling & MCP support in the Realtime API GA! `gpt-realtime` is a lot more natural and expressive, and every time a SOTA voice model is released, you know what I gotta do... Here is the new voice Marin, on KaraokeBench! scores 3 out of 7 again from me

swyx

51,219 Aufrufe • vor 10 Monaten

Nano Banana Lite is fast! 🍌🚀 I put it to the test with the Interactions API and Gemini Live to illustrate stories in near-realtime 🤯👇 Try it out now 👉

Nano Banana Lite is fast! 🍌🚀 I put it to the test with the Interactions API and Gemini Live to illustrate stories in near-realtime 🤯👇 Try it out now 👉

Thor 雷神 ⚡️

13,219 Aufrufe • vor 13 Tagen

another realtime api trick i stumbled upon 💡 to prevent the model from "jumping in" to speak whenever you pause, you can give it a stay_silent() function that does nothing it'll call it when it knows you haven't finished your thought, even if you pause - full prompt below👇 -

another realtime api trick i stumbled upon 💡 to prevent the model from "jumping in" to speak whenever you pause, you can give it a stay_silent() function that does nothing it'll call it when it knows you haven't finished your thought, even if you pause - full prompt below👇 -

ilan bigio

74,212 Aufrufe • vor 1 Jahr

Here's the crazy #smilingfriends Jesse puppet in action. Had such a fun time making it and working with ZAM STUDIOS / Aron Fromm was a breeze! #UnrealEngine #RealTime #Zbrush #Houdini

Here's the crazy #smilingfriends Jesse puppet in action. Had such a fun time making it and working with ZAM STUDIOS / Aron Fromm was a breeze! #UnrealEngine #RealTime #Zbrush #Houdini

Ryan Corniel

1,482,382 Aufrufe • vor 8 Monaten

The week in OpenAI and Anthropic news (Week 19, 2026) OpenAI rolled out GPT-5.5 Instant as the new ChatGPT default model with memory sources and ChatGPT for Excel and Google Sheets globally, launched three new realtime voice models in the API (GPT-Realtime-2, GPT-Realtime-Translate, GPT-Realtime-Whisper) and an OpenAI CLI, introduced Trusted Contact safety feature, GPT-5.5-Cyber for defenders, B2B Signals report, ChatGPT Futures Class of 2026, EMEA youth safety blueprint, privacy in model training explainer, expanded ads pilot, published engineering posts on low-latency voice, MRC supercomputer networking, running Codex safely internally, and investigating accidental chain-of-thought grading during reinforcement learning, plus discovered ChatGPT Personal Wiki and dropped a goblin-themed merch line that sold out Anthropic hosted Code with Claude developer conference in San Francisco, announced a new enterprise AI services company with Blackstone, Hellman & Friedman, and Goldman Sachs, signed a SpaceX compute partnership and raised Claude Code and API usage limits, made Claude for Excel, PowerPoint, and Word generally available with Claude for Outlook in beta, launched Workload Identity Federation, financial services agent templates, dreaming, outcomes, and multiagent orchestration in Managed Agents, shipped 60+ Claude Code reliability fixes, published research on agentic misalignment training, sandbagging mitigation, model spec midtraining, and Natural Language Autoencoders, donated Petri to Meridian Labs, introduced The Anthropic Institute research agenda, plus discovered Orbit proactive assistant for Cowork and /radio command in Claude Code, and more

The week in OpenAI and Anthropic news (Week 19, 2026) OpenAI rolled out GPT-5.5 Instant as the new ChatGPT default model with memory sources and ChatGPT for Excel and Google Sheets globally, launched three new realtime voice models in the API (GPT-Realtime-2, GPT-Realtime-Translate, GPT-Realtime-Whisper) and an OpenAI CLI, introduced Trusted Contact safety feature, GPT-5.5-Cyber for defenders, B2B Signals report, ChatGPT Futures Class of 2026, EMEA youth safety blueprint, privacy in model training explainer, expanded ads pilot, published engineering posts on low-latency voice, MRC supercomputer networking, running Codex safely internally, and investigating accidental chain-of-thought grading during reinforcement learning, plus discovered ChatGPT Personal Wiki and dropped a goblin-themed merch line that sold out Anthropic hosted Code with Claude developer conference in San Francisco, announced a new enterprise AI services company with Blackstone, Hellman & Friedman, and Goldman Sachs, signed a SpaceX compute partnership and raised Claude Code and API usage limits, made Claude for Excel, PowerPoint, and Word generally available with Claude for Outlook in beta, launched Workload Identity Federation, financial services agent templates, dreaming, outcomes, and multiagent orchestration in Managed Agents, shipped 60+ Claude Code reliability fixes, published research on agentic misalignment training, sandbagging mitigation, model spec midtraining, and Natural Language Autoencoders, donated Petri to Meridian Labs, introduced The Anthropic Institute research agenda, plus discovered Orbit proactive assistant for Cowork and /radio command in Claude Code, and more

Tibor Blaho

12,602 Aufrufe • vor 2 Monaten

Test the real-time GI function in #Unity6, without any baking, and only use real-time GI to achieve the sense of volume.😊 Come and subscribe to my Fanbox to download this project #Unity #VFX #shader #realtime

Test the real-time GI function in #Unity6, without any baking, and only use real-time GI to achieve the sense of volume.😊 Come and subscribe to my Fanbox to download this project #Unity #VFX #shader #realtime

Sakura Rabbit 樱花兔

66,699 Aufrufe • vor 2 Jahren

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

kwindla

54,912 Aufrufe • vor 2 Monaten

We've been shipping a lot with our Visual Studio Code weekly releases! 🚀 Here's a roundup of some of the highlights from the past month: 🤖 Autopilot 🌐 Integrated browser debugging 🎨 Refreshed themes 📸 Images & video in chat … and much more!

We've been shipping a lot with our Visual Studio Code weekly releases! 🚀 Here's a roundup of some of the highlights from the past month: 🤖 Autopilot 🌐 Integrated browser debugging 🎨 Refreshed themes 📸 Images & video in chat … and much more!

Visual Studio Code

32,412 Aufrufe • vor 3 Monaten

Watch this demo from Thor 雷神 ⚡️ to see Gemini 3.1 Flash Live in action as a real-time DJ. The model uses function calling (to the Gemini API) to generate custom 30-second clips using Lyria 3️⃣ Start your own studio session in Google AI Studio:

Watch this demo from Thor 雷神 ⚡️ to see Gemini 3.1 Flash Live in action as a real-time DJ. The model uses function calling (to the Gemini API) to generate custom 30-second clips using Lyria 3️⃣ Start your own studio session in Google AI Studio:

Google AI Developers

11,216 Aufrufe • vor 2 Monaten

This demo is insane. A student shares their iPad screen with the new ChatGPT + GPT-4o, and the AI speaks with them and helps them learn in *realtime*. Imagine giving this to every student in the world. The future is so, so bright.

This demo is insane. A student shares their iPad screen with the new ChatGPT + GPT-4o, and the AI speaks with them and helps them learn in realtime. Imagine giving this to every student in the world. The future is so, so bright.

Mckay Wrigley

10,928,676 Aufrufe • vor 2 Jahren

Today, we’re excited to launch Razorpay Blade's MCP! 🚀 🎨 Blade is a customizable, themeable design system. Use it as is, or bring your brand colors. 💡 With MCP, go from prompt to code in seconds, with the quality of a battle tested DS. 🌐 OSS →

Razorpay Tech

13,693 Aufrufe • vor 1 Jahr

I've been working with Jakub Červený to integrate our #GaussianSplatting renderer with #threejs, I created this infinite portal demo as a feature showcase! You can play with it live here This is captured in realtime on my mac, here's how it works: 🧵

I've been working with Jakub Červený to integrate our #GaussianSplatting renderer with #threejs, I created this infinite portal demo as a feature showcase! You can play with it live here This is captured in realtime on my mac, here's how it works: 🧵

🌈 George Corney

101,648 Aufrufe • vor 2 Jahren

Function calling is a powerful way to extend the capabilities of LLMs and AI agents by letting them use external tools. Our new short course Function calling and Data Extraction with LLMs, created with @NexusflowX and taught by Jiantao Jiao and Venkat, demonstrates how to prompt LLMs to form calls to external functions. You'll work with NexusRavenV2-13B, a 13B parameter open-source model that excels in function calling tasks while still being small enough to host locally. Learn to use function calling to extract structured data from unstructured text and access web APIs, and build an end-to-end application that processes customer service transcripts. You'll learn how to build LLM-powered applications that can analyze feedback, automate data entry, and enhance search. Please get started here:

Function calling is a powerful way to extend the capabilities of LLMs and AI agents by letting them use external tools. Our new short course Function calling and Data Extraction with LLMs, created with @NexusflowX and taught by Jiantao Jiao and Venkat, demonstrates how to prompt LLMs to form calls to external functions. You'll work with NexusRavenV2-13B, a 13B parameter open-source model that excels in function calling tasks while still being small enough to host locally. Learn to use function calling to extract structured data from unstructured text and access web APIs, and build an end-to-end application that processes customer service transcripts. You'll learn how to build LLM-powered applications that can analyze feedback, automate data entry, and enhance search. Please get started here:

Andrew Ng

110,420 Aufrufe • vor 2 Jahren

here is the first look at realtime voice mode in codex the ui is already in the app, but the codex backend endpoint does not seem to be live yet i got it running by forcing the local feature gate and using my own openai api key, so it goes through the public realtime api instead it's incredible, but this demo alone cost me ~$4 gpt realtime 2 is very expensive, which makes me wonder how they're going to handle it - part of the normal usage limit, or a separate limit like we had with gpt 5.3 codex spark? i'm turning it off until the official rollout but get excited, the next few weeks are going to be amazing

here is the first look at realtime voice mode in codex the ui is already in the app, but the codex backend endpoint does not seem to be live yet i got it running by forcing the local feature gate and using my own openai api key, so it goes through the public realtime api instead it's incredible, but this demo alone cost me ~$4 gpt realtime 2 is very expensive, which makes me wonder how they're going to handle it - part of the normal usage limit, or a separate limit like we had with gpt 5.3 codex spark? i'm turning it off until the official rollout but get excited, the next few weeks are going to be amazing

🥔🥔🥔

39,408 Aufrufe • vor 1 Monat

It’s like Bloomberg meets the world monitor Elie Habib I put Virat Singh financial dataset api to cross reference all the realtime data to make realtime financial decisions and executions. Got multiple agents already inside Convex style and even got Grok with xAI feed This is one of the most powerful GitHub’s I have ever forked in my life brother

It’s like Bloomberg meets the world monitor Elie Habib I put Virat Singh financial dataset api to cross reference all the realtime data to make realtime financial decisions and executions. Got multiple agents already inside Convex style and even got Grok with xAI feed This is one of the most powerful GitHub’s I have ever forked in my life brother

8Bit🦞

20,138 Aufrufe • vor 4 Monaten

I've never used a model that feels this liberating. It's like manifesting daydreams in near realtime, just genuinely cool to use. Got the idea in the subway, generating with Whisper Thunder while in between meetings, 10 mins of editing. And you have it.

I've never used a model that feels this liberating. It's like manifesting daydreams in near realtime, just genuinely cool to use. Got the idea in the subway, generating with Whisper Thunder while in between meetings, 10 mins of editing. And you have it.

Cristóbal Valenzuela

10,081 Aufrufe • vor 7 Monaten

This is a village run by AI. The tribe has different personas managed by ChatGPT, from smart to aggressive or grumpy, and when new things appear they're drawn in realtime by StableDiffusion 3. You can influence what happens in the Twitch chat, or have it run autonomously forever.

This is a village run by AI. The tribe has different personas managed by ChatGPT, from smart to aggressive or grumpy, and when new things appear they're drawn in realtime by StableDiffusion 3. You can influence what happens in the Twitch chat, or have it run autonomously forever.

Phil

151,663 Aufrufe • vor 2 Jahren