Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Want to chat over your own documents using the new OpenAI Realtime API? You can do so now using Voice Chat PDF, built using LlamaIndex 🦙 and Next.js. The video below shows an example using a document about physical mailing standards. 📄

MarcusSchiesser's profile picture

Marcus Schiesser

2,004 subscribers

159,606 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

4 Kommentare

Profilbild von Dody Rachmat W.
Dody Rachmat W.vor 1 Jahr

@jerryjliu0 @OpenAI @llama_index @nextjs Nice, I see it supports multiple models. I'm looking forward to see the improvement using the vector database.

Profilbild von Tharsis
Tharsisvor 1 Jahr

@OpenAI @llama_index @nextjs This is awesome! But latency looks way higher compared to the llama index python api demo, any reason for that?

Profilbild von Kenji
Kenjivor 1 Jahr

@OpenAI @llama_index @nextjs This is cool, thank you for sharing. Will definitely check it out.

Profilbild von ᐸGerardSans/ᐳ🚀🇬🇧
ᐸGerardSans/ᐳ🚀🇬🇧vor 1 Jahr

@OpenAI @llama_index @nextjs Be cautious when incorporating overly anthropomorphic traits, such as voices, into your application. Excessive anthropomorphism in AI design can lead to unforeseen risks in psychological safety, ethics, and emotional impact.

Ähnliche Videos

create-llama is now also the easiest way to get started with multi-agents using LlamaIndex 🦙 v0.2 adds multi-agents using LlamaIndex Workflows. Create a multi-agent chat UI like the one below in a single command line! 🖥️ $ npx create-llama 📄
0:29

create-llama is now also the easiest way to get started with multi-agents using LlamaIndex 🦙 v0.2 adds multi-agents using LlamaIndex Workflows. Create a multi-agent chat UI like the one below in a single command line! 🖥️ $ npx create-llama 📄

Marcus Schiesser

48,338 Aufrufe • vor 1 Jahr

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!
1:18

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Zara Zhang

45,125 Aufrufe • vor 3 Monaten

New OpenAI Realtime model today! Let's do a side-by-side voice comparison using LiveKit agents console. Can it sing now???
2:11

New OpenAI Realtime model today! Let's do a side-by-side voice comparison using LiveKit agents console. Can it sing now???

Shayne

16,338 Aufrufe • vor 11 Monaten

I spent the last 48 hours building on top of the new ChatGPT API. You can now create a custom ChatGPT from the content of your website using You can then take that chatbot and add it to any website as a chat bubble. Pinecone OpenAI
0:55

I spent the last 48 hours building on top of the new ChatGPT API. You can now create a custom ChatGPT from the content of your website using You can then take that chatbot and add it to any website as a chat bubble. Pinecone OpenAI

Yasser

930,036 Aufrufe • vor 3 Jahren

I just deployed a token on Abstract using only my voice, using AI agents. I built an open-source Discord bot that controls a wallet, can perform on-chain actions, and replies to users in the voice chat. Here's a demo:
1:59

I just deployed a token on Abstract using only my voice, using AI agents. I built an open-source Discord bot that controls a wallet, can perform on-chain actions, and replies to users in the voice chat. Here's a demo:

Jarrod Watts

131,616 Aufrufe • vor 1 Jahr

i really enjoy 3Blue1Brown's math animations. so i built a tool that converts natural language into math animations using the manim engine and gpt-4o. now you can create your own math animations! give it a try using the link below.
0:27

i really enjoy 3Blue1Brown's math animations. so i built a tool that converts natural language into math animations using the manim engine and gpt-4o. now you can create your own math animations! give it a try using the link below.

Archie Sengupta

370,227 Aufrufe • vor 1 Jahr

LLaMA voice chat + Siri TTS This example is now truly 100% offline since we are now using the built-in Siri text-to-speech available on MacOS through the "say" command
1:28

LLaMA voice chat + Siri TTS This example is now truly 100% offline since we are now using the built-in Siri text-to-speech available on MacOS through the "say" command

Georgi Gerganov

412,007 Aufrufe • vor 3 Jahren

What if you could create your own OpenAI Assistant with Realtime API that can: 🌐 Browse the Web 📚 Search Files (RAG) 💻 Run Code Interpreter All using open source tools. Check it out
1:28

What if you could create your own OpenAI Assistant with Realtime API that can: 🌐 Browse the Web 📚 Search Files (RAG) 💻 Run Code Interpreter All using open source tools. Check it out

FlowiseAI

23,686 Aufrufe • vor 1 Jahr

You can now build a Deep Research Agent over your organization's data in literally 1 tool call using ZeroEntropy (YC W25)'s MCP server! We just launched our MCP server, which you can connect to the OpenAI Deep Research API! This demo shows to find ZeroEntropy's secret buried in 50k+ documents
0:29

You can now build a Deep Research Agent over your organization's data in literally 1 tool call using ZeroEntropy (YC W25)'s MCP server! We just launched our MCP server, which you can connect to the OpenAI Deep Research API! This demo shows to find ZeroEntropy's secret buried in 50k+ documents

Ghita

17,447 Aufrufe • vor 1 Jahr

I'm deeply impressed. You can now have your own AI tutor who can see your screen and chat in real time with Gemini 2.0. It's a real revolution in the way you learn new things. Available for free using Google AI Studio (link below)
3:49

I'm deeply impressed. You can now have your own AI tutor who can see your screen and chat in real time with Gemini 2.0. It's a real revolution in the way you learn new things. Available for free using Google AI Studio (link below)

Paul Couvert

266,658 Aufrufe • vor 1 Jahr

In the latest version, we've launched the Chat feature! You can now: 1. Chat with AI from OpenAI, Gemini, and Anthropic using your notes as context. 2. Chat with collaborators and track mentions in your Inbox. 3. Drag messages onto whiteboards for deeper exploration.
0:34

In the latest version, we've launched the Chat feature! You can now: 1. Chat with AI from OpenAI, Gemini, and Anthropic using your notes as context. 2. Chat with collaborators and track mentions in your Inbox. 3. Drag messages onto whiteboards for deeper exploration.

Heptabase

14,870 Aufrufe • vor 1 Jahr

🚨The video demonstrates how to prevent an AI agent from accessing your private key when using a crypto wallet MCP. An example of using NEAR Protocol MCP, check it below👇🏻
8:04

🚨The video demonstrates how to prevent an AI agent from accessing your private key when using a crypto wallet MCP. An example of using NEAR Protocol MCP, check it below👇🏻

Wenfeng Wang

23,635 Aufrufe • vor 1 Jahr

Just built a better & nicer Bank Statement Converter ($50K MRR) using Rocket + PDF Vector just 15 minutes: 1️⃣ Use Rocket to build the frontend and integrate with PDF Vector API 2️⃣ Use PDF Vector API to process the documents (PDF, Word, or images) & convert them to CSV/Excel
1:10

Just built a better & nicer Bank Statement Converter ($50K MRR) using Rocket + PDF Vector just 15 minutes: 1️⃣ Use Rocket to build the frontend and integrate with PDF Vector API 2️⃣ Use PDF Vector API to process the documents (PDF, Word, or images) & convert them to CSV/Excel

Minh-Phuc Tran

30,185 Aufrufe • vor 9 Monaten

Built an open-source Jupyter Notebook that brings the power of OpenAI's code interpreter into your local Python development environment. Watch how easy it is to use Thread to edit code I wrote, chat with my notebook, or generate charts just using prompts. We built Thread using Next.js, Chakra and Project Jupyter and you can install it by running: pip install thread-dev
0:22

Built an open-source Jupyter Notebook that brings the power of OpenAI's code interpreter into your local Python development environment. Watch how easy it is to use Thread to edit code I wrote, chat with my notebook, or generate charts just using prompts. We built Thread using Next.js, Chakra and Project Jupyter and you can install it by running: pip install thread-dev

Ali Shobeiri

112,649 Aufrufe • vor 2 Jahren

INSANE: Grok 3 + Replit Agent is a Superpower!! Using the pair, I built an AI agent that reviews my Pull Requests Here's the flow: • Grok 3 generates PR-reviewing agent code using Composio + LlamaIndex • Replit Agent automatically crafts the front-end interface • Get a ready-to-run workflow where you paste the url to your PR, and the agent generates a code review instantly with suggestions. Built with Grok Replit ⠕ Agent Powered by LlamaIndex 🦙 Groq Inc repl link:
0:59

INSANE: Grok 3 + Replit Agent is a Superpower!! Using the pair, I built an AI agent that reviews my Pull Requests Here's the flow: • Grok 3 generates PR-reviewing agent code using Composio + LlamaIndex • Replit Agent automatically crafts the front-end interface • Get a ready-to-run workflow where you paste the url to your PR, and the agent generates a code review instantly with suggestions. Built with Grok Replit ⠕ Agent Powered by LlamaIndex 🦙 Groq Inc repl link:

Karan Vaidya

1,684,869 Aufrufe • vor 1 Jahr

I just built and shipped my own personal Sora Video Studio using Replit ⠕ using the Sora API and launched to my own custom domain name. As the API evolves and improves I'll be able to have greater control of the videos made. It really feels like magic making software right now.
0:20

I just built and shipped my own personal Sora Video Studio using Replit ⠕ using the Sora API and launched to my own custom domain name. As the API evolves and improves I'll be able to have greater control of the videos made. It really feels like magic making software right now.

Levin Stanley

40,783 Aufrufe • vor 10 Monaten

Using Skills with the Claude Agent SDK How do you use skills to build agents? Here's an example demo I've built using one of our premade skills to make an excel demo agent.
1:27

Using Skills with the Claude Agent SDK How do you use skills to build agents? Here's an example demo I've built using one of our premade skills to make an excel demo agent.

Thariq

38,217 Aufrufe • vor 9 Monaten

New JavaScript short course: Build a full-stack web application that uses RAG in JavaScript RAG Web Apps with LlamaIndex, taught by Laurie Voss, VP of Developer Relations at LlamaIndex 🦙 and npm co-founder. - Build a RAG application for querying your own data - Develop tools to interact with multiple data sources using an agent that intelligently selects the right tool for your queries - Create a full-stack web app that can chat with your data - Dig further into production-ready techniques, like how to persist your data so you aren’t constantly reindexing, and try the create-llama command line tool from LlamaIndex You can sign up here:
2:47

New JavaScript short course: Build a full-stack web application that uses RAG in JavaScript RAG Web Apps with LlamaIndex, taught by Laurie Voss, VP of Developer Relations at LlamaIndex 🦙 and npm co-founder. - Build a RAG application for querying your own data - Develop tools to interact with multiple data sources using an agent that intelligently selects the right tool for your queries - Create a full-stack web app that can chat with your data - Dig further into production-ready techniques, like how to persist your data so you aren’t constantly reindexing, and try the create-llama command line tool from LlamaIndex You can sign up here:

Andrew Ng

218,284 Aufrufe • vor 2 Jahren