Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

🧑‍🍳 Experiment with a multimodal LLM in WebAR. The AI identifies ingredients, sets up bounding boxes, and prepares them for AR. I'm also using open-source models to generate recipes and corresponding images. #threejs #8thwall #generativeai

Stijn Spanhove

2,964 subscribers

61,019 görüntüleme • 2 yıl önce •via X (Twitter)

#threejs #8thwall #generativeai

Anya Rossi• Live Now

Private livecam show

10 Yorum

Stijn Spanhove profil fotoğrafı

Stijn Spanhove2 yıl önce

Result from Llava 1.6 34b on @replicate

Stijn Spanhove profil fotoğrafı

Stijn Spanhove2 yıl önce

Bounding boxes

Michael + puppetto.com profil fotoğrafı

Michael + puppetto.com2 yıl önce

@MagusWazir Dude what is this future magic

Daniel Bigham profil fotoğrafı

Daniel Bigham2 yıl önce

Nice!

mongrov profil fotoğrafı

mongrov2 yıl önce

"Exciting! Integrating open-source models for recipes is a brilliant idea. I'd love to see how the multimodal LLM enhances the AR experience. Have you considered incorporating IoT to enhance user interaction or provide real-time feedback? #WebAR #AI #IoT

Stijn Spanhove profil fotoğrafı

Stijn Spanhove2 yıl önce

Did some experiments before with AR and visualising IoT data. Interesting indeed!

Peter VRMRCK profil fotoğrafı

Peter VRMRCK2 yıl önce

So good! Love it!

Stijn Spanhove profil fotoğrafı

Stijn Spanhove2 yıl önce

Thanks 🙌

jake nachlas profil fotoğrafı

jake nachlas2 yıl önce

This is really awesome!! It could also be great to see the recipes on a standard webpage so user points and scans like you have and then can lower their phone to look at the options. What do you think?

Stijn Spanhove profil fotoğrafı

Stijn Spanhove2 yıl önce

Thanks! Yes I agree, would be more user friendly. This is now running on a phone. Think could also be nice with a headset.

Benzer Videolar

An experiment with 𝘃𝗶𝗿𝘁𝘂𝗮𝗹 𝘁𝗿𝘆-𝗼𝗻 in WebAR 👇 👕 The GenAI-model seamlessly maps pictures onto my 3D-body in AR, all running smoothly on the web. Cool to see the results 👀 #generativeai #threejs #8thwall

An experiment with 𝘃𝗶𝗿𝘁𝘂𝗮𝗹 𝘁𝗿𝘆-𝗼𝗻 in WebAR 👇 👕 The GenAI-model seamlessly maps pictures onto my 3D-body in AR, all running smoothly on the web. Cool to see the results 👀 #generativeai #threejs #8thwall

Stijn Spanhove

42,097 görüntüleme • 2 yıl önce

Introducing the Describe Anything Model (DAM), a powerful Multimodal LLM that generates detailed descriptions for user-specified regions in images or videos using points, boxes, scribbles, or masks. Open-source code, models, demo, data, and benchmark at:

Introducing the Describe Anything Model (DAM), a powerful Multimodal LLM that generates detailed descriptions for user-specified regions in images or videos using points, boxes, scribbles, or masks. Open-source code, models, demo, data, and benchmark at:

Yin Cui

34,990 görüntüleme • 1 yıl önce

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

Avthar

34,261 görüntüleme • 1 yıl önce

Ready to play? AI Playground curates 60+ top open-source AI models for you to explore, experiment, generate images and video, edit, chat, find answers, and more. Plus, it’s easy to use and optimized to run locally on your Intel-powered AI PC. Try it out:

Ready to play? AI Playground curates 60+ top open-source AI models for you to explore, experiment, generate images and video, edit, chat, find answers, and more. Plus, it’s easy to use and optimized to run locally on your Intel-powered AI PC. Try it out:

Intel

11,304 görüntüleme • 4 ay önce

I'm cooking up a cool tool to enhance photos with threejs and AI :) More videos in the thread! #threejs #AI

I'm cooking up a cool tool to enhance photos with threejs and AI :) More videos in the thread! #threejs #AI

Sébastien Lempens - PIXILA

88,261 görüntüleme • 2 yıl önce

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models paper page: github: Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However, these models still encounter difficulties when generating images from prompts that demand spatial or common sense reasoning. We propose to equip diffusion models with enhanced reasoning capabilities by using off-the-shelf pretrained large language models (LLMs) in a novel two-stage generation process. First, we adapt an LLM to be a text-guided layout generator through in-context learning. When provided with an image prompt, an LLM outputs a scene layout in the form of bounding boxes along with corresponding individual descriptions. Second, we steer a diffusion model with a novel controller to generate images conditioned on the layout. Both stages utilize frozen pretrained models without any LLM or diffusion model parameter optimization. We validate the superiority of our design by demonstrating its ability to outperform the base diffusion model in accurately generating images according to prompts that necessitate both language and spatial reasoning. Additionally, our method naturally allows dialog-based scene specification and is able to handle prompts in a language that is not well-supported by the underlying diffusion model.

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models paper page: github: Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However, these models still encounter difficulties when generating images from prompts that demand spatial or common sense reasoning. We propose to equip diffusion models with enhanced reasoning capabilities by using off-the-shelf pretrained large language models (LLMs) in a novel two-stage generation process. First, we adapt an LLM to be a text-guided layout generator through in-context learning. When provided with an image prompt, an LLM outputs a scene layout in the form of bounding boxes along with corresponding individual descriptions. Second, we steer a diffusion model with a novel controller to generate images conditioned on the layout. Both stages utilize frozen pretrained models without any LLM or diffusion model parameter optimization. We validate the superiority of our design by demonstrating its ability to outperform the base diffusion model in accurately generating images according to prompts that necessitate both language and spatial reasoning. Additionally, our method naturally allows dialog-based scene specification and is able to handle prompts in a language that is not well-supported by the underlying diffusion model.

AK

83,657 görüntüleme • 3 yıl önce

Just built Openjourney 🚀 a vibe coded UI inspired by MidJourney built with Cursor and Replit for you to plug in your favorite models. Generate images with Imagen 4, animate them with Veo 3 or generate videos with sound. Fully open source for you to customize. Links below 👇

Just built Openjourney 🚀 a vibe coded UI inspired by MidJourney built with Cursor and Replit for you to plug in your favorite models. Generate images with Imagen 4, animate them with Veo 3 or generate videos with sound. Fully open source for you to customize. Links below 👇

Ammaar Reshi

52,820 görüntüleme • 1 yıl önce

Introducing an open-source template for broadcasting realtime transcripts. • Generate live transcripts with Scribe • Broadcast to many using Supabase • Translate with Chrome’s built-in AI Demo and open source template below.

Introducing an open-source template for broadcasting realtime transcripts. • Generate live transcripts with Scribe • Broadcast to many using Supabase • Translate with Chrome’s built-in AI Demo and open source template below.

ElevenLabs Developers

28,102 görüntüleme • 9 ay önce

Introducing private AI image generation on your Mac. Generate images with leading and open weight models, from a private workspace. Zero data retention by default. No one looking at your prompts and images. Yours only. Open Source + MIT.

Introducing private AI image generation on your Mac. Generate images with leading and open weight models, from a private workspace. Zero data retention by default. No one looking at your prompts and images. Yours only. Open Source + MIT.

OpenSoftware

137,221 görüntüleme • 1 ay önce

🆕 How to run (and finetune) open source AI models with a simple API! In 5 mins, I go over how to: ◆ Generate text with DeepSeek R1 & Llama 3 ◆ Generate code with Qwen on LlamaCoder ◆ Generate images with Flux on BlinkShot ◆ Finetune a model on your own data & run it

🆕 How to run (and finetune) open source AI models with a simple API! In 5 mins, I go over how to: ◆ Generate text with DeepSeek R1 & Llama 3 ◆ Generate code with Qwen on LlamaCoder ◆ Generate images with Flux on BlinkShot ◆ Finetune a model on your own data & run it

Hassan

30,236 görüntüleme • 1 yıl önce

I am excited to introduce OpenGeoAgent, a powerful open-source multimodal AI agent for automated geospatial analysis and visualization! It supports QGIS, Jupyter notebook, and Python scripting. In this tutorial, you’ll learn how to automate GIS workflows using natural language, generate maps, analyze satellite data, and even run complex hydrological models. You can even interact with the agent using voice commands (no typing needed). Video: GitHub: QGIS Plugin: #geospatial #GeoAgent #OpenSource #AI

I am excited to introduce OpenGeoAgent, a powerful open-source multimodal AI agent for automated geospatial analysis and visualization! It supports QGIS, Jupyter notebook, and Python scripting. In this tutorial, you’ll learn how to automate GIS workflows using natural language, generate maps, analyze satellite data, and even run complex hydrological models. You can even interact with the agent using voice commands (no typing needed). Video: GitHub: QGIS Plugin: #geospatial #GeoAgent #OpenSource #AI

Qiusheng Wu

62,928 görüntüleme • 4 ay önce

Introducing `gpt-llm-trainer` ✍️ The world's simplest way to train a task-specific LLM. **Just write a sentence describing the model you want.** A chain of AI systems will generate a dataset and train a model for you. And it's open-source:

Introducing `gpt-llm-trainer` ✍️ The world's simplest way to train a task-specific LLM. Just write a sentence describing the model you want. A chain of AI systems will generate a dataset and train a model for you. And it's open-source:

Matt Shumer

337,464 görüntüleme • 3 yıl önce

Introducing `claude-llm-trainer` ✍️ The world's simplest way to train a task-specific LLM. Just write a sentence describing the model you want. A chain of AI systems will generate a dataset and train a model for you. And it's open-source.

Introducing `claude-llm-trainer` ✍️ The world's simplest way to train a task-specific LLM. Just write a sentence describing the model you want. A chain of AI systems will generate a dataset and train a model for you. And it's open-source.

Matt Shumer

383,208 görüntüleme • 2 yıl önce

Want to quickly craft and iterate on prompts? Check out Prompt builder in the AI Toolkit for VS Code ( Experiment with local or remote models, generate prompts using AI, and test multi-turn conversations. Plus, view the code to start building right away! 💡

Want to quickly craft and iterate on prompts? Check out Prompt builder in the AI Toolkit for VS Code ( Experiment with local or remote models, generate prompts using AI, and test multi-turn conversations. Plus, view the code to start building right away! 💡

Visual Studio Code

52,751 görüntüleme • 1 yıl önce

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.

AI at Meta

351,764 görüntüleme • 1 yıl önce

New: AI Image Generation in Spline Hana 🧙‍♂️ - Generate images with various models - Combine or modify images and frames - Make Variations, remove BG, and Upscale Available now to try for free!

New: AI Image Generation in Spline Hana 🧙‍♂️ - Generate images with various models - Combine or modify images and frames - Make Variations, remove BG, and Upscale Available now to try for free!

Spline

21,620 görüntüleme • 11 ay önce

5/ Open source isn’t enough. Application is everything. China isn’t waiting for open-source models to catch up. They're customizing them and making them useful now in real-world settings. From factory lines to traffic systems, AI is already embedded.

5/ Open source isn’t enough. Application is everything. China isn’t waiting for open-source models to catch up. They're customizing them and making them useful now in real-world settings. From factory lines to traffic systems, AI is already embedded.

Carlo Edoardo Ferraris

75,649 görüntüleme • 1 yıl önce

Meet #DBRX: a general-purpose LLM that sets a new standard for efficient open source models. Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications.

Meet #DBRX: a general-purpose LLM that sets a new standard for efficient open source models. Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications.

Databricks

327,800 görüntüleme • 2 yıl önce

Final day of replicating those shitty mobile ads using Box3D in Omma AI: it's complete! Link below. With people and cars it is way more fun 😈 generated and rigged the models in Omma Studio and then used navcat to transform them into agents. Also added a custom LOD and culling system in #threejs for performance. Here is the playable demo 👇

Final day of replicating those shitty mobile ads using Box3D in Omma AI: it's complete! Link below. With people and cars it is way more fun 😈 generated and rigged the models in Omma Studio and then used navcat to transform them into agents. Also added a custom LOD and culling system in #threejs for performance. Here is the playable demo 👇

Marco Fugaro

25,257 görüntüleme • 1 ay önce