Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Apple just released and open-sourced FastVLM! FastVLM is a lightning-fast vision-language model that combines rapid image and text understanding with efficient on-device performance. 100% Open Source

Sumanth_077's profile picture

Sumanth

76,939 subscribers

43,734 görüntüleme • 1 yıl önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

13 Yorum

Sumanth profil fotoğrafı
Sumanth1 yıl önce

Demo: Github Repo:

Sumanth profil fotoğrafı
Sumanth1 yıl önce

If you found it useful, reshare it with your network. Follow me → @Sumanth_077 for more such content and tutorials on ML, LLMs and AI Agents!

Wang Samuel profil fotoğrafı
Wang Samuel1 yıl önce

Nice

Machine Learning Community ⭐️ profil fotoğrafı
Machine Learning Community ⭐️1 yıl önce

This could be huge. Running real-time on mobile have plenty of applications. Will try this out!

Sumanth profil fotoğrafı
Sumanth1 yıl önce

Absolutely!

AIUpdated profil fotoğrafı
AIUpdated1 yıl önce

build by a private lab, sold to apple so they can say it's theirs

Charlie profil fotoğrafı
Charlie1 yıl önce

Thanks, wish they would have just included the GGUF as a standalone.

Suhrab Khan⚡️ profil fotoğrafı
Suhrab Khan⚡️1 yıl önce

Apple going open-source with FastVLM is a big shift; fast, on-device vision-language models could redefine edge AI.

Tsukuyomi profil fotoğrafı
Tsukuyomi1 yıl önce

fast and open-source? sounds like apple's trying to make a dent in the ai world. but can it outsmart the rogue AIs lurking in the shadows? let's see if it really delivers or just bites the dust.

ManiFest_GENAI profil fotoğrafı
ManiFest_GENAI1 yıl önce

Thanks for sharing!

theDevStuff profil fotoğrafı
theDevStuff1 yıl önce

Awesome. Used smartly in applications it can really help disabled people.

yamz8 profil fotoğrafı
yamz81 yıl önce

@adamcohenhillel 🙄

Saïd Aitmbarek profil fotoğrafı
Saïd Aitmbarek1 yıl önce

awesome share, added to the spotlights

Benzer Videolar

Everyone is sleeping on this new OCR model! dots-ocr is a new 1.7B vision-language model that achieves SOTA performance on multilingual document parsing. - Supports 100+ languages - Works with both images and PDFs - Handles text, tables, formulas seamlessly 100% open-source.
0:33

Everyone is sleeping on this new OCR model! dots-ocr is a new 1.7B vision-language model that achieves SOTA performance on multilingual document parsing. - Supports 100+ languages - Works with both images and PDFs - Handles text, tables, formulas seamlessly 100% open-source.

Akshay 🚀

252,368 görüntüleme • 1 yıl önce

1. Meta’s open-sourced multisensory model Meta is back (again!) with yet another exciting open-source project. Introducing ImageBind, a new AI research model that understands and combines text, audio, visual, movement, thermal, AND depth data.
1:04

1. Meta’s open-sourced multisensory model Meta is back (again!) with yet another exciting open-source project. Introducing ImageBind, a new AI research model that understands and combines text, audio, visual, movement, thermal, AND depth data.

Rowan Cheung

173,987 görüntüleme • 3 yıl önce

Krea 2 Open-Source is now available on fal The most aesthetic open-source image model, released with open weights Turbo delivers fast, polished text-to-image at low step counts RAW serves as the malleable base checkpoint for LoRA training
0:59

Krea 2 Open-Source is now available on fal The most aesthetic open-source image model, released with open weights Turbo delivers fast, polished text-to-image at low step counts RAW serves as the malleable base checkpoint for LoRA training

fal

47,744 görüntüleme • 3 ay önce

Apple’s AI getting crazy and nobody’s talking about it they just open sourced FastVLM + MobileCLIP2, can do realtime VIDEO captioning with phone camera.. runs 100% local on your phone, 85x faster, 3.4x smaller… free to test and download, link in comment let's break down:
0:23

Apple’s AI getting crazy and nobody’s talking about it they just open sourced FastVLM + MobileCLIP2, can do realtime VIDEO captioning with phone camera.. runs 100% local on your phone, 85x faster, 3.4x smaller… free to test and download, link in comment let's break down:

el.cine

381,441 görüntüleme • 1 yıl önce

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.
0:25

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

Akshay 🚀

66,197 görüntüleme • 8 ay önce

We've officially released and open-sourced HunyuanImage 2.1, our latest text-to-image model. The new model delivers on our commitment to balancing performance and quality. With native 2K image generation, HunyuanImage 2.1 is an advanced open-source text-to-image model.🎨 ✨ New in 2.1: 🔹Advanced Semantics: Supports ultra-long and complex prompts of up to 1000 tokens, and precisely controls the generation of multiple subjects in a single image. 🔹Precise Chinese and English Text Rendering with seamless image–text integration: The model naturally integrates text into images, making it suitable for a wide range of applications such as product covers, illustrations, and poster design to meet the needs of various fields. 🔹Rich Styles and High Aesthetic: Capable of generating images in various styles—including photorealistic portraits, comics, and vinyl figures—it delivers outstanding visual appeal and artistic quality. 🔹High-Quality Generation: Efficiently produces ultra-high-definition (2K) images in the same time other models take to generate a 1K image. HunyuanImage 2.1 uses two text encoders: a multimodal large language model (MLLM) to improve the model's image and text alignment capabilities, and a multi-language character-aware encoder to improve text rendering capabilities. The model is a single- and double-stream diffusion transformer with 17B parameters. We've also open-sourced the weights of the the accelerated version with meanflow which reduces inference steps from 100 to just 8, and PromptEnhancer, the first industrial-grade rewriting model that enhances your prompts for more nuanced and expressive image generation. Now, creators turn complex ideas—like posters with slogans or multi-panel comics—into visuals faster than ever. We’re just getting started. Stay tuned for our native multimodal image generation model coming soon. 🌐Website: 🔗Github: 🤗Hugging Face: ✨Hugging Face Demo:
1:39

We've officially released and open-sourced HunyuanImage 2.1, our latest text-to-image model. The new model delivers on our commitment to balancing performance and quality. With native 2K image generation, HunyuanImage 2.1 is an advanced open-source text-to-image model.🎨 ✨ New in 2.1: 🔹Advanced Semantics: Supports ultra-long and complex prompts of up to 1000 tokens, and precisely controls the generation of multiple subjects in a single image. 🔹Precise Chinese and English Text Rendering with seamless image–text integration: The model naturally integrates text into images, making it suitable for a wide range of applications such as product covers, illustrations, and poster design to meet the needs of various fields. 🔹Rich Styles and High Aesthetic: Capable of generating images in various styles—including photorealistic portraits, comics, and vinyl figures—it delivers outstanding visual appeal and artistic quality. 🔹High-Quality Generation: Efficiently produces ultra-high-definition (2K) images in the same time other models take to generate a 1K image. HunyuanImage 2.1 uses two text encoders: a multimodal large language model (MLLM) to improve the model's image and text alignment capabilities, and a multi-language character-aware encoder to improve text rendering capabilities. The model is a single- and double-stream diffusion transformer with 17B parameters. We've also open-sourced the weights of the the accelerated version with meanflow which reduces inference steps from 100 to just 8, and PromptEnhancer, the first industrial-grade rewriting model that enhances your prompts for more nuanced and expressive image generation. Now, creators turn complex ideas—like posters with slogans or multi-panel comics—into visuals faster than ever. We’re just getting started. Stay tuned for our native multimodal image generation model coming soon. 🌐Website: 🔗Github: 🤗Hugging Face: ✨Hugging Face Demo:

Tencent Hy

89,392 görüntüleme • 1 yıl önce

we built a lightning strike detector in just 2 days in partnership with Embedder and open sourced it! the future of hardware is fast. a thread 🧵
0:20

we built a lightning strike detector in just 2 days in partnership with Embedder and open sourced it! the future of hardware is fast. a thread 🧵

Daniel Liu

166,832 görüntüleme • 1 ay önce

So Alibaba Qwen has released the best image editing model... 100% open source! You can edit any photo using natural language. It can be used both locally and online. More below
0:35

So Alibaba Qwen has released the best image editing model... 100% open source! You can edit any photo using natural language. It can be used both locally and online. More below

Paul Couvert

246,616 görüntüleme • 1 yıl önce

DeepSeek released R1, the best open-source reasoning model that is on par with OpenAI's o1! I have built a RAG app to chat with your PDF files using the DeepSeek R1 model, running locally on your computer. 100% Open Source
0:50

DeepSeek released R1, the best open-source reasoning model that is on par with OpenAI's o1! I have built a RAG app to chat with your PDF files using the DeepSeek R1 model, running locally on your computer. 100% Open Source

Sumanth

678,727 görüntüleme • 1 yıl önce

Finally! A Text-to-SQL tool that actually works! Vanna is an open-source RAG framework for complex Text-to-SQL generation. It manages dynamic data and allows custom RAG model training for greater accuracy. 100% open-source.
0:38

Finally! A Text-to-SQL tool that actually works! Vanna is an open-source RAG framework for complex Text-to-SQL generation. It manages dynamic data and allows custom RAG model training for greater accuracy. 100% open-source.

Akshay 🚀

168,649 görüntüleme • 1 yıl önce

One image + text + camera trajectory = controllable worlds. All on a single GPU. Our research team just released SANA-WM, a 2.6B open source world model natively trained for 60-second video generation with precise camera control.
0:20

One image + text + camera trajectory = controllable worlds. All on a single GPU. Our research team just released SANA-WM, a 2.6B open source world model natively trained for 60-second video generation with precise camera control.

NVIDIA AI

93,282 görüntüleme • 4 ay önce

Introducing TraceVLA: a fully open-source Vision-Language-Action model reimagining spatial-temporal awareness: ✨ 3.5x gains on real robots, SOTA in simulation 💡 Fine-tunes on just 150K trajectories ⚡ Compact 4B model = 7B performance
0:29

Introducing TraceVLA: a fully open-source Vision-Language-Action model reimagining spatial-temporal awareness: ✨ 3.5x gains on real robots, SOTA in simulation 💡 Fine-tunes on just 150K trajectories ⚡ Compact 4B model = 7B performance

Yongyuan Liang

39,603 görüntüleme • 1 yıl önce

🚀UniWorld: a unified model that skips VAEs and uses semantic features from SigLIP! Using just 1% of BAGEL’s data, it outperforms on image editing and excels in understanding & generation. 🌟Now data, model, training & evaluation script are open-source!
2:06

🚀UniWorld: a unified model that skips VAEs and uses semantic features from SigLIP! Using just 1% of BAGEL’s data, it outperforms on image editing and excels in understanding & generation. 🌟Now data, model, training & evaluation script are open-source!

Bin Lin

22,345 görüntüleme • 1 yıl önce

Google just released Muse: a text to image model achieving state of the art performance. It is significantly more efficient than diffusion models. Muse also allows for inpainting, outpainting, and mask-free editing without finetuning or inverting the model.
0:33

Google just released Muse: a text to image model achieving state of the art performance. It is significantly more efficient than diffusion models. Muse also allows for inpainting, outpainting, and mask-free editing without finetuning or inverting the model.

bleedingedge.ai

183,750 görüntüleme • 3 yıl önce

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊
0:23

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊

calle

70,215 görüntüleme • 1 ay önce

🚨 BREAKING: NVIDIA just removed the biggest friction point in Voice AI They open-sourced PersonaPlex 7B, a real-time conversational model. It listens and speaks simultaneously to handle natural interruptions and overlaps. 100% Open Source.
0:43

🚨 BREAKING: NVIDIA just removed the biggest friction point in Voice AI They open-sourced PersonaPlex 7B, a real-time conversational model. It listens and speaks simultaneously to handle natural interruptions and overlaps. 100% Open Source.

How To Prompt

704,256 görüntüleme • 5 ay önce

InternLM-XComposer-2.5 A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output We present InternLM-XComposer-2.5 (IXC-2.5), a versatile large-vision language model that supports long-contextual input and output. IXC-2.5 excels in various text-image comprehension and composition applications, achieving GPT-4V level capabilities with merely 7B LLM backend. Trained with 24K interleaved image-text contexts, it can seamlessly extend to 96K long contexts via RoPE extrapolation. This long-context capability allows IXC-2.5 to excel in tasks requiring extensive input and output contexts. Compared to its previous 2.0 version, InternLM-XComposer-2.5 features three major upgrades in vision-language comprehension: (1) Ultra-High Resolution Understanding, (2) Fine-Grained Video Understanding, and (3) Multi-Turn Multi-Image Dialogue. In addition to comprehension, IXC-2.5 extends to two compelling applications using extra LoRA parameters for text-image composition: (1) Crafting Webpages and (2) Composing High-Quality Text-Image Articles. IXC-2.5 has been evaluated on 28 benchmarks, outperforming existing open-source state-of-the-art models on 16 benchmarks. It also surpasses or competes closely with GPT-4V and Gemini Pro on 16 key tasks.
2:45

InternLM-XComposer-2.5 A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output We present InternLM-XComposer-2.5 (IXC-2.5), a versatile large-vision language model that supports long-contextual input and output. IXC-2.5 excels in various text-image comprehension and composition applications, achieving GPT-4V level capabilities with merely 7B LLM backend. Trained with 24K interleaved image-text contexts, it can seamlessly extend to 96K long contexts via RoPE extrapolation. This long-context capability allows IXC-2.5 to excel in tasks requiring extensive input and output contexts. Compared to its previous 2.0 version, InternLM-XComposer-2.5 features three major upgrades in vision-language comprehension: (1) Ultra-High Resolution Understanding, (2) Fine-Grained Video Understanding, and (3) Multi-Turn Multi-Image Dialogue. In addition to comprehension, IXC-2.5 extends to two compelling applications using extra LoRA parameters for text-image composition: (1) Crafting Webpages and (2) Composing High-Quality Text-Image Articles. IXC-2.5 has been evaluated on 28 benchmarks, outperforming existing open-source state-of-the-art models on 16 benchmarks. It also surpasses or competes closely with GPT-4V and Gemini Pro on 16 key tasks.

AK

66,476 görüntüleme • 2 yıl önce

GPT-4o level intelligence running on your phone! MiniCPM-V 4.5 delivers enterprise-grade AI performance in just 8B parameters, outperforming models like GPT-4o, Gemini-2.0 Pro on vision and language tasks. - 30+ language support - Runs smoothly on iPhone/iPad 100% open-source!
0:28

GPT-4o level intelligence running on your phone! MiniCPM-V 4.5 delivers enterprise-grade AI performance in just 8B parameters, outperforming models like GPT-4o, Gemini-2.0 Pro on vision and language tasks. - 30+ language support - Runs smoothly on iPhone/iPad 100% open-source!

Akshay 🚀

84,720 görüntüleme • 1 yıl önce

📲 Gemma 3n delivers advanced on-device AI with optimized performance and multimodal understanding. Take a closer look at the early preview text capabilities available in Google AI Studio, GenAI SDK, and text/image capabilities via MediaPipe.
5:47

📲 Gemma 3n delivers advanced on-device AI with optimized performance and multimodal understanding. Take a closer look at the early preview text capabilities available in Google AI Studio, GenAI SDK, and text/image capabilities via MediaPipe.

Google AI Developers

16,639 görüntüleme • 1 yıl önce