Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Experimenting with the magic of open-source! Whisper for text translation, XTTS for audio, and Video-retalker for seamless mouth sync in a short video Its not perfect, but I think we're close with open source #buildinpublic #opensource

Luis Catacora

9,456 subscribers

80,983 Aufrufe • vor 2 Jahren •via X (Twitter)

Wissenschaft & Technologie Kunst #buildinpublic #opensource

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Luis C

Luis Cvor 2 Jahren

For reference these were my runs on @replicate: Curious to see what you all come up with!

Profilbild von Michael Aubry — BasedLabs.ai

Michael Aubry — BasedLabs.aivor 2 Jahren

Do you know how d-id or heygen works? Wondering if there is a good oss model

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 2 Jahren

this is awesome, but gosh i wish it worked better for beards

Profilbild von Luis C

Luis Cvor 2 Jahren

Likewise. There seems to be limits when using the video-retalking model

Profilbild von AP

APvor 2 Jahren

Really cool! @artificialguybr

Profilbild von Luis C

Luis Cvor 2 Jahren

@artificialguybr Thanks! It was cool enough that I just had to share it

Profilbild von ⟁ndrew V

⟁ndrew Vvor 2 Jahren

Pretty damn good for a first pass, impressive!

Profilbild von Luis C

Luis Cvor 2 Jahren

Right? All these models have been open source for a while too, just needed to chain them together

Profilbild von Crypto Industry

Crypto Industryvor 2 Jahren

The magic of open source is real, and you're the tech wizard making it happen! 🧙‍♀️

Profilbild von Luis C

Luis Cvor 2 Jahren

Thanks! Im just testing out ideas tbh

Ähnliche Videos

🎧 IAMF: The Future of Audio with Open Standards! 🎧 At CES , #VLC with #FFMPEG showcases #IAMF redefining sound: 🎵 Spatial audio for next-level immersion 🌌 Cinema-quality sound 📱 Seamless playback across devices 💻 Powered by open-source tech #VLC #CES2025 #OPENSOURCE

🎧 IAMF: The Future of Audio with Open Standards! 🎧 At CES , #VLC with #FFMPEG showcases #IAMF redefining sound: 🎵 Spatial audio for next-level immersion 🌌 Cinema-quality sound 📱 Seamless playback across devices 💻 Powered by open-source tech #VLC #CES2025 #OPENSOURCE

VideoLAN

13,391 Aufrufe • vor 1 Jahr

Open-source and free apps for coders and makers - CSS Text effects with AI prompts - Open-source self-hosted dashboard for Amazon SES - Free directory of public APIs - Open-source security framework - UI library for building terminal user interfaces

Open-source and free apps for coders and makers - CSS Text effects with AI prompts - Open-source self-hosted dashboard for Amazon SES - Free directory of public APIs - Open-source security framework - UI library for building terminal user interfaces

Csaba Kissi

27,438 Aufrufe • vor 2 Monaten

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

Akshay 🚀

66,268 Aufrufe • vor 8 Monaten

Aligned with Matan Grinberg's intuition that in the next 12 months, 90% of tokens could be going to open models. We're seeing more and more companies using frontier APIs for experimenting and open-source or private models for production and larger workloads!

Aligned with Matan Grinberg's intuition that in the next 12 months, 90% of tokens could be going to open models. We're seeing more and more companies using frontier APIs for experimenting and open-source or private models for production and larger workloads!

clem 🤗

24,138 Aufrufe • vor 2 Monaten

New open-source LoRA built in-house: LTX2.3 Audio Reactive LoRA. Built for music-driven video generation: stronger beat sync, graphic texture, color separation, light pulses, particles, and shapes that move with the track. Model:

New open-source LoRA built in-house: LTX2.3 Audio Reactive LoRA. Built for music-driven video generation: stronger beat sync, graphic texture, color separation, light pulses, particles, and shapes that move with the track. Model:

fal

17,789 Aufrufe • vor 3 Monaten

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

Avthar

34,261 Aufrufe • vor 1 Jahr

Announcing SubStudio! Generate subtitles for any video in seconds with AI. 100% free & open source! Powered by Whisper on Together AI and FFmpeg via fluent-ffmpeg.

Announcing SubStudio! Generate subtitles for any video in seconds with AI. 100% free & open source! Powered by Whisper on Together AI and FFmpeg via fluent-ffmpeg.

Hassan

136,237 Aufrufe • vor 5 Monaten

We are thrilled to announce the open-source release of Hallo2: a new avatar video generative model capable of generating stunning 4K resolution videos for up to 1 hour! 🎥✨ Explore the project for the open source code: Let's push the boundaries of avatar video generative model! #OpenSource #AI #FaceAnimation #GenerativeArt

Siyu ZHU

58,323 Aufrufe • vor 1 Jahr

Elon Musk played a key role in the creation of OpenAI, even coming up with the name “OpenAI” to reflect its commitment to being open source. But Sam Altman transformed this open-source, non-profit company into a closed-source, for-profit company.

Elon Musk played a key role in the creation of OpenAI, even coming up with the name “OpenAI” to reflect its commitment to being open source. But Sam Altman transformed this open-source, non-profit company into a closed-source, for-profit company.

DogeDesigner

2,360,643 Aufrufe • vor 1 Jahr

Elon Musk played a key role in the creation of OpenAI, even coming up with the name “OpenAI” to reflect its commitment to being open source. But Sam Altman transformed this open-source, non-profit company into a closed-source, for-profit company.

Elon Musk played a key role in the creation of OpenAI, even coming up with the name “OpenAI” to reflect its commitment to being open source. But Sam Altman transformed this open-source, non-profit company into a closed-source, for-profit company.

DogeDesigner

57,624 Aufrufe • vor 1 Jahr

🚀 Introducing HunyuanCustom: An open-source, multimodal-driven architecture for customized video generation, powered by HunyuanVideo-13B. Outperforming existing open-source models, it rivals top closed-source solutions! 🎥 Highlights: ✅Subject Consistency: Maintains identity across single & multi-subject video generation. ✅Multimodal Inputs: Supports text, images, audio, and video for highly controlled outputs. ✅High-Quality Output: Industry-leading detail, motion smoothness, and lighting realism. Key Features: 1️⃣Single-Subject Video: Upload an image + text (e.g., “He’s walking a dog”) to create coherent videos with new actions, outfits, and scenes. 2️⃣Multi-Subject Video: Generate videos with multiple subjects (e.g., a man drinking coffee in a cozy room) from separate image inputs. 3️⃣Audio-Driven Video: Sync audio with visuals for talking or singing in any scene—perfect for digital avatars, virtual customer service, and more. 4️⃣Video-Driven Video: Seamlessly insert or replace subjects into any video for creative enhancements. Dive Deeper: 🌐Project: 📝Technical Details: 💻Code: The single-subject video capability is open-sourced and live on the Hunyuan website, with more features to be released soon! 👉 Try it now: #HunyuanCustom #VideoGeneration #AI #TencentHunyuan

🚀 Introducing HunyuanCustom: An open-source, multimodal-driven architecture for customized video generation, powered by HunyuanVideo-13B. Outperforming existing open-source models, it rivals top closed-source solutions! 🎥 Highlights: ✅Subject Consistency: Maintains identity across single & multi-subject video generation. ✅Multimodal Inputs: Supports text, images, audio, and video for highly controlled outputs. ✅High-Quality Output: Industry-leading detail, motion smoothness, and lighting realism. Key Features: 1️⃣Single-Subject Video: Upload an image + text (e.g., “He’s walking a dog”) to create coherent videos with new actions, outfits, and scenes. 2️⃣Multi-Subject Video: Generate videos with multiple subjects (e.g., a man drinking coffee in a cozy room) from separate image inputs. 3️⃣Audio-Driven Video: Sync audio with visuals for talking or singing in any scene—perfect for digital avatars, virtual customer service, and more. 4️⃣Video-Driven Video: Seamlessly insert or replace subjects into any video for creative enhancements. Dive Deeper: 🌐Project: 📝Technical Details: 💻Code: The single-subject video capability is open-sourced and live on the Hunyuan website, with more features to be released soon! 👉 Try it now: #HunyuanCustom #VideoGeneration #AI #TencentHunyuan

Tencent HY

191,908 Aufrufe • vor 1 Jahr

a short video about "gorge music", a japanese open-source genre for rock climbers and mountaineers. exploring its mythology, IDM influence and how it solves artist ego

a short video about "gorge music", a japanese open-source genre for rock climbers and mountaineers. exploring its mythology, IDM influence and how it solves artist ego

RamonPang

17,317 Aufrufe • vor 6 Monaten

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊

calle

71,989 Aufrufe • vor 1 Monat

Japan reports strong growth in open source value and new expectations for support, security, and governance. Watch the highlights and explore the full findings from the 2025 State of Open Source Japan report. Read the full report: #OpenSource #LFResearch #WorldOfOpenSource

Japan reports strong growth in open source value and new expectations for support, security, and governance. Watch the highlights and explore the full findings from the 2025 State of Open Source Japan report. Read the full report: #OpenSource #LFResearch #WorldOfOpenSource

The Linux Foundation

28,543 Aufrufe • vor 9 Monaten

Holy smokes! AI video just had its DeepSeek moment. LTX Video just got a massive update in both quality & speed. 13B parameters! It is a game-changing moment for AI video and... ...it’s open-source! See for yourself: 1. Fading Glory, a short I made in @LTXStudio

Holy smokes! AI video just had its DeepSeek moment. LTX Video just got a massive update in both quality & speed. 13B parameters! It is a game-changing moment for AI video and... ...it’s open-source! See for yourself: 1. Fading Glory, a short I made in @LTXStudio

Alex Patrascu

90,223 Aufrufe • vor 1 Jahr

Siri not using Whisper is one of the strangest things in tech. Whisper: open-source, years old, near-perfect speech-to-text. Siri: still mishears half of what you say. Hard to believe the engineers actually dogfood the product.

Siri not using Whisper is one of the strangest things in tech. Whisper: open-source, years old, near-perfect speech-to-text. Siri: still mishears half of what you say. Hard to believe the engineers actually dogfood the product.

AI Breakfast

42,020 Aufrufe • vor 6 Monaten

LTX-2 is natively supported in ComfyUI on Day 0 🎬🔊 The next chapter in controllability for open-source video generation. - Open-source audio-video foundation model - Generates motion, dialogue, SFX, and music together - Canny, Depth & Pose video-to-video control - Keyframe-driven generation - Native upscaling and prompt enhancement Everything in a single pass.

LTX-2 is natively supported in ComfyUI on Day 0 🎬🔊 The next chapter in controllability for open-source video generation. - Open-source audio-video foundation model - Generates motion, dialogue, SFX, and music together - Canny, Depth & Pose video-to-video control - Keyframe-driven generation - Native upscaling and prompt enhancement Everything in a single pass.

ComfyUI

108,504 Aufrufe • vor 8 Monaten

Here are 10 AI video editor GitHub repos worth bookmarking: 1. Shotcut Most actively maintained open source video editor in 2026. 14K stars. Cross-platform with AI-assisted features. Just shipped a new release April 30, 2026. 2. Kdenlive The closest open source alternative to Adobe Premiere Pro. Multi-track editing, proxy editing, VST audio, and customizable workspace. Best for professional workflows. 3. OpenShot The easiest entry point for beginners. Drag and drop, 400+ transitions, 3D titles, and AI-assisted trimming. 5,700 stars. 4. Blender Not just 3D. Blender's video sequence editor and compositing pipeline is used in professional film production. 18,300 stars. Unmatched for VFX. 5. Recordly Screen recorder with auto-zoom, cursor polish, webcam overlays, and styled frames built in. Built for demo videos and walkthroughs. 6. Wan2.1 Alibaba's open source text-to-video model. Cinema-grade 1080p generation. Apache 2.0. The gold standard for open source video generation in 2026. 7. HunyuanVideo Tencent's 13B parameter open source video model. 11.9K stars. Handles 720p and 1080p with high temporal coherence. 8. CogVideoX Apache 2.0 licensed. Loads natively via Hugging Face Diffusers. Strong prompt following and smooth frame transitions. Needs 16GB VRAM minimum. 12.5K stars. 9. Open-Sora Most starred open source video generation project at 24K stars. Full training pipeline for $200K. Production-level output quality. 10. Mochi 1 Focused entirely on motion quality. The most natural-looking physics of any open source video model. Water, fabric, and human gestures without AI jitter. Apache 2.0.

Here are 10 AI video editor GitHub repos worth bookmarking: 1. Shotcut Most actively maintained open source video editor in 2026. 14K stars. Cross-platform with AI-assisted features. Just shipped a new release April 30, 2026. 2. Kdenlive The closest open source alternative to Adobe Premiere Pro. Multi-track editing, proxy editing, VST audio, and customizable workspace. Best for professional workflows. 3. OpenShot The easiest entry point for beginners. Drag and drop, 400+ transitions, 3D titles, and AI-assisted trimming. 5,700 stars. 4. Blender Not just 3D. Blender's video sequence editor and compositing pipeline is used in professional film production. 18,300 stars. Unmatched for VFX. 5. Recordly Screen recorder with auto-zoom, cursor polish, webcam overlays, and styled frames built in. Built for demo videos and walkthroughs. 6. Wan2.1 Alibaba's open source text-to-video model. Cinema-grade 1080p generation. Apache 2.0. The gold standard for open source video generation in 2026. 7. HunyuanVideo Tencent's 13B parameter open source video model. 11.9K stars. Handles 720p and 1080p with high temporal coherence. 8. CogVideoX Apache 2.0 licensed. Loads natively via Hugging Face Diffusers. Strong prompt following and smooth frame transitions. Needs 16GB VRAM minimum. 12.5K stars. 9. Open-Sora Most starred open source video generation project at 24K stars. Full training pipeline for $200K. Production-level output quality. 10. Mochi 1 Focused entirely on motion quality. The most natural-looking physics of any open source video model. Water, fabric, and human gestures without AI jitter. Apache 2.0.

Kanika

17,726 Aufrufe • vor 3 Monaten