Загрузка видео...

Не удалось загрузить видео

На главную

Experimenting with the magic of open-source! Whisper for text translation, XTTS for audio, and Video-retalker for seamless mouth sync in a short video Its not perfect, but I think we're close with open source #buildinpublic #opensource

lucataco's profile picture

Luis Catacora

9,456 subscribers

80,983 просмотров • 2 лет назад •via X (Twitter)

Наука и технологииИскусство#buildinpublic#opensource
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 10

Фото профиля Luis C
Luis C2 лет назад

For reference these were my runs on @replicate: Curious to see what you all come up with!

Фото профиля Michael Aubry — BasedLabs.ai
Michael Aubry — BasedLabs.ai2 лет назад

Do you know how d-id or heygen works? Wondering if there is a good oss model

Фото профиля Bilawal Sidhu
Bilawal Sidhu2 лет назад

this is awesome, but gosh i wish it worked better for beards

Фото профиля Luis C
Luis C2 лет назад

Likewise. There seems to be limits when using the video-retalking model

Фото профиля AP
AP2 лет назад

Really cool! @artificialguybr

Фото профиля Luis C
Luis C2 лет назад

@artificialguybr Thanks! It was cool enough that I just had to share it

Фото профиля ⟁ndrew V
⟁ndrew V2 лет назад

Pretty damn good for a first pass, impressive!

Фото профиля Luis C
Luis C2 лет назад

Right? All these models have been open source for a while too, just needed to chain them together

Фото профиля Crypto Industry
Crypto Industry2 лет назад

The magic of open source is real, and you're the tech wizard making it happen! 🧙‍♀️

Фото профиля Luis C
Luis C2 лет назад

Thanks! Im just testing out ideas tbh

Похожие видео

🎧 IAMF: The Future of Audio with Open Standards! 🎧 At CES , #VLC with #FFMPEG showcases #IAMF redefining sound: 🎵 Spatial audio for next-level immersion 🌌 Cinema-quality sound 📱 Seamless playback across devices 💻 Powered by open-source tech #VLC #CES2025 #OPENSOURCE
0:37

🎧 IAMF: The Future of Audio with Open Standards! 🎧 At CES , #VLC with #FFMPEG showcases #IAMF redefining sound: 🎵 Spatial audio for next-level immersion 🌌 Cinema-quality sound 📱 Seamless playback across devices 💻 Powered by open-source tech #VLC #CES2025 #OPENSOURCE

VideoLAN

13,391 просмотров • 1 год назад

Open-source and free apps for coders and makers - CSS Text effects with AI prompts - Open-source self-hosted dashboard for Amazon SES - Free directory of public APIs - Open-source security framework - UI library for building terminal user interfaces
0:35

Open-source and free apps for coders and makers - CSS Text effects with AI prompts - Open-source self-hosted dashboard for Amazon SES - Free directory of public APIs - Open-source security framework - UI library for building terminal user interfaces

Csaba Kissi

27,438 просмотров • 2 месяцев назад

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.
0:25

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

Akshay 🚀

66,268 просмотров • 8 месяцев назад

Aligned with Matan Grinberg's intuition that in the next 12 months, 90% of tokens could be going to open models. We're seeing more and more companies using frontier APIs for experimenting and open-source or private models for production and larger workloads!
1:08

Aligned with Matan Grinberg's intuition that in the next 12 months, 90% of tokens could be going to open models. We're seeing more and more companies using frontier APIs for experimenting and open-source or private models for production and larger workloads!

clem 🤗

24,138 просмотров • 2 месяцев назад

New open-source LoRA built in-house: LTX2.3 Audio Reactive LoRA. Built for music-driven video generation: stronger beat sync, graphic texture, color separation, light pulses, particles, and shapes that move with the track. Model:
0:39

New open-source LoRA built in-house: LTX2.3 Audio Reactive LoRA. Built for music-driven video generation: stronger beat sync, graphic texture, color separation, light pulses, particles, and shapes that move with the track. Model:

fal

17,789 просмотров • 3 месяцев назад

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)
15:16

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

Avthar

34,261 просмотров • 1 год назад

We are thrilled to announce the open-source release of Hallo2: a new avatar video generative model capable of generating stunning 4K resolution videos for up to 1 hour! 🎥✨ Explore the project for the open source code: Let's push the boundaries of avatar video generative model! #OpenSource #AI #FaceAnimation #GenerativeArt
23:18

We are thrilled to announce the open-source release of Hallo2: a new avatar video generative model capable of generating stunning 4K resolution videos for up to 1 hour! 🎥✨ Explore the project for the open source code: Let's push the boundaries of avatar video generative model! #OpenSource #AI #FaceAnimation #GenerativeArt

Siyu ZHU

58,323 просмотров • 1 год назад

Announcing SubStudio! Generate subtitles for any video in seconds with AI. 100% free & open source! Powered by Whisper on Together AI and FFmpeg via fluent-ffmpeg.
0:20

Announcing SubStudio! Generate subtitles for any video in seconds with AI. 100% free & open source! Powered by Whisper on Together AI and FFmpeg via fluent-ffmpeg.

Hassan

136,237 просмотров • 5 месяцев назад

Elon Musk played a key role in the creation of OpenAI, even coming up with the name “OpenAI” to reflect its commitment to being open source. But Sam Altman transformed this open-source, non-profit company into a closed-source, for-profit company.
6:50

Elon Musk played a key role in the creation of OpenAI, even coming up with the name “OpenAI” to reflect its commitment to being open source. But Sam Altman transformed this open-source, non-profit company into a closed-source, for-profit company.

DogeDesigner

57,624 просмотров • 1 год назад

Elon Musk played a key role in the creation of OpenAI, even coming up with the name “OpenAI” to reflect its commitment to being open source. But Sam Altman transformed this open-source, non-profit company into a closed-source, for-profit company.
0:45

Elon Musk played a key role in the creation of OpenAI, even coming up with the name “OpenAI” to reflect its commitment to being open source. But Sam Altman transformed this open-source, non-profit company into a closed-source, for-profit company.

DogeDesigner

2,360,643 просмотров • 1 год назад

🚀 Introducing HunyuanCustom: An open-source, multimodal-driven architecture for customized video generation, powered by HunyuanVideo-13B. Outperforming existing open-source models, it rivals top closed-source solutions! 🎥 Highlights: ✅Subject Consistency: Maintains identity across single & multi-subject video generation. ✅Multimodal Inputs: Supports text, images, audio, and video for highly controlled outputs. ✅High-Quality Output: Industry-leading detail, motion smoothness, and lighting realism. Key Features: 1️⃣Single-Subject Video: Upload an image + text (e.g., “He’s walking a dog”) to create coherent videos with new actions, outfits, and scenes. 2️⃣Multi-Subject Video: Generate videos with multiple subjects (e.g., a man drinking coffee in a cozy room) from separate image inputs. 3️⃣Audio-Driven Video: Sync audio with visuals for talking or singing in any scene—perfect for digital avatars, virtual customer service, and more. 4️⃣Video-Driven Video: Seamlessly insert or replace subjects into any video for creative enhancements. Dive Deeper: 🌐Project: 📝Technical Details: 💻Code: The single-subject video capability is open-sourced and live on the Hunyuan website, with more features to be released soon! 👉 Try it now: #HunyuanCustom #VideoGeneration #AI #TencentHunyuan
0:40

🚀 Introducing HunyuanCustom: An open-source, multimodal-driven architecture for customized video generation, powered by HunyuanVideo-13B. Outperforming existing open-source models, it rivals top closed-source solutions! 🎥 Highlights: ✅Subject Consistency: Maintains identity across single & multi-subject video generation. ✅Multimodal Inputs: Supports text, images, audio, and video for highly controlled outputs. ✅High-Quality Output: Industry-leading detail, motion smoothness, and lighting realism. Key Features: 1️⃣Single-Subject Video: Upload an image + text (e.g., “He’s walking a dog”) to create coherent videos with new actions, outfits, and scenes. 2️⃣Multi-Subject Video: Generate videos with multiple subjects (e.g., a man drinking coffee in a cozy room) from separate image inputs. 3️⃣Audio-Driven Video: Sync audio with visuals for talking or singing in any scene—perfect for digital avatars, virtual customer service, and more. 4️⃣Video-Driven Video: Seamlessly insert or replace subjects into any video for creative enhancements. Dive Deeper: 🌐Project: 📝Technical Details: 💻Code: The single-subject video capability is open-sourced and live on the Hunyuan website, with more features to be released soon! 👉 Try it now: #HunyuanCustom #VideoGeneration #AI #TencentHunyuan

Tencent HY

191,908 просмотров • 1 год назад

a short video about "gorge music", a japanese open-source genre for rock climbers and mountaineers. exploring its mythology, IDM influence and how it solves artist ego
2:03

a short video about "gorge music", a japanese open-source genre for rock climbers and mountaineers. exploring its mythology, IDM influence and how it solves artist ego

RamonPang

17,317 просмотров • 6 месяцев назад

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊
0:23

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊

calle

71,989 просмотров • 1 месяц назад

Japan reports strong growth in open source value and new expectations for support, security, and governance. Watch the highlights and explore the full findings from the 2025 State of Open Source Japan report. Read the full report: #OpenSource #LFResearch #WorldOfOpenSource
0:44

Japan reports strong growth in open source value and new expectations for support, security, and governance. Watch the highlights and explore the full findings from the 2025 State of Open Source Japan report. Read the full report: #OpenSource #LFResearch #WorldOfOpenSource

The Linux Foundation

28,543 просмотров • 9 месяцев назад

Holy smokes! AI video just had its DeepSeek moment. LTX Video just got a massive update in both quality & speed. 13B parameters! It is a game-changing moment for AI video and... ...it’s open-source! See for yourself: 1. Fading Glory, a short I made in @LTXStudio
2:16

Holy smokes! AI video just had its DeepSeek moment. LTX Video just got a massive update in both quality & speed. 13B parameters! It is a game-changing moment for AI video and... ...it’s open-source! See for yourself: 1. Fading Glory, a short I made in @LTXStudio

Alex Patrascu

90,223 просмотров • 1 год назад

Siri not using Whisper is one of the strangest things in tech. Whisper: open-source, years old, near-perfect speech-to-text. Siri: still mishears half of what you say. Hard to believe the engineers actually dogfood the product.
0:28

Siri not using Whisper is one of the strangest things in tech. Whisper: open-source, years old, near-perfect speech-to-text. Siri: still mishears half of what you say. Hard to believe the engineers actually dogfood the product.

AI Breakfast

42,020 просмотров • 6 месяцев назад

LTX-2 is natively supported in ComfyUI on Day 0 🎬🔊 The next chapter in controllability for open-source video generation. - Open-source audio-video foundation model - Generates motion, dialogue, SFX, and music together - Canny, Depth & Pose video-to-video control - Keyframe-driven generation - Native upscaling and prompt enhancement Everything in a single pass.
0:36

LTX-2 is natively supported in ComfyUI on Day 0 🎬🔊 The next chapter in controllability for open-source video generation. - Open-source audio-video foundation model - Generates motion, dialogue, SFX, and music together - Canny, Depth & Pose video-to-video control - Keyframe-driven generation - Native upscaling and prompt enhancement Everything in a single pass.

ComfyUI

108,504 просмотров • 8 месяцев назад

Here are 10 AI video editor GitHub repos worth bookmarking: 1. Shotcut Most actively maintained open source video editor in 2026. 14K stars. Cross-platform with AI-assisted features. Just shipped a new release April 30, 2026. 2. Kdenlive The closest open source alternative to Adobe Premiere Pro. Multi-track editing, proxy editing, VST audio, and customizable workspace. Best for professional workflows. 3. OpenShot The easiest entry point for beginners. Drag and drop, 400+ transitions, 3D titles, and AI-assisted trimming. 5,700 stars. 4. Blender Not just 3D. Blender's video sequence editor and compositing pipeline is used in professional film production. 18,300 stars. Unmatched for VFX. 5. Recordly Screen recorder with auto-zoom, cursor polish, webcam overlays, and styled frames built in. Built for demo videos and walkthroughs. 6. Wan2.1 Alibaba's open source text-to-video model. Cinema-grade 1080p generation. Apache 2.0. The gold standard for open source video generation in 2026. 7. HunyuanVideo Tencent's 13B parameter open source video model. 11.9K stars. Handles 720p and 1080p with high temporal coherence. 8. CogVideoX Apache 2.0 licensed. Loads natively via Hugging Face Diffusers. Strong prompt following and smooth frame transitions. Needs 16GB VRAM minimum. 12.5K stars. 9. Open-Sora Most starred open source video generation project at 24K stars. Full training pipeline for $200K. Production-level output quality. 10. Mochi 1 Focused entirely on motion quality. The most natural-looking physics of any open source video model. Water, fabric, and human gestures without AI jitter. Apache 2.0.
1:18

Here are 10 AI video editor GitHub repos worth bookmarking: 1. Shotcut Most actively maintained open source video editor in 2026. 14K stars. Cross-platform with AI-assisted features. Just shipped a new release April 30, 2026. 2. Kdenlive The closest open source alternative to Adobe Premiere Pro. Multi-track editing, proxy editing, VST audio, and customizable workspace. Best for professional workflows. 3. OpenShot The easiest entry point for beginners. Drag and drop, 400+ transitions, 3D titles, and AI-assisted trimming. 5,700 stars. 4. Blender Not just 3D. Blender's video sequence editor and compositing pipeline is used in professional film production. 18,300 stars. Unmatched for VFX. 5. Recordly Screen recorder with auto-zoom, cursor polish, webcam overlays, and styled frames built in. Built for demo videos and walkthroughs. 6. Wan2.1 Alibaba's open source text-to-video model. Cinema-grade 1080p generation. Apache 2.0. The gold standard for open source video generation in 2026. 7. HunyuanVideo Tencent's 13B parameter open source video model. 11.9K stars. Handles 720p and 1080p with high temporal coherence. 8. CogVideoX Apache 2.0 licensed. Loads natively via Hugging Face Diffusers. Strong prompt following and smooth frame transitions. Needs 16GB VRAM minimum. 12.5K stars. 9. Open-Sora Most starred open source video generation project at 24K stars. Full training pipeline for $200K. Production-level output quality. 10. Mochi 1 Focused entirely on motion quality. The most natural-looking physics of any open source video model. Water, fabric, and human gestures without AI jitter. Apache 2.0.

Kanika

17,726 просмотров • 3 месяцев назад