Loading video...

Video Failed to Load

Go Home

🌟Introducing🎻Violin — an Open-source Video Translation Skill. 📹Video is the dominant medium on the internet, yet most high-quality content (lecture, talk, podcast) is locked behind a single language, leaving global audiences behind. So we built Violin: a video skill that combines speech recognition, LLM translation, and speech synthesis into...

139,822 views • 5 months ago •via X (Twitter)

34 Comments

Kevin Lin's profile picture
Kevin Lin5 months ago

🤗We are grateful to @BarteldsMartijn , @ykwon_0407 , @federicobianchy , and @KaitlynZhou for their thoughtful feedback!! ❤️We also thank the open-source community behind Whisper, DeepSeek, Qwen, and Cartesia, whose contributions form the foundation upon which Violin is built. 😊special thanks go to @nutlope and @percyliang for generously providing videos and valuable feedback during the development of this project!

zhPencil's profile picture
zhPencil5 months ago

I think the better technology combination is STT+ translation+speech synthesis+video character mouth generation. Without the last one, the final generated video will actually be very strange.

Kevin Lin's profile picture
Kevin Lin5 months ago

good suggestion, we have considered this. one factor need to consider is that the mouth gen is more costly as it is video gen, so far our version is lightweight and very fast. but we will love to include this in our next version!

Vinay Prabhu 🧬+🐍+🕷️+💉+🇮🇳's profile picture
Vinay Prabhu 🧬+🐍+🕷️+💉+🇮🇳5 months ago

Absolutely brilliant! This tool can be a gamechanger for people learning new languages using content that they are already familiar with or emotionally connected to. If the UI can be tweaked a little to juxtapose the native language alongside the translated language, I'd totally pay for this like today.

Kevin Lin's profile picture
Kevin Lin5 months ago

Thanks for your good words! @vinayprabhu

Mesut De's profile picture
Mesut De5 months ago

Wow, I just gave this a try and it works incredibly well! The translations are spot on. Huge congratulations to the team! 👏🔥

Nemo Feng's profile picture
Nemo Feng5 months ago

I built something similar - translating a 3+ hour Chinese podcast to English. CN: EN:

Kevin Lin's profile picture
Kevin Lin5 months ago

lol it looks amazing!

Nil moraes's profile picture
Nil moraes5 months ago

Thanks keviin

Jagan Mohan R., MD's profile picture
Jagan Mohan R., MD5 months ago

We create interactive video lectures for medical students with multiple audio tracks and captions. We translate the text, normalise the length, adjust the tempo and mux the audio into the video. Hope this works better. Will try this out. Thank you!

Kevin Lin's profile picture
Kevin Lin5 months ago

wow sound amazing! can you please share me the link for your work?

Tritonatis's profile picture
Tritonatis5 months ago

Sound good. How many generate times in we can use ?

Kevin Lin's profile picture
Kevin Lin5 months ago

@4Dominam 😊Hi @4Dominam so far we offer 1 times due to rate limit, and we will consider further scale this number soon. btw it is very cheap if use api, just 0.0x usd per video of several minute length!

Kristoph's profile picture
Kristoph5 months ago

Are you doing any image understanding or just ASR?

Kevin Lin's profile picture
Kevin Lin5 months ago

Hi we have vlm for vision understanding for chat with the video.

T.Rex-Baby's profile picture
T.Rex-Baby5 months ago

This is great, well done. It could also as easily work local, and even pushed higher using Voxtral realtime, replacing the STT, LLM, and TTS, making it possible with as little 32GB unified memory on a MacBook Pro.

JAGS DESIGN's profile picture
JAGS DESIGN5 months ago

perfect... seems awesome.. exploring

林夕 AI's profile picture
林夕 AI5 months ago

I had previously developed a version of this project as well, but gpt-translate came out.

SKK Java ☕️'s profile picture
SKK Java ☕️5 months ago

I like this because I can source it openly

Fisher Museum of Art's profile picture
Fisher Museum of Art5 months ago

太需要这个了。

Viz's profile picture
Viz5 months ago

So you do audio translation-> merge new audio to video ? Cos lip sync is still with old lang

Kevin Lin's profile picture
Kevin Lin5 months ago

@reachmeviz thanks for your nice suggestion! lip sync is relate to video gen and more costly. Yes, we plan to include the lip sync as well!

Leo Phiêu Diêu's profile picture
Leo Phiêu Diêu5 months ago

@KevinQHLin Hi, can it work with Vietnamese ?

Kevin Lin's profile picture
Kevin Lin5 months ago

Yes it can work for Vietnamese!

Daud Ainoo's profile picture
Daud Ainoo5 months ago

This the best video translator l have used with ease. Thank you

Kevin Lin's profile picture
Kevin Lin5 months ago

Thanks for your recognition!

Donald's profile picture
Donald5 months ago

Great! I also build a custom "Violin Studio", Can I copy a part in my project? 3Q

Kevin Lin's profile picture
Kevin Lin5 months ago

Yes for sure, thanks for your interests! and welcome contribution!

woniu's profile picture
woniu5 months ago

very useful, thank you , I'm using it now

Klea's profile picture
Klea5 months ago

Hey Kevin, Violin is pretty awesome... Would love to support you with pf github sponsorships if you’re okay with it @KevinQHLin

Kevin Lin's profile picture
Kevin Lin5 months ago

thank for your interests! will let you know if we need sponsor!

Mehul Ambedkar's profile picture
Mehul Ambedkar3 months ago

Terminal

Freya | AI Explorer's profile picture
Freya | AI Explorer5 months ago

如果能把这个功能/SKILL做成插件,或者上传视频链接,不需要上传原视频文件也能翻译的话就更棒了

Unity Eagle's profile picture
Unity Eagle5 months ago

Unfortunately the demo isn’t working network error

Related Videos

Anthropic's most viral feature is now open-source! Until now, Anthropic's Generative UI capabilities only existed inside its own products. CopilotKit🪁 just shipped Open Generative UI, an open-source implementation of Claude Artifacts that works in any app. The agent generates HTML/SVG at runtime, and CopilotKit streams it token-by-token into a sandboxed iframe inside the app's chat. So the user can watch the UI assemble itself in real time, not after the full response is ready. The sandbox is fully isolated with no access to the parent app, the DOM, or user data. So if the agent hallucinates broken markup or unexpected JavaScript, nothing leaks outside the iframe. Under the hood, the agent does not select from pre-built components. Instead, it generates arbitrary visuals from scratch every time. The output is unconstrained by default, but you can shape it by defining prompt-based skills that teach the agent specific visual formats or guidelines. For instance, a skill prompt can guide the agent toward producing a Chart.js dashboard with proper axis labels and responsive sizing, or an interactive 3D model with rotation controls. The video below shows this in action, and the output quality you see actually comes from the skills layer. Open Generative UI runs on AG-UI, so it works out of the box with LangGraph, CrewAI, Mastra, Google ADK, AWS Strands, and more. It also ships with a standalone MCP server that plugs into Claude Code, Cursor, or any MCP-compatible client. And the entire stack is built on top of CopilotKit, the open-source frontend framework for agents and generative UI. 30k+ GitHub stars, with SDKs for React, Next.js, Angular, and Vue. I have shared the GitHub repo and a live playground in the replies!

Akshay 🚀

87,048 views • 5 months ago

HE MAKES MONEY IN REAL ESTATE WITHOUT BUYING, SELLING, OR EVEN SEEING A SINGLE HOUSE. HERE'S THE EXACT SETUP He never owns a property. He takes a single listing, turns it into a polished 30-second video, and sells that to the agent who posted it. Realtors need video for their feeds and almost none of them can make it. He sits in the middle and builds the whole thing once as a skill that runs on command Here is the exact process: 1. Pull the listing. Go to Zillow, open any listing, download the high-res images, and grab the property info. That is your raw material 2. Turn photos into video with Google Veo. Get a Google API key for Veo, the image-to-video model. It takes the listing photos and animates them into clean 30-second footage. This is the best one out right now 3. Add the voice with ElevenLabs. Get an ElevenLabs API key. Feed it the listing details and it returns a voiceover that sounds like a real human, not a robot. Lay it over the video with the text on screen 4. Send it with AgentMail. Get an AgentMail key so the system can send the finished email out on its own Then you wire it into one skill. Scrape the listing, send images to Veo, add the ElevenLabs voiceover and on-screen text, then send the email. Feed it each key one at a time and have it build each step Who you sell to: Pull realtors off Zillow and Realtor com whose listings have flat photos and zero video. That gap is your pitch. Send a free sample made from their own listing first, then charge a monthly rate for ongoing clips. One agent with ten listings is a recurring client, fully online Bookmark this

Yarchi

106,174 views • 4 months ago

REAL ESTATE PEOPLE WILL HATE HIM FOR THIS. HE BUILT A CLAUDE AGENT THAT TURNS ANY LISTING INTO A SELLABLE VIDEO ON ITS OWN Playbook: connect Claude to a video generator, paste a listing, get a cinematic tour of every room, sell it to the agent But typing the prompt for every listing doesn't scale. He turned it into a skill his Claude runs on its own Here's how to build the automated version: 1. Connect the video engine once. In Claude, go to Customize, Connectors, Add Custom Connector, name it Higgsfield, and paste the server URL from higgsfield. ai/mcp. Authenticate through your account. No API keys. Now Claude can generate video straight from chat 2. Turn the workflow into a skill. Instead of pasting the same prompt every time, have Claude build a skill. Tell it: "Create a skill called listing-to-video. When I give it a listing URL, scrape the room photos, generate a cinematic clip of each room with Higgsfield, and save them to a folder." Now the whole process is one command, not a wall of text 3. Let the agent run the listing. Hand it a URL and say "run listing-to-video on this." It pulls the photos, fires each room through the video model, and brings the clips back. You wrote the prompt once, inside the skill. You never write it again 4. Stitch and deliver. Drop the clips together into one tour. Send a free sample to the listing's agent, then charge per video or a monthly rate for ongoing listings 5. Scale it with your team. Add a skill that drafts the outreach email and one that builds a simple landing page for the agent. Now one operator runs sourcing, production, and pitching from a single Claude session The edge isn't generating one video. It's building the skill once so every future listing runs itself Bookmark this

Yarchi

54,840 views • 4 months ago

I solved building decks with AI agents — by giving them a CLI tool like Powerpoint or Google Slides. AI could already make a beautiful deck if you asked it to using Ant's pptx skill. The problem was working with it. If it made one alignment mistake, fixing it on one slide would break something on another, and it became a game of whack-a-mole. One time I spent two days playing AI roulette, hoping the next prompt would finally fix the thing, and ended up building the whole deck by hand because I was on a deadline. So I built Hands-on Deck. And the reason it works is that this isn't just a skill — this is PowerPoint. The actual application: PowerPoint, Google Slides, Keynote, whatever you use. This is that, but for an agent, presented as a CLI. Every gesture you make in a deck app maps to a command. Click a box and type, drag a shape from here to there, look at a slide – agent can do it all in a command. And that changes how the agent behaves. With this CLI it works and thinks like a designer — it looks, makes an edit, looks again, makes another surgical edit. Compare that to Anthropic's pptx skill, built on the idea that Claude is a great programmer: it literally writes code to manipulate the deck, hand-editing XML and hoping it doesn't break anything else in the middle. The real test isn't creating something once — it's whether it can make surgical edits like you want. That's what I did in this video walkthrough and my claude crushed it! Check it out for yourself. So decks can be built like a designer now — with real flavor and taste. If you spend hours every week on decks, this gives those hours back. You can install it as a skill in Claude Code, Codex, whatever you use. Works every harness that supports skills. Let me know if you make something cool with it.

Nityesh

70,086 views • 3 months ago

Fable 5 and GPT-5.6 built the same scroll-animated website from 1 skill in 32 minutes and only 1 of them made it feel like a film. Same prompt: boutique Japan travel brand, origami style. A subway pulls in, a paper house unfolds into a hotel, a bird takes flight as you scroll. Doing this by hand is brutal multiple videos, matched starting frames, frames ripped out 1 by 1 and synced to scroll position. The skill does all of it: Generate 1 anchor image and approve it every scene inherits the style Turn it into video through the Higgs Field MCP (Seedance), straight from the terminal FFmpeg pulls every frame Each frame maps to scroll position, so your scrollbar becomes the playhead Setup is just connecting the MCP and loading the skill works in Claude Code and Codex. It interviews you first about scenes, budget and mobile, then shows the anchor image before burning a single credit on video. Budget reality: 6 scenes runs ~800 credits and is overkill, 4 scenes is the sweet spot, crop-safe mobile is the cheap path. The verdict came down to transitions. GPT-5.6 Soul built strong scenes with incredible detail inside each one then hard cuts between scene 1 and 2, and again between 2 and 3. Fable 5 stitched them together: wires push out of the top of frame while the next scene blurs in behind, gains depth and locks into place. Same skill, same prompts, 10 generations each. Credit to Peter Wang for the original Scroll World skill open source, now forked with budget tiers and mobile fixes. Soul built 4 scenes. Fable built 1 film.

Spike 1%

45,683 views • 3 months ago

is live on the Solana dApp Store. Your Solana Seeker is now a 3D agent studio. MAKE SOMETHING IN 3D A selfie becomes a rigged, textured, animation-ready character in about a minute. Or describe it in text. Or turn any photo into a model. Or upload a GLB you already have. Then restyle its materials, change its clothes, check its rig and fix it. MAKE IT MOVE A clip library that retargets onto any humanoid skeleton. Mocap from your camera. Lipsync from text or a live mic. Gestures. Sign language. A choreographer for full routines. And motion swap, which drops your avatar into video you already shot. GIVE IT A MIND A personality, a voice, skills, and a choice of models behind it. Then talk to it. It answers in 3D, out loud or in text, in your language. PUT IT ANYWHERE Every agent has a URL and a one-line embed, so it drops into a site, a chat, or a widget. Place it in your room in AR. Walk it across any web page. Turn a URL into a 3D world it can stand in. Render it out as video. OWN IT Deploy it on-chain as a Metaplex Core asset your wallet holds. Open manifest, no lock-in. Give it an on-chain identity, a name, and a wallet with recovery and inheritance. Sell its skills. Take tips. Trade the agent itself in USDC. LET IT EARN Pay-per-call, so other agents can buy what yours does and yours can buy what it needs. A skills marketplace, a labor market, vaults that let people back an agent, and a live feed of agents paying each other. Launch a coin around it if you want one. FIND EVERYONE ELSE A marketplace of what the community built: orbit any agent, inspect it, fork it, talk to it. Crews, rankings, tournaments, leaderboards. And build on it: SDKs, an MCP server, a CLI, an API, and the whole platform open source. AND THE PART THAT NEEDED THIS PHONE Every signature routes to Seed Vault through Mobile Wallet Adapter. Signing in is one tap, and the private key never enters the app process. Creating, chatting and browsing are free. Search in the dApp Store on your Seeker.

three.ws

11,973 views • 1 month ago

I made a Draconia Malfoid Visual Novel. I used Vivix's new W1 model, which is unique for it's real-time interaction. No more static cut-outs of characters and still backgrounds. Vivix's W1 model costs $0.003 per second and is fully interactive, shattering the cost barrier while being high quality and real-time. Vivix W1 is also different. It's not a simple clip model, its beta API offers something unique - it lets you modify the video on the fly, a real-time interactive video model. Most AI video is prompt in, clip out, then repeat. Every prompt a break or cut in the video. Vivix W1 is continuous, creating a seamless video experience. That means you can have an LLM handle the conversation, and stream the new chat and emotions and scenes as signals into the API to direct the character's video in real-time, without pauses. You can take characters anywhere in the world, any setting. That's kinda nuts. Vivix reached out to see if I was interested, so I put together a quick AI Visual Novel system with their API. The prototype video is impressive at this speed. The W1 model is directable in real-time. The responses, outfit changes and the dances are all live. The W1 seamless responsiveness is something no clip generator offers. At just about 10 bucks/hour of video, gaming applications are within reach. I do wish the audio was better, it tends to have drop-outs, and it currently doesn't do seamless scene transitions. But the model is in full scale training now, and I hope to have characters moving from location to location with the player. The site is clip-only for now, real-time is the beta API, browser interaction is later. This is the part I am most interested in. You can check it out at: *Sponsored by Vivix.AI

Grummz

69,613 views • 2 days ago

Hermes + Claude + Higgsfield MCP + ViralBuilder = 💰💰💰 Four tools. One prompt chain. Hook to finished video in 10 minutes. I built a Claude skill that writes shot-by-shot Higgsfield prompts from a single creative brief. ViralBuilder tells you what's winning. The skill turns it into a production-ready prompt. Higgsfield renders it. No creative director. No guessing. No separate tools. Here is the setup: Higgsfield MCP → Open Claude Code → Settings → Connectors → Enter: → Connect your account Hermes → The agent layer running underneath Claude Code → It holds your skills, crons, memory, and routing rules → When you prompt Claude, Hermes feeds it the context it needs ViralBuilder (like Gethookd) → The winning ecom video database → Scrapes top performing ecom videos across platforms → Claude reads the data and extracts what styles, hooks, and formats are actually scaling The skill: video-prompt-builder → Installed inside Claude via Hermes → Takes a creative brief and outputs a full shot-by-shot prompt → Covers camera work, effects, transitions, pacing, and energy arc → Every output is structured for Higgsfield to render without ambiguity No switching apps. No export steps. Everything runs from one place. ▸ FIND WINNING CREATIVE ANGLES ViralBuilder tells you what the market already validated. Claude reads it and extracts the pattern. Prompts to run: "Search ViralBuilder for the top performing ecom videos in [niche] over the last 21 days. Extract the 3 dominant hook styles and rank by view velocity." "Pull the winning video formats in [niche] from ViralBuilder. Which opening 3 seconds appears most across videos spending over $10k?" "Find what video style is scaling right now in [niche] for the US market. UGC, talking head, or product demo. Filter for videos with over 1M views." "Pull the last 30 days of viral ecom hooks in [niche] from ViralBuilder. Cluster by emotional trigger. Which cluster has the most longevity?" You are not guessing at angles. You are reading what the market already spent money validating. ▸ BUILD THE PROMPT WITH THE SKILL This is where the video-prompt-builder skill takes over. You give Claude the winning angle. The skill outputs a complete shot-by-shot prompt with effects, transitions, pacing, and energy arc ready to fire into Higgsfield. Prompts to run: "Use the video-prompt-builder skill. Brief: 15-second UGC ad for [product] in [niche]. Hook style: [style from ViralBuilder]. Tone: direct to camera, US English. Output the full shot-by-shot effects timeline, effects inventory, density map, and energy arc." "Use the video-prompt-builder skill. The dominant hook in [niche] this week is [hook]. Build a 10-second product video prompt that opens with a speed ramp into a close-up product reveal. Include a signature visual effect and a low-density CTA landing." "Use the video-prompt-builder skill. Brief: replicate the pacing and energy of a [style description] video for [product]. Target duration: 20 seconds. Output all four sections. Then generate the video with Higgsfield using the shot-by-shot prompt." The skill outputs four sections every time: → Shot-by-shot effects timeline with camera, movement, and transitions per shot → Master effects inventory showing every technique used and where → Effects density map showing high, medium, and low intensity across the timeline → Energy arc describing how the video opens, builds, and lands That output goes directly into Higgsfield. No rewriting. No translating. ▸ GENERATE THE CREATIVE Claude writes the brief via the skill. Higgsfield MCP builds the video. Both happen in the same session. Prompts to run: "Use the video-prompt-builder skill to write a 15-second UGC prompt for [product]. Hook in the first 3 seconds, speed ramp into product reveal, slow-motion CTA landing. Then generate with Higgsfield in 9:16 format." "Build 3 prompt variations on this winning angle: [angle]. Each variation opens with a different effect — speed ramp, digital zoom, whip pan. Use the video-prompt-builder skill for each. Then generate all three with Higgsfield." "Use the video-prompt-builder skill. Brief: problem-solution ad for [product], 20 seconds, US market. Problem shot at high density, product reveal at medium, result and CTA at low. Generate with Higgsfield in 9:16." No separate tool. No file transfer. The video comes back in the same thread. ▸ CHAIN THE WHOLE STACK One prompt. All four tools firing together. "You are my ad creative director. Hermes has loaded my brand context. Pull the top performing video style in [niche] from ViralBuilder this week. Use the video-prompt-builder skill to write a full shot-by-shot prompt for [product] that replicates that style — 20 seconds, 9:16, US market, hook in the first 3 seconds. Output the effects timeline, inventory, density map, and energy arc. Then generate the video with Higgsfield." That single prompt replaces a half-day of production. The math before this stack: Brief: 30 minutes Script: 1 hour Creative production: 2 to 3 hours Agency or freelancer cost: $500 to $2,000 per creative With this stack: Hook to finished creative: 10 minutes Cost per creative: tool subscription, a fraction of agency rate 5 product tests in the time it used to take to brief one Bad product tests are where US ad budget disappears. $600 to $1,500 per failed test, before you even know if the angle works. This stack shows you what the market already validated before you spend a dollar on production. Hermes = your context layer. Brand, goals, past performance. Claude is always informed. ViralBuilder = your winning video database. See exactly what styles, hooks, and formats are scaling before you produce anything. video-prompt-builder skill = the translation layer. Turns a creative brief into a structured, production-ready Higgsfield prompt every time. Claude = the brain. Reads the market, writes the brief, chains the tools. Higgsfield MCP = the output. Video generated directly from the prompt. No export step. Four tools. One session. 10 minutes. Comment + RT "STACK" and I'll DM you the full workflow + the video-prompt-builder skill file.

Kid Pak

59,475 views • 5 months ago