Loading video...

Video Failed to Load

Go Home

AI has transformed how video is created. We think the next wave is about understanding it. Over the past few years, we've seen remarkable advances in video generation, editing, avatars, and creative tooling. An increasingly important problem is teaching machines to search, analyze, reason over, and extract insight from...

36,205 views • 2 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

New short course Multimodal RAG: Chat with Videos, developed with Intel and taught by vasudevlal! In this course, you’ll work with LLaVA (Large Language and Vision Assistant), a Large Vision Language Model (LVLM) that can process both images and text. For example, given an image of a person doing a handstand on a skateboard at the beach, LLaVA doesn't just caption the scene, it’s able to predict possible outcomes, like the person losing balance or falling off. By understanding not just what's in a video frame, but what might happen next, your application can provide more insightful answers to questions about video. You'll build a full multimodal RAG pipeline that can chat about video content: - Use the BridgeTower model to create joint text-image embeddings in a 512-dimensional multimodal semantic space. - Learn video processing techniques to extract keyframes, generate transcripts using Whisper, and create captions. - Use the LanceDB vector database to store and retrieve high-dimensional multimodal embeddings. - Integrate the LLaVA model, combining CLIP's (Contrastive Language Image Pretraining) vision transformer with Llama, for advanced visual-textual reasoning. Your final system will ingest video data, generate embeddings for frames and text, perform similarity searches for relevant content, and use the retrieved multimodal context to inform LVLM-based response generation. The result is a system capable of answering nuanced questions about video content, effectively chatting about the video it has processed. Please sign up here!

Andrew Ng

107,548 views • 1 year ago

“Liam was … we spent a lot of time together and we were together a few weeks before he passed away. […] •An acoustic version of “Through the Dark” was what I wanted to do [at the Grammys]. And that was the plan for a little while to do that separate from Immemorium. And then sadly, the artist I had in mind couldn't make it. […] •We like half filmed a video many years ago called ‘Infinity’ and we never finished the video because […] the boys changed their mind and they decided to go with another single [‘History’]. […]So we had these like this half video of like two hour shoot. So for years the fans have always been going, ‘when's the Infinity video?’ ‘We want the Infinity video.’ But it never existed. There never was one. […] We like took a bit from ‘This Is Us’. We took a bit from the Where We Are Tour at San Siro. And then we took a little bit from Wembley Stadium. And then also from that Infinity video that's never been seen. So people could just see like his joy and love for life. There was so many clips, but he's just laughing and like loving life and like enjoying it and looking at the camera. And like, if you look at it, the consistency of every single one of those clips is significant because he's looking over Verona and celebrating with his hands in the air and smiling. And then he's looking at Wembley Stadium, he's smiling, and then San Siro and he's laughing. And then we're doing the Infinity video and he's laughing. And like, that was really beautiful just to show across the period of like a few years, his joy and kindness and love for life.” - Ben Winston about Liam’s Tribute at the Grammys, Rolling Stone Music Now

HSNews

203,067 views • 1 year ago