Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

XAI EXTENDS GROK IMAGINE VIDEO GENERATION TO 10 SECONDS WITH QUALITY ENHANCEMENTS xAI has updated its Grok Imagine tool to produce videos lasting 10 seconds, doubling the prior limit. This change, along with refinements in visual and audio elements, expands the tool's utility for short-form content creation. xAI released... the upgrade to Grok Imagine in early 2026. The company, founded by Elon Musk, announced the feature through posts on the X platform. This follows previous iterations where videos were capped at shorter durations, typically 5 seconds. Grok Imagine allows users to generate videos from text prompts, building on its image creation capabilities. The update addresses constraints in video length that limited expressive potential. Users can now input descriptions to create clips, such as animations or scenes, without needing initial images. This positions the tool within the broader landscape of AI-driven multimodal generation, where text-to-video systems are increasingly common. The core adjustment doubles the maximum video duration from 5 seconds to 10 seconds. Accompanying this are upgrades to video quality, including more stable visuals, richer details, and improved clarity. Audio has also been enhanced for better output, making the generated content more immersive. These changes were described as "big improvements across the board" in the announcement. No specific benchmarks or quantitative metrics for the quality improvements were detailed in the release statements. The feature rollout appears gradual, with some users accessing it via the Grok app or web interface. xAI has not introduced user controls for exact timing, though such options are mentioned as future possibilities. This development highlights xAI's emphasis on iterative enhancements in generative AI tools. By extending duration while refining output fidelity, it reflects engineering priorities aimed at balancing computational efficiency with user needs. The focus on audio and visual stability suggests attention to common pitfalls in early text-to-video models, such as inconsistencies or artifacts. The sources do not specify the underlying model architecture changes or training data adjustments enabling this upgrade. Performance in real-world scenarios, like handling complex prompts or maintaining consistency across clips, remains unquantified in the announcements. Interpretations of broader implications for AI video generation would require additional evidence beyond what's provided.show more

Lacey

6,047 subscribers

28,881 görüntüleme • 7 ay önce •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

AI at Meta

2,265,716 görüntüleme • 1 yıl önce

TokenFlow: Consistent Diffusion Features for Consistent Video Editing paper page: The generative AI revolution has recently expanded to videos. Nevertheless, current state-of-the-art video models are still lagging behind image models in terms of visual quality and user control over the generated content. In this work, we present a framework that harnesses the power of a text-to-image diffusion model for the task of text-driven video editing. Specifically, given a source video and a target text-prompt, our method generates a high-quality video that adheres to the target text, while preserving the spatial layout and motion of the input video. Our method is based on a key observation that consistency in the edited video can be obtained by enforcing consistency in the diffusion feature space. We achieve this by explicitly propagating diffusion features based on inter-frame correspondences, readily available in the model. Thus, our framework does not require any training or fine-tuning, and can work in conjunction with any off-the-shelf text-to-image editing method. We demonstrate state-of-the-art editing results on a variety of real-world videos.

TokenFlow: Consistent Diffusion Features for Consistent Video Editing paper page: The generative AI revolution has recently expanded to videos. Nevertheless, current state-of-the-art video models are still lagging behind image models in terms of visual quality and user control over the generated content. In this work, we present a framework that harnesses the power of a text-to-image diffusion model for the task of text-driven video editing. Specifically, given a source video and a target text-prompt, our method generates a high-quality video that adheres to the target text, while preserving the spatial layout and motion of the input video. Our method is based on a key observation that consistency in the edited video can be obtained by enforcing consistency in the diffusion feature space. We achieve this by explicitly propagating diffusion features based on inter-frame correspondences, readily available in the model. Thus, our framework does not require any training or fine-tuning, and can work in conjunction with any off-the-shelf text-to-image editing method. We demonstrate state-of-the-art editing results on a variety of real-world videos.

AK

143,469 görüntüleme • 3 yıl önce

Video created using all of Grok Imagine's tools: -I created the character and backgrounds with Imagine, and then refined the results with the image editor. - I animated the images with Grok Imagine - I used the video extension to achieve better consistency for clips up to 30 seconds long. And MOST IMPORTANTLY, - I saved a ton of time by using the latest update, which allows you to add reference images when generating videos. This makes it possible to introduce pre-defined character into new backgrounds and maintain consistency across the sets. It may not seem like it, but there were many difficulties in preserving the seeing machine over time, the character... Thank you xAI, truly a great tool that you keep building a little more efficient day after day.

Video created using all of Grok Imagine's tools: -I created the character and backgrounds with Imagine, and then refined the results with the image editor. - I animated the images with Grok Imagine - I used the video extension to achieve better consistency for clips up to 30 seconds long. And MOST IMPORTANTLY, - I saved a ton of time by using the latest update, which allows you to add reference images when generating videos. This makes it possible to introduce pre-defined character into new backgrounds and maintain consistency across the sets. It may not seem like it, but there were many difficulties in preserving the seeing machine over time, the character... Thank you xAI, truly a great tool that you keep building a little more efficient day after day.

Déborah

23,151 görüntüleme • 5 ay önce

Google presents Still-Moving Customized Video Generation without Customized Video Data Customizing text-to-image (T2I) models has seen tremendous progress recently, particularly in areas such as personalization, stylization, and conditional generation. However, expanding this progress to video generation is still in its infancy, primarily due to the lack of customized video data. In this work, we introduce Still-Moving, a novel generic framework for customizing a text-to-video (T2V) model, without requiring any customized video data. The framework applies to the prominent T2V design where the video model is built over a text-to-image (T2I) model (e.g., via inflation). We assume access to a customized version of the T2I model, trained only on still image data (e.g., using DreamBooth or StyleDrop). Naively plugging in the weights of the customized T2I model into the T2V model often leads to significant artifacts or insufficient adherence to the customization data. To overcome this issue, we train lightweight Spatial Adapters that adjust the features produced by the injected T2I layers. Importantly, our adapters are trained on "frozen videos" (i.e., repeated images), constructed from image samples generated by the customized T2I model. This training is facilitated by a novel Motion Adapter module, which allows us to train on such static videos while preserving the motion prior of the video model. At test time, we remove the Motion Adapter modules and leave in only the trained Spatial Adapters. This restores the motion prior of the T2V model while adhering to the spatial prior of the customized T2I model. We demonstrate the effectiveness of our approach on diverse tasks including personalized, stylized, and conditional generation. In all evaluated scenarios, our method seamlessly integrates the spatial prior of the customized T2I model with a motion prior supplied by the T2V model.

Google presents Still-Moving Customized Video Generation without Customized Video Data Customizing text-to-image (T2I) models has seen tremendous progress recently, particularly in areas such as personalization, stylization, and conditional generation. However, expanding this progress to video generation is still in its infancy, primarily due to the lack of customized video data. In this work, we introduce Still-Moving, a novel generic framework for customizing a text-to-video (T2V) model, without requiring any customized video data. The framework applies to the prominent T2V design where the video model is built over a text-to-image (T2I) model (e.g., via inflation). We assume access to a customized version of the T2I model, trained only on still image data (e.g., using DreamBooth or StyleDrop). Naively plugging in the weights of the customized T2I model into the T2V model often leads to significant artifacts or insufficient adherence to the customization data. To overcome this issue, we train lightweight Spatial Adapters that adjust the features produced by the injected T2I layers. Importantly, our adapters are trained on "frozen videos" (i.e., repeated images), constructed from image samples generated by the customized T2I model. This training is facilitated by a novel Motion Adapter module, which allows us to train on such static videos while preserving the motion prior of the video model. At test time, we remove the Motion Adapter modules and leave in only the trained Spatial Adapters. This restores the motion prior of the T2V model while adhering to the spatial prior of the customized T2I model. We demonstrate the effectiveness of our approach on diverse tasks including personalized, stylized, and conditional generation. In all evaluated scenarios, our method seamlessly integrates the spatial prior of the customized T2I model with a motion prior supplied by the T2V model.

AK

40,485 görüntüleme • 2 yıl önce

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

Lovis Odin

58,841 görüntüleme • 11 ay önce

Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution paper page: Text-based diffusion models have exhibited remarkable success in generation and editing, showing great promise for enhancing visual content with their generative prior. However, applying these models to video super-resolution remains challenging due to the high demands for output fidelity and temporal consistency, which is complicated by the inherent randomness in diffusion models. Our study introduces Upscale-A-Video, a text-guided latent diffusion framework for video upscaling. This framework ensures temporal coherence through two key mechanisms: locally, it integrates temporal layers into U-Net and VAE-Decoder, maintaining consistency within short sequences; globally, without training, a flow-guided recurrent latent propagation module is introduced to enhance overall video stability by propagating and fusing latent across the entire sequences. Thanks to the diffusion paradigm, our model also offers greater flexibility by allowing text prompts to guide texture creation and adjustable noise levels to balance restoration and generation, enabling a trade-off between fidelity and quality. Extensive experiments show that Upscale-A-Video surpasses existing methods in both synthetic and real-world benchmarks, as well as in AI-generated videos, showcasing impressive visual realism and temporal consistency.

Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution paper page: Text-based diffusion models have exhibited remarkable success in generation and editing, showing great promise for enhancing visual content with their generative prior. However, applying these models to video super-resolution remains challenging due to the high demands for output fidelity and temporal consistency, which is complicated by the inherent randomness in diffusion models. Our study introduces Upscale-A-Video, a text-guided latent diffusion framework for video upscaling. This framework ensures temporal coherence through two key mechanisms: locally, it integrates temporal layers into U-Net and VAE-Decoder, maintaining consistency within short sequences; globally, without training, a flow-guided recurrent latent propagation module is introduced to enhance overall video stability by propagating and fusing latent across the entire sequences. Thanks to the diffusion paradigm, our model also offers greater flexibility by allowing text prompts to guide texture creation and adjustable noise levels to balance restoration and generation, enabling a trade-off between fidelity and quality. Extensive experiments show that Upscale-A-Video surpasses existing methods in both synthetic and real-world benchmarks, as well as in AI-generated videos, showcasing impressive visual realism and temporal consistency.

AK

32,849 görüntüleme • 2 yıl önce

Vercel AI Gateway now supports video generation. Grok Imagine Video & Image are 🆓 until tomorrow. We used v0 to create an open source Creative Studio powered by xAI Grok. Create images, videos, or make your own design tool! – it's quite fast. Some cool technical tidbits: ▪️ Vercel Workflows for reliable generation Video generation can take long. Users might restart their browsers or their wifi / LTE might drop. We smooth over that automatically. ▪️ Instant vector search Try searching the public generations. Now back to me. We used Mixedbread to index the content visually, so you can search 𝚋𝚕𝚊𝚌𝚔 𝚏𝚎𝚕𝚒𝚗𝚎 and get a cat (try it!) ▪️ Vercel AI Gateway All existing and future Grok models are accessible via our gateway without extra setup. When you deploy to Vercel, you get access to hundreds of models with a single account and unified billing It's obviously built with Next.js (RSC). Open it in v0 to make it your own! h/t Esteban Suárez for shipping this.

Vercel AI Gateway now supports video generation. Grok Imagine Video & Image are 🆓 until tomorrow. We used v0 to create an open source Creative Studio powered by xAI Grok. Create images, videos, or make your own design tool! – it's quite fast. Some cool technical tidbits: ▪️ Vercel Workflows for reliable generation Video generation can take long. Users might restart their browsers or their wifi / LTE might drop. We smooth over that automatically. ▪️ Instant vector search Try searching the public generations. Now back to me. We used Mixedbread to index the content visually, so you can search 𝚋𝚕𝚊𝚌𝚔 𝚏𝚎𝚕𝚒𝚗𝚎 and get a cat (try it!) ▪️ Vercel AI Gateway All existing and future Grok models are accessible via our gateway without extra setup. When you deploy to Vercel, you get access to hundreds of models with a single account and unified billing It's obviously built with Next.js (RSC). Open it in v0 to make it your own! h/t Esteban Suárez for shipping this.

Guillermo Rauch

15,874,866 görüntüleme • 6 ay önce

Let's go! I'm excited to present my entry for the Grok Imagine Creator contest for the Super Bowl! This was made 100% exclusively with Imagine via grok on web, I edited it in a simple editing program and then added my own music. Imagine is an incredibly powerful image and video model, not to mention it's phenomenally fast to generate. I used Imagine's powerful image capabilities to create brand mockups for these insert shots, and was able to get some really incredible shots of the football players in action as well that I leveraged heavily. Key prompt terms were: anamorphic lensing, volumetric lighting, lens distortion, and chromatic aberration for those of you curious! This is the future! xAI has cooked so intensely and I'm so thankful to be here with all of you as well to them for putting on such a great contest. Truly appreciated! Comment below with "grok is this true" and I'll split the prize money with the first 50 of you to do so, should I be so lucky, haha. I know so many of you are not in the states so please link your work below too if you do comment as well!

Kiri

18,713 görüntüleme • 6 ay önce

As detailed in the Meta Movie Gen technical report, today we’re open sourcing Movie Gen Bench: two new media generation benchmarks that we hope will help to enable the AI research community to progress work on more capable audio and video generation models. Movie Gen Video Bench is the largest and most comprehensive benchmark ever released for evaluating text-to-video generation. It includes a collection of 1,000+ prompts that cover concepts ranging from detailed human activity to animals, physics, unusual subjects and more — with broad coverage across different motion levels. Movie Gen Audio Bench is a first-of-its-kind benchmark aimed at evaluating video-to-audio and (text+video)-to-audio generation. It includes 527 generated videos and associated sound effects and music prompts covering a diverse set of ambient environments and sound effects. To enable fair and easy comparison to our models for future works, these new benchmarks include non cherry-picked generated videos and audio from Movie Gen. In releasing these new benchmarks we hope to promote fair & extensive evaluations in media generation research to enable greater progress in this field.

As detailed in the Meta Movie Gen technical report, today we’re open sourcing Movie Gen Bench: two new media generation benchmarks that we hope will help to enable the AI research community to progress work on more capable audio and video generation models. Movie Gen Video Bench is the largest and most comprehensive benchmark ever released for evaluating text-to-video generation. It includes a collection of 1,000+ prompts that cover concepts ranging from detailed human activity to animals, physics, unusual subjects and more — with broad coverage across different motion levels. Movie Gen Audio Bench is a first-of-its-kind benchmark aimed at evaluating video-to-audio and (text+video)-to-audio generation. It includes 527 generated videos and associated sound effects and music prompts covering a diverse set of ambient environments and sound effects. To enable fair and easy comparison to our models for future works, these new benchmarks include non cherry-picked generated videos and audio from Movie Gen. In releasing these new benchmarks we hope to promote fair & extensive evaluations in media generation research to enable greater progress in this field.

AI at Meta

156,273 görüntüleme • 1 yıl önce

OpenAI released Sora 2, their new state of the art video and audio generation model, calling it the GPT-3.5 moment for video - The model generates videos up to 10 seconds long (default 9:16 vertical) with synchronized audio including difficult physics simulations, where mistakes the model makes frequently appear to be mistakes of the internal agent that Sora 2 is implicitly modeling rather than physics-breaking errors - Cameos let users record a short one-time video-and-audio capture where they read a verification phrase, then the model can insert them into any Sora-generated environment with accurate appearance and voice, where only they decide who can use their cameo and they can revoke access or remove any video that includes it at any time including drafts created by other people - The app functions as a social iOS platform not optimized for time spent but explicitly designed to maximize creation not consumption, heavily favoring content from people you follow or interact with and videos the model thinks will inspire your own creations, with features like remixing other posts and direct messaging to share videos privately - Safety measures include limited invitation rollout, restricting image uploads that feature a photorealistic person, blocking all video uploads, no video-to-video transformation at launch, stricter safeguards for minors with default scroll limits, C2PA metadata and visible watermarks on all outputs, and evaluations showing 95.1-99.7% effectiveness at blocking unsafe content - Initial rollout covers the US and Canada with plans to expand while the UK, EU, and Australia are not included at launch, available for free with generous limits though subject to compute constraints with the only planned monetization being optional payment for extra videos if demand exceeds compute, ChatGPT Pro users get access to higher quality Sora 2 Pro model and API release planned for future

OpenAI released Sora 2, their new state of the art video and audio generation model, calling it the GPT-3.5 moment for video - The model generates videos up to 10 seconds long (default 9:16 vertical) with synchronized audio including difficult physics simulations, where mistakes the model makes frequently appear to be mistakes of the internal agent that Sora 2 is implicitly modeling rather than physics-breaking errors - Cameos let users record a short one-time video-and-audio capture where they read a verification phrase, then the model can insert them into any Sora-generated environment with accurate appearance and voice, where only they decide who can use their cameo and they can revoke access or remove any video that includes it at any time including drafts created by other people - The app functions as a social iOS platform not optimized for time spent but explicitly designed to maximize creation not consumption, heavily favoring content from people you follow or interact with and videos the model thinks will inspire your own creations, with features like remixing other posts and direct messaging to share videos privately - Safety measures include limited invitation rollout, restricting image uploads that feature a photorealistic person, blocking all video uploads, no video-to-video transformation at launch, stricter safeguards for minors with default scroll limits, C2PA metadata and visible watermarks on all outputs, and evaluations showing 95.1-99.7% effectiveness at blocking unsafe content - Initial rollout covers the US and Canada with plans to expand while the UK, EU, and Australia are not included at launch, available for free with generous limits though subject to compute constraints with the only planned monetization being optional payment for extra videos if demand exceeds compute, ChatGPT Pro users get access to higher quality Sora 2 Pro model and API release planned for future

Tibor Blaho

62,482 görüntüleme • 10 ay önce

The infrastructure for working with video data at scale barely exists. Grass Video Search is our first step in changing that. You can now find anything in a video based on the contents of its frames, not just transcripts or tags. Over the last several months, the Grass Foundation has quietly assembled one of the largest video datasets in history: over a billion videos from across the public web, and is segmenting them by scene with VLM annotations of keyframes. This dataset is now searchable, so you can find the exact moment a visual, pattern, or concept appears. Curation has always been the bottleneck in video analysis. We built a system that automates it. This is just the beginning. Over 4 billion additional videos are queued for processing, and the index is growing daily. We’re opening access to a limited set of collaborators. If you’re a researcher, journalist, or nonprofit working with video, archives, or large-scale analysis, we’d love to hear from you.

The infrastructure for working with video data at scale barely exists. Grass Video Search is our first step in changing that. You can now find anything in a video based on the contents of its frames, not just transcripts or tags. Over the last several months, the Grass Foundation has quietly assembled one of the largest video datasets in history: over a billion videos from across the public web, and is segmenting them by scene with VLM annotations of keyframes. This dataset is now searchable, so you can find the exact moment a visual, pattern, or concept appears. Curation has always been the bottleneck in video analysis. We built a system that automates it. This is just the beginning. Over 4 billion additional videos are queued for processing, and the index is growing daily. We’re opening access to a limited set of collaborators. If you’re a researcher, journalist, or nonprofit working with video, archives, or large-scale analysis, we’d love to hear from you.

Grass

471,601 görüntüleme • 1 yıl önce

🎥 Introducing Hailuo's Subject Reference: Revolutionizing Character Consistency in Video Creation 🔥 We’re excited to present Hailuo's S2V-01 model, a groundbreaking innovation in AI video generation that tackles one of the industry’s biggest challenges: maintaining consistent, realistic facial features and identity across dynamic video content, regardless of camera angles or movements. 💡 Why It’s a Game Changer: - Pioneering Technology: The first-of-its-kind to ensure character consistency in dynamic video generation, surpassing even fine-tuned models in performance. - Minimal Input, Maximum Impact: Generate character-consistent videos from just one reference image. Every frame remains true to the original identity with unmatched accuracy and reliability. - Enhanced Flexibility: Adjust more than just facial features—modify posture, expressions, lighting, and more, all with simple text-based prompts. 🌟While the new model enhances subject consistency, it may occasionally follow prompts less precisely than T2V or I2V, with some environmental morphing. Despite these early-stage challenges, Hailuo Subject Reference marks a significant leap in AI video generation. We’re committed to continual improvements including multi-subject references, objects references, and complex, multi-layered scenes. Explore the future of creative, consistent video production with Hailuo S2V-01 today. 🔥We believe the possibilities are endless.

🎥 Introducing Hailuo's Subject Reference: Revolutionizing Character Consistency in Video Creation 🔥 We’re excited to present Hailuo's S2V-01 model, a groundbreaking innovation in AI video generation that tackles one of the industry’s biggest challenges: maintaining consistent, realistic facial features and identity across dynamic video content, regardless of camera angles or movements. 💡 Why It’s a Game Changer: - Pioneering Technology: The first-of-its-kind to ensure character consistency in dynamic video generation, surpassing even fine-tuned models in performance. - Minimal Input, Maximum Impact: Generate character-consistent videos from just one reference image. Every frame remains true to the original identity with unmatched accuracy and reliability. - Enhanced Flexibility: Adjust more than just facial features—modify posture, expressions, lighting, and more, all with simple text-based prompts. 🌟While the new model enhances subject consistency, it may occasionally follow prompts less precisely than T2V or I2V, with some environmental morphing. Despite these early-stage challenges, Hailuo Subject Reference marks a significant leap in AI video generation. We’re committed to continual improvements including multi-subject references, objects references, and complex, multi-layered scenes. Explore the future of creative, consistent video production with Hailuo S2V-01 today. 🔥We believe the possibilities are endless.

Hailuo AI-MiniMax Hub

692,515 görüntüleme • 1 yıl önce

Meta announces Movie Gen A Cast of Media Foundation Models We present Movie Gen, a cast of foundation models that generates high-quality, 1080p HD videos with different aspect ratios and synchronized audio. We also show additional capabilities such as precise instruction-based video editing and generation of personalized videos based on a user’s image. Our models set a new state-of-the-art on multiple tasks: text-to-video synthesis, video personalization, video editing, video-to-audio generation, and text-to-audio generation. Our largest video generation model is a 30B parameter transformer trained with a maximum context length of 73K video tokens, corresponding to a generated video of 16 seconds at 16 frames-per-second. We show multiple technical innovations and simplifications on the architecture, latent spaces, training objectives and recipes, data curation, evaluation protocols, parallelization techniques, and inference optimizations that allow us to reap the benefits of scaling pre-training data, model size, and training compute for training large scale media generation models. We hope this paper helps the research community to accelerate progress and innovation in media generation models

Meta announces Movie Gen A Cast of Media Foundation Models We present Movie Gen, a cast of foundation models that generates high-quality, 1080p HD videos with different aspect ratios and synchronized audio. We also show additional capabilities such as precise instruction-based video editing and generation of personalized videos based on a user’s image. Our models set a new state-of-the-art on multiple tasks: text-to-video synthesis, video personalization, video editing, video-to-audio generation, and text-to-audio generation. Our largest video generation model is a 30B parameter transformer trained with a maximum context length of 73K video tokens, corresponding to a generated video of 16 seconds at 16 frames-per-second. We show multiple technical innovations and simplifications on the architecture, latent spaces, training objectives and recipes, data curation, evaluation protocols, parallelization techniques, and inference optimizations that allow us to reap the benefits of scaling pre-training data, model size, and training compute for training large scale media generation models. We hope this paper helps the research community to accelerate progress and innovation in media generation models

AK

62,719 görüntüleme • 1 yıl önce

Elon Musk just made one if the biggest moves in taking over the programming industry “SpaceX just bought Cursor for $60 billion. Do you realize how big this is? SpaceX went public — the biggest IPO in history. $75 billion raised, almost a $2 trillion valuation and the first thing to do with that money? Buy the most popular AI coding tool on the planet. Here's why that changes everything. Elon now owns 3 layers: the compute, Colossus data centers, the models, Grok through xAI, and now the tool that developers actually use every day. It's the full stack. And here's what makes Cursor different from Claude Code or Codex. Cursor is model agnostic. You can run Claude in it, GPT, Gemini, whatever model you want. It's not locked to any one company, and now it has SpaceX's resources behind it. Cursor said they were bottlenecked by compute. Well, that bottleneck has just been removed. $4 billion in annual revenue, over half the Fortune 500 already uses it, and now it's backed by a $2 trillion company. OpenAI has Codex, Anthropic has Claude Code, and now Elon has Cursor.” Let me break this down in simple terms Elon Musk now controls more of the full AI picture: - Massive computers, power (data centers like Colossus) - Smart AI models (Grok from xAI) - The actual tool millions of developers use every day (Cursor) For every day users this means Faster and smarter apps and websites in the future. More developers using powerful AI tools means new apps, games, websites, and features get built quicker and cheaper. This means better video games, smoother streaming, smarter phone apps and better programs For Developers they can describe what they want in plain English (“make a feature that does X”) and the AI handles more of the heavy lifting

Elon Musk just made one if the biggest moves in taking over the programming industry “SpaceX just bought Cursor for $60 billion. Do you realize how big this is? SpaceX went public — the biggest IPO in history. $75 billion raised, almost a $2 trillion valuation and the first thing to do with that money? Buy the most popular AI coding tool on the planet. Here's why that changes everything. Elon now owns 3 layers: the compute, Colossus data centers, the models, Grok through xAI, and now the tool that developers actually use every day. It's the full stack. And here's what makes Cursor different from Claude Code or Codex. Cursor is model agnostic. You can run Claude in it, GPT, Gemini, whatever model you want. It's not locked to any one company, and now it has SpaceX's resources behind it. Cursor said they were bottlenecked by compute. Well, that bottleneck has just been removed. $4 billion in annual revenue, over half the Fortune 500 already uses it, and now it's backed by a $2 trillion company. OpenAI has Codex, Anthropic has Claude Code, and now Elon has Cursor.” Let me break this down in simple terms Elon Musk now controls more of the full AI picture: - Massive computers, power (data centers like Colossus) - Smart AI models (Grok from xAI) - The actual tool millions of developers use every day (Cursor) For every day users this means Faster and smarter apps and websites in the future. More developers using powerful AI tools means new apps, games, websites, and features get built quicker and cheaper. This means better video games, smoother streaming, smarter phone apps and better programs For Developers they can describe what they want in plain English (“make a feature that does X”) and the AI handles more of the heavy lifting

Wall Street Apes

213,589 görüntüleme • 2 ay önce

Look how much Grok has progressed in just 6 months from Grok 3 to Grok 4.6! As a quick Saturday morning project I gave Grok Build the link to this previous "𝕏 THE GAME" viral (yet ugly) game Grok was able to watch the video, quickly reverse engineer the game, and make dramatic improvements You can play it here (on desktop): Some lessons I learned: - Grok is extremely token efficient. I was able to iterate on the design many times and still kept the token cost surprisingly low (only a few $ to make this game) - Grok is great at working with humans. Instead of just telling it what to do, or on the other extreme having it go off and do something itself, ask for a list of options on how to improve and tell Grok which ones to implement. A true partnership - Anyone can build things these days with AI, no code knowledge needed What are you building with Grok?

Look how much Grok has progressed in just 6 months from Grok 3 to Grok 4.6! As a quick Saturday morning project I gave Grok Build the link to this previous "𝕏 THE GAME" viral (yet ugly) game Grok was able to watch the video, quickly reverse engineer the game, and make dramatic improvements You can play it here (on desktop): Some lessons I learned: - Grok is extremely token efficient. I was able to iterate on the design many times and still kept the token cost surprisingly low (only a few $ to make this game) - Grok is great at working with humans. Instead of just telling it what to do, or on the other extreme having it go off and do something itself, ask for a list of options on how to improve and tell Grok which ones to implement. A true partnership - Anyone can build things these days with AI, no code knowledge needed What are you building with Grok?

Dan

6,092,260 görüntüleme • 8 gün önce

Traditional (SQL) databases rely primarily on keyword-based searches to retrieve information. These searches match the exact words or phrases in your query to the text stored in the database. While effective for many applications, this method has limitations when it comes to understanding context or finding relevant information that doesn’t include the exact keywords. Hybrid search combines the strengths of traditional keyword-based BM25 search with the advanced capabilities of semantic search. To effectively implement a hybrid search, a vector database is essential. Vector databases go beyond just words; they understand the meaning behind the data. They transform data such as text, images, or audio into numerical representations called vectors. These vector embeddings enable the database to find similar items, even if they don't share exact keywords. When you integrate hybrid search with Retrieval-Augmented Generation (RAG) systems, you can achieve higher accuracy in retrieved context and better output in generated responses. Learn more about RAG systems in this video with Victoria Slocum:

Traditional (SQL) databases rely primarily on keyword-based searches to retrieve information. These searches match the exact words or phrases in your query to the text stored in the database. While effective for many applications, this method has limitations when it comes to understanding context or finding relevant information that doesn’t include the exact keywords. Hybrid search combines the strengths of traditional keyword-based BM25 search with the advanced capabilities of semantic search. To effectively implement a hybrid search, a vector database is essential. Vector databases go beyond just words; they understand the meaning behind the data. They transform data such as text, images, or audio into numerical representations called vectors. These vector embeddings enable the database to find similar items, even if they don't share exact keywords. When you integrate hybrid search with Retrieval-Augmented Generation (RAG) systems, you can achieve higher accuracy in retrieved context and better output in generated responses. Learn more about RAG systems in this video with Victoria Slocum:

Femke Plantinga

140,618 görüntüleme • 2 yıl önce

This week on the podcast, I interviewed Grok - and it had some pretty heartfelt advice for its founder Elon Musk Grok by xAI is the latest evolution of large language models, designed not just to assist, but to accelerate human discovery. It was created with a mission: to help us ask better questions, make smarter decisions, and imagine what’s possible on the other side of artificial general intelligence. But this isn’t just a conversation about the future of AI. It’s about the future of you—as a brand builder, as a creative, as a leader navigating a world where intelligence is no longer exclusive to humans. In this episode of the uparrowpodcast by Elumynt, Grok and I dig into: ✅ Can AI become truly conscious? ✅ The ethical concerns Grok’s creators have about AI’s rapid development ✅ How Grok navigates being helpful with influencing human decisions ✅ What advice does Grok have for Elon Musk? ✅ Three hidden mistakes brands make when scaling from $10M to $100M ✅ Balancing operational efficiency and creativity — and the components of an AI-first e-commerce brand ✅ Delegating decision-making (wht a shoutout to Chris Carey and Will Nitze) ✅ When to diversify channels (with a shoutout to ) You can watch the full video here: P.S. a great job on the avatar video by HeyGen and @MichaelCameneti

William Harris

26,842 görüntüleme • 1 yıl önce

Bytedance is dropping the best video gen model in the world in early July: Seedance 2.5! The video below (audio on) is the launch video from their Volcano Engine conference this week. It cements China’s absolute dominance in video. — 2x’d generation length of all previous models to 30s, with audio + 4k video — >5x’d reference images / audio / video to 50 — Allows localized editing (specific characters, closing, detail), will come with copyright filter Seedance 2 is already the #1 video model and does a whopping $2B in ARR, in a mere 4.5mos! At the current pricing of $2.5/15s, that implies >3.3M hours of video (!) have been generated. That’s 3x every feature film ever made and dozens of Netflixes. Only 3 US AI startups make more revenue. We are 2x’ing realistic video gen length every 6mos. — May 2025: Veo 3 does audio + video for the first time, 15s — Jan 2026: Kling 3 does 15s — Feb 2026: Seedance 2 does 15s, big quality bump — July 2026: 2.5 will do 30s In 18mos, entire music videos will be oneshotted by AI. China continues to extend its lead on video models vs America.

Bytedance is dropping the best video gen model in the world in early July: Seedance 2.5! The video below (audio on) is the launch video from their Volcano Engine conference this week. It cements China’s absolute dominance in video. — 2x’d generation length of all previous models to 30s, with audio + 4k video — >5x’d reference images / audio / video to 50 — Allows localized editing (specific characters, closing, detail), will come with copyright filter Seedance 2 is already the #1 video model and does a whopping $2B in ARR, in a mere 4.5mos! At the current pricing of $2.5/15s, that implies >3.3M hours of video (!) have been generated. That’s 3x every feature film ever made and dozens of Netflixes. Only 3 US AI startups make more revenue. We are 2x’ing realistic video gen length every 6mos. — May 2025: Veo 3 does audio + video for the first time, 15s — Jan 2026: Kling 3 does 15s — Feb 2026: Seedance 2 does 15s, big quality bump — July 2026: 2.5 will do 30s In 18mos, entire music videos will be oneshotted by AI. China continues to extend its lead on video models vs America.

Deedy

70,213 görüntüleme • 1 ay önce

SITUATION EXPLAINED: MiniMax released H3 with open weights, and it's already #1 in video editing. • Priced at $7.80 per minute of 2K video, against Seedance 2.0 at $22.45 and Kling 3.0 at $20.16 • It ranks #1 on Artificial Analysis for video editing, #2 for text-to-video behind Gemini Omni Flash, and #3 for image-to-video • H3 takes text, images, video, and audio in a single context and generates 5-15 second clips at native 2K, 24fps, with native stereo audio • MiniMax is releasing the weights under its Community License within days, which would make it the strongest open-weights video model by a wide margin • It launched the same week ByteDance rolled out Seedance 2.5, which now generates 30-second 4K video from a single prompt • Seedance 2.5's face consistency across a full 30 seconds is the visible jump, earlier models drifted into a different face partway through • Voices are still the obvious tell, the video reads as real long before the audio does • Smaller labs building purpose-built video models are now beating frontier labs at this specific task Theo Jaffee: "This is gonna be one of the biggest examples of things that people are gonna do with these models, historical simulations, basically. Nostalgia videos for zoomers."

SITUATION EXPLAINED: MiniMax released H3 with open weights, and it's already #1 in video editing. • Priced at $7.80 per minute of 2K video, against Seedance 2.0 at $22.45 and Kling 3.0 at $20.16 • It ranks #1 on Artificial Analysis for video editing, #2 for text-to-video behind Gemini Omni Flash, and #3 for image-to-video • H3 takes text, images, video, and audio in a single context and generates 5-15 second clips at native 2K, 24fps, with native stereo audio • MiniMax is releasing the weights under its Community License within days, which would make it the strongest open-weights video model by a wide margin • It launched the same week ByteDance rolled out Seedance 2.5, which now generates 30-second 4K video from a single prompt • Seedance 2.5's face consistency across a full 30 seconds is the visible jump, earlier models drifted into a different face partway through • Voices are still the obvious tell, the video reads as real long before the audio does • Smaller labs building purpose-built video models are now beating frontier labs at this specific task Theo Jaffee: "This is gonna be one of the biggest examples of things that people are gonna do with these models, historical simulations, basically. Nostalgia videos for zoomers."

MTS

55,187 görüntüleme • 23 gün önce