正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Announcing: a new interactive tool for a quick and simple start of encoding or encoding: 🧠 fMRI, EEG, MEG, iEEG, spikes… preprocessing 💬 text 🔊 audio ▶️ video 🏞️ image… embeddings 📦 pip install neuralset 🔍 #NeuroAI #OpenSource

Jean-Rémi King

8,204 subscribers

10,589 次观看 • 2 个月前 •via X (Twitter)

#NeuroAI #OpenSource

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

This is, by far, one of the best uses of modern AI. If you don't use embeddings when querying your database, you are definitely leaving a lot on the table. In this video, I'll show you how to run semantic searches using OpenAI and PostgreSQL. It's all thanks to Pgai, an open-source PostgreSQL extension: Here's what will happen: 1. We'll create a simple table with news articles 2. We'll generate embeddings for those articles 3. We'll run queries on top of those embeddings For this video, I generated the embeddings using a simple query, but pgai Vectorizer would do the same automatically as new information makes it into the database. This is awesome! If you have a PostgreSQL database with data you are searching over, you should start experimenting with semantic searches immediately. For most use cases, a combination of full-text search + semantic search is the best approach. If you don't have a PostgreSQL database around, you can try free for 30 days using Timescale: Thanks to the Timescale (now TigerData) team for partnering with me on this post!

This is, by far, one of the best uses of modern AI. If you don't use embeddings when querying your database, you are definitely leaving a lot on the table. In this video, I'll show you how to run semantic searches using OpenAI and PostgreSQL. It's all thanks to Pgai, an open-source PostgreSQL extension: Here's what will happen: 1. We'll create a simple table with news articles 2. We'll generate embeddings for those articles 3. We'll run queries on top of those embeddings For this video, I generated the embeddings using a simple query, but pgai Vectorizer would do the same automatically as new information makes it into the database. This is awesome! If you have a PostgreSQL database with data you are searching over, you should start experimenting with semantic searches immediately. For most use cases, a combination of full-text search + semantic search is the best approach. If you don't have a PostgreSQL database around, you can try free for 30 days using Timescale: Thanks to the Timescale (now TigerData) team for partnering with me on this post!

Santiago

109,517 次观看 • 1 年前

New short course Multimodal RAG: Chat with Videos, developed with Intel and taught by vasudevlal! In this course, you’ll work with LLaVA (Large Language and Vision Assistant), a Large Vision Language Model (LVLM) that can process both images and text. For example, given an image of a person doing a handstand on a skateboard at the beach, LLaVA doesn't just caption the scene, it’s able to predict possible outcomes, like the person losing balance or falling off. By understanding not just what's in a video frame, but what might happen next, your application can provide more insightful answers to questions about video. You'll build a full multimodal RAG pipeline that can chat about video content: - Use the BridgeTower model to create joint text-image embeddings in a 512-dimensional multimodal semantic space. - Learn video processing techniques to extract keyframes, generate transcripts using Whisper, and create captions. - Use the LanceDB vector database to store and retrieve high-dimensional multimodal embeddings. - Integrate the LLaVA model, combining CLIP's (Contrastive Language Image Pretraining) vision transformer with Llama, for advanced visual-textual reasoning. Your final system will ingest video data, generate embeddings for frames and text, perform similarity searches for relevant content, and use the retrieved multimodal context to inform LVLM-based response generation. The result is a system capable of answering nuanced questions about video content, effectively chatting about the video it has processed. Please sign up here!

New short course Multimodal RAG: Chat with Videos, developed with Intel and taught by vasudevlal! In this course, you’ll work with LLaVA (Large Language and Vision Assistant), a Large Vision Language Model (LVLM) that can process both images and text. For example, given an image of a person doing a handstand on a skateboard at the beach, LLaVA doesn't just caption the scene, it’s able to predict possible outcomes, like the person losing balance or falling off. By understanding not just what's in a video frame, but what might happen next, your application can provide more insightful answers to questions about video. You'll build a full multimodal RAG pipeline that can chat about video content: - Use the BridgeTower model to create joint text-image embeddings in a 512-dimensional multimodal semantic space. - Learn video processing techniques to extract keyframes, generate transcripts using Whisper, and create captions. - Use the LanceDB vector database to store and retrieve high-dimensional multimodal embeddings. - Integrate the LLaVA model, combining CLIP's (Contrastive Language Image Pretraining) vision transformer with Llama, for advanced visual-textual reasoning. Your final system will ingest video data, generate embeddings for frames and text, perform similarity searches for relevant content, and use the retrieved multimodal context to inform LVLM-based response generation. The result is a system capable of answering nuanced questions about video content, effectively chatting about the video it has processed. Please sign up here!

Andrew Ng

107,825 次观看 • 1 年前

Today we're announcing the open-source release of HunyuanVideo-Foley, our new end-to-end Text-Video-to-Audio (TV2A) framework for generating high-fidelity audio.🚀 This tool empowers creators in video production, filmmaking, and game development to generate professional-grade audio that precisely aligns with visual dynamics and semantic context, addressing key challenges in V2A generation.🔊 Key Innovations: 🔹Exceptional Generalization: Trained on a massive 100k-hour multimodal dataset, the model generates contextually-aware soundscapes for a wide range of scenes, from natural landscapes to animated shorts. 🔹Balanced Multimodal Response: Our innovative multimodal diffusion transformer (MMDiT) architecture ensures the model balances video and text cues, generating rich, layered sound effects that capture every detail—from the main subject to subtle background elements. 🔹High-Fidelity Audio: Using a Representation Alignment (REPA) loss function and a powerful Audio VAE, we've improved generation stability and producing professional-grade audio, free of noise and inconsistencies. HunyuanVideo-Foley achieves SOTA on multiple benchmarks, surpassing all open-source models in audio quality, visual-semantic alignment, and temporal alignment. 👉Try it now: 🌐Project Page: 🔗Code: 📄Technical Report: 🤗Hugging Face:

Today we're announcing the open-source release of HunyuanVideo-Foley, our new end-to-end Text-Video-to-Audio (TV2A) framework for generating high-fidelity audio.🚀 This tool empowers creators in video production, filmmaking, and game development to generate professional-grade audio that precisely aligns with visual dynamics and semantic context, addressing key challenges in V2A generation.🔊 Key Innovations: 🔹Exceptional Generalization: Trained on a massive 100k-hour multimodal dataset, the model generates contextually-aware soundscapes for a wide range of scenes, from natural landscapes to animated shorts. 🔹Balanced Multimodal Response: Our innovative multimodal diffusion transformer (MMDiT) architecture ensures the model balances video and text cues, generating rich, layered sound effects that capture every detail—from the main subject to subtle background elements. 🔹High-Fidelity Audio: Using a Representation Alignment (REPA) loss function and a powerful Audio VAE, we've improved generation stability and producing professional-grade audio, free of noise and inconsistencies. HunyuanVideo-Foley achieves SOTA on multiple benchmarks, surpassing all open-source models in audio quality, visual-semantic alignment, and temporal alignment. 👉Try it now: 🌐Project Page: 🔗Code: 📄Technical Report: 🤗Hugging Face:

Tencent Hy

122,706 次观看 • 11 个月前

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

AI at Meta

2,265,027 次观看 • 1 年前

Phoenix GenAI’s new generative AI model Image-to-3D is now online. Create high fidelity 3D models importable to Unreal Engine 5 or Unity simply by sending an original image into PhoenixLLM. Better yet, generate the source image using Phoenix GenAI’s Flux and feed it into Image-to-3D. This release marks yet another upgrade of GenAI’s arsenal of capabilities, getting it ready for multi-workflow GenAI agents, in which users will be able to combine text-to-image, image-to-prompt, text-to-video, text-to-3D, and image-to-3D into complex multi-step workflows with simple commands via PhoenixLLM. Image-to-3D is yet another addition to Phoenix’s Vertical AI Solutions for gaming, content, and metaverse. Users are able to use it as a Phoenix-native alternative to SkyNet AI Marketplace’s Tripo Integration earlier this year. #Phoenix $PHB

Phoenix GenAI’s new generative AI model Image-to-3D is now online. Create high fidelity 3D models importable to Unreal Engine 5 or Unity simply by sending an original image into PhoenixLLM. Better yet, generate the source image using Phoenix GenAI’s Flux and feed it into Image-to-3D. This release marks yet another upgrade of GenAI’s arsenal of capabilities, getting it ready for multi-workflow GenAI agents, in which users will be able to combine text-to-image, image-to-prompt, text-to-video, text-to-3D, and image-to-3D into complex multi-step workflows with simple commands via PhoenixLLM. Image-to-3D is yet another addition to Phoenix’s Vertical AI Solutions for gaming, content, and metaverse. Users are able to use it as a Phoenix-native alternative to SkyNet AI Marketplace’s Tripo Integration earlier this year. #Phoenix $PHB

Phoenix AI

30,853 次观看 • 1 年前

🚨Science nerds are going to lose their minds. Kai Rowan just open sourced a framework that predicts how your brain responds to any text, audio, or video by simulating cortical fMRI activity with 30% more accuracy than Meta's own model. No fMRI scanner. No neuroscience PhD. No million-dollar lab. It's called NForge. Here's what this thing actually does: → Feed it any combination of text, audio, or video and it predicts cortical surface activity across ~20,484 brain vertices → Extracts deep features via LLaMA 3.2, V-JEPA2, and Wav2Vec-BERT simultaneously → Generates ROI attention maps showing exactly which brain regions fire hardest at which moments → Runs real-time streaming predictions from live feature streams -- no pre-loading the full clip → Breaks down exactly how much text vs audio vs video drove each prediction with per-vertex modality attribution scores → Adapts to entirely new subjects with just a few calibration scans -- no full retraining required Here's the wildest part: Built on Meta's TRIBE v2 foundation but adds 6 major capabilities Meta never shipped. Cross-subject generalization. Streaming inference. Modality attribution. torch.compile support. Full test coverage. Professional src/ package layout. You literally point this at a movie clip and it tells you which parts of the human cortex light up -- broken down by what your eyes, ears, and language centers each contributed. That sentence shouldn't be real in 2026. But here we are. 100% Open Source. pip install nforge. (Link in the comments)

🚨Science nerds are going to lose their minds. Kai Rowan just open sourced a framework that predicts how your brain responds to any text, audio, or video by simulating cortical fMRI activity with 30% more accuracy than Meta's own model. No fMRI scanner. No neuroscience PhD. No million-dollar lab. It's called NForge. Here's what this thing actually does: → Feed it any combination of text, audio, or video and it predicts cortical surface activity across ~20,484 brain vertices → Extracts deep features via LLaMA 3.2, V-JEPA2, and Wav2Vec-BERT simultaneously → Generates ROI attention maps showing exactly which brain regions fire hardest at which moments → Runs real-time streaming predictions from live feature streams -- no pre-loading the full clip → Breaks down exactly how much text vs audio vs video drove each prediction with per-vertex modality attribution scores → Adapts to entirely new subjects with just a few calibration scans -- no full retraining required Here's the wildest part: Built on Meta's TRIBE v2 foundation but adds 6 major capabilities Meta never shipped. Cross-subject generalization. Streaming inference. Modality attribution. torch.compile support. Full test coverage. Professional src/ package layout. You literally point this at a movie clip and it tells you which parts of the human cortex light up -- broken down by what your eyes, ears, and language centers each contributed. That sentence shouldn't be real in 2026. But here we are. 100% Open Source. pip install nforge. (Link in the comments)

Guri Singh

244,515 次观看 • 3 个月前

Grok Imagine API now supports built-in video editing on top of powerful video generation You can feed in your own videos and edit them directly with Grok Imagine, transforming or enhancing footage without traditional timeline editing Developers can generate high-quality videos at scale with fast iteration and simple integration into existing workflows One API does it all: • Text-to-video • Image-to-video • Edit existing videos directly • Replace, remove, or add objects inside a video • Built-in audio sync for every clip Turn your ideas into finished videos – at scale, through a single API

Grok Imagine API now supports built-in video editing on top of powerful video generation You can feed in your own videos and edit them directly with Grok Imagine, transforming or enhancing footage without traditional timeline editing Developers can generate high-quality videos at scale with fast iteration and simple integration into existing workflows One API does it all: • Text-to-video • Image-to-video • Edit existing videos directly • Replace, remove, or add objects inside a video • Built-in audio sync for every clip Turn your ideas into finished videos – at scale, through a single API

X Freeze

19,054 次观看 • 5 个月前

Text-to-speech is moving way too fast. Just a few days ago, I tweeted about PersonaPlex-7B, NVIDIA's new open source TTS ( And today, Qwen just open-sourced Qwen3-TTS 🤯 It’s a revolutionary text-to-speech model built for control. Not just about generating speech, but about shaping how it sounds directly from language. You can guide the pace, the tone, and the expressiveness straight from text, without touching audio graphs or hand-tuning parameters. That’s the real shift! What makes Qwen3-TTS stand out is how practical it already is: → voice cloning from just a few seconds of audio → voice creation without any reference sample → support for 10 languages out of the box → end-to-end latency down to ~97ms → works in both streaming and non-streaming setups The models come in two sizes (0.6B and 1.7B), so you can trade off quality and hardware cost depending on your setup. You can work with curated voices, designed voices, or cloned ones, and it integrates cleanly with vLLM for production use. It also ships as a simple Python package you can pip install. If you’re building real-time voice systems, this removes a lot of friction! 100% free and open source. I put the repo in the 🧵↓

Text-to-speech is moving way too fast. Just a few days ago, I tweeted about PersonaPlex-7B, NVIDIA's new open source TTS ( And today, Qwen just open-sourced Qwen3-TTS 🤯 It’s a revolutionary text-to-speech model built for control. Not just about generating speech, but about shaping how it sounds directly from language. You can guide the pace, the tone, and the expressiveness straight from text, without touching audio graphs or hand-tuning parameters. That’s the real shift! What makes Qwen3-TTS stand out is how practical it already is: → voice cloning from just a few seconds of audio → voice creation without any reference sample → support for 10 languages out of the box → end-to-end latency down to ~97ms → works in both streaming and non-streaming setups The models come in two sizes (0.6B and 1.7B), so you can trade off quality and hardware cost depending on your setup. You can work with curated voices, designed voices, or cloned ones, and it integrates cleanly with vLLM for production use. It also ships as a simple Python package you can pip install. If you’re building real-time voice systems, this removes a lot of friction! 100% free and open source. I put the repo in the 🧵↓

Charly Wargnier

59,144 次观看 • 6 个月前

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

Lovis Odin

58,769 次观看 • 10 个月前

Excited to share a new open-source project for the web-mapping and LiDAR community: maplibre-gl-lidar 🚀 With maplibre-gl-lidar, you can visualize large-scale LiDAR point clouds (LAS/LAZ, including COPC) directly in the browser using MapLibre GL JS. It supports point-cloud data stored locally or hosted on the web, and comes with an interactive GUI featuring customizable color schemes, classification legends, and point picking. It even works seamlessly inside Jupyter Notebooks. Visualizing tens of millions of LiDAR points has never been this simple or fast, making it easy to build modern, lightweight, and fully interactive web-based LiDAR viewers. Try it out: Live Demo Viewer: GitHub Repository: Full Video Tutorial: #MapLibre #LiDAR #WebGIS #OpenSource #PointCloud #3DMapping

Excited to share a new open-source project for the web-mapping and LiDAR community: maplibre-gl-lidar 🚀 With maplibre-gl-lidar, you can visualize large-scale LiDAR point clouds (LAS/LAZ, including COPC) directly in the browser using MapLibre GL JS. It supports point-cloud data stored locally or hosted on the web, and comes with an interactive GUI featuring customizable color schemes, classification legends, and point picking. It even works seamlessly inside Jupyter Notebooks. Visualizing tens of millions of LiDAR points has never been this simple or fast, making it easy to build modern, lightweight, and fully interactive web-based LiDAR viewers. Try it out: Live Demo Viewer: GitHub Repository: Full Video Tutorial: #MapLibre #LiDAR #WebGIS #OpenSource #PointCloud #3DMapping

Qiusheng Wu

52,855 次观看 • 6 个月前

Announcing Gemini 2.5 Flash Image! (Nano Banana) from Google DeepMind. This model brings you state of the art image generation! Here's 7m of demos. Today marks a leap forward in AI-powered image creativity with the launch of stronger native image generation and editing in Gemini 2.5 Flash. Here's what's new: 👤 Consistent character design: Maintain a character's identity across multiple images, changing their outfits, poses, and scenes without losing their core look. 🎨 Creative composition: Seamlessly merge elements from up to three different images into a single, cohesive masterpiece. The potential for surrealist art and unique compositions is endless. ✍️ Targeted edits with natural language: Go beyond the prompt. You can now make highly specific edits like "change the background," "restore this faded photo," or "edit the character's outfit" with simple commands. ✨ Design & identity adaptation: Apply a specific style, texture, or pattern from one image to another, unlocking new possibilities for fashion, product design, and architectural visualization. I've put together a ~7-minute video demo to walk you through these features and show just how powerful they are in action. We can't wait to see what you all create! Try the model out in Google AI Studio, Gemini app or the Gemini API.

Announcing Gemini 2.5 Flash Image! (Nano Banana) from Google DeepMind. This model brings you state of the art image generation! Here's 7m of demos. Today marks a leap forward in AI-powered image creativity with the launch of stronger native image generation and editing in Gemini 2.5 Flash. Here's what's new: 👤 Consistent character design: Maintain a character's identity across multiple images, changing their outfits, poses, and scenes without losing their core look. 🎨 Creative composition: Seamlessly merge elements from up to three different images into a single, cohesive masterpiece. The potential for surrealist art and unique compositions is endless. ✍️ Targeted edits with natural language: Go beyond the prompt. You can now make highly specific edits like "change the background," "restore this faded photo," or "edit the character's outfit" with simple commands. ✨ Design & identity adaptation: Apply a specific style, texture, or pattern from one image to another, unlocking new possibilities for fashion, product design, and architectural visualization. I've put together a ~7-minute video demo to walk you through these features and show just how powerful they are in action. We can't wait to see what you all create! Try the model out in Google AI Studio, Gemini app or the Gemini API.

Addy Osmani

159,059 次观看 • 11 个月前

Get on the record with Noosphere 's commenting feature. This isn’t just a typical commenting section; this is a new way to connect with the reporters you follow. Through our commenting feature, you can ask questions and start conversations directly with our reporters, and get answers in video, audio, or text. They are putting the journalist back in the driving seat of conversation, filtering for trolls and making it actually possible for us to truly engage with you. Just tap the speech bubble in the top right corner for any story or video and submit your comment. This is a total redesign of how followers and reporters interact, creating a direct connection between you and reports you trust. Get news directly from reporters you trust, download Noosphere. Link in bio.

Get on the record with Noosphere 's commenting feature. This isn’t just a typical commenting section; this is a new way to connect with the reporters you follow. Through our commenting feature, you can ask questions and start conversations directly with our reporters, and get answers in video, audio, or text. They are putting the journalist back in the driving seat of conversation, filtering for trolls and making it actually possible for us to truly engage with you. Just tap the speech bubble in the top right corner for any story or video and submit your comment. This is a total redesign of how followers and reporters interact, creating a direct connection between you and reports you trust. Get news directly from reporters you trust, download Noosphere. Link in bio.

Chuck Todd

15,373 次观看 • 6 个月前

Here is a quick walkthrough of everything new in Stitch: 🎨 The AI-native canvas can hold and reason across images, code, and text simultaneously. The new agent manager helps you design in parallel. (PS … light mode!) 🧠 A smarter design agent now understands your entire canvas context. You can swap images, generate product briefs, or mix mobile and desktop screens on the same canvas. 🎙️ You can vibe design with your voice (in Preview). Stitch can ‘see’ your canvas and your selected screens. You can ask for design critiques, variations, or navigate your canvas. ⚡️ Instant prototypes. Just hit the play button to see a prototype or preview your app in seconds. Stitch can imagine the next screen based on your mouse click. 📐 DESIGN.md and consistency. Every new design automatically starts with a cohesive design system which vastly improves consistency. The new DESIGN.md file can be used to export or import your design rules. Walkthrough video👇 Details for each major improvement 🧵

Here is a quick walkthrough of everything new in Stitch: 🎨 The AI-native canvas can hold and reason across images, code, and text simultaneously. The new agent manager helps you design in parallel. (PS … light mode!) 🧠 A smarter design agent now understands your entire canvas context. You can swap images, generate product briefs, or mix mobile and desktop screens on the same canvas. 🎙️ You can vibe design with your voice (in Preview). Stitch can ‘see’ your canvas and your selected screens. You can ask for design critiques, variations, or navigate your canvas. ⚡️ Instant prototypes. Just hit the play button to see a prototype or preview your app in seconds. Stitch can imagine the next screen based on your mouse click. 📐 DESIGN.md and consistency. Every new design automatically starts with a cohesive design system which vastly improves consistency. The new DESIGN.md file can be used to export or import your design rules. Walkthrough video👇 Details for each major improvement 🧵

Stitch by Google

487,548 次观看 • 4 个月前

Having audio issues on your Zoom call? That's not a VC, it's North Korean hackers. Fortunately, this founder realized what was going on. The call starts with a few "VCs" on the call. They send messages in the chat saying they can't hear your audio, or suggesting there's an issue where you can't hear them, and play a stock video of a bored VC. If the target had for it, the next step would've been that they're directed to a new Zoom room. It's a fake link and instructs the target to install a patch to fix their audio/video. They exploit human psychology -- you think you're meeting with important VCs and rush to fix the audio, causing you to be less careful than you usually are. Once you install the patch, you're rekt. This threat group has stolen $10s of millions of dollars and others are copying their tactics. Now you know, so you won't fall for this. If anybody ever tells you to switch conference rooms, create your own secure Google meet room and direct them there, instead of using whatever they suggest. If you did start installing whatever they told you to, disconnect your computer from the internet, turn it off, immediately contact Security Alliance and we'll help you out. Note: The founder's voice has been replaced in this video, but the rest is 100% authentic.

Having audio issues on your Zoom call? That's not a VC, it's North Korean hackers. Fortunately, this founder realized what was going on. The call starts with a few "VCs" on the call. They send messages in the chat saying they can't hear your audio, or suggesting there's an issue where you can't hear them, and play a stock video of a bored VC. If the target had for it, the next step would've been that they're directed to a new Zoom room. It's a fake link and instructs the target to install a patch to fix their audio/video. They exploit human psychology -- you think you're meeting with important VCs and rush to fix the audio, causing you to be less careful than you usually are. Once you install the patch, you're rekt. This threat group has stolen $10s of millions of dollars and others are copying their tactics. Now you know, so you won't fall for this. If anybody ever tells you to switch conference rooms, create your own secure Google meet room and direct them there, instead of using whatever they suggest. If you did start installing whatever they told you to, disconnect your computer from the internet, turn it off, immediately contact Security Alliance and we'll help you out. Note: The founder's voice has been replaced in this video, but the rest is 100% authentic.

Nick Bax

233,064 次观看 • 1 年前

New short course: Collaborative Writing and Coding with OpenAI Canvas! Explore new ways to write and code with OpenAI Canvas, a user-friendly interface that allows you to brainstorm, draft, and refine text and code in collaboration with ChatGPT. In the short course, created with OpenAI, and taught by , a research lead at OpenAI, you’ll learn to use Canvas to enhance your workflows. Canvas lets you go beyond simple chat interactions. It provides a side-by-side workspace where you and ChatGPT can edit and refine text or code collaboratively. This makes brainstorming, drafting, and iterating as you write feel more natural and effective. As the first major update to ChatGPT’s visual interface since its launch in 2022, Canvas gives a new, innovative approach to collaboration with AI. For instance, after writing the first version of your code, Canvas can review it and give suggestions for improvement. It can also help with debugging by adding logging, identifying problems to fix, and writing comments. In addition, you'll also learn what it takes to train the model for an interface like Canvas. In this video-only short course, you’ll: - Learn how to ask for in-line feedback and control the iteration of your work by directly editing selected areas of your text or code from the model’s output. - Learn how to access quick automation tools in a shortcut menu that allows you to modify your writing tone and length, enhance your code, and restore previous versions of your work. - Learn how to use Canvas as a research assistant tool with an example of asking the model to reason through the screenshot of a plot to write a research report, in which you can ask questions within the created report. - Ask the model to write Python code to replicate the graph seen on a screenshot image. - Go behind the scenes of how you can create a video game, such as Space Battleship, from scratch, edit it, and display it in one self-contained HTML file. - Get a real-world application example of creating a SQL database from the image of its architecture. - Understand the model training and design processes that power Canvas! Please sign up here:

New short course: Collaborative Writing and Coding with OpenAI Canvas! Explore new ways to write and code with OpenAI Canvas, a user-friendly interface that allows you to brainstorm, draft, and refine text and code in collaboration with ChatGPT. In the short course, created with OpenAI, and taught by , a research lead at OpenAI, you’ll learn to use Canvas to enhance your workflows. Canvas lets you go beyond simple chat interactions. It provides a side-by-side workspace where you and ChatGPT can edit and refine text or code collaboratively. This makes brainstorming, drafting, and iterating as you write feel more natural and effective. As the first major update to ChatGPT’s visual interface since its launch in 2022, Canvas gives a new, innovative approach to collaboration with AI. For instance, after writing the first version of your code, Canvas can review it and give suggestions for improvement. It can also help with debugging by adding logging, identifying problems to fix, and writing comments. In addition, you'll also learn what it takes to train the model for an interface like Canvas. In this video-only short course, you’ll: - Learn how to ask for in-line feedback and control the iteration of your work by directly editing selected areas of your text or code from the model’s output. - Learn how to access quick automation tools in a shortcut menu that allows you to modify your writing tone and length, enhance your code, and restore previous versions of your work. - Learn how to use Canvas as a research assistant tool with an example of asking the model to reason through the screenshot of a plot to write a research report, in which you can ask questions within the created report. - Ask the model to write Python code to replicate the graph seen on a screenshot image. - Go behind the scenes of how you can create a video game, such as Space Battleship, from scratch, edit it, and display it in one self-contained HTML file. - Get a real-world application example of creating a SQL database from the image of its architecture. - Understand the model training and design processes that power Canvas! Please sign up here:

Andrew Ng

128,180 次观看 • 1 年前

We partnered with artists, designers, and builders to create new AI tools that solve real problems in their creative workflows. Here’s what’s new: — Introducing Google Pics in Google Workspace: A brand-new image creation & editing tool. Move and resize objects, add text, and translate just by hovering and clicking — Big updates to صافي النيه😉: 1) You can now create with Gemini Omni Flash in Google Flow 2) Google Flow Agent is a multi-step creative partner that reasons and plans complex tasks with you. 3) Google Flow tools are custom tools you can “vibe code” for animations, video effects, text layering & more — Design live with Stitch by Google: Now, you can use text or voice prompts to edit layouts in real time then export those designs straight to code — More creative control in صافي النيه😉Music: Edit songs section by section, remix the style of full songs, and create music videos with our new Gemini Omni Flash model

Google AI

13,953,239 次观看 • 2 个月前

I couldn't believe it. One product image = a full video ad with Wizstar. No script. No shoot. No editor. Just the image, one sentence of instruction, and Wizstar did everything else. It analyzes your product automatically, builds the scene around it, and generates a complete marketing video. Character stays consistent across every shot. Product details stay accurate. Audio and video sync perfectly. It powers multi-model invocation to match any style you need, and Seedance 2.0 supports face input for consistent character generation. But wait, it gets better. You can also upload any viral video from TikTok or Amazon. Then it will recreate that EXACT winning formula for YOUR product. No more guessing what works. Zero creative trial and error. Make a video today, start seeing sales in 7 days. New users get free credits on signup. First subscription is only $19 and includes a 30-second E-commerce Agent experience. Try it here: Who's making their first ad tonight? 👇 #Wizstar #AIVideo #EcommerceMarketing

I couldn't believe it. One product image = a full video ad with Wizstar. No script. No shoot. No editor. Just the image, one sentence of instruction, and Wizstar did everything else. It analyzes your product automatically, builds the scene around it, and generates a complete marketing video. Character stays consistent across every shot. Product details stay accurate. Audio and video sync perfectly. It powers multi-model invocation to match any style you need, and Seedance 2.0 supports face input for consistent character generation. But wait, it gets better. You can also upload any viral video from TikTok or Amazon. Then it will recreate that EXACT winning formula for YOUR product. No more guessing what works. Zero creative trial and error. Make a video today, start seeing sales in 7 days. New users get free credits on signup. First subscription is only $19 and includes a 30-second E-commerce Agent experience. Try it here: Who's making their first ad tonight? 👇 #Wizstar #AIVideo #EcommerceMarketing

Pradeep Pandey

59,917 次观看 • 1 个月前

🚀 New Paper: Pixel Reasoner 🧠🖼️ How can Vision-Language Models (VLMs) perform chain-of-thought reasoning within the image itself? We introduce Pixel Reasoner, the first open-source framework that enables VLMs to “think in pixel space” through curiosity-driven reinforcement learning. Current VLMs reason only in text — even when grounded in rich images or videos, their logical steps are verbalized in natural language. This restricts their ability to interrogate visual evidence and demonstrate how conclusions are drawn. 🔍 So we ask: What if we could make VLMs "show their work" by reasoning directly in the pixel space? Inspired by GPT-o3’s "think-in-image" ability, we propose a framework where VLMs use interactive visual operations — zoom, select-frame, highlight — to reason through complex visual inputs. To do this, we design a two-stage training process: Instruction tuning with synthesized visual reasoning traces. Reinforcement learning with curiosity-driven reward to balance exploration between pixel and text reasoning ✨ With this, Pixel Reasoner achieves near-SoTA performance on many information-rich multimodal benchmarks: 📊 84% on InfographicsVQA 🧠 84% on V* benchmark 🧩 74% on TallyQA-Complex It also achieves strong accuracy of 68% on MVBench (a video benchmark). Website: Paper: Code: Demo: (coming soon)

🚀 New Paper: Pixel Reasoner 🧠🖼️ How can Vision-Language Models (VLMs) perform chain-of-thought reasoning within the image itself? We introduce Pixel Reasoner, the first open-source framework that enables VLMs to “think in pixel space” through curiosity-driven reinforcement learning. Current VLMs reason only in text — even when grounded in rich images or videos, their logical steps are verbalized in natural language. This restricts their ability to interrogate visual evidence and demonstrate how conclusions are drawn. 🔍 So we ask: What if we could make VLMs "show their work" by reasoning directly in the pixel space? Inspired by GPT-o3’s "think-in-image" ability, we propose a framework where VLMs use interactive visual operations — zoom, select-frame, highlight — to reason through complex visual inputs. To do this, we design a two-stage training process: Instruction tuning with synthesized visual reasoning traces. Reinforcement learning with curiosity-driven reward to balance exploration between pixel and text reasoning ✨ With this, Pixel Reasoner achieves near-SoTA performance on many information-rich multimodal benchmarks: 📊 84% on InfographicsVQA 🧠 84% on V* benchmark 🧩 74% on TallyQA-Complex It also achieves strong accuracy of 68% on MVBench (a video benchmark). Website: Paper: Code: Demo: (coming soon)

Wenhu Chen

82,829 次观看 • 1 年前

BREAKING🚨: Video editing just got as simple as editing a text document. Aleph 2.0 is live on Runway's new Edit Studio right now! Here is my quick tutorial showing 3 of its most powerful post-production strengths: Infinite Variations: Swap product colors, change seasons, or update styles—all from the exact same video clip. Zero Wasted Renders: Preview your edit instantly as a static image first to lock in the look before you commit to generating the full video. Multi-Shot Power: Apply an edit once, and watch it propagate automatically across cuts and scene changes without resetting. Stop regenerating from scratch. Grab your own camera roll footage and try it today. 🔗 Try it: > 🎟️ Use code ALEPH2 at checkout for 22% off 2 months of Runway Pro (valid through May 31, 2026) #MadeWithRunway

BREAKING🚨: Video editing just got as simple as editing a text document. Aleph 2.0 is live on Runway's new Edit Studio right now! Here is my quick tutorial showing 3 of its most powerful post-production strengths: Infinite Variations: Swap product colors, change seasons, or update styles—all from the exact same video clip. Zero Wasted Renders: Preview your edit instantly as a static image first to lock in the look before you commit to generating the full video. Multi-Shot Power: Apply an edit once, and watch it propagate automatically across cuts and scene changes without resetting. Stop regenerating from scratch. Grab your own camera roll footage and try it today. 🔗 Try it: > 🎟️ Use code ALEPH2 at checkout for 22% off 2 months of Runway Pro (valid through May 31, 2026) #MadeWithRunway

Arcane Ai

73,066 次观看 • 1 个月前

Stop begging a model for magic. Start directing. Koyal is an agentic AI filmmaking platform It turns a script - or even raw audio - into a film you can cut, recut, and release It starts where filmmakers start: performance Then agents do what a crew would: scenes, shots, retakes Multilingual script → audio → video Agentic lip-sync with believable motion Characters that stay themselves across scenes Because real directors don’t “prompt” a movie They write. Perform. Reshoot. Koyal brings AI to that century-old workflow 🎙️ Mehul Agarwal, Co-founder & CEO koyal.ai (YC F25) on Fondo.com Start 00:00 Intro to Mehul and Koyal “Agentic AI filmmaking platform” 01:10 Most exciting videos on the platform 01:34 Music video and filming at a UNESCO site with AI 02:55 Origin story from text-to-3D gaming startup to AI filmmaking 03:24 The early days of Stable Diffusion, Midjourney, and the AI image explosion 04:22 Why the gaming industry is a "thankless" place for startups 04:50 "why isn't this a startup?" moment 05:15 meme pages, standup comedy, and scriptwriting 07:08 How Koyal works: the "Pixar process" without a camera 08:30 Launching the first video hackathon at YC 10:47 Where to follow and try Koyal

Stop begging a model for magic. Start directing. Koyal is an agentic AI filmmaking platform It turns a script - or even raw audio - into a film you can cut, recut, and release It starts where filmmakers start: performance Then agents do what a crew would: scenes, shots, retakes Multilingual script → audio → video Agentic lip-sync with believable motion Characters that stay themselves across scenes Because real directors don’t “prompt” a movie They write. Perform. Reshoot. Koyal brings AI to that century-old workflow 🎙️ Mehul Agarwal, Co-founder & CEO koyal.ai (YC F25) on Fondo.com Start 00:00 Intro to Mehul and Koyal “Agentic AI filmmaking platform” 01:10 Most exciting videos on the platform 01:34 Music video and filming at a UNESCO site with AI 02:55 Origin story from text-to-3D gaming startup to AI filmmaking 03:24 The early days of Stable Diffusion, Midjourney, and the AI image explosion 04:22 Why the gaming industry is a "thankless" place for startups 04:50 "why isn't this a startup?" moment 05:15 meme pages, standup comedy, and scriptwriting 07:08 How Koyal works: the "Pixar process" without a camera 08:30 Launching the first video hackathon at YC 10:47 Where to follow and try Koyal

David J Phillips

25,753 次观看 • 5 个月前