正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...

Jesse Engel

9,199 subscribers

183,654 次观看 • 1 年前 •via X (Twitter)

科学技术音乐

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument. MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency. Open weights. Open source inference engine. Suite of apps and plugins. Hear what it can do and try it out for yourself below 🧵

Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument. MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency. Open weights. Open source inference engine. Suite of apps and plugins. Hear what it can do and try it out for yourself below 🧵

Google Magenta Project

113,807 次观看 • 3 个月前

the new OpenAI realtime voice model just released + gpt 5.5 fast mode brings us a new possibility - realtime speech to live presentation! i just talk, and the whiteboard would whiteboard itself prototype is open sourced. details in thread below -

the new OpenAI realtime voice model just released + gpt 5.5 fast mode brings us a new possibility - realtime speech to live presentation! i just talk, and the whiteboard would whiteboard itself prototype is open sourced. details in thread below -

Kun Chen

114,908 次观看 • 3 个月前

Really proud to share something we’ve been working on for a while: Magenta RealTime 2 (MTR2), a live music model that is highly interactive (MIDI, audio, text, lots of parameters) and low-latency (~200ms end-to-end), and runs locally on a MacBook!

Really proud to share something we’ve been working on for a while: Magenta RealTime 2 (MTR2), a live music model that is highly interactive (MIDI, audio, text, lots of parameters) and low-latency (~200ms end-to-end), and runs locally on a MacBook!

Ilaria Manco

45,212 次观看 • 3 个月前

New Experiment: SerendipityLM - Interactive evolutionary exploration of generative design spaces with large language models. Check out the extensive experiment report, incl. many generative art examples & link to open source repo: Find out more in this 🧵

New Experiment: SerendipityLM - Interactive evolutionary exploration of generative design spaces with large language models. Check out the extensive experiment report, incl. many generative art examples & link to open source repo: Find out more in this 🧵

samim

23,741 次观看 • 2 年前

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

OpenAI

3,662,973 次观看 • 3 个月前

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Harper Carroll

30,392 次观看 • 1 个月前

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

Lior Alexander

231,665 次观看 • 3 年前

OpenAI just dropped a completely new kind of model gpt-realtime-translate takes in speech audio from any language and outputs speech in your target language LLMs are great, but you need specialized models for specialized use cases We're running this on our smart glasses

OpenAI just dropped a completely new kind of model gpt-realtime-translate takes in speech audio from any language and outputs speech in your target language LLMs are great, but you need specialized models for specialized use cases We're running this on our smart glasses

cayden 凯登

100,395 次观看 • 3 个月前

Today we’re announcing two new updates in our computer vision work — a new, expanded license for our DINOv2 model and the release of FACET, a comprehensive new benchmark dataset to help evaluate and improve fairness in vision models. More details ➡️ 🧵

Today we’re announcing two new updates in our computer vision work — a new, expanded license for our DINOv2 model and the release of FACET, a comprehensive new benchmark dataset to help evaluate and improve fairness in vision models. More details ➡️ 🧵

AI at Meta

454,030 次观看 • 3 年前

Your Zoom meetings, now with an AI coach! Live analysis. Realtime guidance. Better outcomes. We collaborated with Zoom to build a Runtime template for integrating Zoom’s Realtime Media Streams. Boost the effectiveness of your sales and support teams while ensuring compliance. And, the code is open-sourced. Read more → Build on our template →

Your Zoom meetings, now with an AI coach! Live analysis. Realtime guidance. Better outcomes. We collaborated with Zoom to build a Runtime template for integrating Zoom’s Realtime Media Streams. Boost the effectiveness of your sales and support teams while ensuring compliance. And, the code is open-sourced. Read more → Build on our template →

Inworld AI

649,217 次观看 • 8 个月前

Stop hardcoding one model name in your code. Now you can give each request a policy: a small rule for what the call needs It picks the right model for the job, on your own keys This is unhardcoded, our new open source routing for AI models, live today

Stop hardcoding one model name in your code. Now you can give each request a policy: a small rule for what the call needs It picks the right model for the job, on your own keys This is unhardcoded, our new open source routing for AI models, live today

GenLayer

95,502 次观看 • 2 个月前

A quick first pass at a new iteration of the realtime diffusion pipeline: physical interface → camera → realtime img2img → upscale → 3DGS through the new TripoSplat. Rough and held together with tape for now, but the whole loop runs end to end. Next: - better input and camera's pov, - splitting it across two machines to automate the hand-off, - and adding in the Tripo3D API for higher-res models... the 3D printer is just waiting for that. #diffusion #3DGS #TripoSplat

A quick first pass at a new iteration of the realtime diffusion pipeline: physical interface → camera → realtime img2img → upscale → 3DGS through the new TripoSplat. Rough and held together with tape for now, but the whole loop runs end to end. Next: - better input and camera's pov, - splitting it across two machines to automate the hand-off, - and adding in the Tripo3D API for higher-res models... the 3D printer is just waiting for that. #diffusion #3DGS #TripoSplat

Hugues Bruyère

15,526 次观看 • 2 个月前

Today is a good day for open science. As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and help advance AI in a responsible way. More in the video from Joelle Pineau. What we’re releasing: 🦎 Meta Chameleon 7B & 34B language models that support mixed-modal input and text-only outputs. 🪙 Meta Multi-Token Prediction Pretrained Language Models for code completion using Multi-Token Prediction. 🎼 Meta JASCO Generative text-to-music models capable of accepting various conditioning inputs for greater controllability. Paper available today with a pretrained model coming soon. 🗣️ Meta AudioSeal An audio watermarking model that we believe is the first designed specifically for the localized detection of AI-generated speech, available under a commercial license. 📝 Additional RAI artifacts Including research, data and code to measure and improve the representation of geographical and cultural preferences and diversity in AI systems. We believe that access to state-of-the-art AI creates opportunities for everyone – not just a small handful of Big Tech companies. We’re excited to share this work and to see how the community learns, iterates and builds using this technology. Details and access to everything released by FAIR today ➡️

Today is a good day for open science. As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and help advance AI in a responsible way. More in the video from Joelle Pineau. What we’re releasing: 🦎 Meta Chameleon 7B & 34B language models that support mixed-modal input and text-only outputs. 🪙 Meta Multi-Token Prediction Pretrained Language Models for code completion using Multi-Token Prediction. 🎼 Meta JASCO Generative text-to-music models capable of accepting various conditioning inputs for greater controllability. Paper available today with a pretrained model coming soon. 🗣️ Meta AudioSeal An audio watermarking model that we believe is the first designed specifically for the localized detection of AI-generated speech, available under a commercial license. 📝 Additional RAI artifacts Including research, data and code to measure and improve the representation of geographical and cultural preferences and diversity in AI systems. We believe that access to state-of-the-art AI creates opportunities for everyone – not just a small handful of Big Tech companies. We’re excited to share this work and to see how the community learns, iterates and builds using this technology. Details and access to everything released by FAIR today ➡️

AI at Meta

381,021 次观看 • 2 年前

Exciting update for AI developers! The Hugging Face Hub is now more natively integrated into Google Cloud Vertex AI Model Garden. Search through thousands of open Generative AI models from Hugging Face models & deploy them with one click to Vertex AI or GKE. 🤯 What's new: 🔎 Browse and search thousands of Hugging Face models directly within the Vertex AI Model Garden and filter based on what is currently trending in the community. 🚀 Accelerate your AI projects by leveraging readily available one-click deploy your model to Vertex AI or Google Kubernetes Engine (GKE). ⭐️ Featuring popular open models from BlackForestLabsAI - Unofficial FLUX.1, AI at Meta Llama 3.1, Mistral AI, Google DeepMind Gemma, and countless others. Get Started:

Exciting update for AI developers! The Hugging Face Hub is now more natively integrated into Google Cloud Vertex AI Model Garden. Search through thousands of open Generative AI models from Hugging Face models & deploy them with one click to Vertex AI or GKE. 🤯 What's new: 🔎 Browse and search thousands of Hugging Face models directly within the Vertex AI Model Garden and filter based on what is currently trending in the community. 🚀 Accelerate your AI projects by leveraging readily available one-click deploy your model to Vertex AI or Google Kubernetes Engine (GKE). ⭐️ Featuring popular open models from BlackForestLabsAI - Unofficial FLUX.1, AI at Meta Llama 3.1, Mistral AI, Google DeepMind Gemma, and countless others. Get Started:

Philipp Schmid

34,757 次观看 • 1 年前

Today, we're announcing that Comfy is the first and only commercial license distributor for MiniMax (official)'s generative media models. MiniMax open weight models have been downloaded through Comfy close to 20M times. Now you can license them for commercial work. → Full commercial rights to your outputs → Fine-tuning and LoRA training, fully allowed → Client and agency projects covered → MiniMax Audio & Music, not just video Professional and Enterprise plans, with Enterprise covering every H3 model version. Request a license with the link below today ⬇️

Today, we're announcing that Comfy is the first and only commercial license distributor for MiniMax (official)'s generative media models. MiniMax open weight models have been downloaded through Comfy close to 20M times. Now you can license them for commercial work. → Full commercial rights to your outputs → Fine-tuning and LoRA training, fully allowed → Client and agency projects covered → MiniMax Audio & Music, not just video Professional and Enterprise plans, with Enterprise covering every H3 model version. Request a license with the link below today ⬇️

ComfyUI

132,917 次观看 • 7 天前

Livestream Alert: Open World Models in Production: LTX.io and ComfyUI Founders Live A special live conversation with Yoland Yan ( CEO, ComfyUI ) & comfyanonymous ( Founder, ComfyUI ) and Zeev Farbman ( CEO, LTX ) Join us as we sit down with the teams behind LTX and ComfyUI to talk about building an open world model that integrates natively into the production tools creators use. We'll explore what it took to build LTXa foundational model that understands space, motion, and how the physical world operates—with synchronized video and audio generation, truly open weights, and the flexibility to fine-tune on your own data. We'll explore what it took to ship a frontier video model in the open, how LTX and ComfyUI are building the pipeline for AI-driven production together, and what it means for creators, developers, and the wider open-source ecosystem. What we'll cover: → LTX: the open world model for synchronized video + audio, and beyond → Native integration into ComfyUI workflows and production pipelines → Open world models vs. closed platforms and where things are headed → Fine-tuning LTX on your own data with LTX Trainer → Community Q&A — bring your questions

Livestream Alert: Open World Models in Production: LTX.io and ComfyUI Founders Live A special live conversation with Yoland Yan ( CEO, ComfyUI ) & comfyanonymous ( Founder, ComfyUI ) and Zeev Farbman ( CEO, LTX ) Join us as we sit down with the teams behind LTX and ComfyUI to talk about building an open world model that integrates natively into the production tools creators use. We'll explore what it took to build LTXa foundational model that understands space, motion, and how the physical world operates—with synchronized video and audio generation, truly open weights, and the flexibility to fine-tune on your own data. We'll explore what it took to ship a frontier video model in the open, how LTX and ComfyUI are building the pipeline for AI-driven production together, and what it means for creators, developers, and the wider open-source ecosystem. What we'll cover: → LTX: the open world model for synchronized video + audio, and beyond → Native integration into ComfyUI workflows and production pipelines → Open world models vs. closed platforms and where things are headed → Fine-tuning LTX on your own data with LTX Trainer → Community Q&A — bring your questions

ComfyUI

13,174 次观看 • 1 个月前

Excited to release a tool that makes the joy of live music creation more accessible 🎸 “Music FX DJ” is new and improved: Featuring a whole suite of new controls, sharing and remix features, and improved audio quality and diversity of outputs, to let you blend and warp genres and instruments in an ever evolving stream of music. It’s been an absolute pleasure to work with Jacob Collier over the past year on this. It was very affirming to find him pushing for the same things Google Magenta Project has always valued: making tools that intrinsically value creativity and agency over just imitation, embrace the “weird corners” of AI, encouraging veterans to express themselves in new ways, while empowering novices to express themselves musically maybe for the first time. Read details at: And in the 🧵 below…

Excited to release a tool that makes the joy of live music creation more accessible 🎸 “Music FX DJ” is new and improved: Featuring a whole suite of new controls, sharing and remix features, and improved audio quality and diversity of outputs, to let you blend and warp genres and instruments in an ever evolving stream of music. It’s been an absolute pleasure to work with Jacob Collier over the past year on this. It was very affirming to find him pushing for the same things Google Magenta Project has always valued: making tools that intrinsically value creativity and agency over just imitation, embrace the “weird corners” of AI, encouraging veterans to express themselves in new ways, while empowering novices to express themselves musically maybe for the first time. Read details at: And in the 🧵 below…

Jesse Engel

20,117 次观看 • 1 年前