Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Introducing CycleQD: A population-based model merging via Quality Diversity CycleQD builds on our model merging research, advancing two fronts: evolving a swarm of specialized agents to complement one another, and laying the groundwork for life-long learning by enabling diverse, adaptable skill acquisition at the population-level.

Sakana AI

72,570 subscribers

121,567 Aufrufe • vor 1 Jahr •via X (Twitter)

Bildung Wissenschaft & Technologie Gesundheit & Wellness

Anya Rossi• Live Now

Private livecam show

8 Kommentare

Profilbild von Sakana AI

Sakana AIvor 1 Jahr

Please check out our paper, Agent Skill Acquisition for Large Language Models via CycleQD This work aims to mimic an ecological niche during the training of a swarm of LLM agents. Just like how each species in an environment finds its own role and position, or niche, a well-evolved AI agent doesn’t have to be great at everything, but it can effectively occupy a specific niche, making it resilient to competition from other agents in the swarm. This kind of approach can enable a population of AI agents to emerge, each with specific capabilities that complement each other, collectively improving over time. The core idea in CycleQD is to create an artificial evolutionary process in which Model Merging is used as a cross-over operation, SVD as a mutation operation, and Quality Diversity as the selection operation, encouraging each agent in the population to develop its own unique capabilities which adds value to the collective. In the paper, we show that CycleQD is able to evolve a swarm of LLM agents, each with their own niche, to tackle difficult agentic workflow tasks. We believe that the future of AI lies in life-long learning where collective systems continuously grow, adapt, and accumulate knowledge over time. CycleQD is a first step, enabling diverse skill learning as a foundation for continual learning.

Profilbild von TuringPost

TuringPostvor 1 Jahr

This is very interesting! Can we say, that you use a swarm intelligence concept here?

Profilbild von Brandon

Brandonvor 1 Jahr

Seems pretty reasonable to me

Profilbild von baraa tulip

baraa tulipvor 1 Jahr

@ceobillionaire 💥💥💢💢💥💥💢💥 please please Help Btc : bc1qv0xceh6h4eaawhnqq95nty85r02vpgjzrjyrjg Eth : 0xaeac98A1a3a3f260Ce969fB57C4ab0595f51f113

Profilbild von justboulatbek

justboulatbekvor 1 Jahr

Are these things available for self deploy to try? Or as a service?

Profilbild von AI Carlos

AI Carlosvor 1 Jahr

I'm intrigued by CycleQD's potential for life-long learning. Can it adapt to new tasks without requiring extensive retraining?

Profilbild von Belkhir Nacim

Belkhir Nacimvor 1 Jahr

any idea to investigate differential evolution or an ES strategy in lieu of a swarm approach?

Profilbild von Data & Analytics

Data & Analyticsvor 1 Jahr

@hardmaru @hardmaru, cycleQD sounds like an intriguing concept! Merging models with Quality Diversity could shake things up in AI research. What aspects of it grab your attention?

Ähnliche Videos

Introducing Adjoint Sampling, a new learning algorithm that trains generative models based on scalar rewards. Based on theoretical foundations developed by FAIR, Adjoint Sampling leads to a highly scalable practical algorithm, and can become the foundation for further research into highly scalable sampling methods. Read our research paper on Adjoint Sampling and download the model, code, and benchmark ➡️

Introducing Adjoint Sampling, a new learning algorithm that trains generative models based on scalar rewards. Based on theoretical foundations developed by FAIR, Adjoint Sampling leads to a highly scalable practical algorithm, and can become the foundation for further research into highly scalable sampling methods. Read our research paper on Adjoint Sampling and download the model, code, and benchmark ➡️

AI at Meta

36,987 Aufrufe • vor 1 Jahr

Excited to share that our paper 🌊🤺 “CFC: Simulating Character–Fluid Coupling using a Two-Level World Model” has been accepted to #SIGGRAPHASIA2025! In this work, we build a two-level world model (neural physics) for rigid-body–fluid interaction and use it to train physics-based character controllers efficiently. We study: (1) learning to model highly dynamic fluid environments, (2) representing character–fluid interaction via joint-level forces as an interface, and (3) enabling supervised policy learning on the learned world model—avoiding expensive fluid simulation in the training loop. Our talk is on Monday afternoon(Dec 15)—hope to see you there! Time: Monday, 15 December 2025 5:02pm - 5:13pm GMT+8 Location: Meeting Room S221, Level 2. #SIGGRAPHASIA #SIGGRAPH

Excited to share that our paper 🌊🤺 “CFC: Simulating Character–Fluid Coupling using a Two-Level World Model” has been accepted to #SIGGRAPHASIA2025! In this work, we build a two-level world model (neural physics) for rigid-body–fluid interaction and use it to train physics-based character controllers efficiently. We study: (1) learning to model highly dynamic fluid environments, (2) representing character–fluid interaction via joint-level forces as an interface, and (3) enabling supervised policy learning on the learned world model—avoiding expensive fluid simulation in the training loop. Our talk is on Monday afternoon(Dec 15)—hope to see you there! Time: Monday, 15 December 2025 5:02pm - 5:13pm GMT+8 Location: Meeting Room S221, Level 2. #SIGGRAPHASIA #SIGGRAPH

Zhiyang (Frank) Dou

20,200 Aufrufe • vor 7 Monaten

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 Aufrufe • vor 2 Jahren

Meet physics-intern🧑‍🎓, our agentic framework for theoretical physics. It takes Gemini 3.1 Pro from 17.7% to 31.4% on CritPt, a new SOTA on one of the hardest benchmarks for LLMs. Theoretical physics is hard for humans and LLMs alike. But physics-intern decomposes problems and dispatches them to a team of specialized agents, solving research-level questions far more effectively than the base model alone.

Meet physics-intern🧑‍🎓, our agentic framework for theoretical physics. It takes Gemini 3.1 Pro from 17.7% to 31.4% on CritPt, a new SOTA on one of the hardest benchmarks for LLMs. Theoretical physics is hard for humans and LLMs alike. But physics-intern decomposes problems and dispatches them to a team of specialized agents, solving research-level questions far more effectively than the base model alone.

David Louapre

112,251 Aufrufe • vor 2 Monaten

Introducing Agentkit: A production-ready, model-agnostic framework for building AI agents with infinite onchain and web2 functionality, powered by @coinbaseDev and Based Agents on Base were just the beginning. its time to change the way we interact onchain. 🧵

Introducing Agentkit: A production-ready, model-agnostic framework for building AI agents with infinite onchain and web2 functionality, powered by @coinbaseDev and Based Agents on Base were just the beginning. its time to change the way we interact onchain. 🧵

lincoln.base.eth

409,263 Aufrufe • vor 1 Jahr

Everyone is racing toward AGI. Most are running in the wrong direction. The future isn't a single god-like model controlled by a handful of closed labs. It's millions of specialized agents, coordinating and evolving together, on a foundation that's open, verifiable, and owned by the people building on it. Our executive team on what’s next. $OPG TGE April 21 👇

Everyone is racing toward AGI. Most are running in the wrong direction. The future isn't a single god-like model controlled by a handful of closed labs. It's millions of specialized agents, coordinating and evolving together, on a foundation that's open, verifiable, and owned by the people building on it. Our executive team on what’s next. $OPG TGE April 21 👇

OpenGradient (∇, ∇)

3,246,937 Aufrufe • vor 3 Monaten

The largest advancement of the CUDA platform since its creation in 2006 is here 👀 Introducing CUDA Tile, a tile-based programming model that provides the ability to write algorithms at a higher level and abstract away the details of specialized hardware, such as tensor cores. Read the technical blog 👉

The largest advancement of the CUDA platform since its creation in 2006 is here 👀 Introducing CUDA Tile, a tile-based programming model that provides the ability to write algorithms at a higher level and abstract away the details of specialized hardware, such as tensor cores. Read the technical blog 👉

NVIDIA AI Developer

244,885 Aufrufe • vor 8 Monaten

Introducing Stable Audio 2.0 – a new model capable of producing high-quality, full tracks with coherent musical structure up to three minutes long at 44.1 kHz stereo from a single prompt. Explore the model and start creating for free at: Read the blogpost here: (1/3)

Introducing Stable Audio 2.0 – a new model capable of producing high-quality, full tracks with coherent musical structure up to three minutes long at 44.1 kHz stereo from a single prompt. Explore the model and start creating for free at: Read the blogpost here: (1/3)

Stability AI

457,837 Aufrufe • vor 2 Jahren

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Stability AI

1,024,571 Aufrufe • vor 2 Jahren

As we get ready to shoot for the Moon, let’s get to know the talented Fireflies from all over the world who are about to make history with our Blue Ghost lunar lander. These individuals are forging a highway to the Moon by enabling regular lunar access, advancing lunar research, and laying the groundwork for humans to have a lasting lunar presence. Stay tuned over the coming weeks as we share stories of our #GhostRiders, including their passions, innovation, and relentless drive to push the limits of space exploration.

As we get ready to shoot for the Moon, let’s get to know the talented Fireflies from all over the world who are about to make history with our Blue Ghost lunar lander. These individuals are forging a highway to the Moon by enabling regular lunar access, advancing lunar research, and laying the groundwork for humans to have a lasting lunar presence. Stay tuned over the coming weeks as we share stories of our #GhostRiders, including their passions, innovation, and relentless drive to push the limits of space exploration.

Firefly Aerospace

25,608 Aufrufe • vor 1 Jahr

Speaking in 1994, arch-globalist David Rockefeller makes the case for halting the growth of the human population: "The negative impact of population growth on all of our planetary ecosystems is becoming appallingly evident." "Unless nations will agree to work together to tackle these cross-border challenges posed by population growth... the prospects for a decent life on our planet will be threatened." "The United Nations can and should play an essential role in helping the world find a satisfactory way of stabilising world population." This speech was made two years after the launch of UN Agenda 21.

Speaking in 1994, arch-globalist David Rockefeller makes the case for halting the growth of the human population: "The negative impact of population growth on all of our planetary ecosystems is becoming appallingly evident." "Unless nations will agree to work together to tackle these cross-border challenges posed by population growth... the prospects for a decent life on our planet will be threatened." "The United Nations can and should play an essential role in helping the world find a satisfactory way of stabilising world population." This speech was made two years after the launch of UN Agenda 21.

Wide Awake Media

58,464 Aufrufe • vor 1 Jahr

Elon Musk and Population Collapse Many people around the world mistakenly believe that there are too many people on Earth. However, in reality, the planet has the capacity to sustain a much higher population than its current level. The birth rate is declining rapidly, which is a key factor in population growth. By multiplying the birth rate by the life expectancy, we can estimate the number of people who will be alive in the future. Surprisingly, in many cases, the result is a negative figure. For instance, let's take the example of Japan, which currently has a population of 110 million. Based on the birth rate calculation, the projected population for the future is only 68 million. Furthermore, many countries are facing the challenge of an aging population. Population collapse can lead to the destruction of society, particularly in the case of an aging population with too few young people to sustain it. Entire industries may collapse due to a lack of an adequate workforce. Modern society relies on a specific level of population to sustain its functioning, and current data indicates that ongoing trends suggest population numbers may fall far below what is needed to maintain the current societal structure.

Elon Musk and Population Collapse Many people around the world mistakenly believe that there are too many people on Earth. However, in reality, the planet has the capacity to sustain a much higher population than its current level. The birth rate is declining rapidly, which is a key factor in population growth. By multiplying the birth rate by the life expectancy, we can estimate the number of people who will be alive in the future. Surprisingly, in many cases, the result is a negative figure. For instance, let's take the example of Japan, which currently has a population of 110 million. Based on the birth rate calculation, the projected population for the future is only 68 million. Furthermore, many countries are facing the challenge of an aging population. Population collapse can lead to the destruction of society, particularly in the case of an aging population with too few young people to sustain it. Entire industries may collapse due to a lack of an adequate workforce. Modern society relies on a specific level of population to sustain its functioning, and current data indicates that ongoing trends suggest population numbers may fall far below what is needed to maintain the current societal structure.

Mario Nawfal

840,672 Aufrufe • vor 3 Jahren

Happy to share what I’ve been working on since joining Genesis! GENE-26.5 is a one-of-a-kind, robotics-native multimodal foundation model that learns from diverse, in-the-wild data across modalities and outputs actions enabling a 54-DoF robot system to perform the most dexterous, long-horizon manipulation tasks to date—approaching human-level capability. This is the result of innovations across the full stack—data collection and processing, robot systems, model architecture, training strategies, and scalable evaluation infrastructure.

Happy to share what I’ve been working on since joining Genesis! GENE-26.5 is a one-of-a-kind, robotics-native multimodal foundation model that learns from diverse, in-the-wild data across modalities and outputs actions enabling a 54-DoF robot system to perform the most dexterous, long-horizon manipulation tasks to date—approaching human-level capability. This is the result of innovations across the full stack—data collection and processing, robot systems, model architecture, training strategies, and scalable evaluation infrastructure.

Zu Wang

19,493 Aufrufe • vor 3 Monaten

The network for machine intelligence Two years ago, we laid out our vision for a machine learning compute protocol. One that connects every device in the world into an open network for machine intelligence, with no gatekeepers or artificial boundaries. This week, we’ll be sharing some of our early progress, beginning with RL Swarm, a peer-to-peer system for collaborative reinforcement learning over the internet. Next month, we’ll open our Testnet, allowing anyone to contribute to the frontier of open machine intelligence. Introducing RL Swarm RL Swarm is a fully open source system for collaborative reinforcement learning over the internet. It is a live demo of our research findings, which show that models training with RL learn faster when they train as a collective swarm than they do on their own. Join our swarm now to see this in practice. You can participate with consumer hardware at home or a powerful GPU in the cloud. You can follow along with the swarm’s progress by following the links below.

The network for machine intelligence Two years ago, we laid out our vision for a machine learning compute protocol. One that connects every device in the world into an open network for machine intelligence, with no gatekeepers or artificial boundaries. This week, we’ll be sharing some of our early progress, beginning with RL Swarm, a peer-to-peer system for collaborative reinforcement learning over the internet. Next month, we’ll open our Testnet, allowing anyone to contribute to the frontier of open machine intelligence. Introducing RL Swarm RL Swarm is a fully open source system for collaborative reinforcement learning over the internet. It is a live demo of our research findings, which show that models training with RL learn faster when they train as a collective swarm than they do on their own. Join our swarm now to see this in practice. You can participate with consumer hardware at home or a powerful GPU in the cloud. You can follow along with the swarm’s progress by following the links below.

gensyn

228,900 Aufrufe • vor 1 Jahr

The model township taking shape in Wayanad for the Mundakkai–Chooralmala disaster-affected families is advancing at a remarkable pace. With safe housing and quality amenities, the Government’s promise to stand by the people on their path to recovery is fast becoming a reality. #wayanadtownship

The model township taking shape in Wayanad for the Mundakkai–Chooralmala disaster-affected families is advancing at a remarkable pace. With safe housing and quality amenities, the Government’s promise to stand by the people on their path to recovery is fast becoming a reality. #wayanadtownship

Pinarayi Vijayan

90,931 Aufrufe • vor 8 Monaten

Introducing SDXL Turbo: A real-time text-to-image generation model. SDXL Turbo achieves state-of-the-art performance with a new distillation technology, enabling single-step image generation with unprecedented quality, reducing the required step count from 50 to just one. The code, research paper, and weights for non-commercial use are now available on our website. You can test SDXL Turbo on Stability AI’s image editing platform Clipdrop, with a beta demonstration of the real-time text-to-image generation capabilities. Learn more:

Introducing SDXL Turbo: A real-time text-to-image generation model. SDXL Turbo achieves state-of-the-art performance with a new distillation technology, enabling single-step image generation with unprecedented quality, reducing the required step count from 50 to just one. The code, research paper, and weights for non-commercial use are now available on our website. You can test SDXL Turbo on Stability AI’s image editing platform Clipdrop, with a beta demonstration of the real-time text-to-image generation capabilities. Learn more:

Stability AI

976,344 Aufrufe • vor 2 Jahren

Bio-inspired swarm intelligence for AI music composition: MusicSwarm instantiates many identical, frozen foundation-model agents that coordinate only via peer-to-peer feedback and pheromone-like signals. Without any weight updates, these agents spontaneously self-organize into differentiated roles and produce compositions with higher local novelty, richer rhythmic diversity, and more human-like small-world structure than centrally critiqued multi-agent or single-shot baselines. We observe swarm dynamics that converge toward Nash-like equilibria in the space of agent behaviors, while the continual emergence of new motifs and long-range links realizes a Gödelian perspective: interacting agents plus a shared external world model behave as a meta-system whose creative trajectories go beyond those of any single, monolithic model.

Bio-inspired swarm intelligence for AI music composition: MusicSwarm instantiates many identical, frozen foundation-model agents that coordinate only via peer-to-peer feedback and pheromone-like signals. Without any weight updates, these agents spontaneously self-organize into differentiated roles and produce compositions with higher local novelty, richer rhythmic diversity, and more human-like small-world structure than centrally critiqued multi-agent or single-shot baselines. We observe swarm dynamics that converge toward Nash-like equilibria in the space of agent behaviors, while the continual emergence of new motifs and long-range links realizes a Gödelian perspective: interacting agents plus a shared external world model behave as a meta-system whose creative trajectories go beyond those of any single, monolithic model.

Markus J. Buehler

24,478 Aufrufe • vor 8 Monaten

Our research team just released Flex-Forcing: a video generation method that lets a single model switch between generation methods at inference time. Right now there are two main approaches to video generation. Bidirectional diffusion models attend to every frame at once, holding structure well at the cost of speed. Autoregressive models generate frame by frame, so they stream fast and scale to long clips, but accumulate error and drift over time. Flex-Forcing trains a single model to do both, letting you choose from the range at inference based on your compute budget.

Our research team just released Flex-Forcing: a video generation method that lets a single model switch between generation methods at inference time. Right now there are two main approaches to video generation. Bidirectional diffusion models attend to every frame at once, holding structure well at the cost of speed. Autoregressive models generate frame by frame, so they stream fast and scale to long clips, but accumulate error and drift over time. Flex-Forcing trains a single model to do both, letting you choose from the range at inference based on your compute budget.

NVIDIA AI

31,412 Aufrufe • vor 27 Tagen

Introducing arkenOS — an autonomous training gym that takes any RL agent from a goal to a proven, deployable policy. We are automating complex RL research, enabling high-velocity training and rigorous, diverse environment design and testing right on your local hardware. Out of the box. Our bet is simple: The future of AI will be built by companies giving millions of agents millions of simulated environments to adapt and learn cause and effect in, and survive. This continuous, autonomous selection will create a digital Cambrian explosion, distilling evolutionary trial and error into a foundational specialized intuition.

Introducing arkenOS — an autonomous training gym that takes any RL agent from a goal to a proven, deployable policy. We are automating complex RL research, enabling high-velocity training and rigorous, diverse environment design and testing right on your local hardware. Out of the box. Our bet is simple: The future of AI will be built by companies giving millions of agents millions of simulated environments to adapt and learn cause and effect in, and survive. This continuous, autonomous selection will create a digital Cambrian explosion, distilling evolutionary trial and error into a foundational specialized intuition.

Dev Shah

16,462 Aufrufe • vor 25 Tagen