Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Today, we're open sourcing the code behind "The Infinite Crate," our VST/AU plugin that lets you play with Lyria RealTime directly inside your favorite DAW! 🎧🎶 Since we released The Infinite Crate last year, it’s been used by some of our favorite artists - including a wonderful showcase with...

20,912 görüntüleme • 6 ay önce •via X (Twitter)

15 Yorum

Jesse Engel profil fotoğrafı
Jesse Engel6 ay önce

We architected the plugin using JUCE/C++ and React/Typescript - a clever idea presented by @spencersalazar at ADC 2020. This approach ensures latency sensitive operations (audio streaming and processing) happen in a compiled and unmanaged language with a tight clock, while leveraging web technologies for rapid prototyping of the UI (@reactjs, @shadcn, and @tailwindcss). State is synced between Typescript and C++ using Zustand’s state management and nlohmann json. The based frontend also makes it easier for developers to open the codebase in Antigravity (or similar LLM coding tool) and vibecode new interfaces and functionality.

Jesse Engel profil fotoğrafı
Jesse Engel6 ay önce

In the near term, we hope to update the plugin to support on-device inference of the Magenta RealTime open-weights model for offline use. In the long term, we hope to support future music models with improved controls, such as audio and MIDI input. We’ll be running a few workshops for people interested in learning to build on the Infinite Crate plugin and the Magenta RealTime model. Join the discussion on our Discord if you’re interested: Looking forward to seeing what new plugins and interfaces you build 🙂

Jesse Engel profil fotoğrafı
Jesse Engel6 ay önce

This work has been a labor of love of Ashutosh Desai (@desaiashu). He also releases awesome music through his project Tōsh (IG: @toshbeats), check him out 🎵. Many thanks to Spencer Salazar for his talk on prototyping DAW plugins in web technologies at ADC 2020, JUCE for implementing a C++ to Web/JS bridge in JUCE 8, to the support of artists Sidecar Tommy from Beats Antique (@sidecartommy), Toro y Moi (@ToroyMoi) in exploring the possibilities of DAW integration of our models. Thanks also to the Magenta Team, particularly Noah Constant (@noahconst) for studio experiments and managing development, Ilaria Manco (@Ilaria__Manco), Cassie Tarakajian (@hellothisiscass), Jeff Chang (IG: @instajeffchang), and Adam Roberts (@adarob), Alberto Lalama and Joyce Xie for their work on the API, Nikhil Bhanu for his work on the windows build, and the whole Lyria team that helped contribute to Lyria RealTime.

Jesse Engel profil fotoğrafı
Jesse Engel6 ay önce

More info and links in the blog post:

James Julius profil fotoğrafı
James Julius6 ay önce

Super cool! I've been playing around with this and it's really fun. Looking forward to exploring the code and maybe making some samples

Sadi Moodi profil fotoğrafı
Sadi Moodi6 ay önce

JUCE + React for audio plugins is such a smart split. Latency-critical paths in C++ (you get it), UI in web tech (faster iteration). One tip: use WebAudio API for the bridge - native audio graph in JS, zero-copy buffers via SharedArrayBuffer. Also, expose JUCE params as React state via a thin IPC layer, not direct DOM manipulation.

W3Metal profil fotoğrafı
W3Metal6 ay önce

now, is a potential use-case me being able to sing along with it, sort of flowing based on the music and my vocals, like I am jamming with a IRL band?

miguel michelson profil fotoğrafı
miguel michelson6 ay önce

Would you be interested in being interviewed about this project? We have a section on our magazine at that focuses on music-related open-source projects. our platform is also open source :)

Jesse Engel profil fotoğrafı
Jesse Engel6 ay önce

@DesaiAshu

@mozz profil fotoğrafı
@mozz6 ay önce

🔥

Duke Skyrunner profil fotoğrafı
Duke Skyrunner6 ay önce

@grok wwhat does this app do?

Yash P profil fotoğrafı
Yash P6 ay önce

ok wow, gonna have to try that out in ableton later. what are your favorite artists who use it?

ANR profil fotoğrafı
ANR6 ay önce

@jesseengel is there some kind of press material for us to work with, or should I just try gather all you have on github?

Jesse Engel profil fotoğrafı
Jesse Engel6 ay önce

There's a blog post here:

ANR profil fotoğrafı
ANR6 ay önce

Thank you Jesse, here's our coverage:

Benzer Videolar

elon musk grabbed the source code openai open-sourced by accident, rewrote it in rust over a weekend, and shipped it as a free coding agent that does everything $200/mo chatgpt pro does. why pay $200 to openai and $200 to claude when this runs for $8 the swarm above is one weekend of exactly that: thousands of agents pouring through four endpoints, three paid seats billing $1.80 a task while the free fork bills $0. musk co-founded openai, walked out, and when they left codex on github under a permissive license, he forked it, stamped grok on it, and gave it away what the free version does that the $200 seat charges for: the agent · openai's own engine -> it reads your repo, writes patches, runs your tests, and loops until they pass, exactly like codex -> because under the hood it is codex, just faster and free. you are paying $200 for the paid skin of a tool now sitting on github the license · apache-2.0, un-revocable -> free to use, free to fork, free to ship inside your own product with zero strings -> openai cannot pull it back. musk made sure the license is the kind that never expires the switch · one line, no new tools -> point it at any openai-compatible or claude-compatible endpoint, including an $8 kimi backend -> same terminal, same workflow, gpt-5.6 and opus 5 just quietly lose the seat the bill · $400 down to $8 -> chatgpt pro plus claude max is $400 a month. the free agent plus an $8 kimi key does the same daily work -> that is a 98% cut, built out of openai's own source code, handed to you by the guy suing them here is the part they will fight me on: openai did not lose this to a better model, they lost it to their own license and an enemy with a weekend free. the $200 was never the tool, it was the toll, and musk just put openai's own logo on the road around it drop your $400/mo ai stack to $8. the run above is openai's own agent, rewritten free, doing the job it bills $200 a month for. the full breakdown is in the article below

starmex

111,577 görüntüleme • 1 ay önce