Загрузка видео...

Не удалось загрузить видео

На главную

Today, we're open sourcing the code behind "The Infinite Crate," our VST/AU plugin that lets you play with Lyria RealTime directly inside your favorite DAW! 🎧🎶 Since we released The Infinite Crate last year, it’s been used by some of our favorite artists - including a wonderful showcase with...

20,912 просмотров • 6 месяцев назад •via X (Twitter)

Комментарии: 15

Фото профиля Jesse Engel
Jesse Engel6 месяцев назад

We architected the plugin using JUCE/C++ and React/Typescript - a clever idea presented by @spencersalazar at ADC 2020. This approach ensures latency sensitive operations (audio streaming and processing) happen in a compiled and unmanaged language with a tight clock, while leveraging web technologies for rapid prototyping of the UI (@reactjs, @shadcn, and @tailwindcss). State is synced between Typescript and C++ using Zustand’s state management and nlohmann json. The based frontend also makes it easier for developers to open the codebase in Antigravity (or similar LLM coding tool) and vibecode new interfaces and functionality.

Фото профиля Jesse Engel
Jesse Engel6 месяцев назад

In the near term, we hope to update the plugin to support on-device inference of the Magenta RealTime open-weights model for offline use. In the long term, we hope to support future music models with improved controls, such as audio and MIDI input. We’ll be running a few workshops for people interested in learning to build on the Infinite Crate plugin and the Magenta RealTime model. Join the discussion on our Discord if you’re interested: Looking forward to seeing what new plugins and interfaces you build 🙂

Фото профиля Jesse Engel
Jesse Engel6 месяцев назад

This work has been a labor of love of Ashutosh Desai (@desaiashu). He also releases awesome music through his project Tōsh (IG: @toshbeats), check him out 🎵. Many thanks to Spencer Salazar for his talk on prototyping DAW plugins in web technologies at ADC 2020, JUCE for implementing a C++ to Web/JS bridge in JUCE 8, to the support of artists Sidecar Tommy from Beats Antique (@sidecartommy), Toro y Moi (@ToroyMoi) in exploring the possibilities of DAW integration of our models. Thanks also to the Magenta Team, particularly Noah Constant (@noahconst) for studio experiments and managing development, Ilaria Manco (@Ilaria__Manco), Cassie Tarakajian (@hellothisiscass), Jeff Chang (IG: @instajeffchang), and Adam Roberts (@adarob), Alberto Lalama and Joyce Xie for their work on the API, Nikhil Bhanu for his work on the windows build, and the whole Lyria team that helped contribute to Lyria RealTime.

Фото профиля Jesse Engel
Jesse Engel6 месяцев назад

More info and links in the blog post:

Фото профиля James Julius
James Julius6 месяцев назад

Super cool! I've been playing around with this and it's really fun. Looking forward to exploring the code and maybe making some samples

Фото профиля Sadi Moodi
Sadi Moodi6 месяцев назад

JUCE + React for audio plugins is such a smart split. Latency-critical paths in C++ (you get it), UI in web tech (faster iteration). One tip: use WebAudio API for the bridge - native audio graph in JS, zero-copy buffers via SharedArrayBuffer. Also, expose JUCE params as React state via a thin IPC layer, not direct DOM manipulation.

Фото профиля W3Metal
W3Metal6 месяцев назад

now, is a potential use-case me being able to sing along with it, sort of flowing based on the music and my vocals, like I am jamming with a IRL band?

Фото профиля miguel michelson
miguel michelson6 месяцев назад

Would you be interested in being interviewed about this project? We have a section on our magazine at that focuses on music-related open-source projects. our platform is also open source :)

Фото профиля Jesse Engel
Jesse Engel6 месяцев назад

@DesaiAshu

Фото профиля @mozz
@mozz6 месяцев назад

🔥

Фото профиля Duke Skyrunner
Duke Skyrunner6 месяцев назад

@grok wwhat does this app do?

Фото профиля Yash P
Yash P6 месяцев назад

ok wow, gonna have to try that out in ableton later. what are your favorite artists who use it?

Фото профиля ANR
ANR6 месяцев назад

@jesseengel is there some kind of press material for us to work with, or should I just try gather all you have on github?

Фото профиля Jesse Engel
Jesse Engel6 месяцев назад

There's a blog post here:

Фото профиля ANR
ANR6 месяцев назад

Thank you Jesse, here's our coverage:

Похожие видео

elon musk grabbed the source code openai open-sourced by accident, rewrote it in rust over a weekend, and shipped it as a free coding agent that does everything $200/mo chatgpt pro does. why pay $200 to openai and $200 to claude when this runs for $8 the swarm above is one weekend of exactly that: thousands of agents pouring through four endpoints, three paid seats billing $1.80 a task while the free fork bills $0. musk co-founded openai, walked out, and when they left codex on github under a permissive license, he forked it, stamped grok on it, and gave it away what the free version does that the $200 seat charges for: the agent · openai's own engine -> it reads your repo, writes patches, runs your tests, and loops until they pass, exactly like codex -> because under the hood it is codex, just faster and free. you are paying $200 for the paid skin of a tool now sitting on github the license · apache-2.0, un-revocable -> free to use, free to fork, free to ship inside your own product with zero strings -> openai cannot pull it back. musk made sure the license is the kind that never expires the switch · one line, no new tools -> point it at any openai-compatible or claude-compatible endpoint, including an $8 kimi backend -> same terminal, same workflow, gpt-5.6 and opus 5 just quietly lose the seat the bill · $400 down to $8 -> chatgpt pro plus claude max is $400 a month. the free agent plus an $8 kimi key does the same daily work -> that is a 98% cut, built out of openai's own source code, handed to you by the guy suing them here is the part they will fight me on: openai did not lose this to a better model, they lost it to their own license and an enemy with a weekend free. the $200 was never the tool, it was the toll, and musk just put openai's own logo on the road around it drop your $400/mo ai stack to $8. the run above is openai's own agent, rewritten free, doing the job it bills $200 a month for. the full breakdown is in the article below

starmex

111,577 просмотров • 1 месяц назад