Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Our infra lets us steer trillion-parameter frontier models in real time: - live, mid-CoT edits to internal activations - directly altering how the model reasons (not just outputs) - stackable edits - no added latency We can make models more Gen Z, more concise, etc.

Goodfire

25,743 subscribers

29,603 views • 7 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Pocket TTS goes multilingual! Now you can use our 100M-parameter models to generate speech in six languages, fast enough to run real-time without a GPU. We also improved the quality of the English model while keeping the same size. And all of this is open-source.

Pocket TTS goes multilingual! Now you can use our 100M-parameter models to generate speech in six languages, fast enough to run real-time without a GPU. We also improved the quality of the English model while keeping the same size. And all of this is open-source.

kyutai

29,601 views • 2 months ago

🚀 Our "technical" marketer might not be looped in, but today is our biggest launch day yet. We're introducing two new products to serve the inference lifecycle: Model APIs and Training. Model APIs are frontier models running on the Baseten Inference Stack, purpose-built for production. Baseten Training (Beta) provides infra and tooling without limitations for AI models destined for production. Huge shoutout to the many partners and customers we've worked with as we built these two new products—more details below.

🚀 Our "technical" marketer might not be looped in, but today is our biggest launch day yet. We're introducing two new products to serve the inference lifecycle: Model APIs and Training. Model APIs are frontier models running on the Baseten Inference Stack, purpose-built for production. Baseten Training (Beta) provides infra and tooling without limitations for AI models destined for production. Huge shoutout to the many partners and customers we've worked with as we built these two new products—more details below.

Baseten

35,207 views • 1 year ago

Adobe + Topaz Labs 🤝🙌 Just announced—you can now access select Topaz models directly in Photoshop inside your workflow. We’ve been working hard to make this happen, and now we get to share it. 🙌It's all live in Photoshop right now. See the thread for more details.

Adobe + Topaz Labs 🤝🙌 Just announced—you can now access select Topaz models directly in Photoshop inside your workflow. We’ve been working hard to make this happen, and now we get to share it. 🙌It's all live in Photoshop right now. See the thread for more details.

Topaz Labs

53,155 views • 9 months ago

At Cohere we deploy our models directly to our customers, instead of them sending data to us. It makes our job harder, but their business more secure: “When you’re using a consumer app, they are using the data you’re putting in there, training on it, all the time” - Nick Frosst

At Cohere we deploy our models directly to our customers, instead of them sending data to us. It makes our job harder, but their business more secure: “When you’re using a consumer app, they are using the data you’re putting in there, training on it, all the time” - Nick Frosst

Cohere

10,460 views • 22 days ago

The more AI can do, the more we need to ask what it should and shouldn’t do. OpenAI researcher Jason Wolfe joins host Andrew Mayne to explore the Model Spec, the public framework that defines how models are intended to behave. They break down how it works in practice, from the chain of command that resolves conflicting instructions to the way it evolves over time through real-world use, feedback, and new model capabilities.

The more AI can do, the more we need to ask what it should and shouldn’t do. OpenAI researcher Jason Wolfe joins host Andrew Mayne to explore the Model Spec, the public framework that defines how models are intended to behave. They break down how it works in practice, from the chain of command that resolves conflicting instructions to the way it evolves over time through real-world use, feedback, and new model capabilities.

OpenAI

225,477 views • 4 months ago

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models paper page: github: Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However, these models still encounter difficulties when generating images from prompts that demand spatial or common sense reasoning. We propose to equip diffusion models with enhanced reasoning capabilities by using off-the-shelf pretrained large language models (LLMs) in a novel two-stage generation process. First, we adapt an LLM to be a text-guided layout generator through in-context learning. When provided with an image prompt, an LLM outputs a scene layout in the form of bounding boxes along with corresponding individual descriptions. Second, we steer a diffusion model with a novel controller to generate images conditioned on the layout. Both stages utilize frozen pretrained models without any LLM or diffusion model parameter optimization. We validate the superiority of our design by demonstrating its ability to outperform the base diffusion model in accurately generating images according to prompts that necessitate both language and spatial reasoning. Additionally, our method naturally allows dialog-based scene specification and is able to handle prompts in a language that is not well-supported by the underlying diffusion model.

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models paper page: github: Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However, these models still encounter difficulties when generating images from prompts that demand spatial or common sense reasoning. We propose to equip diffusion models with enhanced reasoning capabilities by using off-the-shelf pretrained large language models (LLMs) in a novel two-stage generation process. First, we adapt an LLM to be a text-guided layout generator through in-context learning. When provided with an image prompt, an LLM outputs a scene layout in the form of bounding boxes along with corresponding individual descriptions. Second, we steer a diffusion model with a novel controller to generate images conditioned on the layout. Both stages utilize frozen pretrained models without any LLM or diffusion model parameter optimization. We validate the superiority of our design by demonstrating its ability to outperform the base diffusion model in accurately generating images according to prompts that necessitate both language and spatial reasoning. Additionally, our method naturally allows dialog-based scene specification and is able to handle prompts in a language that is not well-supported by the underlying diffusion model.

AK

83,657 views • 3 years ago

Speech-native models like Moshi sound great and answer fast, but aren’t as smart as text LLMs. In our new paper, MoshiRAG, we show how Moshi can ask for advice from a text LLM or a knowledge base. The tricky part is how to do this in real time without adding latency. 🧵

Speech-native models like Moshi sound great and answer fast, but aren’t as smart as text LLMs. In our new paper, MoshiRAG, we show how Moshi can ask for advice from a text LLM or a knowledge base. The tricky part is how to do this in real time without adding latency. 🧵

kyutai

53,003 views • 2 months ago

Introducing OpenVenice — an open-source, customizable frontend for Venice. Your API key stays in your browser, talks directly to Venice. No server, no backend. - Chat, image gen, audio, music, video, embeddings — everything venice offers in one clean UI - Visual workflows — chain models together (vision → LLM → image gen -> video gen). Venice is multimodal so you can build some really powerful workflows - Full control over every model parameter - Runs locally, deploys anywhere — zero infrastructure I'm a $DIEM holder and heavy Venice user. The models are solid and website is great but I kept wanting more freedom with the UX — more control, custom tools, being able to give it access to my local computer, multimodal chaining -- something I could shape to how I actually work. Didn't exist, so I built it. Feel free to fork and make it yours. Open source, MIT licensed.

Introducing OpenVenice — an open-source, customizable frontend for Venice. Your API key stays in your browser, talks directly to Venice. No server, no backend. - Chat, image gen, audio, music, video, embeddings — everything venice offers in one clean UI - Visual workflows — chain models together (vision → LLM → image gen -> video gen). Venice is multimodal so you can build some really powerful workflows - Full control over every model parameter - Runs locally, deploys anywhere — zero infrastructure I'm a $DIEM holder and heavy Venice user. The models are solid and website is great but I kept wanting more freedom with the UX — more control, custom tools, being able to give it access to my local computer, multimodal chaining -- something I could shape to how I actually work. Didn't exist, so I built it. Feel free to fork and make it yours. Open source, MIT licensed.

nikshep

40,500 views • 4 months ago

We are opening up the beta of our new AI writing tool to Exclusive Models. If you're exclusive to JFF, try it out and let us know your thoughts. At our Anniversary Conference, lots of models said they needed help making their posts more creative. This is a tool to help models take what they write and help them make better posts. Does this replace a human? No! In fact, if you are an erotic writer, apply to be in our Business Directory so models can hire you to help them out!

Sensitive content

We are opening up the beta of our new AI writing tool to Exclusive Models. If you're exclusive to JFF, try it out and let us know your thoughts. At our Anniversary Conference, lots of models said they needed help making their posts more creative. This is a tool to help models take what they write and help them make better posts. Does this replace a human? No! In fact, if you are an erotic writer, apply to be in our Business Directory so models can hire you to help them out!

JustForFans

15,325 views • 3 years ago

Decart just dropped Lucy 2.5 and it completely changes what live video can do. This is their Live AI model that edits video as it streams, no post production needed. > add, replace, or remove anything mid stream > restyle entire scenes on the fly > generate realtime VFX with a single prompt > better prompt adherence and more realism than before > already live across streaming, e-commerce, and advertising We are officially in the era where AI does not just generate video, it directs it live.

Decart just dropped Lucy 2.5 and it completely changes what live video can do. This is their Live AI model that edits video as it streams, no post production needed. > add, replace, or remove anything mid stream > restyle entire scenes on the fly > generate realtime VFX with a single prompt > better prompt adherence and more realism than before > already live across streaming, e-commerce, and advertising We are officially in the era where AI does not just generate video, it directs it live.

Abdul Șhakoor

204,912 views • 9 days ago

From Palantir and Two Sigma to turning mechanistic interpretability into a production-grade platform, Mark Bissell (Member of Technical Staff) and Myra Deng (Head of Product) are building Goodfire on the belief that “understanding what’s inside the model” is the path to safer, more controllable AI and Goodfire just raised a $150M Series B at a $1.25B valuation to scale that bet. We sat down with Mark and Myra to unpack what actionable interpretability looks like beyond demos: why SAE features can lose to raw-activation probes on real detection tasks, how they deployed token-level PII monitoring with Rakuten across English + Japanese without training on real customer data, and what it takes to do real-time steering on a trillion-parameter model (including the infamous Gen-Z feature). We also dig into hallucination detection, surgical post-training edits for bias/unlearning, the emerging equivalence between activation steering and in-context learning, and their push to bring interpretability into training so model development isn’t just “data in, weights out.” Goodfire mark bissell Myra Deng

From Palantir and Two Sigma to turning mechanistic interpretability into a production-grade platform, Mark Bissell (Member of Technical Staff) and Myra Deng (Head of Product) are building Goodfire on the belief that “understanding what’s inside the model” is the path to safer, more controllable AI and Goodfire just raised a $150M Series B at a $1.25B valuation to scale that bet. We sat down with Mark and Myra to unpack what actionable interpretability looks like beyond demos: why SAE features can lose to raw-activation probes on real detection tasks, how they deployed token-level PII monitoring with Rakuten across English + Japanese without training on real customer data, and what it takes to do real-time steering on a trillion-parameter model (including the infamous Gen-Z feature). We also dig into hallucination detection, surgical post-training edits for bias/unlearning, the emerging equivalence between activation steering and in-context learning, and their push to bring interpretability into training so model development isn’t just “data in, weights out.” Goodfire mark bissell Myra Deng

Latent.Space

19,389 views • 5 months ago

Too many blockchain infra providers run in the cloud or on rented servers That's a problem is built different 3 reasons why you want to work with us: 1) Best in class, enterprise grade bare metal, all fully owned 2) SOC 2 Type II certified--not just the data centers, but our own internal team 3) Optimized performance on our infra for your staked assets Curious to learn more? Check out the video and short overview thread below!

Too many blockchain infra providers run in the cloud or on rented servers That's a problem is built different 3 reasons why you want to work with us: 1) Best in class, enterprise grade bare metal, all fully owned 2) SOC 2 Type II certified--not just the data centers, but our own internal team 3) Optimized performance on our infra for your staked assets Curious to learn more? Check out the video and short overview thread below!

Phunky (Ryan) 🌎🥩

32,792 views • 1 year ago

This is wild. Seedream 5.0 Lite just landed on HailuoAI and it’s lowkey a creative weapon. Here’s what makes it different: → Precise edits that actually listen → Full control over outputs (no more “why did it change that?”) → Lock consistency with up to 14 reference images → Reasons across text + image like it has context, not vibes → Turns messy notes into pro-level visuals → Batch generate without losing your style Most image models give you cool outputs. This one gives you control. And if you’re a Hailuo Member? 365 days unlimited. No credit anxiety. Just build. #Hailuo

This is wild. Seedream 5.0 Lite just landed on HailuoAI and it’s lowkey a creative weapon. Here’s what makes it different: → Precise edits that actually listen → Full control over outputs (no more “why did it change that?”) → Lock consistency with up to 14 reference images → Reasons across text + image like it has context, not vibes → Turns messy notes into pro-level visuals → Batch generate without losing your style Most image models give you cool outputs. This one gives you control. And if you’re a Hailuo Member? 365 days unlimited. No credit anxiety. Just build. #Hailuo

Hasan Toor

59,603 views • 4 months ago

Exa CEO Will Bryk explains why retrieval can help solve the tokenpocalypse: "We should not be using gigantic models for every task." "You should use a family of models of different sizes. The big model decides what to do, and it dishes out commands to the small models, and those small models can be way more accurate and reliable if they're using retrieval." "Retrieval helps small models act like big models... We do save our customers a huge amount of tokens because they can use smaller models and use retrieval." "We could save 20x on cost for customers compared to other providers by being very efficient in what information from the web the agent actually sees." Will Bryk with Sarah Wang

Exa CEO Will Bryk explains why retrieval can help solve the tokenpocalypse: "We should not be using gigantic models for every task." "You should use a family of models of different sizes. The big model decides what to do, and it dishes out commands to the small models, and those small models can be way more accurate and reliable if they're using retrieval." "Retrieval helps small models act like big models... We do save our customers a huge amount of tokens because they can use smaller models and use retrieval." "We could save 20x on cost for customers compared to other providers by being very efficient in what information from the web the agent actually sees." Will Bryk with Sarah Wang

a16z

25,144 views • 1 month ago

Day 18 — back in the 6ix. Drake doesn’t just have to edge out Jay-Z at $2.5B… he can shatter it. 💥 The path? Not more hits. Not more tours. 📀 It’s stocks. 📈 Here’s how we make the 6 produce the world’s richest rapper. $OPEN 🚪🚀

Day 18 — back in the 6ix. Drake doesn’t just have to edge out Jay-Z at $2.5B… he can shatter it. 💥 The path? Not more hits. Not more tours. 📀 It’s stocks. 📈 Here’s how we make the 6 produce the world’s richest rapper. $OPEN 🚪🚀

Eric Jackson

53,291 views • 10 months ago

Washington has meddled in our elections for far too long. South Dakota doesn’t need any more DC insiders telling us how to live our lives. We need real South Dakota leaders who will represent the people, NOT the powerful.

Washington has meddled in our elections for far too long. South Dakota doesn’t need any more DC insiders telling us how to live our lives. We need real South Dakota leaders who will represent the people, NOT the powerful.

Toby Doeden

42,916 views • 1 year ago

Revolutionizing Move Programming with OpenLedger In this demo, we showcase how Move datasets contributed by data providers to OpenLedger’s datanets are used to fine-tune specialized models with LoRA fine-tuning. As seen in the video, we showcase an example on how builders can deploy a Move-specialized model that powers Co-pilot agents using our no-code model fine-tuning platform. This is the future of AI and Web3 innovation. Watch this space to see more specialised models and data feeds being built for next generation agents on top of OpenLedger #Move

Revolutionizing Move Programming with OpenLedger In this demo, we showcase how Move datasets contributed by data providers to OpenLedger’s datanets are used to fine-tune specialized models with LoRA fine-tuning. As seen in the video, we showcase an example on how builders can deploy a Move-specialized model that powers Co-pilot agents using our no-code model fine-tuning platform. This is the future of AI and Web3 innovation. Watch this space to see more specialised models and data feeds being built for next generation agents on top of OpenLedger #Move

OpenLedger

61,662 views • 1 year ago

NVIDIA CEO: GROK 5 IS A 7 TRILLION PARAMETER RACE AGAINST TIME Jensen Huang is dialing in on the real challenge: not making bigger models, but training them fast without draining power or budgets. Grok 5 is right in the middle of that race. “The next frontier model. Elon already mentioned that the next version of Grok, Grok 5 I believe, is 7 trillion parameters. This one is 10, and the green represents Blackwell. In the case of Rubin, notice that the throughput is much higher, so it only takes one fourth as many of these systems to train the model within the one-month timeframe we have given here.” Source: Rohan Paul

NVIDIA CEO: GROK 5 IS A 7 TRILLION PARAMETER RACE AGAINST TIME Jensen Huang is dialing in on the real challenge: not making bigger models, but training them fast without draining power or budgets. Grok 5 is right in the middle of that race. “The next frontier model. Elon already mentioned that the next version of Grok, Grok 5 I believe, is 7 trillion parameters. This one is 10, and the green represents Blackwell. In the case of Rubin, notice that the throughput is much higher, so it only takes one fourth as many of these systems to train the model within the one-month timeframe we have given here.” Source: Rohan Paul

Mario Nawfal

76,356 views • 6 months ago

Have you peeped the latest Model Playground update on our serverless inference service? We upgraded our UI so you can test and iterate on models with zero setup. Toggle live updates to see real-time API behavior. Adjust input parameters with full visibility. > Copy-ready requests in Python, TypeScript, cURL, and Gradio > Works across text, vision, image, and audio models > Built on top of the Vercel AI SDK

Have you peeped the latest Model Playground update on our serverless inference service? We upgraded our UI so you can test and iterate on models with zero setup. Toggle live updates to see real-time API behavior. Adjust input parameters with full visibility. > Copy-ready requests in Python, TypeScript, cURL, and Gradio > Works across text, vision, image, and audio models > Built on top of the Vercel AI SDK

Hyperbolic

12,919 views • 1 year ago

This is the most realistic voice cloning I’ve ever heard. It captures voice, emotion, speaking style, and even your rhythm. Powered by EVI 3, Hume’s next-gen speech-to-speech model that: ➔ Streams your speech → replies in real-time ➔ Understands tone and context ➔ Adapts emotion on cue (“whisper fearfully,” “sound excited”) Try it now: 🔗 (live demo, no prompt edits) 🔗 (customize voices, integrate with LLMs) You can even integrate it with top AI models like Groq, Anthropic, and DeepSeek 👇 Talk to the voice I cloned here:

This is the most realistic voice cloning I’ve ever heard. It captures voice, emotion, speaking style, and even your rhythm. Powered by EVI 3, Hume’s next-gen speech-to-speech model that: ➔ Streams your speech → replies in real-time ➔ Understands tone and context ➔ Adapts emotion on cue (“whisper fearfully,” “sound excited”) Try it now: 🔗 (live demo, no prompt edits) 🔗 (customize voices, integrate with LLMs) You can even integrate it with top AI models like Groq, Anthropic, and DeepSeek 👇 Talk to the voice I cloned here:

Ali Sufian

15,063 views • 1 year ago