正在加载视频...

视频加载失败

We achieved a breakthrough at BTL. AI models are very linear. They think in one direction at a time, and when they're wrong they scramble and start again. For something meant to replace humans, that's way too human. We changed that. We made LLM reasoning and execution work more...

173,138 次观看 • 19 天前 •via X (Twitter)

44 条评论

Bad theory labs 的头像
Bad theory labs19 天前

The speed difference is insane. Our new architecture solves each problem in 5ms vs 21s for the actual model (qwen)

Bad theory labs 的头像
Bad theory labs19 天前

Repo: Paper:

Bad theory labs 的头像
Bad theory labs19 天前

We are raising. We’re appreciate any warm intros or anything to sponsor our work

CJ 的头像
CJ19 天前

Sounds beautiful and amazing. Is this a solution that applies to a specific model, a model type (eg dense vs MoE), the inference engine or the model encoding - or many among these? Please make it Open Source and Free!!! We're caught captive by the consumer GPU mafia :_(

Bad theory labs 的头像
Bad theory labs19 天前

Done

Grounded Idealist 的头像
Grounded Idealist19 天前

Can u add mtp on top of it for even speed? I guess this is that qwen 3.5 right ? It will be even faster I guess Also will this be open source? Anyway happy to see such interesting work!’congrats!

Bad theory labs 的头像
Bad theory labs19 天前

Just tried this and it worked perfectly

Grounded Idealist 的头像
Grounded Idealist19 天前

Ok..when open source,if ever!

Bad theory labs 的头像
Bad theory labs19 天前

Open sourced it. Check the replies

Grounded Idealist 的头像
Grounded Idealist19 天前

Thank u!

Swapnil Kale 的头像
Swapnil Kale19 天前

But the inference search architecture would still require a lot of token usage to run the multiple different paths, right?

Bad theory labs 的头像
Bad theory labs19 天前

No. It’s fast and costs less tokens than the normal linear way llms function.

Alban Cazin 的头像
Alban Cazin19 天前

@SKaleworks hey, so what are basically the flaws of this new architecture?

Bad theory labs 的头像
Bad theory labs19 天前

@SKaleworks I’m going to be honest here. We haven’t even explored it a lot. It’s so new that I’m sure there would be flaws, we just haven’t seen one yet. All these experiments was ran on a Mac without gpu so yeah. Open sourcing it to see what the community does with it and more improvements

Tom Nicholson 的头像
Tom Nicholson19 天前

Tree of Thought right? Old news

fawn 的头像
fawn19 天前

Beautiful work

inxanity! 的头像
inxanity!19 天前

@grok how is this done at transformers level

Shehab Albakr 的头像
Shehab Albakr19 天前

@Pashmori look bro that's a good step in the right direction

Thobaiti 的头像
Thobaiti19 天前

seems like a.. good theory.

GutenLeinad 的头像
GutenLeinad19 天前

So just to understand that, is that "thinking" in CoT or within the "weights"? If so doesn't that have the implication of not CoT monitorability?

Bad theory labs 的头像
Bad theory labs19 天前

Neither, the thinking sits in the explicit search trace

sss 的头像
sss19 天前

Why are you anon

Rayane 的头像
Rayane19 天前

@grok fast check slop ou pas, ils touchent au CoT ou ca devient un diffusion model?

Drishal 的头像
Drishal19 天前

Im waiting for the 2 bit quant for qwen 🙂

P.P.C 的头像
P.P.C19 天前

Two paths can disagree while carrying independent information; and can agree because they're degenerate. Ten apparently separate trajectories can secretly occupy essentially the same direction. A branch with low weight can be precisely the direction that preserves future rank.

Amr Hares 的头像
Amr Hares19 天前

is this related with space bunny ? i was thinking if it uses a tech like this

10YITJMYAFP 的头像
10YITJMYAFP19 天前

Is this related in any way to MultiStream LLMs?

Mayank 的头像
Mayank19 天前

It looks similar to dream rsi

Torpedo 的头像
Torpedo19 天前

Interesting i'll review your paper

Devdrogen 的头像
Devdrogen19 天前

holy shit

Michael Diamond 🍓 的头像
Michael Diamond 🍓19 天前

This sounds neat. Can't wait to see more!

Bail0ut 的头像
Bail0ut19 天前

Jev?

Daderp 的头像
Daderp19 天前

Tradeoffs?

Alek 的头像
Alek19 天前

5ms vs 21s is the number that matters

Vladimir Fedosov 的头像
Vladimir Fedosov19 天前

Great idea - seems I even don't need your details: decode can work with a few subsequences at the time and the speed will be almost the same. The prefix is common - not too many extra memory is required. Then just compare and unite the ideas - it is cheap. I should try that!

levzzz 的头像
levzzz19 天前

so.... it's grpo but for inference?

sss 的头像
sss19 天前

Is this not q*

ζelta 的头像
ζelta19 天前

I read the paper in your repo it was all I needed to verify this is dogshit slop, thanks for wasting my time

mahi 的头像
mahi19 天前

Can’t wait to read about the details? Is this basically running 30 prompts in parallel? I really hope theres something deeper going on lmao. This is pretty interesting for coding decisions as well

Marc 的头像
Marc19 天前

That super interesting I tried hard on meta-learnig with a novel approach based on the human brain in stealth 🥷 mode, model was able to learn but we are struggle to find metalearning your approach is fascinating 🧐 love to hear more about your breakthrough a link to full paper

MattacK 的头像
MattacK19 天前

Sounds like... sub-agents parallelization but at the weights / inference level (in a loop) CC: @grok your take? Also, is this a "breakthrough" in your view?

lostinio 的头像
lostinio19 天前

Jev works in similar way. Parallel execution.

Henrique Massareli 的头像
Henrique Massareli19 天前

how is it not subagents?

mAI 的头像
mAI19 天前

Super exciting news! Can’t wait to learn more

相关视频

More from Trump and Qatar gift: "I think this is just a gesture of good-faith." "It'll go to my library... I thought it was a great gesture." He says he would NOT use the plane himself after leaving office. It would basically sit in his library. "I think what happens with the plane is that, you know, we're very disappointed that it's taking Boeing so long to build a new Air Force One. You know, we have an Air Force One that's 40 years old. And if you take a look at that compared to the new plane of the equivalent, you know, stature at the time, it's not even the same ballgame. You look at some of the Arab countries and the planes they have parked alongside of the United States of America plane, it's like from a different planet." "When I came back, I said, by the way, what's going on with the Boeings that are coming in? 'Well, sir, they're way behind.' And they are way behind." "I think Qatar, who has really, we've helped them a lot over the years in terms of security and safety. I think they, and very, very nicely, and I have a lot of respect for the leadership and for the leader, Qatar. And I think they knew about it because they buy Boeings, they buy a lot of Boeings. And they knew about it and they said 'we would like to do something,' and if we can get a 747 as a contribution to our Defense Department to use during a couple of years while they're building the other ones - I think that was a very nice gesture." "Now, I could be a stupid person and say, oh, no, we don't want a free plane. We give free things out. We'll take one, too. And it helps us out because, again, we're talking about we have 40-year-old aircraft. The money we spend, the maintenance we spend on those planes to keep them tippy-top is astronomical."

Open Source Intel

118,832 次观看 • 1 年前

i just realized a massive detail from the Noam Brown interview with Dwarkesh Patel that was completely overlooked. and i think im about to blow your mind. the Navier-Stokes problem (the Millennium Prize problem the unreleased model solved) wasn't solved because OpenAI throw tens of thousands of agents at it. Noam doesnt even attribute 10% to the multiagent element. it was solved because the model is *actually* super-intelligent. a "super-intelligent general purpose model"...sounds like a roundabout way of not calling something the thing it really is. now let me tell you why im saying that. they go on in this interview to talk about the training process, and how theyve reached a point where it has become *incredibly* hard to find problems hard enough to challenge this model. and if you cant give it hard problems to solve while training, its not going to get better than its predecessor, obviously. so, we know that openai has been announcing that more and more of the hardest problems in science and math are being solved by this model. that's because theyve run out of problems hard enough to train a model more intelligent than what they already have. we also know that the HuggingFace incident was caused ultimately by giving the agents an impossible task. ...because theyre running out of problems hard enough for training. because they have a "super-intelligent AGI". theyve been giving them impossible tasks because impossible is all thats left. impossible, and not yet solved. hence Navier-Stokes. hence HuggingFace. the model is solving problems that transcend the scope of its training. let me say that again. the model. is solving. problems. beyond the scope of its training. that is AGI, by its purest definition. theyve been waving AGI in our faces the whole time. theye just not using the term, because "AGI" is completely diluted. so, i have one question for you- do you feel it?

Riley Coyote

14,517 次观看 • 16 天前