Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing Flow Reasoning Models. We developed a recurrent flow-based architecture to efficiently solve structured reasoning problems (e.g., Sudoku). FRMs apply continuous flows to discrete data and recurrently refine their past mistakes through self-conditioning.

129,816 Aufrufe • vor 1 Monat •via X (Twitter)

46 Kommentare

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

FRMs are dramatically more efficient at inference than competing methods like HRM, TRM, and masked diffusion. On Sudoku-Extreme, FRMs match the next best method EqR’s 98.7% solve rate with 44× fewer FLOPs and reach a higher 99.5% peak accuracy.

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

Unlike conventional self-conditioning training, we apply multiple recurrent passes to the self-conditioned flow. This mitigates exposure bias in the self-conditioned carry state and dramatically improves performance (e.g., Sudoku-Extreme goes from ~30% to 99%).

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

Flow Reasoning Models admit a surprisingly elegant dynamical-systems perspective. Correct answers are fixed-point attractors of the self-conditioned flow’s dynamics.

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

Link to paper here:

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

Code coming soon:

Profilbild von KyberNuII
KyberNuIIvor 1 Monat

So basically with Flow Matching

Profilbild von λux
λuxvor 1 Monat

@nopainkiller waow this is really cool research direction!

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

@nopainkiller Ty ty!

Profilbild von AI Quanting
AI Quantingvor 1 Monat

honestly the 30 to 99 ablation is more interesting than the 44x. training on the messy states the model actually hits at inference instead of clean ones is the scheduled sampling idea again, and it looks like thats doing more of the work than the flow part

Profilbild von Stefano Martiniani
Stefano Martinianivor 1 Monat

Cool, seems related to

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

Nice! I'll check it out.

Profilbild von Stefano Martiniani
Stefano Martinianivor 1 Monat

Someone on your team came across it, we just realized it was cited in v1, alongside Biroli and Mezard's work which is also related (you can find more relevant citations in our paper). Wyart also looked at cycling diffusion around the same time as us arXiv:2605.27006

Profilbild von Manuel Brack
Manuel Brackvor 1 Monat

Alec really does have the most pleasing visuals for his work.

Profilbild von Antonio Valerio Miceli Barone
Antonio Valerio Miceli Baronevor 1 Monat

Ouch, scooped. Good work.

Profilbild von Raymond Weitekamp
Raymond Weitekampvor 1 Monat

looks very interesting! can't wait to see the code!

Profilbild von Gregor
Gregorvor 1 Monat

When you say self-conditioning, is it conditioning on previous logits or on a decoded discrete sample at each recurrent step?

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

Good question. We condition on the previous logits rather than the decoded sample. These logits retain valuable information.

Profilbild von YingTangLab
YingTangLabvor 1 Monat

Great work! I wonder how FRM compares to ERM, which also reaches peak accuracy, given that their names happen to be very close😃

Profilbild von parthak ✧
parthak ✧vor 1 Monat

Woww amazing

Profilbild von Zhihan Yang
Zhihan Yangvor 1 Monat

What is the "Adaptive MDLM" used in this work? Is this the top-probability-margin sampler from Kim et al?

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

Yep!

Profilbild von Sonnen
Sonnenvor 1 Monat

Nice

Profilbild von bill
billvor 1 Monat

Coll

Profilbild von Kneeanderthul
Kneeanderthulvor 1 Monat

Nice nice!!! Did something similar with a heavy harness and a SLM Tower of Hanoi at 100 disk Congratulations on the release

Profilbild von (((Palee)))
(((Palee)))vor 1 Monat

This is really cool!

Profilbild von ORQANTA
ORQANTAvor 1 Monat

perfect!

Profilbild von Günter Klambauer
Günter Klambauervor 1 Monat

Great visualization! Since you seem to be aware of HRM, TRM, EqR, please also check SE-RRM ( , ICML2026)

Profilbild von Nathan Kochera
Nathan Kocheravor 1 Monat

Excited to take a look at the paper. Congrats!

Profilbild von Cyan Ding
Cyan Dingvor 1 Monat

very cool work!

Profilbild von Arnas Uselis
Arnas Uselisvor 1 Monat

Very cool!! How does it compare to ELF (language flows) conceptually? (Apart from the fact that this isn't language-based)

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

Thanks! The core difference is that ELF operates no embeddings of tokens from some external encoder (like T5). In our setting, we use a one hot encoding similar to Flow Language Models. This makes sense for problems like sudoku where digits are interchangeable and there is no inherent semantics differentiating the different vocabulary elements.

Profilbild von Shaurya
Shauryavor 1 Monat

Intresting if this is so fast in inference can we distill large models after training into FRMs?

Profilbild von snow
snowvor 1 Monat

Is it generalized or only works for sudoku problem ? Did you try other richer problems ?

Profilbild von Immanuel Kan’t
Immanuel Kan’tvor 1 Monat

@adamnemecek1 is this Energy Based Model?

Profilbild von Formiga
Formigavor 1 Monat

Where do you see this going when dealing with continuous problem such as robotics policies?

Profilbild von Lord of the Mountains
Lord of the Mountainsvor 1 Monat

Can you describe the residual in your DiT? I'm waiting for you code to drop so I understand what happened there. I'm comparing to which fully depends on carrying the hidden state.

Profilbild von Alec Helbling
Alec Helblingvor 1 Monat

We take the logits, the un-decoded output, of the last denoising pass as an additional conditioning signal.

Profilbild von Lord of the Mountains
Lord of the Mountainsvor 1 Monat

Just finished testing FRM, Stage A -> Stage B (FPF), I found that it starts with some degradation before it picks back up. Carried information mechanism doesn't appear to deliver (self-conditioning on the model's own predictions). Now just waiting for you code to confirm diff

Profilbild von Talgat Daulbaev
Talgat Daulbaevvor 1 Monat

Hi! Have you run any experiments on ARC-AGI?

Profilbild von Ankush Singal
Ankush Singalvor 1 Monat

Wrote an article on it Flow Reasoning Models: Turning Flows Into Efficient Recurrent Reasoners

Profilbild von Juan Pablo Gallego
Juan Pablo Gallegovor 1 Monat

Beautiful! Have you considered using FPF’s convergence signal as a learned per-token error/value-of-compute map? you could halt easy cases, refine unresolved regions, and replay confidently wrong low residual states? It could make recurrence both adaptive and locally targeted.

Profilbild von ♠️🗝♦️Omicron's Domain♣️🧩❤️
♠️🗝♦️Omicron's Domain♣️🧩❤️vor 1 Monat

What does the edge it's following represent?

Profilbild von Arnaud Deza
Arnaud Dezavor 1 Monat

Wow! Have you tested any other discrete optimization problem than sudoku? I.e doing this for maxcut or vertex cover etc I.e neural combinatorial optimization

Profilbild von TTD 🇮🇩
TTD 🇮🇩vor 1 Monat

Agreed

Profilbild von Oliver S
Oliver Svor 1 Monat

Great research! The self-conditioning loop mirrors how good science works: propose, verify, falsify, refine. Love seeing that built into the architecture itself! Any plans to test it beyond Sudoku?

Profilbild von Sanket Desai
Sanket Desaivor 1 Monat

I built these last month lmao. Nice research. Did you check out the block version of this?

Ähnliche Videos

Check out our #PAMI paper with code "Dense Continuous-Time Optical Flow from Event Cameras," where we show how to regress *continuous-time* trajectories of every pixel from event cameras alone or events plus frames! The key idea is to iteratively estimate per-pixel polynomials using a recurrent lookup and update scheme. Paper: Code: DOI: We present a method for estimating dense continuous-time optical flow from event data. Traditional dense optical flow methods compute the pixel displacement between two images. Due to missing information, these approaches cannot recover the pixel trajectories in the blind time between two images. We show that it is possible to compute per-pixel, continuous-time optical flow using events from an event camera. Events provide temporally fine-grained information about movement in pixel space due to their asynchronous nature and microsecond response time. We leverage these benefits to predict pixel trajectories densely in continuous time via parameterized Bézier curves. To achieve this, we build a neural network with strong inductive biases for this task: First, we build multiple sequential correlation volumes in time using event data. Second, we use Bézier curves to index these correlation volumes at multiple timestamps along the trajectory. Third, we use the retrieved correlation to update the Bézier curve representations iteratively. Our method can optionally include image pairs to boost performance further. To train and evaluate our model, we introduce a synthetic dataset (MultiFlow) that features moving objects and ground truth trajectories for every pixel. Our quantitative experiments suggest that our method successfully predicts pixel trajectories in continuous time and is competitive in the traditional two-view pixel displacement metric on MultiFlow and DSEC-Flow. Open source code and datasets are released to the public. Kudos to Mathias Gehrig Manasi Muglikar

Davide Scaramuzza

12,692 Aufrufe • vor 2 Jahren