🚨How do LLMs acquire human values?🤔 We often point... to preference optimization. However, in our new work, we trace how and when model values shift during post-training and uncover surprising dynamics. We ask: How do data, algorithms, and their interaction shape model values?🧵show more

Diffusions are excellent in creating fantastic images and videos... 🔎 We cooked a *diffusion* model to synthesize structured data #ICLR2025 🔥 Introducing TabDiff, a mixed-type diffusion model for generating synthetic tabular data, imputing missing values, and beyond! 🧵 1/nshow more

To build Heaviside, our foundation model for EM, we... needed to collect a huge amount of data from traditional FEM simulations of electronic devices. Early on, we ran into a surprisingly basic question: once an FEM solver finishes running its simulation, how do we extract electromagnetic field values from the solution? Here’s Chris Bryant’s interactive explainer on we learned:show more

Ever wondered how training dynamics differ between LLMs 🖋️... and Vision 👁️ models? We explore this and close the gap between VMs and LLMs in our #NeurIPS2024 paper "TrAct: Making First-layer Pre-Activations Trainable". Paper📜 Video🎥show more

When will this 𝗧𝗶𝗸𝗧𝗼𝗸𝗶𝗳𝗶𝗰𝗮𝘁𝗶𝗼𝗻 of Pakistan finally stop, or... will it eventually engulf our entire social, cultural, religious, and traditional values and ethics? It is increasingly becoming a platform for promoting indecency and vulgarity, all in the pursuit of views, attention, and virality. How long will we continue to normalize this erosion of our values in the name of entertainment and social media fame?show more

Grasps are one of the primary ways in which... we interact with and shape our environments. How can we faithfully capture human grasps with details such as hand/object shape and contact points? At #CVPR2026, we present MANUS, a method to accurately reconstruct grasps and contacts. 🧵show more

Living in harmony and respecting each other are good... behaviors and values💞👍👍👍🙏Are you agree with me🤔 How we can call this behavior from this 👇👇 movie 🎥🤔show more

Republicans are attacking our democracy. This is how we... chose to respond. California will not sit idle as they shred our democracy. We hope other states join us in defending our democratic values and the voices of voters all across this country.show more

How robust can model predictive control be if we... can solve each trajectory optimization to global optimality? On the contact-rich push-T problem, we show that model-based global optimization is so robust that it never fails, even if the model is not even correct! We achieve global optimality via sparse Moment and SOS relaxations. -- Yes, we managed to solve SDPs online on a robot. Amazing work by Shucheng Kang and Guorui Liu.show more

Coarse2Real (C2R) transfers simple 3D renderings into realistic style... video. Check our paper and project page to learn how to hedge small amount of synthetic paired data with real non-pair data for training the C2R model. We will release the model soon!show more

We built an AI model to simulate how a... fruit fly walks, flies and behaves – in partnership with HHMI | Janelia. 🪰 Our computerized insect replicates realistic motion, and can even use its eyes to control its actions. Here’s how we developed it – and what it means for science. 🧵show more

Dear Africa, I still ask today: why are we... keeping European borders and these tiny, unviable countries? How do we control our resources when we are so fragmented and divided? How do tiny countries of 3 or 5 or 10 or even 50 million negotiate anything successful against others?show more

His Highness محمد بن زايد “I call on everyone... to abide by values of peace and stability and cooperation” This is our leader… this is how we operate… these values have been instilled into our very fabric as a nation. Now it’s time for the rest of the world to take the UAE as THE blueprint to a successful nation locally and globally.show more

When I look at Jimmy Carter, I see a... man not only for our times, but for all times. A man who embodied the most fundamental human values we can never let slip away. And while we may never see his likes again, we would all do well to try to be a little more like Jimmy Carter.show more

New work: The Value Axis 🎯 How do LLMs... choose which path to take mid-task? We find they internally track the chance of reaching their goal along a linear axis, akin to a value function in RL. We show it modulates confidence in math & coding and can be reshaped with DPO and SFT.show more

Disinformation isn't new; it's part of human history. Our... tendency to believe what we want to believe is now amplified by technology. How do we combat this growing threat to democracy and society? Learn more: #wef25show more

President Trump on Iran: “We killed all their leadership.... And then they met to choose new leaders, and we killed all of them. And now we have a new group and we can easily do that. But let’s see how they turn out.” Most based POTUS in history.show more

We trained our Large Sensor Model (LSM) on over... 40 million hours of de-identified multimodal sensor data from 165K users to demonstrate how it could improve performance in wearable tasks like exercise and activity recognition. Here’s what we found →show more

Very good meeting with Prime Minister Shehbaz Sharif at... #UNGA. The EU values its partnership with Pakistan. Our Strategic Engagement Plan reflects both the breadth of this partnership and the shared commitment to democracy, the rule of law, human rights and civic space. We work together on stability and security. We thanked the Prime Minister for his initiative to mediate in the conflict between the US and Iran. Pakistan is playing an important role in support of de-escalation, dialogue and peaceful resolution of conflicts. We discussed how to take our partnership forward, from trade to addressing illegal migration.show more

"How do we define "good and evil", or rather,... what are their measures? Do their definitions change over time? What is the root cause of these phenomena and how did they form in our world?" - Zafar Mirzo Zafar Mirzoshow more