Can Vision-Language Models Solve the Shell Game? paper:

My favorite paper this year: "Video models are zero-shot... learners and reasoners" It illustrates that video models show emergent visual reasoning at scale - they can solve vision tasks they weren't trained for. This may be the "GPT moment" for vision. Let's break it down 👇show more

Scaling laws describe how loss changes with scale. Do... neurons inside models change predictably too? We study vision and language models up to 30B params and find systematic scaling in neuron universality, specialization, and selectivity. Paper+code: 1/nshow more

Automating the Search for Artificial Life with Foundation Models... Presents ASAL, the first use of vision-language models in Artificial Life, discovering diverse, novel simulations across substrates proj: abs:show more

THE VISION PAPER HAS ARRIVED

Introducing ✨ Aya Vision ✨ - an open-weights model... to connect our world through language and vision Aya Vision adds breakthrough multimodal capabilities to our state-of-the-art multilingual 8B and 32B models. 🌿show more

Artificial Intelligence (#AI) models that process and interpret visual... data are called large vision models. These models, like large language models, are trained on large amounts of data. #midjourney #dalle #stablediffusion (1/8) 🧵 ⤵️show more

Congratulations also to Patrick 👍 for his #ICLR paper... on Temporal Difference (TD) learning , in it We solve the decades-old puzzle of why TD can solve complex RL tasks that Gradient Descent cannot.show more

See how Gemini 3 Flash and Vision-Language-Action (VLA) models... work together to teach a robot how to play the board game First Orchard. This project shows how to use Gemini as the “brain” for tracking game rules and state, while the VLA handles complex physical manipulations like picking and placing fruit 🍎show more

Ever wondered how training dynamics differ between LLMs 🖋️... and Vision 👁️ models? We explore this and close the gap between VMs and LLMs in our #NeurIPS2024 paper "TrAct: Making First-layer Pre-Activations Trainable". Paper📜 Video🎥show more

🤖 Does VLA models really listen to language instructions?... Maybe not 👀 🚀 Introducing our RSS paper: CodeDiffuser -- using VLM-generated code to bridge the gap between **high-level language** and **low-level visuomotor policy** 🎮 Try the live demo: (1/9)show more

First look at the Shell in the game

Placing objects sounds simple… until robots have to do... it. This method makes it simple, fast & reliable. [Github ⬇️] Robotic object placement is tough, especially with stacking, hanging, or insertion. AnyPlace is a new two-stage method that uses only synthetic data and a vision-language model to teach robots where and how to place objects; even in the real world. Why this works ✅ Finds the right spot with help from vision-language models ✅ Handles stacking, insertion, and hanging with no real-world training ✅ Trained on synthetic data using Blender and IsaacSim ✅ Works in the real world without fine-tuning It shows that smart use of simulation and language models can make robotic placement tasks easier, faster, and more reliable. Github: Paper: Thank you for sharing Animesh Garg !show more

If can Tesla AI can solve the most infamous... round about in the world in France, they can solve India.show more

The NDA government should solve the issue of NEET... paper leak as soon as possible. When will the NEET paper leak thieves be caught?? #NEETfraud #JusticeforNeet2024Aspirants #NEET_परीक्षा_परिणाम #Neetpaperरद्दकरोshow more

Counting penguins can be challenging 🧐🐧 New in LM... Studio 0.2.9: 🎉 Local & Offline Vision Models! In this demo: the small and impressive Obsidian Vision 3B by Nous Research.show more

that the game. German language difficult language 🤣✌️

Video game: The Simpsons Game Language: Italian

Can you solve the riddle?

#GhostofYotei when it’s raining in-game and you open the... map, you can see the rain droplets hit the paper. attention to detail in this game is outstanding.show more

NO LIDAR, NO RADAR – TESLA BETS EVERYTHING ON... VISION Tesla’s FSD cameras called the future early – just eyes on the road, silicon style! Vision Facts: •⁠ ⁠GPS + passive optical, nothing else in the stack •⁠ ⁠Road system built for cameras, not sci-fi sensors •⁠ ⁠Superhuman driving is possible with vision alone Tesla called it in 2017 – solve vision, solve autonomy! Source: Elon Musk, TED Talks, 2017show more