正在加载视频...

视频加载失败

Mistral AI Releases Robostral Navigate: An 8B Model Enabling Robots to Navigate Complex Environments Hitting 76.6% on R2R-CE With One RGB Camera. No LiDAR. No depth sensor. No multi-camera rig. Here's how it works. 👇 1. Pointing, not metric commands The model predicts the pixel coordinates of the next...

39,955 次观看 • 1 个月前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

New Course: Post-training of LLMs Learn to post-train and customize an LLM in this short course, taught by Banghua Zhu, Assistant Professor at the University of Washington University of Washington, and co-founder of @NexusflowX. Training an LLM to follow instructions or answer questions has two key stages: pre-training and post-training. In pre-training, it learns to predict the next word or token from large amounts of unlabeled text. In post-training, it learns useful behaviors such as following instructions, tool use, and reasoning. Post-training transforms a general-purpose token predictor—trained on trillions of unlabeled text tokens—into an assistant that follows instructions and performs specific tasks. Because it is much cheaper than pre-training, it is practical for many more teams to incorporate post-training methods into their workflows than pre-training. In this course, you’ll learn three common post-training methods—Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL)—and how to use each one effectively. With SFT, you train the model on pairs of input and ideal output responses. With DPO, you provide both a preferred (chosen) and a less preferred (rejected) response and train the model to favor the preferred output. With RL, the model generates an output, receives a reward score based on human or automated feedback, and updates the model to improve performance. You’ll learn the basic concepts, common use cases, and principles for curating high-quality data for effective training. Through hands-on labs, you’ll download a pre-trained model from Hugging Face and post-train it using SFT, DPO, and RL to see how each technique shapes model behavior. In detail, you’ll: - Understand what post-training is, when to use it, and how it differs from pre-training. - Build an SFT pipeline to turn a base model into an instruct model. - Explore how DPO reshapes behavior by minimizing contrastive loss—penalizing poor responses and reinforcing preferred ones. - Implement a DPO pipeline to change the identity of a chat assistant. - Learn online RL methods such as Proximal Policy Optimization (PPO) and Group Relative Policy Optimization (GRPO), and how to design reward functions. - Train a model with GRPO to improve its math capabilities using a verifiable reward. Post-training is one of the most rapidly developing areas of LLM training. Whether you’re building a high-accuracy context-specific assistant, fine-tuning a model's tone, or improving task-specific accuracy, this course will give you experience with the most important techniques shaping how LLMs are post-trained today. Please sign up here:

Andrew Ng

125,146 次观看 • 1 年前

Mistral AI Releases Leanstral 1.5: An Apache-2.0 Lean 4 Code Agent Model Solving 587 of 672 PutnamBench Problems Most AI theorem proving is a language model generating a proof in one shot, with a verifier bolted on at the end to check it. That's autocomplete with a grader — and Mistral just drew a clear line between that and an actual proof agent. They released Leanstral 1.5 — a 119B MoE with 6.5B active parameters, trained as a code agent that lives inside the Lean 4 compiler loop: propose a proof, read the compiler's goals and errors, refine, repeat until it compiles or the budget runs out. Verification isn't the eval here. It's the training signal. Here's what's actually interesting: → Test-time scaling behaves like a dial: PutnamBench Pass@8 climbs 44 → 244 → 493 → 587 solved as the per-attempt token budget moves 50k → 200k → 1M → 4M → 587/672 on PutnamBench at ~$4 per problem, versus an estimated $300+ for Seed-Prover 1.5 high (a 10 H20-days-per-problem budget) → Saturates miniF2F: 100% on both validation and test sets → Two RL environments in training — a multiturn prover, and a raw-filesystem code agent that edits files, runs bash, and queries the Lean language server for live goals and types → Not just math: an Aeneas (Rust → Lean) pipeline flagged 11 genuine bugs across 57 repos, 5 previously unreported — including an integer overflow in datrs/varinteger when (value + 1) hits Std.U64.MAX Apache 2.0 weights, free API endpoint Full analysis: Model weights: Project: Technical Details: Mistral AI Mistral AI for Developers Sophia Yang, Ph.D.

Marktechpost AI

56,695 次观看 • 2 个月前

Check out our #PAMI paper with code "Dense Continuous-Time Optical Flow from Event Cameras," where we show how to regress *continuous-time* trajectories of every pixel from event cameras alone or events plus frames! The key idea is to iteratively estimate per-pixel polynomials using a recurrent lookup and update scheme. Paper: Code: DOI: We present a method for estimating dense continuous-time optical flow from event data. Traditional dense optical flow methods compute the pixel displacement between two images. Due to missing information, these approaches cannot recover the pixel trajectories in the blind time between two images. We show that it is possible to compute per-pixel, continuous-time optical flow using events from an event camera. Events provide temporally fine-grained information about movement in pixel space due to their asynchronous nature and microsecond response time. We leverage these benefits to predict pixel trajectories densely in continuous time via parameterized Bézier curves. To achieve this, we build a neural network with strong inductive biases for this task: First, we build multiple sequential correlation volumes in time using event data. Second, we use Bézier curves to index these correlation volumes at multiple timestamps along the trajectory. Third, we use the retrieved correlation to update the Bézier curve representations iteratively. Our method can optionally include image pairs to boost performance further. To train and evaluate our model, we introduce a synthetic dataset (MultiFlow) that features moving objects and ground truth trajectories for every pixel. Our quantitative experiments suggest that our method successfully predicts pixel trajectories in continuous time and is competitive in the traditional two-view pixel displacement metric on MultiFlow and DSEC-Flow. Open source code and datasets are released to the public. Kudos to Mathias Gehrig Manasi Muglikar

Davide Scaramuzza

12,681 次观看 • 2 年前

AI TENNIS ANALYSIS. A FULL COMPUTER VISION SYSTEM. BUILT ON YOLO, PYTORCH, AND KEYPOINT EXTRACTION. Take any tennis match broadcast, any camera angle, any resolution. Feed it into the pipeline. YOLO detects both players and the tennis ball frame by frame. No manual labeling, no pre-annotated dataset. A fine-tuned YOLOv5 model trained on a Roboflow tennis ball dataset handles the ball - the hardest object to track in any sport. Tiny, fast, constantly occluded. The model finds it anyway. Trackers maintain identity across frames so Player 1 stays Player 1 from the first serve to match point. But detection is just the start. A ResNet50 CNN trained in PyTorch predicts court keypoints from every frame - the corners, service lines, baselines, net posts. Fourteen points that define the entire playing surface geometry. From those keypoints the system builds a homography matrix and warps the broadcast perspective into a top-down mini court with real coordinates. Now every player has a position in real space, not pixel space. Every frame becomes a measurement. Every rally becomes a dataset. Player movement speed - calculated from position deltas between frames, converted to meters per second through the homography. Ball shot speed - measured from the ball trajectory across consecutive detections. Number of shots per rally - counted automatically through ball direction changes. All of this rendered live on the video as an overlay. A mini court in the corner showing both players as dots moving in real time. Stats updating after every point. OpenCV handles the rendering. Pandas handles the math. PyTorch handles the intelligence. YOLO handles the eyes. No Hawkeye subscription, no court-embedded sensors, no tracking chips in the ball. A Python script, a trained model, and a GPU. The full code is on GitHub. The tutorial walks through every module - from ball detector training to court keypoint extraction to the final statistical overlay. Professional teams used to need broadcast deals and proprietary hardware for this kind of analysis. Now you build it in an afternoon with open-source tools. Trading here: Computer vision didn't just enter tennis. It made the expensive stuff free.

zostaff

120,370 次观看 • 4 个月前

a team of researchers just proved you don't need a bigger model, you need a smarter plan researchers from Tsinghua and South China University of Technology built a framework called Atomic Task Graph. it turned 7B-8B open-source models into GPT-4 competitors on complex agent benchmarks, beating it on two out of three. no fine-tuning. no extra training. zero parameter updates. current AI agents plan in a straight line. step 1, step 2, step 3. when step 4 fails, the whole chain breaks. and the longer the chain gets, the more the model hallucinates because it's reasoning over a ballooning text history. here's how it works. 1. instead of a linear chain, ATG breaks any complex task into a directed graph where subtask inputs and outputs are explicitly mapped 2. it recursively decomposes each subtask until every node is one atomic tool call 3. independent branches run in parallel instead of waiting in line 4. before anything executes, a lightweight "thought experiment" simulates the plan internally to catch bad dependencies and missing steps early 5. when something breaks at runtime, ATG traces the failure to the exact subgraph that caused it and repairs only that piece. validated work stays frozen. the old way meant a failure at step 5 forced a full replan from scratch. hallucinated actions piled up the longer the task ran. ReAct hit a 43% hallucination rate on household tasks. ATG on an 8B Llama model scored 63.65 on ALFWorld. GPT-4 with ReAct scored 41.24 on the same benchmark. hallucinated actions dropped to 12%. those numbers happened because someone stopped throwing compute at the problem and started thinking about how work gets organized. that's the part that gets me. the industry is spending billions on scale. this team spent time on architecture. and the architecture won.

Alex Veremeyenko

173,351 次观看 • 1 个月前

There is a beautiful story that just happened in AI so let me share it for a lighter tone weekend post among all the doom stories in our AI field this week. It’s a story of people on three continents building and sharing in the open a new small efficient and state-of-the-art AI model. It started a couple of months ago when a new team in the AI scene released their first model from their headquarters in Paris (France): Mistral 7B. Impressive model, small and very strong performances in the benchmarks, better than all previous models of this size. And open source! So you could build on top of it. Lewis in Bern (Switzerland) and Ed (in Lyon, in the South of France) both from the H4 team, a team of researchers in model fine-tuning and alignment were talking about it over a coffee, in one of these gatherings that often happen at Hugging Face to break the distance between people (literal distance as HF is a remote company). What about fine-tuning it using this new DPO method that a research team from Stanford in California just posted on Arxiv, says one? Hey, that’s a great idea, replies the other. We've just build a great code base (with Nathan, Nazneen, Costa, Younes and all the H4 team and TRL community) let's use it! The next day they start diving in the datasets openly shared on the HF hub and stumble upon two interesting large and good quality fine-tuning datasets recently open-sourced by OpenBMB, a Chinese team from Tsinghua: UltraFeedback and UltraChat. A few rounds of training experiments confirm the intuition, the resulting model is super strong, by far the strongest they have ever seen in their benchmarks from Berkeley and Stanford (LMSYS and Alpaca). Join Clementine, the big boss of the open evaluation leaderboard. Her deep dive into the model capabilities confirms the results: impressive performance. But the H4 team also hosts a famous faculty member, Pr. Sasha Rush, Associate Professor at Cornell University in his daytime, hacker at HF in his nighttime. Joining the conversation, he proposes to quickly draft a research paper to organize and share all the details with the community. A few days later, the model, called Zephyr (a wind like Mistral), paper, and all details are shared with the world. Quickly other companies, everywhere in the world starts to use it. LlamaIndex, a famous data framework and community, shares how the model blew their expectations on real-life use-case benchmarks, while researchers and practitioners discuss the paper and work on the Hugging Face hub. All this happened in just a few weeks catalyzed by open access to knowledge, models, research, and datasets released all over the world (Europe, California, China) and by the idea that people can build upon one another work in AI to bring real-world value with efficient and open models. Stories like this are numerous everywhere around us and make me really proud of the AI community and see how we can build amazingly useful things together. [the video is just me reading this Friday post hahah]

Thomas Wolf

169,200 次观看 • 2 年前

Today, we give robots a /skills library that self-evolves and compounds indefinitely! Introducing ASPIRE: a robot solving its 100th task is no longer as clueless as solving its first. Coding agents observe multimodal sensory traces from simulation and real robots, launch an evolutionary search over control programs, and distill the best know-how into an ever-expanding library. ASPIRE is a new type of continual learning: "training" is skill refinement instead of gradient descent. "Trained model" is a repo of sensorimotor skills instead of floating weights. “Distributed training” is a panel of agents each practicing a different skill instead of sharded minibatches. Here's the beauty: ASPIRE gives the tired terms "sim2real transfer" and "cross-embodiment transfer" a whole new meaning. Bridging the sim-to-real gap is notoriously brutal. An end-to-end policy has to swallow both the visual shift (sim looks toyish next to a real camera) and the subtle contact physics it never quite gets right. ASPIRE sidesteps the mess, because it doesn't ship pixels or weights across the gap, but ships the know-how. The robot still has to practice in the real world, not zero-shot, but it gets there way faster because it isn't rediscovering the strategy from scratch. Same for going single-arm to bimanual hardware, which usually requires new data and retraining from zero. ASPIRE achieves up to ~10x cut in "transfer learning” tokens (yes, tokens are the new unit of *training* compute ;) Check out our gallery of 150+ tasks and 90+ skills the robots taught themselves, all on the website! Kind of wild that we can ship the "learned weights" as an HTML page rather than a GGUF. We'll open-source the full stack so your own robot library starts compounding from ours! Deep dive in thread:

Jim Fan

209,534 次观看 • 2 个月前

WATCH ME BUILD AN AI BUSINESS FROM SCRATCH (EPISODE 1) I'm building an AI services business from scratch, on camera, with 4 rules: -100% cold outreach -No audience -No network -60 minutes a day max The scoreboard is how many days it takes a total stranger to pay me $500. Here's the entire model: 1) The niche is tree services in Charlotte. High ticket, no private equity, and after-hours emergencies where the first person to answer wins the job. 2) The offer: a built and hosted website, an AI-powered speed-to-quote form, and a Google Business Profile cleanup. $500 flat. 3) The website IS the lead magnet. We build it first, give it away free, and charge $500 to install and host it. 4) Five agents inside Hyperagent run everything. Prospector, Opener, Sitesmith, Fulfiller, and an Account Manager upsell. 5) The Prospector dispatched 8 subagents, scraped 494 businesses, and verified 98 real leads. Done in 30 minutes. 6) The competition is a joke. The first five "websites" on my list: a blank page, a 404, two dead links, and a redirect to a crypto gaming site. 7) First-touch texts: under 160 characters, no links, no emojis, no mention of AI. "Hey, do y'all still do tree removal in Charlotte? Found you on Google. Corey." 8) The agent wrote "y'all" on its own. Sounding like a neighbor, not a company, is the whole reply-rate game. 9) 60 minutes a day covers 25-50 outreach attempts. Outreach is the only work that actually makes money. 10) All 5 agents get given away free in episode 4, plus $1,000 in free Hyperagent credits at the link in the YouTube subscription. Enough to run my entire lead scrape 6 times over. Two things that I'm looking to accomplish here: 1) Strip away every advantage and prove the model still works. If it works with no audience and one hour a day, nobody has an excuse left. 2) Give away the finished deliverable, not a pitch. An owner looking at their own new website doesn't need convincing. Full breakdown below. (also available on the Build With AI podcast)

Corey Ganim

39,767 次观看 • 1 个月前

100 years. 10 iconic looks. One seamless journey through the evolution of men's fashion. Which decade would you wear? 👔✨ Created with GPT image 2.0 and Seedance 2.0 on Thank You AI PROMPT: Style: Ultra-realistic cinematic fashion reel, luxury editorial, premium Instagram creator aesthetic, smooth camera movement, natural lighting, 4K, highly detailed fabrics, realistic clothing physics. Scene Overview A stylish male model showcases five iconic fashion eras from the 1920s to the 1960s. The video takes place in the same modern studio with soft daylight and a clean architectural background. The same model appears throughout the video while only the clothing changes between decades. Every outfit change happens naturally during camera movement, creating a smooth and satisfying visual flow. The only on-screen text is the decade name. Music is a modern electronic fashion track that builds continuously without vocals. Character Use the reference image as the model. Young adult male. Confident but relaxed. Friendly expression. Natural walking pace. The same model appears in every scene. Environment Minimalist fashion studio. Large windows. Warm daylight. Neutral beige walls. Polished concrete floor. Luxury editorial atmosphere. Keep the background consistent throughout the video. 0:00–0:03 — 1920s The video opens with the model standing confidently in the center of the studio. The camera slowly moves closer. He adjusts his cufflinks before looking toward the camera. Outfit Charcoal pinstripe three-piece suit White dress shirt Dark tie Waistcoat Pocket watch chain Oxford shoes Grey newsboy cap On-screen text: 1920s As the camera quickly pans to the right, the clothing smoothly changes into the next decade. 0:03–0:06 — 1930s The camera finishes the movement. The model now wears a cream double-breasted suit with wide lapels, pleated trousers, spectator shoes, and a fedora. He places one hand in his pocket and takes a confident step forward. On-screen text: 1930s The camera gently circles around him, and during the movement the outfit changes into the next style. 0:06–0:09 — 1940s The camera completes the circle. The model now wears an olive green utility jacket with tailored trousers, brown leather boots, and a classic wristwatch. He buttons the jacket while walking slowly toward the camera. On-screen text: 1940s A warm light sweep crosses the frame, leading naturally into the next outfit. 0:09–0:12 — 1950s The model now wears a fitted white T-shirt, dark blue cuffed jeans, a brown leather belt, leather boots, and classic sunglasses. He casually adjusts the sunglasses before taking two relaxed steps forward. On-screen text: 1950s The camera briefly moves closer, then pulls back, allowing the clothing to change smoothly. 0:12–0:15 — 1960s The model now wears a black turtleneck, camel overcoat, slim trousers, Chelsea boots, and a simple wristwatch. He walks confidently toward the camera with both hands in his coat pockets. On-screen text: 1960s During the final second, the camera begins a slow clockwise circle around him. His coat moves naturally as he lightly adjusts the collar. The music continues to build instead of ending. 0:15–0:18 — 1970s The video begins exactly where Part 1 ended. The camera continues its slow clockwise movement around the model before settling into a smooth front-facing angle. The music hits the next beat naturally. Outfit Brown suede jacket Patterned open-collar shirt Flared trousers Brown leather belt Platform shoes Gold wristwatch Aviator sunglasses The model adjusts his sunglasses before removing them with a confident smile. On-screen text: 1970s As the camera moves slightly closer, the outfit changes naturally into the next decade. 0:18–0:21 — 1980s The camera continues tracking forward. The model now wears a charcoal oversized business suit with a patterned tie, pleated trousers, polished loafers, and a classic dress watch. He straightens his tie while walking confidently toward the camera. On-screen text: 1980s The camera briefly passes beside him, creating a smooth transition into the next outfit. 0:21–0:24 — 1990s The camera emerges on the opposite side. The model now wears an oversized light-wash denim jacket over a graphic T-shirt, relaxed jeans, chunky white sneakers, and a simple silver chain. He smiles naturally while walking across the frame with both hands in his jacket pockets. On-screen text: 1990s The camera follows his movement before quickly swinging to reveal the next decade. 0:24–0:27 — 2000s The camera settles into a smooth tracking shot. The model now wears a black leather jacket over a fitted white T-shirt, slim dark jeans, white high-top sneakers, and aviator sunglasses. He casually removes the jacket from one shoulder while continuing to walk. The movement of the jacket naturally fills part of the frame as the clothing changes into the final look. On-screen text: 2000s 0:27–0:30 — 2020s The jacket clears the frame. The camera slowly pushes toward the model. He now wears a modern quiet luxury outfit. Outfit Beige overshirt Premium white T-shirt Relaxed tailored trousers White minimalist sneakers Luxury stainless steel watch Simple silver ring The model walks toward the camera before stopping naturally. He smiles confidently while looking directly into the lens. On-screen text: 2020s The decade text gently fades into: 100 YEARS OF MEN'S FASHION Then below it: 1920 → 2020 The music reaches its final peak before fading smoothly. The camera holds on the model for a brief moment before fading to black. Camera Style Smooth cinematic movement Gentle dolly shots Slow orbit around the model Occasional push-in Natural handheld feel Soft depth of field Luxury fashion commercial look Visual Style Premium editorial photography Warm natural colors Soft contrast Highly detailed fabrics Clean tailoring Realistic lighting Crisp facial details Natural movement Elegant pacing

Caden Flux

30,445 次观看 • 1 个月前