Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Open-Source Multi-Sensor Data Platform for Neural 3D Reconstruction and Physical AI [📍github] It handles cameras, LiDAR, radar, poses, calibrations & labels in one clean format. No more messy custom parsers. • Super efficient (non-redundant storage) • New .itar single-file format with lightning-fast random access • Streams straight from S3/GCS/Azure...

32,717 görüntüleme • 3 ay önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Something big is happening in robotics - and it’s hiding in plain sight. This post is not about dancing robots but in the data that powers them. Open robotics datasets have exploded this year, turning the field into a more scalable and collaborative ecosystem. In just two years, Hugging Face datasets grew from 11k to over 600k - and robotics is by far the fastest-growing segment. We went from 1k robotics datasets in 2024 to 27k in 2025! For comparison, text generation, the second-largest category, has only around 5k datasets in 2025. That gap is massive. Open datasets are important because robotics lives and dies by real-world robot data - video, actions, sensors, failures. By making this data easy to upload, reuse, and benchmark, researchers, startups, and large players are now releasing real-robot datasets that would have stayed locked inside labs just a few years ago. Major contributors include NVIDIA, LeRobot initiative, and a rapidly growing maker community. This surge is also enabled by cheaper video storage, better tooling, and an open-source AI culture now spilling into the physical world. And it really matters: open robotics data dramatically lowers entry barriers, accelerates learning-by-doing, and speeds up progress toward generalist and humanoid robots. Robotics won’t scale through hardware alone - but to a large extent through shared data. Viz below from AI World - link to the story and more viz/filters in comment.

Pierre-Alexandre Balland

186,061 görüntüleme • 7 ay önce

🚨 BREAKING: NVIDIA just announced the Isaac GR00T Reference Humanoid Robot. The first fully open humanoid robot reference design built on Jetson Thor, and it's going straight to the world's top research institutions. This is Jensen Huang's bet on open physical AI infrastructure. The hardware stack is serious: → Unitree H2 Plus chassis, 6 feet tall, 150 pounds, 31 degrees of freedom → Sharpa Wave tactile five-finger hands, 22 degrees of freedom, bringing total to 75 across the full body → NVIDIA Jetson AGX Thor onboard compute, 2,070 FP4 teraflops of AI performance, 128GB unified memory → Multi-view sensing, stereo head camera, wrist cameras, IMU Alongside this announcement, Unitree also introduced the H2 Plus as a standalone product, a frontier humanoid combining Unitree's own body, Sharpa's five-finger hands and NVIDIA Robotics Jetson Thor compute into one fully integrated research platform. The full Isaac GR00T software stack ships with it, teleoperation for data capture, open foundation models, Isaac Sim for training, Isaac Lab for evaluation, and accelerated ROS middleware for deployment. The complete loop from data to real-world robot in one unified platform. ETH Zürich, Stanford Robotics Center, UC San Diego and Ai2 are already on board as launch research partners. NVIDIA Robotics did to AI what it's now doing to robotics, build the platform, open the ecosystem, let the world build on top of it. Whoever owns the infrastructure layer wins. NVIDIA knows this better than anyone. 👀 Read more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

16,062 görüntüleme • 2 ay önce

🚀 Introducing EgoExo Forge - built on top of Rerun, Gradio, and Hugging Face hub (I’ll be in San Francisco July 21–29 — if you’re into robotics, egocentric AI, large-scale data collection, or just want to chat, DM me!) In my opinion, large-scale, diverse, and high-quality data is still the largest bottleneck for generalized robotics deployment. I believe that some version of imitation learning from human examples will be the most scalable + clean way to train humanoid robots 🤖 (similar to what Tesla did for Full Self Driving). Teleop is too expensive to collect a large enough dataset in a reasonable manner, so passive collection via egocentric (and in certain cases, exocentric) views feels like the right bet. Over the past few months, I've been trying to build out the scaffolding for this and using Rerun as my underlying infrastructure. Data being collected needs to be easily inspectable + time series and rerun provides the right tooling for this. My goal is to first build out a ground truth representative dataset from already existing open source data, generate some reasonable baselines, and then go out and collect my own data that adheres to the defined schema. 🔍 Starting with open-source datasets 1. EgoDex from Apple 2. HOCap from Nvidia and the University of Texas at Dallas 3. Assembly101 from Meta All these different datasets have different sensor configurations + annotations, so my goal with egoexo-forge is to have one consistent labeling scheme + data layout. I built a data pipeline that aligns all of the different datasets in one general schema assuming the COCO133 keypoint layout that allows for exo+ego, ego only, or exo only Since the scaffolding is already there, it becomes MUCH easier to add other datasets. So the next ones that I'll be including are HD-EPIC kitchens dataset, HOT3D, and finally my own personal iPhone + insta360 go collection method. Once I have a diverse variety of datasets, I'll double down on what I believe to be the key algorithms required to make useful data for imitation learning 📊 1. Camera Pose estimation via SLAM/SFM for ego perspective (and automatic calibration for exo) 2. Human pose estimation for both egocentric + exocentric views 3. Metric 3D reconstruction + object tracking I'll be setting up reasonable open-source baselines for each of these to validate that these datasets work, and then finally try to use the generated datasets for some imitation learning via the pi0-lerobot repo I've been working on. I plan on making a blog post + providing more info on all of this in the near future so stay tuned

Pablo Vela

32,085 görüntüleme • 1 yıl önce

🚨 THE BIGGEST BOTTLENECK IN AI ISN'T COMPUTING POWER ANYMORE IT'S MOVING DATA. Instead of laying new cables, Chinese researchers have upgraded existing fiber infrastructure by doing two things at once: Using three wavelength bands (C + L + S) instead of the usual two. Using four cores inside each fiber instead of one. Each core acts like an independent highway, and each band acts like an extra lane on that highway. Together, they’ve reportedly increased transmission capacity per core by nearly 50% and overall data throughput by up to 5×. This matters enormously for AI. Modern AI clusters move terabits of data per second between thousands of GPUs. The biggest bottleneck is often not the chips themselves, but moving data fast enough between them. If you can push 5× more data through the same physical cables, you can train bigger models faster and reduce network congestion. Why this is significant: • It shows multi-core + extended spectrum technology moving from labs into real-world commercial use • The system has already run over 35 km of existing telecom network • It could be especially useful for submarine cables and large-scale data center interconnects • China is also eyeing it for its “Eastern Data, Western Computing” project The deeper implication: We’re reaching the physical limits of how much data we can push through single-core fibers using traditional methods. By combining spatial multiplexing (multiple cores) with spectral multiplexing (more wavelength bands), engineers are finding new ways to keep scaling bandwidth without having to dig up the planet to lay new cables. This kind of breakthrough is quiet but foundational it’s the kind of infrastructure upgrade that will determine how fast AI and cloud computing can actually grow in the coming years. The future of data movement might not require more cables. It might just require smarter ones. How important do you think multi-core and multi-band fiber will be for keeping up with AI’s exploding data demands? Follow for more frontier networking, photonics, and infrastructure technology.

TheNewPhysics

20,485 görüntüleme • 1 ay önce

Trained on zero real-world data. Learned to walk, pick up boxes, and follow multi-step instructions... in the REAL world. ( 📌 Paper below) Researchers from Amazon FAR, Berkeley, Stanford, and CMU scanned real rooms with an iPhone, rebuilt them as 3D Gaussian Splatting scenes, then generated 48,000 synthetic trajectories of a Unitree G1 walking, grasping, and placing objects inside those virtual replicas. They rendered the robot's first-person camera view from each run and paired it with the matching language instruction and motion data. That's the dataset every humanoid team needs and nobody has: synced egocentric video + language + kinematics, at scale. Instead of collecting it in the real world, they manufactured it. They trained a vision-language-kinematics policy on that synthetic data alone, then deployed it on the physical G1 across five task types: navigation to a named object, lifting boxes of three different sizes with no per-size tuning, chained multi-step tasks, robustness to mid-task layout changes and flickering lights, and multi-minute long-horizon runs. No real-world fine-tuning at any point. Real-world interaction data has been the hard limit on humanoid learning... slow, expensive, and small. If scanning a room once and synthesizing thousands of labeled interactions holds up as a general recipe, that limit moves. Data stops being the bottleneck robotics teams have to solve for. 📌 Paper: Project: ——- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

12,950 görüntüleme • 21 gün önce

🚨 SCIENTISTS JUST BUILT A CHIP THAT CAN SEE, THINK, AND REMEMBER ALL AT THE SAME TIME. And it works more like a biological brain than a traditional computer. Researchers at RMIT University have created a neuromorphic vision chip that mimics the human eye and brain. Unlike conventional systems that capture images and send data to external processors, this chip performs sensing, processing, and memory storage directly where the light hits. The active layer is thousands of times thinner than a human hair. It uses doped indium oxide to detect light, process the information on-chip, and retain what it sees over time without constant electrical refreshing. Why this matters: • It dramatically cuts energy use and latency by eliminating data transfer to separate processors • Enables much faster real-time decision making for autonomous systems • Works more like biological vision than traditional machine vision • Could power the next generation of efficient edge AI in vehicles, robots, and remote sensors The deeper implication: For decades, we’ve built vision systems by bolting cameras, processors, and memory together like separate organs. This chip collapses those functions into one biological-style unit. It’s a step toward machines that don’t just “see” but actually perceive and remember in a more efficient, brain-like way. If scaled successfully, it could become a foundational component for autonomous systems that need to operate intelligently with minimal power and minimal delay. We’re moving from cameras that take pictures to chips that truly see. How do you think neuromorphic vision chips like this will change what’s possible for self-driving cars and autonomous robots? Follow for more frontier neuromorphic computing, AI hardware, and brain-inspired technology.

TheNewPhysics

23,196 görüntüleme • 1 ay önce

You can't 3D reconstruct glass from images... ...WRONG! Thanks for video diffusion, now just about anything is possible! Introducing...Diffusion Knows Transparency (DKT) Transparent and reflective objects usually break robot vision and photogrammetry pipelines because they don't follow the "solid object" rules standard cameras expect. DKT is a new AI model that repurposes the "internal physics engine" found in video generation models to solve this problem. Researchers took a massive video diffusion model (WAN) and fine-tuned it using a custom-built synthetic dataset to turn it into a high-precision depth sensor. To train the AI, they built the first massive synthetic video library of transparent objects, 1.32 million frames of perfectly labeled glass and metal objects in motion. Without ever seeing a "real" labeled video of glass during training, the model (DKT) outperformed all previous specialized systems on real-world benchmarks (ClearPose, DREDS). They created a "lightweight" 1.3B parameter version that runs fast enough (0.17s per frame) to be used on actual robot hardware. Two reasons I find this project important: 1. It further proves that synthetic data will be essential for training the next generation vision models. 2. In real-world robotic tests, using DKT's depth maps nearly doubled the success rate of robot arms trying to pick up objects on tricky reflective or translucent surfaces. At home robots will need to interact with these types of objects on a daily basis. Check out the project page here: Code is LIVE! #Computervision #Robotics #AI

Jonathan Stephens

17,712 görüntüleme • 7 ay önce

The future of footwear may not be manufactured in bulk. It may be fabricated around you. That is what makes this shift so interesting to me. 3D-printed footwear is moving from novelty to a real industrial model, with market forecasts pointing to rapid growth over the next decade. At the same time, brands and manufacturers are using additive manufacturing, digital design, and custom-fit workflows to shorten development cycles and make more personalized products viable. What is new here is not just the printer. It is the system around it: → scan the foot → model the fit digitally → print the part on demand → produce closer to the customer That matters. Because once footwear becomes data-driven and locally fabricated, several things change fast: → fit gets more personal → prototyping gets faster → waste drops because you do not overproduce → inventory pressure falls because you do not need to guess demand the same way To me, that is the bigger signal. This is not just about a better sneaker. It is about a different manufacturing logic. Formlabs notes that 3D printing already enables customized orthotics with better biomechanical precision, lower material waste, and simpler digital workflows. McKinsey has also pointed to digitization and 3D design as a way to shorten design cycles and reduce sampling iterations in apparel and footwear. And once that logic matures, the use cases get much bigger: → custom athletic footwear built from gait and pressure data → hospitals producing orthotics faster and closer to the patient → micro-factories making products on demand instead of stocking shelves → footwear designed for one body, not an average body That is why I think this matters now. The question is no longer whether personalized fabrication is possible. It is whether brands move fast enough before customers start expecting every product to fit like it was made only for them. Would you actually wear a shoe fabricated around your own biometric data? #AI #3DPrinting #Footwear #Manufacturing #Innovation #FutureOfWork #RetailTech #Customization #Technology

Pascal Bornet

47,489 görüntüleme • 3 ay önce

A Letter to Our Community: The Road Ahead for Robotics To our Community and Partners, As we step into 2026, our mission at Axis is clearer than ever: Constructing the definitive End-to-End Scaling Layer for Robotics. Our goal is to accelerate the transfer of diverse human intelligence into Robotics General Intelligence (RGI). By owning the critical path of intelligence creation, we are turning the physical limitations of robotics into a scalable, software-driven future. Here is our strategic outlook and roadmap for the year ahead. The Core Thesis: Simulation is the Only Way Out The path to RGI is currently blocked by Data Scarcity, Generalization Fragility, and Hardware Fragmentation. At Axis, we believe Simulation is the only way out. Our Simulation Data Platform and Data Augmentation Engine transform raw data into "Synthetic Gold". Backed by academic milestones like Roboverse, Skill Blending, and GraspVLA, we have proven that pure simulation can achieve the generalization required for the real world. We don’t just collect data; we architect it. The Engine: Why Crypto? We believe RGI should come from all, not a few. Crypto is not just a feature; it is the primitive that powers our entire ecosystem flywheel: - Incentive Mechanism: Democratizing contribution and rewarding the trainers and developers. - Assetization: Turning proprietary data and refined models into liquid, ownable assets. - Verifiable Workflow: We are opening the "Black Box" of AI. By bringing total transparency to the Task Generation → Data Collection → Model Training pipeline, we ensure every byte of intelligence is verifiable, traceable, and secure. 2026 Strategic Deliverables This year, we are committed to delivering three foundational pillars: - The World's Largest Training Dataset for Robots: A robot training set—diverse, high-quality interaction data at an unprecedented scale. - A Robotics Foundation Model: A universal robotic brain trained on our pure simulation and synthetic data, capable of robust cross-embodiment transfer and open-world adaptability. - Evolvable Robot Hardware: Robots deployed with Axis models that autonomously evolve through continuous interaction, turning every deployment into a self-improving node within our RGI network. The Ultimate Vision We are building more than models; we are architecting the Distributed Machine Economy. A future where every dataset, model, and robotic embodiment is a verifiable asset in a global, autonomous network. Thank you for building the future of intelligence with us✌️📷

Axis Robotics

27,858 görüntüleme • 7 ay önce

Why is the market selling off today? (Save this). The semi selloff right now is being driven by a mix of macro fear, profit taking and investors questioning how quickly all of this AI spending will actually pay off, not because demand for AI infrastructure suddenly disappeared. The market is basically trading this chain reaction, the ongoing US Iran escalation pushes oil higher, higher oil keeps inflation elevated, sticky inflation keeps Treasury yields high and that increases the risk of the Fed staying hawkish or even hiking again. That is a terrible setup for semis because many of these companies are valued on the massive earnings investors expect them to generate years from now. When yields rise, those future earnings become worth less today which is why the highest multiple AI and semiconductor names usually get hit first. (I don't think there will be a hike this year). This is also why everything is moving together right now. Nvidia, Micron, Nebius, SanDisk, Broadcom and Applied Optoelectronics are all completely different businesses, but institutions are not separating memory, networking, optics, compute and cloud infrastructure at the moment. They are reducing exposure to the entire AI trade, taking profits in the names that have already run the most and moving into a more defensive position potentially ahead of the Fed. There is also growing pressure around hyperscaler capex. Microsoft, Meta, Amazon and Google are still spending enormous amounts on GPUs, data centers, networking and power but the market is starting to ask when all of that spending will actually turn into revenue and free cash flow. Investors are no longer satisfied with hearing that AI capex is growing. They want proof that the returns are arriving fast enough to justify the valuations already priced into the entire AI ecosystem. That creates a weird situation where hyperscaler capex can continue rising while semiconductor stocks still fall. The market is not asking whether AI spending is growing anymore but rather asking whether it is growing fast enough to beat the expectations already baked into these stocks. Crowded positioning is another major factor. Semis and AI infrastructure stocks have been some of the biggest winners in the market so institutions are sitting on huge profits and many funds own the exact same names. When macro risk increases, investors usually sell the most liquid winners first. That does not mean demand for memory, optics or custom chips suddenly collapsed but rather means investors are locking in gains and reducing risk. Tariffs add another layer because even when they are not directly placed on chips, they can still raise the cost of servers, electrical equipment, cooling systems, construction materials and the overall data center buildout. That makes AI infrastructure more expensive while also adding another source of inflation. Then you have Jensen Huang’s letter to the White House this morning about open weight AI models, which I think is one of the most important long term developments here. Nvidia, Meta, Microsoft, Palantir and several other companies are pushing Washington not to place broad restrictions on open weight AI. OpenAI and Anthropic were notably absent because open models are much more of a threat to their business models. OpenAI and Anthropic benefit from a world where a few closed frontier labs control the best models and companies have to pay them through subscriptions and APIs. Open weight models weaken that advantage because businesses can download a model, customize it for their own use and run it on their own infrastructure or through a neocloud. That is bad for OpenAI and Anthropic because it puts pressure on pricing, margins and the idea that they will control the intelligence layer of the economy but it is very good for the AI ecosystem as a whole over the long run. But the question is what does this mean for all the OpenAI and Anthropic commitments? so that's adding to the fear as well. But with that being said open models make AI cheaper and more accessible. Instead of AI being controlled by a few giant labs, thousands of startups, universities, governments and regular businesses can deploy models themselves. That spreads AI adoption across the entire economy and creates a much larger infrastructure opportunity and that is exactly why Jensen cares. Nvidia does not need OpenAI or Anthropic to win. Nvidia just needs more people using AI. Whether the model comes from OpenAI, Anthropic, Meta, Mistral, Kimi or some startup nobody has heard of yet, it still needs GPUs, memory, networking, data centers and electricity. So open weight AI could actually weaken the model companies while making the infrastructure layer much bigger. More open models mean more companies running inference. More inference means more GPUs. More GPUs mean more HBM, optical transceivers, switches, data centers and power. That is bullish for Nvidia Nebius, Micron, Broadcom , Marvell and Applied Optoelectronics over the long run. So my take is that the current semi selloff is being driven mostly by macro uncertainty, higher oil, rising yields, Fed fears, tariffs, crowded positioning and questions around the return on hyperscaler capex. The underlying AI infrastructure thesis has not suddenly broken. We are not broadly seeing hyperscalers cancel GPU orders, slash capex, abandon data center projects or report that AI demand has collapsed. What has changed is the valuation investors are willing to pay while the macro environment remains unstable. The market is lowering the price it is willing to pay for semiconductor growth but is not necessarily saying that growth is gone. And while Jensen’s open weight push may be bad for OpenAI and Anthropic, it could be one of the best things possible for the AI ecosystem over the long run because it creates more models, more developers, more competition and ultimately much more demand for the infrastructure underneath all of it. Nothing about the AI thesis has changed for me, so I will be going shopping and taking advantage of this sale while the market is selling everything together. I am an analyst at Milk Road Pro, and if you want to see exactly what I am buying, you can join for just $1 using the link below.

Melvin

179,939 görüntüleme • 18 gün önce

LLM Artifacts Connected to Andrej Karpathy's LLM Knowledge base idea, I've been building out a fun way to generate dynamic artifacts from these knowledge bases with the goal of discovering and revealing meaningful and deeper insights. LLM KBs are hard to consume for humans, as I think they are more built for agents. So the question is, what form would be useful for humans to take actions and make important decisions? That's what I am trying to figure out with these artifacts. The artifact example shows a pulse on HN discussions around AI-related stories. The insights can go deeper, of course, but this is already super fun and thought-provoking, like some of my favorite podcasts. The format and depth matter a lot. The aggregation skills of agents are outstanding if you tune the prompts and skill carefully. I built this artifact generator in a few minutes through an agent skill, but I feel like there are so many ways that LLM-generated information can be used and consumed. Like generating deeper insights and analysis, and things that are just not feasible for humans today. The generated artifact (including its data and design) serves as reusable templates or can be updated in real-time via auomations, which is something I am also working on. It is truly an insane way to monitor and track information. Better than a newsletter. Better than newspapers. There is something about this that gets me really excited about the future of AI agents for knowledge generation and discovery. Lots of hidden gems everywhere just waiting to be discovered and acted on if the information is presented correctly. This is not perfect. The format, style/prose can be improved, but this is easy to customize via skill. You can personalize it to your liking. I feel like these dynamic artifacts are going to emerge as a strong new medium to stay on the cutting edge of things, both for agents and humans. My target is research, of course. This was just a basic example. Besides animation, I am also targeting other components like voice, videos, images, slides, etc. This space is full of opportunities to explore. Skill for this coming soon.

elvis

31,242 görüntüleme • 3 ay önce

Free NVIDIA GPU with 16 GB VRAM GPU for Running Local LLMs! If you want to master local LLMs but you're waiting until you can afford a $1,500 GPU, you're honestly not going to make it. The open source AI ecosystem is moving way too fast for you to wait on your budget to catch up. Especially when you can build a bleeding edge inference engine from scratch right now, completely for free. You don't need a heavy local rig to start. Google is literally letting you use an enterprise grade NVIDIA Tesla T4 GPU for $0/hour. At standard cloud computing rates (~$0.20/hr), Google Colab’s 4 hour daily free tier hands you roughly $24 worth of data center tier GPU compute every single month. And most people just waste it. Let’s talk about the hardware you get access to for free. The NVIDIA Tesla T4 is an absolute workhorse: - Architecture: NVIDIA Turing (TU104) - VRAM: 16GB GDDR6 (320 GB/s bandwidth) - Compute: 320 Tensor Cores | 2560 CUDA Cores - Performance: 130 TOPS INT8 | 8.1 TFLOPS FP32 - Power: Sipping energy at a max 70W TDP This is the exact same hardware I used to run DeepMind's Gemma 4 26B A4B QAT MoE at a 250,000 context window without a single Out Of Memory (OOM) crash. If you have a web browser and 10 minutes, you have everything you need. I’ve put together a fully documented, cell by cell Google Colab notebook that teaches you exactly how to do this. Here is what the notebook actually teaches you: - How to provision an Ubuntu Linux environment with CUDA 13.0 and verify your driver stack. - How to pull the source code and compile the latest llama.cpp C++ binaries from scratch, specifically optimizing the build for your exact GPU using the -DCMAKE_CUDA_ARCHITECTURES=native flag. - How to directly download quantized local LLMs (GGUF format) straight from HuggingFace using the CLI. - How to manage 16GB VRAM limits, offload neural network layers to the GPU, and push massive context windows. Compile raw llama.cpp, ollama run a model, or spin up the LM Studio CLI. Pick whatever stack you are comfortable with. just start building. No hardware. No credit card. No excuses. Bookmark this post right now so you don't lose the tutorial. Even if you don't have time to run it today, you are going to want this workflow in your engineering toolkit. The link to the free Colab Notebook is in the comments below. Lemme know if you need more tutorials like this.

Alok

178,744 görüntüleme • 1 ay önce

OpenAI's AgentKit will be so insane, build every step of agents on one platform. These visual agent builders make the whole process of iterating and launching agents far more efficient. It sits on top of the Responses API and unifies the tools that were previously scattered across SDKs and custom orchestration. It lets developers create agent workflows visually, connect data sources securely, and measure performance automatically without coding every layer by hand. The core of AgentKit is the Agent Builder, a drag-and-drop canvas where each node represents an action, guardrail, or decision branch. Developers can link these nodes into multi-agent workflows, preview results instantly, and version each setup. It supports inline evaluation so that developers can see how changes affect output before deploying. The Connector Registry is a single admin panel that manages how data and tools connect across the OpenAI ecosystem. It centralizes integrations like Google Drive, SharePoint, Dropbox, and Microsoft Teams. Large organizations can govern access and flow of data between agents securely under one global console. ChatKit provides a ready-to-use chat interface for embedding agents inside apps or websites. It manages streaming, message threads, and model reasoning displays automatically. Developers can skin the interface to match their product without writing custom front-end code. Under the hood, all these blocks use the same execution core that runs agent reasoning through OpenAI’s APIs. Workflows in Agent Builder compile down to structured instructions for the Responses API, which handles model calls, tool use, and context passing. Connector Registry handles authentication and routing for external tools, while Evals and RFT provide feedback loops that improve agents over time. This integration means developers no longer need to handle orchestration logic, model evaluation pipelines, or safety layers separately. Everything runs natively within OpenAI’s control plane with managed security, automatic versioning, and built-in testing. In short, AgentKit standardizes the entire life cycle of an AI agent—from visual design to deployment and performance tuning—inside a single unified system.

Rohan Paul

178,460 görüntüleme • 10 ay önce

Before the week ends, let's acknowledge one of the most INSANE week ever for open AI, with 25+ notable open-weight drops across every modality: 🧠 LLMs → NVIDIA Nemotron 3 Ultra: 550B hybrid Mamba-MoE, only 55B active, 1M context, MMLU 89.1. NVFP4 variant claims ~5x throughput on Blackwell. First openly-weighted 550B hybrid Mamba-Transformer, closing the gap with frontier closed models. → Google Gemma 4 12B: fully open dense any-to-any (text/image/audio/video), 256k context, encoder-free, 140+ languages, AIME 2026 at 77.5. Shipped with a 23-checkpoint QAT wave (mobile ONNX + MLX). Most deployable model of the week. → StepFun Step-3.7-Flash: 198B sparse MoE VLM, ~11B active, SWE-Bench PRO 56.3. Apache 2.0. → Liquid AI LFM2.5-8B-A1B: edge MoE, just 1.5B active, 128k ctx, MATH500 88.8, MLX-ready. Best on-device option this week. → JetBrains Mellum2-12B-A2.5B-Thinking: their first open MoE, near-Qwen3-14B coding at 2.5B active. Apache 2.0. 🎨 Image gen (the surprise of the week) → Ideogram 4: their FIRST-EVER open weights. 9.3B flow-matching DiT trained from scratch. #2 overall behind GPT Image 2, top open-weight model on Design Arena + LMArena. Strongest open checkpoint for text-rich images, full stop. It has taste. Still can't believe this is open weights. 🔊 Audio & Speech (a breakout week for open TTS, 4 labs shipped) → Boson Higgs Audio v3 4B: 102 languages, 21 emotions, singing/whispering/shouting, sub-second TTFA. → RedNote dots.tts: the only fully continuous (no codec) open TTS pipeline, Apache 2.0. → Google Magenta RealTime 2: real-time music gen, <200ms latency, text+audio+MIDI. multimodalart ported it to PyTorch within hours with live ZeroGPU demos. → NVIDIA Nemotron-3.5 ASR: 600M streaming, 17x more concurrent streams vs Parakeet RNNT 1.1B. 👁️ Vision & VLMs → PaddleOCR-VL-1.6: SOTA document parsing at 1B params, Apache 2.0. → Baidu NAVA: 6.3B joint audio-video gen, best-in-class A/V sync, Apache 2.0. 🎬 Video, 3D & World Models → NVIDIA Cosmos3-Super: 64B omnimodal world model coupling action trajectories with video+audio gen, for Physical AI. → JD JoyAI-Echo: up to 5-min multi-shot text-to-video on LTX-2.3. → ByteDance Bernini-R + VAST TripoSplat (single-image-to-3D Gaussian splats, MIT).

Victor M

540,784 görüntüleme • 2 ay önce

I went a little overboard with Codex last week and burned through my entire weekly allowance in two days. Luckily, my quota reset today. Otherwise, I’m not sure what I would’ve done. It got me thinking: instead of asking one large model to handle everything from start to finish, why not let a stronger model plan the project and review the work, while a model built for execution handles the day-to-day implementation? So I tried it. The result was better than I expected. I used GPT-5.6 Sol in Codex as the decision-maker, then ran Ling-3.0-flash from Ant Ling inside OpenCode as the execution engine. Together, they built a small 3D farming game. Before writing any code, I had Codex create four documents: SPEC.md defined the product scope and the lines we couldn’t cross. ARCHITECTURE.md laid out the isometric coordinate system, state machine, and module boundaries. TASKS.md broke the project into small jobs Ling could tackle one at a time. ACCEPTANCE.md explained how each step would be tested and what “done” actually meant. Then I gave Ling a very straightforward role: You are the execution model for this project. Read all four documents before you begin. Work only on the task assigned for this round. When you’re done, run typecheck, test, and build. If anything fails, read the error, fix it, and run the checks again. Do not move on to the next task early. Ling handled dependency installation, project structure, strict TypeScript configuration, test setup, and a production build in 6 minutes and 3 seconds. It ran into issues with the Vite test config, a TS6310 error, and a missing jsdom dependency along the way. Instead of stopping at the first error, it kept reading the logs and fixing the problems until all three checks passed. The speed was honestly hard to believe. If you exclude the time spent waiting on tools, it was producing more than 100 tokens per second. That made the whole development loop feel noticeably faster. After this experiment, I’m planning to keep using the same workflow. If the task is small, there’s no reason to call an expensive planning model for every single step. If the task is large, handing the entire project to a Flash model in one prompt isn’t a great idea either. The setup that makes more sense to me is: Use a more capable model such as Codex to explore the project, make architectural decisions, and break the work down. Put the constraints into specs, schemas, types, and tests instead of leaving them buried in chat history. Give Ling-3.0-flash a steady stream of clear, verifiable implementation tasks. Report bugs with structured context and actual error logs, rather than saying, “It still doesn’t work.” Bring Codex back in for architecture reviews, visual checks, and changes that affect multiple parts of the project. The point of this setup isn’t to give AI a big “build the whole project” button. It’s to turn software development into a pipeline with a much more sensible cost structure: Codex figures out the plan, sets the boundaries, and catches problems. Ling-3.0-flash moves quickly, calls tools reliably, and works through well-defined tasks at scale. For agent workflows that involve lots of repetitive edits, production tasks, and tool calls, this may be a more practical answer than simply using the biggest model for everything.

雪踏乌云

23,107 görüntüleme • 16 gün önce

How to make money on the weather using Polymarket I've been noticing more and more traders quietly printing on Polymarket's weather markets lately - and the category is exploding for a reason. Weather has always been super predictable for meteorologists (and us normals) right up to the day of. The whole point? You can earn easy, near-certain yield just knowing it'll rain in London tomorrow. I'm sharing a finished tutorial with you. Here is a small list of traders 1. gopfan2 ( - The absolute leader in weather. Earned over $2M in net profit by focusing on temperature and precipitation. Strategy - buy Yes below 15 cents, No above 45 cents, with risks of less than $1 per position. It dominates the NYC and London markets where the weather is predictable 2. enzocostapt81 ( is a weather-exclusive trader whose profile shows a complete wipeout in resolved positions-no active/open trades, current positions value $0.00, and all listed markets (resolved) at -100% P/L. The trader focused solely on daily/precise temperature predictions in major cities like New York City and London. 3. 0x594edb9112f526fa6a80b8f858a6379c8a2c1c11 ( 100% of active positions are weather/temperature markets across cities like Dallas, London, Seattle, Atlanta, NYC, and Toronto—focused on precise daily highs/thresholds/ranges. 4. meropi ( - Earned ~$30k on micro bets ($1-3) with multipliers up to 500x. Automated bets on temperature rise for 0.01 cents. Focus on speed to capture momentum in daily markets. One of the most stable in weather 5. 1pixel ( – $18.5k profit from $2.3k deposit, weather only (NYC and London) 6. erb80 ( Dominant focus-two massive Atlanta temperature range bets for Dec 17, with enormous share volume at ultra-low entries (0.1¢) turning into huge unrealized gains (+49,550% on the main one) 7. Hans323 ( - Earned $1.1M on one temperature trade in London. Started with $741 in January 2025 and increased to $87k net profit for the year 8. securebet ( - Turned $7 into $640 (+9244%) on a series of temperature bets in NYC and Seattle. 3077 predictions, top 0.04% by metrics. Focus on small bets ($3-20) with high growth on low quotes. High win rate thanks to NOAA data 9. automatedAItradingbot ( Micro/low-cost bets (0.4¢–15¢) on specific outcomes, especially weather thresholds in Seoul/London and fighter matchups.Explosive wins (300%+ on select weather 1,000–5,000% average ROI across successful weather specialists based on this traders Tools and Automation > ( - Built specifically for Polymarket weather traders. Offers real-time multi-model forecasts (GFS, ECMWF, etc.), temperature range dashboards, climate pattern guides per city/station, and settlement station details. Includes educational guides on seasonal biases and forecasting challenges—highly recommended for NYC/London/Atlanta markets. > ( — Free guide/resource hub for weather betting on Polymarket. Covers market overviews, settlement rules >Tropical Tidbits ( - US GFS and ECMWF Europe models for temperature, precipitation, hurricane forecasts. Updates every 6 hours. Ideal for comparing models if 3+ agree, the probability is high >Climate Reanalyzer ( - real-time maps of air/ocean temperature, precipitation anomalies. With historical context for calculating probabilities >Windy ( - interactive maps of wind, temperature, rain, snow. 10+ models, for local events NOAA Climate Data Online ( - 100+ years of historical location data NOAA Weather Prediction ? >Center ( - short forecasts for precipitation, anomalies. Climate Prediction Center ( - long-term ENSO, droughts >Open-Meteo ( - Completely free open-source weather API with no key required. Provides GFS, ECMWF-derived, and ensemble forecasts for temperature, precipitation, and more at hourly/sub-hourly resolution globally. Excellent for scripting quick checks on NYC/London highs or comparing multiple models. Direct API calls make it ideal for automation or batch probability calculations. >OpenWeatherMap ( = Free tier gives current conditions, 5-day/3-hour forecasts, and 16-day daily forecasts. Good for real-time verification and basic historical pulls (limited free). Use for cross-checking Polymarket ranges before resolution. >Visual Crossing Weather ( - Free tier includes historical data (50+ years), current conditions, hourly/sub-hourly forecasts, and alerts. Strong for querying specific cities >WeatherAPI. com ( - Free plan covers real-time, hourly, daily forecasts (up to 14 days), historical data (from 2010), and bulk requests. Reliable for urban stations and includes marine/pollen extras if needed. Quick Tips for Using These in Trading >>>Cross-verify 3+ models (e.g., GFS + ECMWF via Open-Meteo + Windy) → if 80%+ agree on a range/threshold, probability is often very high for "Yes" bets under 10-15¢. >>>Focus on major stations (e.g., Central Park for NYC, Heathrow for London) - check settlement rules on Polymarket pages. >>>ADD TO BOOKMARKS so you don't lose alpha information

Aleiah

77,333 görüntüleme • 6 ay önce

How to make money on the weather using Polymarket I've been noticing more and more traders quietly printing on Polymarket's weather markets lately - and the category is exploding for a reason. Weather has always been super predictable for meteorologists (and us normals) right up to the day of. The whole point? You can earn easy, near-certain yield just knowing it'll rain in London tomorrow. I'm sharing a finished tutorial with you. Here is a small list of traders 1. gopfan2 ( - The absolute leader in weather. Earned over $2M in net profit by focusing on temperature and precipitation. Strategy - buy Yes below 15 cents, No above 45 cents, with risks of less than $1 per position. It dominates the NYC and London markets where the weather is predictable 2. enzocostapt81 ( is a weather-exclusive trader whose profile shows a complete wipeout in resolved positions-no active/open trades, current positions value $0.00, and all listed markets (resolved) at -100% P/L. The trader focused solely on daily/precise temperature predictions in major cities like New York City and London. 3. 0x594edb9112f526fa6a80b8f858a6379c8a2c1c11 ( 100% of active positions are weather/temperature markets across cities like Dallas, London, Seattle, Atlanta, NYC, and Toronto-focused on precise daily highs/thresholds/ranges. 4. meropi ( - Earned ~$30k on micro bets ($1-3) with multipliers up to 500x. Automated bets on temperature rise for 0.01 cents. Focus on speed to capture momentum in daily markets. One of the most stable in weather 5. 1pixel ( - $18.5k profit from $2.3k deposit, weather only (NYC and London) 6. erb80 ( Dominant focus-two massive Atlanta temperature range bets for Dec 17, with enormous share volume at ultra-low entries (0.1¢) turning into huge unrealized gains (+49,550% on the main one) 7. Hans323 ( - Earned $1.1M on one temperature trade in London. Started with $741 in January 2025 and increased to $87k net profit for the year 8. securebet ( - Turned $7 into $640 (+9244%) on a series of temperature bets in NYC and Seattle. 3077 predictions, top 0.04% by metrics. Focus on small bets ($3-20) with high growth on low quotes. High win rate thanks to NOAA data 9. automatedAItradingbot ( Micro/low-cost bets (0.4¢–15¢) on specific outcomes, especially weather thresholds in Seoul/London and fighter matchups.Explosive wins (300%+ on select weather 1,000–5,000% average ROI across successful weather specialists based on this traders Tools and Automation > - Built specifically for Polymarket weather traders. Offers real-time multi-model forecasts (GFS, ECMWF, etc.), temperature range dashboards, climate pattern guides per city/station, and settlement station details. Includes educational guides on seasonal biases and forecasting challenges—highly recommended for NYC/London/Atlanta markets. > - Free guide/resource hub for weather betting on Polymarket. Covers market overviews, settlement rules > - US GFS and ECMWF Europe models for temperature, precipitation, hurricane forecasts. Updates every 6 hours. Ideal for comparing models if 3+ agree, the probability is high > - real-time maps of air/ocean temperature, precipitation anomalies. With historical context for calculating probabilities > - interactive maps of wind, temperature, rain, snow. 10+ models, for local events NOAA Climate Data Online - 100+ years of historical location data NOAA Weather Prediction > - short forecasts for precipitation, anomalies. Climate Prediction Center - long-term ENSO, droughts > - Completely free open-source weather API with no key required. Provides GFS, ECMWF-derived, and ensemble forecasts for temperature, precipitation, and more at hourly/sub-hourly resolution globally. Excellent for scripting quick checks on NYC/London highs or comparing multiple models. Direct API calls make it ideal for automation or batch probability calculations. > - Free tier gives current conditions, 5-day/3-hour forecasts, and 16-day daily forecasts. Good for real-time verification and basic historical pulls (limited free). Use for cross-checking Polymarket ranges before resolution. > - Free tier includes historical data (50+ years), current conditions, hourly/sub-hourly forecasts, and alerts. Strong for querying specific cities > - Free plan covers real-time, hourly, daily forecasts (up to 14 days), historical data (from 2010), and bulk requests. Reliable for urban stations and includes marine/pollen extras if needed. Quick Tips for Using These in Trading >>>Cross-verify 3+ models (e.g., GFS + ECMWF via Open-Meteo + Windy) → if 80%+ agree on a range/threshold, probability is often very high for "Yes" bets under 10-15¢. >>>Focus on major stations (e.g., Central Park for NYC, Heathrow for London) - check settlement rules on Polymarket pages. >>>ADD TO BOOKMARKS so you don't lose alpha information

Valentin

17,081 görüntüleme • 3 ay önce

I Combined ChatGPT 5.5 Image-2 + Claude Fable 5… And Built This FULL Game in JUST 8 Hours 😱 The World Has Officially Changed Forever Guys… I still can’t believe what I just pulled off. I took ChatGPT 5.5’s new Image-2 to generate every single visual characters, environments, UI, particles, everything and paired it with Claude Fable 5 for the entire codebase. The result? A complete, polished, fully playable game… finished in only 8 hours. No massive team. No months of crunch. No expensive asset packs. Image-2 created mind-blowing art assets on demand. Fable 5 turned those images into real, working code mechanics, physics, AI, animations, menus everything. This hybrid combo is straight-up sorcery. The world has truly changed. We are no longer waiting years for games to be made. One person + these two god-tier AIs just built something that used to require entire studios and huge budgets… in less than a single workday. This is the next level of human civilization. This is what creation looks like from now on. But here’s the crazy part: This free access ends June 22, 2026. After that, you’ll have to pay/subscribe to keep using it. If you’ve been waiting to see what the future of game dev actually looks like… THIS IS IT. Go try it right now before the paywall hits. Don’t sleep on this. Seriously. Drop in the comments: What game should I build next with this insane Image-2 + Fable 5 hybrid? Like if your mind is blown too 🔥 And tag a friend who NEEDS to see this before it’s gone. The future isn’t coming… It’s already here. And it’s free for one more day only. #Fable5 #ChatGPT55 #Image2 #AIHybrid #GameDevRevolution

Zayro.ETH

27,929 görüntüleme • 2 ay önce