Загрузка видео...

Не удалось загрузить видео

На главную

Day 1: Benchmarks We ran 1000+ LLM benchmarks on real consumer devices. Data includes single-device and multi-device clusters with Tokens-Per-Second (TPS) and Time-To-First-Token (TTFT). Setups tested: 3x M4 Mac Mini cluster, iPhone 15 + S24, RTX4090 & more.

254,968 просмотров • 1 год назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Does LLM really need to be a helpful assistant all the time? No. If you want to simulate people, “perfectly helpful” could be the wrong objective. Meet OdysSim, a journey toward LLMs beyond assistants, as behavioral foundation models (10B tokens of real human behavior; 23 sim benchmarks, finally in one place. new open models: outperform or on par with GPT-5.5, Gemini 3.1, or Claude Opus 4.7 in many behavior-sim dimensions). Human behavior simulation is becoming essential. Agent evaluation needs realistic users before real users show up. Medical and classroom training need realistic patients and students. Social science needs synthetic participants at scale. But real people are not ideal assistants. Real patients panic or ignore good advice. Real students misunderstand. Real customers are vague, picky, impatient, or simply leave. Human behavior is messy, diverse, and often imperfect. Frontier LLMs are getting better at math, code, and long-horizon tasks. They are NOT getting better at simulating human behavior. If anything, they drift the other way: more assistant-ish, more homogeneous, fewer of the errors and quirks real humans show. This is no accident. The whole pipeline is built for helpfulness and task success, not behavioral realism. And you can't prompt your way out of that. So we rethink the recipe from scratch and release: 🧠 The OdysSim corpus: 21.4M real human interactions (~10B tokens) from 62 sources, every conversation retrofitted with social grounding (who is talking, and why) 📏 SOUL-Index: 23 human-behavior benchmarks unified into one suite across 5 axes 🤖 OSim-8B: open weights; tops more SOUL-Index benchmarks than any frontier model, acts more like a real user than any of them on τ-bench (nearly matching real humans in the reaction dimension), and writes far more human-like text along the way.

Xuhui Zhou

140,585 просмотров • 1 месяц назад

Do you want to own part of a AAA game? I know, you hear it all the time. “Triple A game”, you go to play it, it’s crap. This is different, and it’s only possible with Sonic (Sonic) speed, transaction cost, and of-course FeeM. A game that includes talent from Kojima, Ubisoft, EA Sports, Gameloft & more with advisors from NVIDIA. A game that you’ll be able to play on mobile, desktop, and then Xbox and PlayStation (yes really)! YES! A PRETTY BIG DEAL! Before I tell you about the sale, let me at least tell you about this game (being a massive gamer nerd, this excited me), so…. Introducing Animera (Search for Animera): • Fast-paced skill-based PvP in the Nubera galaxy • Compete in real-time space battles for real rewards It will be powered with $STRIKE: • Compete2Earn: win matches, earn tokens • Play2Burn: 5% of $STRIKE used in matches gets burned Oh, and with 8.75% of all game revenue will be used to buy & burn $SWPx, so the SwapX (SwapX) community owns a real stake in this AAA title. Absolutely insane. > Now let me tell you about its beta run quickly: • 16K+ beta signups • 500+ players added weekly • 7.5K+ matches already played • Launching to 500K+ mobile users via Nomina Games > How can you own a piece of Animera? June 5th at 2pm EDT the sale will go live on SwapX, it will go in three phases each lasting 12 hours or until sold out: PHASE 1️⃣: xNFT Holders Early access with exclusive perks and bonuses. These are for xNFT holders only you can get these here on paintswap PHASE 2️⃣ Whitelisted Communities These will be whitelisted from Creo Engine, SFA AGC, derp, and GOGLZ | SONIC 🥽💥. PHASE 3️⃣ Public Round Any remaining allocation will open to the public - only if Phases 1 & 2 don’t sell out. > What is the raise? Token Price & Allocation: • Token: $STRIKE • Currency: USDC • Total tokens for sale: 101.75M Unlock structure: • 50% unlocked at TGE • Remaining 50% claimable in 30 days • Raise cap: Max $100,000 per user, capped at $10,000 per xNFT • Purchase window priority: xNFT holders get early access (see above)! Transparency is key: Why I love working with the team is because transparency is crucial, so I’m going to tell you about its tokenomics, seed, and fully diluted valuation here: Token Symbol: STRIKE Total Supply: 370,000,000 Initial FDV: $1.48M Total Raise: $950,160 Total Initial Unlock: 112,947,501 STRIKE Initial Market Cap (excluding liquidity): $303,790 Token Allocation: • Seed Round: 59.2M tokens (16% allocation), with a 1-month cliff and linear vesting over 9 months. • Private Round: 94.35M tokens (25.5% allocation), with a 1-month cliff and 6-month vesting period. • Crowdsale: 10.75M tokens (2.91% allocation), unlocked 50% at TGE. • xNFT Holders: 10M tokens (2.7% allocation), with a 1-month cliff. • Liquidity: 37M tokens (10% allocation), with no lock or vesting. • Team: 18.5M tokens (5% allocation), with a 6-month cliff and 12-month vesting. • Rewards: 28.6M tokens (8% allocation), vested over 18 months. • Product Growth: 19.6M tokens (5.3% allocation), vested over 24 months. Token Offering: • Seed Round: Priced at $0.0033 per token, raising $195,360 by selling 59.2M tokens. 10% unlocks at TGE, with a 1-month cliff and 9-month vesting. The initial market cap from seed unlock is $234,127. • Private Round: Priced at $0.0037 per token, raising $349,095 for 94.35M tokens. 15% unlocks at TGE, with a 1-month cliff and 6-month vesting. Initial market cap contribution is $262,508. • Crowdsale: Priced at $0.0040 per token, raising $407,000 by selling 10.75M tokens. 50% unlocks at TGE, with no cliff or vesting. Adds $283,790 to the initial market cap. It’s important you had the full information at hand so you can decide whether or not you’d like to participate. I will be, because it’s a low FDV and it looks great. This is not financial advice, I’m helping the team out. Below is real gameplay: Further details: 👇

hoeem

21,634 просмотров • 1 год назад

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.

Guri Singh

2,180,357 просмотров • 4 месяцев назад

🚨 THE BIGGEST BOTTLENECK IN AI ISN'T COMPUTING POWER ANYMORE IT'S MOVING DATA. Instead of laying new cables, Chinese researchers have upgraded existing fiber infrastructure by doing two things at once: Using three wavelength bands (C + L + S) instead of the usual two. Using four cores inside each fiber instead of one. Each core acts like an independent highway, and each band acts like an extra lane on that highway. Together, they’ve reportedly increased transmission capacity per core by nearly 50% and overall data throughput by up to 5×. This matters enormously for AI. Modern AI clusters move terabits of data per second between thousands of GPUs. The biggest bottleneck is often not the chips themselves, but moving data fast enough between them. If you can push 5× more data through the same physical cables, you can train bigger models faster and reduce network congestion. Why this is significant: • It shows multi-core + extended spectrum technology moving from labs into real-world commercial use • The system has already run over 35 km of existing telecom network • It could be especially useful for submarine cables and large-scale data center interconnects • China is also eyeing it for its “Eastern Data, Western Computing” project The deeper implication: We’re reaching the physical limits of how much data we can push through single-core fibers using traditional methods. By combining spatial multiplexing (multiple cores) with spectral multiplexing (more wavelength bands), engineers are finding new ways to keep scaling bandwidth without having to dig up the planet to lay new cables. This kind of breakthrough is quiet but foundational it’s the kind of infrastructure upgrade that will determine how fast AI and cloud computing can actually grow in the coming years. The future of data movement might not require more cables. It might just require smarter ones. How important do you think multi-core and multi-band fiber will be for keeping up with AI’s exploding data demands? Follow for more frontier networking, photonics, and infrastructure technology.

TheNewPhysics

20,485 просмотров • 1 месяц назад

To replace animal testing with AI, we need MASSIVE human datasets. Today, we're thrilled to share Axiom's new data exploration tool, providing the ability to visually explore the world's largest primary human liver toxicity dataset. Built with Axiom's proprietary wetlab protocols, our dataset includes detailed liver toxicity profiles for over 100,000 distinct molecules. The key to this dataset is our ability to do high-throughput, multiplexed high-content screening with primary human liver cells. Traditionally, toxicity assays either sacrifice throughput or sacrifice biological relevance (using easy-to-grow immortalized cell lines instead of real human cells). We managed to combine throughput, physiological relevance, and multiplexing in one platform. The assays run in a high throughput format using automation, meaning thousands of compound-dose conditions can be tested in one experiment. We achieved this using pooled primary human hepatocytes, which are often fragile and expensive. By systemizing our automation and quality control processes, we were able to run over 120+ batches on the same donor pool with incredible reproducibility and consistency. We did this while integrating many readouts per well, whereas many existing toxicity assays only do a single readout. Our multiplexed approach provides far more data per experiment enabling us to measure 10-20 different toxicity phenotypes such as apoptosis, necrosis, mitochondrial fission, endoplasmic reticulum stress, stress granule formation, microtubules, and more all from a single well on a 384-well plate! The combination of scale, high content information, and data quality is exactly what is needed to train highly accurate AI models in biology. If you're interested, please explore the dataset in the comments below and let me know if you want to chat about the details!

Brandon White

25,117 просмотров • 1 год назад

Depth Any Video with Scalable Synthetic Data AI physicists and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.

MrNeRF

27,428 просмотров • 1 год назад

Today, we’ve successfully launched Band Oracle v3 Testnet Phase 2 — our biggest upgrade yet. This release makes BandChain faster, more transparent, and more interoperable than ever. Let’s break down what’s new👇 What did we achieve? — 3x Faster blocktime from 3s —> 1s — 10x symbols cap expand from 100 —> 300 symbols — 10x Higher Throughputs: 40k to 400k TX/day — 3x Max TXs Support/ Day: 7.2M TXs —> 21.6M TXs 🌐 New Data Tunnel routes are LIVE We’re expanding Band’s oracle reach across the multi-chain world: —> Cosmos - The Interchain ⚛️’s IBC-Hook: seamless interchain contract querying —> Router Protocol: Bridging & EVM chains & Soon on Solana —> Axelar Network: ongoing collab for cross-chain verified feeds Interoperability is no longer a wishlist — it’s real. 🛠️ Minor upgrades with major impact: — Cylinder CLI runs standalone — Signal times are now block-based (not machine time) — Auto-select TSS groups — Yoda now auto-bumps gas to avoid TX failure — Telemetry for BeginBlock/EndBlock durations It’s all about smoother ops for devs and validators. 🧪 What’s next? ✅ Recap + docs for Testnet Phase 2 ✅ More Data Tunnel stress testing ✅ Backend + validator-side optimizations 🚀 Mainnet Launch in Q3 2025 We’re almost there. Band Oracle v3 is becoming the go-to open data oracle for all ecosystems. Fast. Transparent. New standard for Multi-chain native. Thanks to the validators, devs, partners, and Band community for building this with us. Let’s keep going. Read the full announcement here:

Band

17,921 просмотров • 1 год назад

WINDOWS // NYC is an interwoven city that we will all build out together. There are three collections that all interconnect, windows, buildings, and the city itself. Here is exactly how this will unfold with Transient Labs on Tuesday, June 16th. 🏢🏢🏢🏢🏢 BUILDINGS are generative grids of windows, assembled through an onchain seed derived from Ethereum block data and each work’s token ID, creating distinct sizes and layouts. My collectors, friends and family, and limited partner communities can mint these BUILDINGS before public at 0.015Ξ This presale window is FCFS will last two hours (12 NOON EST to 2 PM EST) All remaining supply will go to public at 0.018Ξ after the presale ends. Supply is 1/1/4000 total buildings, each grid is completely unique, and some have very special qualities :) 🪟🪟🪟🪟🪟 Individual windows are 1/1/1000, and each mint is one single window. This is gated at first to my existing collectors, max mint 50 windows per wallet. Priced at 0.03Ξ, blind mint with instant reveal- this section is packed with gems- cats, plants, neon signs, and a bit of New York City embedded in every frame. Its these single windows that are the foundational layer of this project, since all grids are comprised of these windows. All my existing collectors get these multipliers on mint day, final snapshot is MONDAY the 15th at high noon, EST. For example: Drips // 2x DRIVE Lap 1 // 3x DRIVE Lap 2 // 2x 1/1 // 5x Editions // 1x GRAILS from DRIVE and DRIP DROP have an additional allocation on top. To ask about specific collections of mine, drop a comment here. 🌃🌃🌃🌃🌃 Additionally, the major work of this collection is the CITY, a 1/1 interconnected dynamic galaxy of light composed of all the layers below. This also comes with a large, museum quality physical lightbox of all 1,000 windows illuminated from within. This work will be placed by private sale. The CITY contract will also hold 20 NEIGHBORHOODS, our second largest arrangements of WINDOWS, and can be customized in collaboration with the artist or accepted as random grids. NEIGHBORHOODS will have 15 tokens at 1Ξ for private sale, with 5 held back for top holders of BUILDINGS. I am so excited to build this city with all of you. I've never worked so hard on anything in my life, and I am so grateful to all of you for the support so far. Let's do this thing!!!!

Dave

46,097 просмотров • 1 месяц назад

What if you kept asking an LLM to "make it better"? In some recent work at FAIR, we investigate how we can efficiently use RL to fine-tune LLMs to iteratively self-improve on their previous solutions at inference-time. Training for iterated self-improvement can be costly. The naive approach to training for K self-improvement steps leads to K times the number of rollout steps per episode. We introduce Exploratory Iteration (ExIt), an RL-based automatic curriculum method that bootstraps diverse training distributions of self-improvement tasks by upcycling the LLM's own responses at previous turns as the starting points for both self-improvement and *self-divergence.* In order to decide what task to train on next, the curriculum prioritizes sampling of partial turn histories that led to higher return variance in its GRPO group (a learnability score that comes for free). This automatic curriculum over the bootstrapped task space teaches the model how to perform iterated self-improvement while only ever training the model on single-step self-improvement tasks. We look at ExIt's impact in both single-turn (contest math problems) and multi-turn (BFCLv3 multi-turn tasks), as well as MLE-bench, where the LLM is run in a search scaffold to produce solutions to real Kaggle competitions. Across these eval settings, we find ExIt produces models with greater capacity for inference-time self-improvement compared to GRPO. Notably, ExIt models can self-improve on test tasks for many more steps than the typical solution depth encountered during training, including a 22% improvement in MLE-bench performance compared to GRPO.

Minqi Jiang

41,066 просмотров • 10 месяцев назад

We all remember. We all remember when blockchain was pitched as the next big thing. And today, we feel like we’ve been waiting and waiting. Until recently, Blockchain was too expensive, slow under load, and hard to integrate for most businesses. So enterprises ignored it. It didn’t solve their business problems. That’s changed. Why blockchain, why now? Businesses don’t care about the tech, they care about cost and performance. They’d ask a simple question “Does it save or make me more money?” For a long time, blockchain didn’t clearly do this. That’s no longer true. Blockchain is proving real business cases, especially on Avalanche. On Avalanche, transactions cost fractions of a cent. settle in about a second. And instead of forcing everything onto one shared chain, businesses can launch their own Avalanche L1s with their own rules. To understand this let’s identify the problem and then provide the solution in a way that's easy to understand. Where Businesses Lose Money Most large industries lose money due to operational inefficiencies. Data lives in different systems. Teams spend hours reconciling records that should already match. Intermediaries sit in the middle, taking fees to coordinate all of it. Individually, each step looks small. Together, they create real cost: > Labor spent on manual processes > Capital locked up during settlement delays > Fees paid to intermediaries > Risk introduced by time gaps and mismatched data This is where businesses actually lose money. Not in big, obvious ways. In constant, compounding friction. Take Private Credit, for Example Private credit is loans held outside of traditional banks. It’s a multi-trillion dollar market, and much of it still runs on spreadsheets and weekly reconciliation processes. Loan data is tracked across systems. Teams manually process requests. Funds move on traditional rails, often on delayed cycles. It doesn’t have to be this way Entire teams exist just to keep systems in sync. Now move that system onto Avalanche. Loan data updates in real time. Transactions settle in about a second. Every participant sees the same state instantly. Reconciliation isn’t a separate step because the system itself is the source of truth. The impact is straightforward. > Reduced manual work > Shortened settlement cycles > Fewer layers of coordination between parties Avalanche is Infrastructure for Real Businesses Avalanche is designed to match how businesses actually operate. Instead of sharing a single chain, they can launch their own Avalanche L1s with custom rules, built-in compliance, and predictable performance. They control the system. Avalanche’s Moment For the longest time, blockchain naysayers said this could all be done better with spreadsheets or existing systems. They were right. That’s what the technology allowed. Now it’s changed. Avalanche can replace many of those systems with real-time settlement, shared data, and automated execution. For the first time, the economics work. Built for business. 🔺

Avalanche🔺

13,068 просмотров • 3 месяцев назад