正在加载视频...

视频加载失败

🚀 Sol-Attn is here! We present a training-free sparse attention method that accelerates video generation while better preserving quality. Sol-Attn unifies dynamic routing, sparse computation, and approximate correction in a single online-softmax pass: • On-the-fly block thresholding for dynamic yet controllable budgets • Proxy-score reuse to approximate unselected blocks...

19,881 次观看 • 5 天前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

"There are Jews in the diamond and gold trades and they wanted in on what Rhodes was cooking, crazy." Helping Jews, as Rhodes did, is tantamount to helping Jews achieve their ends. In this case, Rhodes helped turn London into a refuge for Jewish terrorists, albeit indirectly. Cecil Rhodes' business partner, investor, and close friend was Nathaniel Rothschild - one of the most destructive Jews to England. Rothschild was not only the sole executor of Rhodes' will after Rhodes died, he was responsible for setting up the famous Rhodes Scholarship. Nathaniel Rothschild was pivotal in turning part of London's East End into a Jewish shtetl in the 1880s, when terrorist Jews fled Russia after the Tsar was murdered. Almost the entire Jewish population of England lived in London's East End during this period, and Rothschild supplied these Jews with welfare, free education, free healthcare, and affordable housing through his Four Percent Industrial Dwellings Company (which still operates today, and is still a Jew-first organization). So many terrorist Jews flooded London's East End (including Jack the Ripper) that parliament had to pass the Alien Act of 1905 to curb it, despite Nathaniel Rothschild's opposition. However, Rothschild was able to secure the "asylum clause," creating a window for more terrorist Jews to enter London. Thirty years later, Oswald Mosley would march through the Jewish enclave of London's East End and clash with these same Jews in what's now known as the Battle of Cable Street. Cecil Rhodes, through ignorance or indifference, was indirectly helping Nathaniel Rothschild turn England into a refuge for Jewish terrorists, whose descendants would turn Britain into a multiracial state, including the one and only Barbara Roche.

Curse

152,275 次观看 • 7 个月前

Day 11/90 of Inference Engineering How does vLLM work and how is it used in production? Before we discuss how vLLM works internally, it helps to understand what vLLM is. At a high level, vLLM is an inference engine that is designed to serve LLMs to thousands of concurrent users efficiently while managing scarce compute and memory. The goal for vLLM is to maximize throughput and minimize latency; optimizing for the best inference economics and experience for end users. With every request from the end user, it eventually ends up in the engine core, gets scheduled alongside other requests from other concurrent users, executes on the GPU, and updates the KV cache with the new key and value vectors, and streams the tokens back to the user. The Scheduler decides what requests should execute next while continuously batching requests together to maximize GPU utilization. Continuous batching is an inference optimization that allows new requests to join a running batch as other requests finish generating tokens. This helps with keeping the GPU utilization high instead of letting it sit idle waiting for an entire batch to complete generating. After the scheduler dispatches the selected batch to the Model Executor, the Model Executor prepares the tensors and metadata required for inference, retrieves each request’s block table from KV Cache Manager, launches the optimized transformer forward pass on the GPU, computes the logits, updates the KV cache with the new key and value vectors, and finally returns the results for sampling and streaming. The KV Cache Manager uses the PagedAttention memory layout to allocate fixed-size cache blocks on demand and maintains a Free Block Queue on the CPU that tracks which blocks in the GPU’s Paged KV Cache are currently free. When a request needs additional KV cache space, the KV Cache manager takes a free block from the queue and assigns it to that request, thus avoiding an expensive search through GPU memory for available cache blocks. All of these components form the core of vLLM’s inference engine. The Scheduler determines what requests are executed, the Model Executor determines how those requests are executed, the KV Cache Manager determines where each request’s KV cache lives using the PagedAttention Memory Layout. This architecture enables vLLM to serve thousands of concurrent requests with high throughput, low latency, and efficient GPU memory utilization. Heres a little animation that visualizes everything! - I've also completed the forward pass for my mnist.c project. I had a nice chat with shrey birmiwal, such a knowledgeable guy. Excited to learn more about vLLM and implement a tiny-vLLM one day.

max fu

70,024 次观看 • 16 天前

Google dropped a new AI paper called LUMIERE. It's remarkably flexible, supporting video inpainting, image-to-video, AND stylized video generation tasks. Say hello to “space-time diffusion” for video generation! Now what the heck does that mean exactly?! 🌐⏳ → TL;DR it utilizes a “Space-Time UNet” architecture that generates the full duration of the video in one pass, rather than generating distant keyframes and interpolating between them like prior works. Because the computation is done in this “compressed space-time representation” to generate the full clip at once, it's far more temporally consistent. → Another benefit of generating the full video at once is that you can “direct” the video generation, making it easier to hand off to other models/tasks without having to stitch together partial solutions. You can condition generations on additional inputs, meaning you get the full stack of AI video capabilities – from video inpainting to image-to-video and beyond. → New SOTA for AI video generation? User study results in the paper suggest human evaluators preferred Lumiere over Runway Gen-2, Pika Labs, and Stable Video Diffusion in terms of quality, text alignment AND motion. But as always, we need to get hands-on with this tech when Google *actually* decides to ship it. → Could this end up inside YouTube? Y’all know i’m obsessed with blending reality and imagination – so it’s the video inpainting tech I'm most excited about. I really hope this model finds its way into YouTube's Generative AI efforts, and based on their prior announcements and the list of acknowledgments in the paper I think it might! 🤞🏽 Links: 🔗Paper: 🔗Project:

Bilawal Sidhu

44,822 次观看 • 2 年前

The EU just passed Chat Control today. Here's what it is, what happened, and why 2.0 is the one that actually matters. What is Chat Control? a regulation that lets online platforms scan private messages for child sexual abuse material (CSAM). Framed as child protection. critics call it mass surveillance infrastructure because a system built to scan for one type of content can scan for anything. the timeline: → March 2026: EU Parliament voted to let Chat Control expire. 307-306. one vote. → April 3: the law expired. legal basis for scanning gone. → July 2: EU Council repackaged the same proposal and brought it back → July 7: Parliament fast-tracked it using a rarely-used emergency procedure 331 to 304 → July 9 (today): passed. extended to April 2028. the procedural trick: by using the second-reading procedure, the Council forced Parliament into an impossible position — to block it, they'd need 361 votes, an absolute majority of all MEPs, not just those present. timed for the last session before summer recess. the EU's own Legal Service had already said the proposal violates the EU Charter of Fundamental Rights. didn't matter. what it actually scans: Instagram DMs, Discord, Snapchat, Xbox messaging, Gmail, iCloud Mail. End-to-end encrypted apps like Signal and WhatsApp are not directly affected; voluntary scanning can't work on messages platforms can't read. yet. YET: Chat Control 2.0, the permanent version, is still in negotiation. it would: → require mandatory scanning, not voluntary → target encrypted messages directly → allow detection orders without a court order or reasonable suspicion → include mandatory age verification across messaging platforms if 2.0 passes in its current form, end-to-end encryption in the EU is functionally over. the global implication: when the EU creates legal infrastructure for scanning private messages, authoritarian governments use it as a template. and any backdoor built for Brussels is technically a backdoor for anyone who can access the same system.

IT Guy

29,430 次观看 • 24 天前

This is my "feel the AGI" moment: I used GPT-5.6 Sol to train my own autocorrect model that outperforms GPT-5.6 Sol (wtf??) I have no ML background. I have no idea what I'm doing. I just kept pushing Sol until it spat out a SOTA model. And I spent $0. The motivation: Years of talking to AI have made me terrible at typing. Rather than fix my skill issue, I decided to throw more AI at it. My idea was: instead of autocorrect that interrupts my flow, I want to type fast with mistakes and have AI clean it up after. I wanted the smallest local model possible, for speed, for battery life, for science! So I decided to train my own. Inspired by Andrej Karpathy’s autoresearch, I ran Codex /goal with this setup: pick an experiment, try it, record the results to a doc, throw it out if it fails, and plan the next experiment without repeating failures. I gave a few examples that had to pass, tight latency targets, and let it run. Sol did some amazing things. First, it scanned benchmarks and shortlisted base models: Qwen 3.5, Gemma 4, Liquid LFM 2.5. It found a dataset on HuggingFace for typed text. Then it built a simulator for fingers striking a Mac keyboard, modeling the physical layout with a Gaussian distribution around each key. It simulated striking the wrong key, wrong order, fat-fingering, etc. With the models + data + simulator, it fine-tuned using MLX right on my MacBook. It had a working prototype within an hour! But accuracy was pretty poor. — Problem 1: Tokenization Sol read papers, ran tests, and identified that the tokenizer was the bottleneck. Tokenization makes typos hard for the model to see, so it memorizes mappings instead of using its language priors. Sol tried ByT5, Google’s tokenizer-free byte-level LLM. This made a big improvement, but the model is old and lacked the knowledge needed to reach Sol performance. Sol dug deeper and realized a tokenizer-free model isn’t needed; instead, it used T5Gemma, an encoder-decoder model. This can understand the input deeply before producing output, and furthermore, Sol could post-train the encoder to improve performance. This gave a much higher ceiling. — Problem 2: Loss function Now the model was correcting some typos perfectly, but ignoring most. Sol realized that standard cross-entropy loss was teaching the model to avoid edits, because the vast majority of characters in the training data were left unmodified. The fix was wild: Sol wrote a custom loss function that byte-aligns the source and target strings, uses a dynamic programming algorithm to compute the minimum edits between the two, then weights correct edits much higher than copies. After a lot of tuning, this dramatically improved accuracy. — Problem 3: Autoregression One failure mode remained: if the model made a mistake, it couldn’t backtrack. It could only predict the next token. Teaching it to “think” like a reasoning model would solve this, but would be far too slow. Sol found a beautiful solution: instead of greedily predicting the next token, beam search over all possibilities. This parallelizes the exploration instead of one linear chain-of-thought. At the end, choose the path with highest cumulative log probability. This worked great, but made the experience worse, since the user wouldn’t see progress until the whole search was done. To fix this, Sol made a clever observation: after each search step, the longest common prefix among surviving branches is guaranteed to appear in the final result, so it can be displayed immediately. As the search progresses, weaker paths are dropped and the prefix grows, so the user sees continuous progress. Sol built all this as a custom MLX pipeline that does the parallel decoding on the MacBook GPU, with just ~40ms TTFT. It’s crazy fast and entirely local. — Final eval (error reduction rate, higher is better): - Apple autocorrect: 49.66% - GPT-5.6 Luna: 82.47% - GPT-5.6 Terra: 87.64% - GPT-5.6 Sol: 90.56% - Our model (1.7B): 91.02% Final cost: - 1 quota reset (thanks Tibo) - $0 (And yes, I verified there's no cheating. In fact, we test words scrubbed from the training data to prove the model isn’t memorizing) There were a ton more details and tangents I could write about: contrastive learning, GRPO, DPO, dynamic masking, and more. Sol is a fascinating and creative model. It blew my mind so many times. Don’t let a lack of experience stop you: Sol makes AI experiments accessible to anyone!

Anshu

178,432 次观看 • 18 天前

Disappointments surround us from all sides. We feel broken.. But we will definitely come back from under the rubble.. We in the north Gaza cling to the land like the roots of trees clinging to the soil. There is no wind that can uproot people who want to remain in their place. We are not just numbers.... We have a case. But there is no justice in this world.. My friends and loved ones.. Based on your advice, I decided to buy cat food and not wait. But I decided not to buy for a very long time for fear of wasting money. I also want to buy now so that I do not feel regret if a ceasefire occurs. Everyone knows that we have to buy from the black market, and unfortunately the prices are very ridiculous. So I will buy enough to last 3 months.. I will try to do my best to find food for cats, but if I cannot, the alternative option will be to use canned human food... I already have enough cat food to last until the end of December. But I want to buy it now because canned meat is available now.. I also mix bread with cat food to make it last longer...as shown in the video below I had a beautiful shelter before the war.. it was completely destroyed.. It had more than 60 cats. There are now about 25 cats left, and there are some cats nearby who find love and food, so they come to eat with the cats in the shelter. I would be very grateful for your support at the following link You can donate via PayPal There are days left until the end of 2024. It has been a year full of pain, patience, pain, fear, hunger, humiliation, oppression and suffering. I don't want this year to end with cats suffering as we do. Your support will help save cats from starvation I am very grateful to everyone who supports me morally and financially, and to everyone who retweets. Thank you all, friends

help cats

119,300 次观看 • 1 年前

Been building this little brand for almost three years now with Grant Eastey and Ejay ODonnell. That’s my wife and I packing our first orders in our tiny garage that couldn’t even fit a car. But in the end the garage found its purpose. There’s something special about just going for it. We just wanted to make some hats for dads that we didn’t see out there for ourselves. Everything else was dad bod humor, mowing the lawn, ugly sneakers, etc. Being a dad is so much more than that. Being a dad really isn’t any of that funny stuff. That’s just the weird brand social media has given us. We’re about to cross half a million hats sold soon and still see ourselves in that tiny garage. Just trying things. Seeing what happens and doubling down if it works. The brand has become so much more than we ever imagined. I don’t enjoy the notion of becoming a “DTC brand”, just become a brand. Become a community and movement. You should see the notes we get from customers saying our hat helped them become better parents, our hat helped them keep trying to have children, our hat brought their kids joy when their dad passed away, our hat showed up and changed the life of someone deciding if they wanted to go on. I don’t care about the metrics. Obsession over CAC and ROAS won’t create this. Building something with meaning is so beyond any of the acronyms we see here on a regular basis. At the end of the day it’s all about trying. You just need to try. It’s as simple as that. I used to think there’s so much to risk by trying. At the end of the day it’s usually ego or fear. And two things are true. Ego decisions are solely based on your perception of what you’ll look like to others, which will never matter in the end. The second thing is fear. Fear usually only lives within YOU. Nowhere else. You make it up and decide how to act from it. Greatness is on the other side of fear. There’s no pressure over here. I was born into project buildings in Poland. “Making it” happened long before the brand started. Making it was getting out of Poland and into the US at the age of 7. On our pod yesterday Nate Lagos📈 asked me why I even stay on X when having a successful brand. The answer is simple. I personally want to give away as much free game as possible. I don’t know it all, not even close. But I want to help others break through and get their ideas into motion. Everyone is charging for courses and slack access. I get it, but it’s not how I care to move. There’s plenty to go around for everyone and if I can help then I’d love to. Gate keeping is weird. Pass it on. Help others win. Looking back at my time in that tiny garage I miss it. The excitement of a new idea forming. Hand packing every order and writing notes. Not caring if it works but trying and having fun. Going for it. To this day. 95% of all creative is Canva and iPhone. Free Shopify theme. I run all marketing. No employees. Great partners. It’s beautiful. One more time. JUST GO FOR IT.

Bart

10,542 次观看 • 1 年前

A Letter to Our Community: The Road Ahead for Robotics To our Community and Partners, As we step into 2026, our mission at Axis is clearer than ever: Constructing the definitive End-to-End Scaling Layer for Robotics. Our goal is to accelerate the transfer of diverse human intelligence into Robotics General Intelligence (RGI). By owning the critical path of intelligence creation, we are turning the physical limitations of robotics into a scalable, software-driven future. Here is our strategic outlook and roadmap for the year ahead. The Core Thesis: Simulation is the Only Way Out The path to RGI is currently blocked by Data Scarcity, Generalization Fragility, and Hardware Fragmentation. At Axis, we believe Simulation is the only way out. Our Simulation Data Platform and Data Augmentation Engine transform raw data into "Synthetic Gold". Backed by academic milestones like Roboverse, Skill Blending, and GraspVLA, we have proven that pure simulation can achieve the generalization required for the real world. We don’t just collect data; we architect it. The Engine: Why Crypto? We believe RGI should come from all, not a few. Crypto is not just a feature; it is the primitive that powers our entire ecosystem flywheel: - Incentive Mechanism: Democratizing contribution and rewarding the trainers and developers. - Assetization: Turning proprietary data and refined models into liquid, ownable assets. - Verifiable Workflow: We are opening the "Black Box" of AI. By bringing total transparency to the Task Generation → Data Collection → Model Training pipeline, we ensure every byte of intelligence is verifiable, traceable, and secure. 2026 Strategic Deliverables This year, we are committed to delivering three foundational pillars: - The World's Largest Training Dataset for Robots: A robot training set—diverse, high-quality interaction data at an unprecedented scale. - A Robotics Foundation Model: A universal robotic brain trained on our pure simulation and synthetic data, capable of robust cross-embodiment transfer and open-world adaptability. - Evolvable Robot Hardware: Robots deployed with Axis models that autonomously evolve through continuous interaction, turning every deployment into a self-improving node within our RGI network. The Ultimate Vision We are building more than models; we are architecting the Distributed Machine Economy. A future where every dataset, model, and robotic embodiment is a verifiable asset in a global, autonomous network. Thank you for building the future of intelligence with us✌️📷

Axis Robotics

27,858 次观看 • 7 个月前

So I’ve lived in Hillsboro, Oregon for 10 years. Drove around today and tonight and shot this myself. This is what the “Data Center Plains” looks like.👇 My town sits at the end of 6 transpacific sea cables connecting the US to Asia. That’s why 30+ data centers landed here. They’re everywhere. Spread across the entire north and west end of the city. Road after road. Building after building. Miles of it. And they keep building. Pushing further west every year into farmland that’s been here for generations. Buying up land, Giving mass amounts of money to home owners to move, Tearing down homes. Tearing down historic sites. $7.2 billion in exempted property taxes. Some of these finished buildings are literally sitting completely dark… PGE told them no power for 3-5 years. They still built them anyway. A power plant is now going up right next to the data centers because they maxed the local grid. There are families still living next to construction zones. Old farmhouses directly across the street from data center walls. Nobody asked the people who already lived here. These are the families who refused to leave, so they said we are just gonna put them up next to your houses anyway. A pioneer homestead from 1865, 190 years of continuous farming is about to be gone, NTT Global Data Centers got that land tax-free until 2051. Signed in a single day at City Hall. Intel, the employer that actually brought thousands of real jobs here is laying off locals at the same time. This sound runs 24 hours a day. 7 days a week. My electricity bill went from $80 to $150. Water rates are set to increase 105% over 5 years, critics say to fund data center infrastructure, not residents. Data centers aren’t a joke. Just wanted to share my first hand experience with them. #datacenters

The Darkpulse Files  𝕏

421,375 次观看 • 2 个月前

I’m not going to make excuses for the clip at the end of the video the president posted on Truth Social, but when media reports on something like this, they should post everything and give context so people can see the full scope and make their own decisions. If people still disagree after seeing it all, that’s fine. But cutting things into pieces to steer public reaction is manipulative. For clarity, here is the full context of what happened. See the clips attached: • Full video that was posted on Donald Trump’s Truth Social page discussing voting machines and what he believes happened in the 2020 election, which is now the subject of a major federal investigation • A clip that shows the ending of that video, where it abruptly transitions into a separate AI-generated segment • The original, longer AI video inspired by The Lion King, depicting Trump as the king of the jungle and various politicians as animals I don’t think that AI video should have been made at all, and I don’t know how it ended up attached to the voting machine video. It does look bad, including how certain figures were portrayed. The Obama and Joe Biden were depicted as apes. People deserve the beginning, the middle, and the end so they can form their own opinions instead of being pushed into one. I also noticed certain media companies and so-called journalists rushing to highlight this for a gotcha moment. That’s what people really need to pay attention to. Watch how coordinated efforts suddenly shift the conversation away from specific people and specific topics.

ComeWithFacts

127,860 次观看 • 5 个月前

Al‑Qaeda Isn’t Finished. They’re Intent on Turning Past Failures into Success. One of the most important things people miss about al‑Qaeda is this: They don’t abandon failed plots. They recycle them. Their current U.S. homeland strategy is built on bringing old failures back, and this time, making them succeed. Look at the pattern: They hit the World Trade Center in 1993 and failed to bring it down. Eight years later, they came back and finished the job. The same mindset applies to everything else al‑Qaeda tried and couldn’t pull off: Project Bojinka was the original blueprint for using commercial aviation as a weapon. Parts of it failed in the 1990s. They brought the idea back and used it to build 9/11. They still believe Bojinka must be completed. That is why the aviation plot is back. None of these ideas are over. The group’s current U.S. homeland plot is not new, it is simply being fulfilled by the next generation of al-Qaeda. It is a direct extension of what they attempted before, only now they intend to turn every past failure into a success. Yes, you read that right. Every. Single. One. Abu Bakr Naji, al‑Qaeda strategist and doctrinal advisor, author of The Management of Savagery, believed failure was part of a longer-term strategy, not a terminal endpoint. In his framework, setbacks aren’t the end of jihad, just a step in escalation, refinement, and eventual success. He wrote: “If we fail—we seek refuge with God from that—it does not mean an end of the matter. Rather, this failure will lead to an increase in savagery.” Understanding this is key: the next attack will hit harder. Our intelligence community knows how each plot failed before. So why can’t they thwart them now?

Sarah Adams

93,303 次观看 • 8 个月前

We found a flaw in Polymarket that can’t be patched. Then we built the most powerful bot of the World Cup around it. Here’s the flaw: their orderbook will always be slower than the pitch. When a goal, red card, or penalty hits, pro feeds (Sportradar, Opta, ScoutingFeed) register it in 200-500ms. Polymarket takes 2 to 8 seconds to reprice. For those few seconds the book is quoting a score that no longer exists. No amount of engineering closes that gap the event happens in the physical world before any oracle can confirm it on-chain. The engine detects the event, recalculates fair value, and fires via Jito bundles before the book catches up. In at the old price, out at the new. The match outcome is irrelevant we don’t bet on who wins. We capture the lag every event creates. We’ve been building Polymarket bots since 2025. This is the most powerful machine we’ve shipped yet. Two months ago we posted the architecture for this. It hit 1M views one of our most popular posts ever on X. That told us everything: this was the engine to build. First 7 days, - Starting balance: $5,000 - 22 matches scanned, 19 captured - Total profit: +$1,946.86 - ROI: +38.94% in 7 days Why it prints harder than anything we’ve built: the World Cup is the deepest liquidity event prediction markets have ever seen. Tens of millions in volume per match. Dozens of probability-shifting events per game. And an orderbook that physically can’t keep pace with the pitch. How to plug in: 1.Sign up at PolyArbiter (link in bio) 2.Generate PolyArbiter RPC URL 3.Paste it into Jupiter Predict (Polymarket but native on Solana) 4.Set your parameters, activate the World Cup module It’s free to use. We take a share of the profit the engine makes for you. You never deposit anything with us everything runs from your wallet. One honest note: the $1,946 above is our engine at our size and settings. Your numbers depend on your capital, your parameters, and how many matches you’re live for. We’re not promising you’ll match it we’re showing you the machine works, and handing you the same one. These numbers are from the engine running solo. Closed test, just us, before any public access wanted to confirm the whole loop held up end to end before handing it to anyone. That changes the second this goes public. Edge per capture is going to compress. When an event fires the mispriced liquidity is thin and gone in a few seconds more wallets hitting the same window, less left for each. Nothing we can do about it, that’s just how latency arb works. So if the edge thins out past the point where it’s still worth running, we cap access. Hard ceiling on how many engines can hit the same liquidity before it’s gone. Not gonna promise the machine stays this sharp in a few days it might not. But right now it’s live and free. Enjoy 🪄

PolyArbiter

100,534 次观看 • 1 个月前