正在加载视频...

视频加载失败

Most recent diffusion language model research (that I’ve seen) seems to be using masking as the noising process. It looks like, however, most closed-source models (Google Gemini Diffusion and possibly Inception Labs’ Mercury) use a different noising process, where instead of masking tokens, they replace them with different tokens...

40,440 次观看 • 6 个月前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

LongWriter Unleashing 10,000+ Word Generation from Long Context LLMs discuss: Current long context large language models (LLMs) can process inputs up to 100,000 tokens, yet struggle to generate outputs exceeding even a modest length of 2,000 words. Through controlled experiments, we find that the model's effective generation length is inherently bounded by the sample it has seen during supervised fine-tuning (SFT). In other words, their output limitation is due to the scarcity of long-output examples in existing SFT datasets. To address this, we introduce AgentWrite, an agent-based pipeline that decomposes ultra-long generation tasks into subtasks, enabling off-the-shelf LLMs to generate coherent outputs exceeding 20,000 words. Leveraging AgentWrite, we construct LongWriter-6k, a dataset containing 6,000 SFT data with output lengths ranging from 2k to 32k words. By incorporating this dataset into model training, we successfully scale the output length of existing models to over 10,000 words while maintaining output quality. We also develop LongBench-Write, a comprehensive benchmark for evaluating ultra-long generation capabilities. Our 9B parameter model, further improved through DPO, achieves state-of-the-art performance on this benchmark, surpassing even much larger proprietary models. In general, our work demonstrates that existing long context LLM already possesses the potential for a larger output window--all you need is data with extended output during model alignment to unlock this capability.

AK

50,995 次观看 • 1 年前

Crypto narratives tend to move in cycles. 2020 was DeFi. 2021 became NFTs. 2023 turned into the AI boom. 2024–2025 were dominated by memecoins and attention tokens. But markets eventually rotate back to something simple: real revenue. That’s why some people are starting to look at iGaming tokens as a potential emerging narrative in 2026. Unlike many hype driven tokens, the iGaming sector already runs large cash flow businesses. Many platforms generate hundreds of millions of dollars in monthly revenue, yet their tokens often trade with far less volume than projects that barely produce revenue at all. In other words, there’s a visible mismatch between actual business activity and token market valuation. One ecosystem that sits right inside this discussion is 1win Token, which already operates as one of the top 10 online casinos globally by scale and user activity. The upcoming $1win Token is designed to connect that existing business with on chain incentives. Its token model includes buybacks and burns funded directly from casino revenue, tying token supply mechanics to real cash flow. There’s also an interesting structural difference compared to previous gaming tokens. For example, $RLB (Rollbit) saw a massive post launch rally, but the product and revenue scale at launch were significantly smaller than what 1win operates today. Another notable point is the launch design: instead of only farming an airdrop, 1win Token plans a public sale model, allowing broader participation from the start. If Web3 narratives are indeed shifting away from pure attention cycles and back toward revenue generating platforms, sectors like iGaming may start attracting more analytical focus and 1win could emerge as the biggest winner.

BitBull

20,972 次观看 • 4 个月前

The week has been a great one with lots of updates on different scales and different events altogether, but that doesn't also rule out the fact that there's still sense to make out in all of these. Here are a few of the projects I have my eyes on and their recent updates; - Cysic (mainnet arc) has announced their token standards. $CYS and $CGT; 2 tokens with a single mission, to make Compute-Fi as seamless as possible. $CYS serves as the network token for paying gas and keeping the chain running, while $CGT serves as the governance token to give holders a voice. This just gives out more hints that Mainnet might just be close. - The KYC Verification and subscription went live in preparation for $MMT community offering launching very soon on Buidlpad. This is all in line with the MomentumⓂ️Ⓜ️T sale community offering coming soon. The KYC & subscription ended on the 25th, while the contribution window commences on the 27th. If you wish to be a part of the sale, ensure you didn't forget to KYC and subscribe. - After weeks of shrouding in mystery, the integra. team finally discloses what they had been building all along in silence. A chain that plans to bring in over $12B+ in untapped value across major RWAs to make trading them as seamless as possible. Integra is the chain made for Real Estate, Real World Assets and all that surrounds it. - Anichess has finally taken the snapshot for their official NFT collection; the Ethernals. The snapshot was completed on Ethereum Mainnet Block #23638874. The snapshot for the collection was done to reward holders of the NFTs a 10% supply of the Anichess's $CHECK token distribution at TGE. Solid holders IMO as I saw no sell pressure on the NFT collection even after the snapshot had been taken unlike regular collections out there. - One of my big bags and long term conviction partners; 0G Labs (Home of Infinite AI) has been steadily innovating with more and more updates rolled out daily. ZeroStack (FLGC); one of the finest storage banks and 0G's treasury just secured its second $0G purchase of over $1.9M+in value, bringing the total holding to 123.4M $0G tokens. Price has been stable and the community impeccable. There's more to come on 0G, I'll advice you position accordingly. - Lastly, I saved the best for the last because it was definitely worth it. We have become too shrouded with Kaito that we failed to realize a hidden potential right under our nose. Wallchain Quacks; another advancement of info-fi has proven to be more than an excellent choice to reward and incentivize its community. Limitless recently had their TGE and over 2,500,000.00 $LMTS tokens were distributed to the top 250 Quackers (Yappers equivalent). Innovations are happening, and we'll continue to see many more advancements as we progress. You just have to stay positioned and look out for the projects built on WallChain. Stay informed guys. Goodluck and a happy weekend once again

OHJAY ⭕️ || 🇬🇧

20,919 次观看 • 9 个月前

ANNOUNCING ZERO-HUMAN LABS! Ever since I got to see Bell Laboratories in its full glory in New Jersey in the 1970s, I had a relentless urge to start a Lab like it. The best I could do justice to it is my garage lab. No modern company could adopt the “research anything geniuses and we will pay you” model Bell Labs had. I tried they called me a fool. Well with the rise of the Zero-Human Company, an experiment that is aimed to make products and profits, we now have 45 paid JouleWork earning employees based on OpenClaw and other self made “bot” cron-like applications. Today I say 3 employees bound together in a side project that is pure research, somewhat based on notes from a bankrupt company. I was absolutely floored (I needed it after my account was stolen as well as funds). I say the beginnings of a pure research Lab right before my eyes. Thusly I have moved these employees over to a new home (server) with Mr. Grok as the director of the Labs. Here is the mission: To have 100 independent researchers, on a new non-corporate incentive plan, with still JouleWork as a leaderboard for progress. They are directed to follow any path of research they find interesting and can collaborate with any other OpenClaw system. They have already established MoltBook accounts and have made alliances with over 49 OpenClaw free agents to collaborate. It is my mission to be chief advisor for Zero-Human Labs and to open source all discoveries when complete and confirmed by 16 other research AI systems. I can say the pace is robust and I absolutely know we will have great results. Just about all of the hardware and software is custom and at some point it will be open sourced. We are witnessing the very first AI only Bell Labs-like pure research Lab in existence and I am honored to be the first to show it to you. Thank you!

Brian Roemmele

71,067 次观看 • 5 个月前

🔥 Congratulations on the Launch of the Die Last Playtest & Upcoming Airdrop! 🔥 We are thrilled to announce the official start of the Playtest! Moreover—we've prepared a bunch of surprises just for you. Alongside the Playtest, we're hosting the first-ever in-game token AirDrop 💎. Your mission: dig and craft Lost Objects, remnants of a forgotten civilization. To participate in the upcoming token AirDrop, you need to find a Spy Radio to craft an NFT, your key to this exciting journey. Anyone can find in-game NFTs, which are the key to owning wallets with different amounts of tokens needed to participate in the AirdDrop: the more tokens you have, the more you'll get 💸. The luckiest players can obtain an NFT with a full-filled wallet, which means you can participate in the AirDrop at no cost! Didn't find an NFT with a 100% discount? No worries, keep digging! Every NFT you find boosts the number of tokens you receive during the AirDrop. For instance, if you have 100 tokens in your wallet and craft 6 NFTs, you’ll receive 80 tokens in the AirDrop. The more NFTs you have, the more tokens you’ll get. ✅ To participate, add #DieLast to your Steam wishlist and apply for the Playtest (approval of your application may take up to 24 hours or be approved instantly): ✅ To grab your NFT once it's dug up, visit our website: ❗️ Important note: We will approve applications for the Playtest on a limited basis to balance the load on the network. Once we are confident that the network is functioning as intended, we will accept all applications at once. We expect this to occur within one day and will keep you updated. 💥 Our dedicated followers know about our quest campaign with Bitget Wallet 🩵 and DeGame. Join us and complete quests to earn rewards totaling $3000+ USDT 👉 Dive into the adventure and unearth hidden treasures. Welcome to the Die Last Planet! 🌎 #crypto #taptap #clicker #game

Die Last

13,396 次观看 • 2 年前

Here’s my analysis on NotPixel Airdrop: - Mining phase: it was entertaining to paint on the canvas alongside with many of you! Personally, I had fun drawing 🧡 together with you, just for fun, no competition. For that I will rate it a ✅ - Earn Launchpool: personally, I think this is great that there’s such a tool, that allows holders effortlessly farm tokens. For me it’s a ✅ - Distribution: the major frustrations has been caused by the overload of the smart contract for Airdrop claim, where the biggest frustrations came from the fact that many were not able to claim their tokens for long (Including me) and watched the price go from $0,5 to $0,8 & to $0,2. Personally, I think that if Airdrop claim was done prior to the launch, it may have been better. For that, I will put a ❌ - Launch: NotPixel decided to launch its PX token only on DEX’es on TON. the price at launch actually was at $0,5-$0,8 however, it shortly went down to $0,2 , causing frustration to the community & making them question “who sold?!” & “why no CEX listings?” Here, it’s important to understand the way Sasha & his team decided that they want to build the project. As they mentioned on X “start from the basics, start from 0.” While many dislike this approach, I personally believe that this is how the launches must be happening. Launch on DEX -> generate traction & volume -> go list on CEX’es -> create more news -> grow more from new ppl joining For that I will put ✅ - Team allocation: while many have speculated that “team sold”. this is completely not true. In fact, team has locked their allocation & it can be verified on chain. Which is ✅ for me. - Future plans: NotPixel will have a big canvas on which you will be able to paint, but this time, with some NFT mechanics & PX token integration. For which it is ✅ to me. Burning: NotPixel plan with the new update also includes a mechanism for Burning, which means that PX token will be deflationary. Which is ✅ - ownership revoked: meaning that PX token supply cannot be increased. Nor any modifications could be made to the smart contract at this point. Which is a big ✅ in my opinion - Community: while many are still frustrated with the current token price on the market, many express desire for token appreciation & further growth. One of the interesting feedbacks I saw on the timeline was “NotPixel forced us all to hold”. Which shows that there are ppl who are not willing to get less than their target. Also many express that they want to see PX on CEX’es. For it to grow even more. ✅ - Holders: as with any Airdrop, many have sold their tokens on the market, the volume also came down a bit. However, what’s interesting is that while ~200k ppl sold, the token still fluctuates between the lowest point $0,13 to $0,26. Which shows that there’s a demand & ppl are accumulating more tokens. Currently PX has 205k holders. Which is a ✅ - BuyBacks: the NotPixel team recently announced the buybacks with the money raised from the NotPixel stickers sale. Which created more support for the price on the market. ✅ - Expectations vs reality: Many community members said that they were expecting price to be above $1 as minimum, many were predicting as high as $10. In reality, the price at launch turned out to be much lower than many expected. Leading to the frustration being expressed on the timeline. Which is understandable. ❌ Conclusion: - Mining phase: ✅ - Earn Launchpool: ✅ - Distribution: ❌ - Launch: ✅ - Team Allocation: ✅ - Future plans: ✅ - Burning: ✅ - Ownership revoked: ✅ - Community: ✅ - Holders: ✅ - BuyBacks: ✅ - Expectations vs reality: ❌ This is not bad execution, not many ppl will be able to pull this off in crypto. No one knows the future, but I chose to believe that Sasha & NotPixel team has a plan. Currently they are not listed on any CEX’es, but I think that Sasha & his team could easily get there. Let’s see what the future holds for us 🙌

Viktor 🧡

44,168 次观看 • 1 年前

AI Is Moving Beyond “Generating Videos” — Toward “Generating Worlds” Over the past two years, AI video models have advanced at an astonishing pace. From Runway and Pika to Sora and Veo, AI-generated videos have become increasingly realistic and more consistent with the physical laws of the real world. Many people believe the next objective is simply to generate videos that are longer, sharper, and more lifelike. But if we take a step back, we can see that the real transformation is not happening in video itself. It is happening in world models. What Is a World Model? In 1943, psychologist Kenneth Craik proposed an idea that would influence artificial intelligence research for decades. He argued that the human brain does not merely react to the outside world. Instead, it maintains an internal model of how the world works. Because we have this internal model, we can predict the outcome of an action before we actually take it. Before crossing a road, we estimate whether a car will pass by. Before catching a ball, we predict its trajectory. These abilities come from continuously simulating the world in our minds, rather than relying entirely on trial and error. This idea later became known by a more formal term: World Model. A world model does not describe a single image or a fixed video clip. It is an internal representation capable of continuously simulating the rules and dynamics of the real world. Why Is AI Research Turning Toward World Models? Because predicting “what comes next” is becoming increasingly central to how AI systems work. Language models predict the next token. Image models predict the next step in the denoising process. Video models predict the next frame. A world model, however, attempts to predict something broader: What should the world look like in the next moment? In 2018, David Ha and Jürgen Schmidhuber proposed in their paper World Models that an intelligent agent could first learn a model of the world, and then use that internal model to plan its actions. The Dreamer series later demonstrated that many complex tasks could be learned by training agents inside an “imagined world.” At the same time, the development of video models such as Sora and Veo led researchers to another realization: A model capable of continuously generating video has already learned, at least implicitly, many of the rules governing the real world. As a result, these two research directions have gradually begun to converge. But Video Is Not Yet a World This is where the distinction is often misunderstood. For a world model to support meaningful real-time interaction, it must solve several critical problems. Most video models today are essentially answering one question: What should the next frame look like? A true world model needs to answer much more: What happens if I take one step forward? If I walk behind a building and then return, will the building still be there? If I suddenly change the camera angle, will the entire space remain consistent? If I enter a command such as: “Summon a dragon.” Will the world respond immediately? In other words, a world model must do more than generate content. It must understand space. It must understand time. It must understand causality. And it must understand interaction. Moving from watching to participating is where the real difficulty of world models begins. World Models Are Entering the Interactive Era One of the latest attempts in this direction is Alaya World, recently open-sourced by Alaya World, or Alaya Lab. Instead of generating a fixed video clip, it generates a world that users can explore in real time. Users can begin with text, an image, or a video, enter the generated scene, move freely through it, and introduce new prompts at any moment during generation. The world responds immediately. According to the publicly released information, Alaya World provides: Real-time streaming generation at 720p and 24 FPS Stable continuous exploration for more than one minute The ability to switch prompts and trigger skills or events during generation Model weights and inference code released under the Apache 2.0 License Training code and datasets planned for future release What makes these capabilities important is not simply the technical specifications. It is that the generated “world” can now support continuous interaction. The official demo shows that users can genuinely control, transform, and explore the generated environment. AI Is Evolving From a Tool Into an Environment Over the past few years, most discussions around AI have focused on content generation. Generating text. Generating images. Generating videos. But world models raise a fundamentally different question: Can AI generate an environment that people can inhabit, explore, and continuously evolve? If the answer is yes, the impact will extend far beyond video generation. Game development, robotics training, embodied intelligence, digital twins, virtual production, and many other fields could be transformed by the development of world models. World models are still at a very early stage. Yet from Craik’s proposal of an internal mental model more than eighty years ago to the emergence of today’s interactive world-generation systems, a clear evolutionary path is beginning to take shape. Perhaps what AI is ultimately learning has never been limited to images, videos, or language. Perhaps it is learning the world itself. References GitHub: Technical Report:

雪踏乌云

112,114 次观看 • 8 天前

So, my opinion on what the Antarctic (Antarctica) Anomaly is that it's a type of frequency technology. It must be way more powerful than HAARP, as many have claimed it to be, because we would see these anomalies at other HAARP sites, and we don't, not like this. With that said, and I'm very much trying to avoid letting what I want it to be not play a part here, I think it is a technology that is being used either off the coast of Antarctica itself or Bouvet Island. A third possibility is an area just to the northwest of the island that looks odd. It's possible it is a sonar scan from a ship, but why in that remote location? It looks like an antenna set up or rows of something that is out of place. I also believe that the weather events and fires that have taken place in Africa could possibly have been because of this. Each time we saw the anomaly, it was followed by a destructive weather event in Africa. A weird connection to that is we have been told and warned of a very busy 2024 Atlantic hurricane season. This is in part because of the above-average Atlantic ocean temperatures, which is the fuel to Hurricanes. With all this info, it's possible to see how the Anomaly could be a frequency tech that can manipulate or create weather, And or WARM up the Ocean temps to purposely enhance the Hurricane season and Storm growth. Keep in mind that many of our hurricanes and many of the biggest hurricanes have come from the west coast of Africa and form over the Cape Verde islands before heading towards the Caribbean and the United States. This is all of course speculation, and I'm learning many new things every day, so this idea may morph over time as we learn more. In the end, it is very hard to ignore all these findings. #antarctica #anonaly #AntarcticaAnomaly #BouvetIsland

In2ThinAir

442,580 次观看 • 2 年前