Loading video...
Video Failed to Load
Silk Song has Advanced Tech! WAVEDASHING: Jump, Instant Down-B, cancel landing frames with Dash. Makes your initial dash MUCH longer. There's also Bunnyhopping (or Spider Hopping) which is hold forward, jump, air dash. I think this is slightly faster than just running.
230,708 views • 10 months ago •via X (Twitter)
0 Comments
No comments available
Comments from the original post will appear here
![ELON: SPACEX INNOVATES MUCH, MUCH FASTER THAN BIG AEROSPACE COMPANIES “In terms of [SpaceX's] competitiveness, I think it mostly comes down to our pace of innovation. Our pace of innovation is much, much faster than the big aerospace companies or the country-driven systems. This is generally true if you look at innovation from large companies or from smaller companies. Smaller companies are generally better at innovating than larger companies. It has to be that way from a Darwinian standpoint because smaller companies would just die if they didn't try innovating. Otherwise, people would just keep buying the product from the big companies.” Source: MIT AeroAstro, October 2014](https://image.24vids.com/tw-1883907803980451882/ext_tw_video_thumb/1883907694685282304/pu/img/3rD4k3ogxFbyTcrO.jpg)
![♾️Infinity Nikki Version 1.8 Outfit Preview: Clouded Loong & Forever Bond When the fates of the Loong and the nimble cat are intertwined by the threads of Yin Yuan, that ancient tale—hazy as smoke, fragile as dreams—drifts across the fields of Inkville. ♾️Clouded Loong >>Main Attribute: Cool >>The outfit "Clouded Loong" comes with the [Default: Roaming Loong] ability. After using the ability, Nikki summons the White Loong and can ride it across Danqing Island. When this ability is equipped, Nikki can place Warp Orbs as location marks and fast travel through them. >>Decoration: [Ink-Woven Scroll] Can be placed in open spaces for photography or display. The vast world is captured in ink, with sun and moon softly resting upon painted scrolls. From this letter, countless wonders unfold, reflecting the ever-changing forms of heaven, earth, rivers, and mountains. The artist wishes for nothing more than that, at the paper's edge, truth is traced through strokes of ink and color, guided by fate. ※Available after reaching 160 Resonances in the limited-time Resonance [Inkwoven Bonds]. ♾️Forever Bond >>Main Attribute: Sexy >>The outfit "Forever Bond" comes with the [Scroll of Splendor: Purification] ability. After using the ability, Nikki opens a scroll to capture nearby Esselings, defeating them with carefree strokes. If Nikki is hit while having only 1 point of Health, she will summon a Petal Rain to protect herself. Enchanted by Purification ability, the falling petals knock back nearby Esselings and restore 2 points of Health for her. Activating Dash makes Nikki dash forward. A quick follow-up activation during the dash transforms her into a cat for a second dash. Hold the Dash button and Nikki will pounce forward in cat form, then leap into the air, lifting up all nearby Esselings. While in cat form, all dash actions Nikki makes can apply a Purification effect to the Esselings. >>[Ocean's Radiance Gift Box] It contains the dance move [Blossom Bond] and the item [Vibrant Blossoms]. Using the item [Vibrant Blossoms] allows you to dance gracefully in the open world. The dance move [Blossom Bond] can be used in Momo's Camera. ※Available after reaching 160 Resonances in the limited-time Resonance [Palette of Destiny]. ♾️Follow @InfinityNikki and retweet this post, and we'll randomly select 10 lucky stylists to win 1 Infinity Nikki Cozy Blanket Set each! —— The Coziest Open-World Game! Infinity Nikki Version 1.8 "Danqing Season" launches globally on July 29 (UTC-7)! ➤ Download Now: ➤ Join us on Reddit: #InfinityNikki](https://image.24vids.com/tw-1948957576160514493/amplify_video_thumb/1948956057231130624/img/tPPBBdTxEe2Evea2.jpg)
![I think I can finally report some success training a quite accurate IDM capable of recovering keystrokes from Minecraft gameplay, even in quite PvP-heavy situations. At this point the model does not only know what keys are pressed to the extent reasonably discernible, it also knows how fast it is moving in 3D space at all times, even when knockback is mixing with the self-move impulse. Now, recovering keystrokes from normal external capture footage is just about impossible. E.g. W/A/S/D does exactly nothing during partial tick frames and jumping mid-air is also equally useless, so asking the model to recover key down states is inherently unreasoanble. Mouse deltas are also completely arbitrary units, as game mouse sensitivity introduces an arbitrary scale factor into the equation. The only good option is to think carefully about your model-environment contract, and only record "logical actions", not raw keystrokes. So here's a few unfortunate lessons I had to learn in roughly this order. - Choose good units. (bad: mouse deltas, good: delta radians [yes, you will need game-internal state]) - Capture from inside the main game loop and read the game fbo to get consistent frame-action pairing. Doing post-mortem pairing is hopeless. - Carefully define when you think keystrokes actually have an effect. (jump only works on ground, when flying or in water etc.) More subtle: The key may already be down, but no tick has happened yet to actually use the value. Hence: ignore Seperate gamestate into "fast and slow-moving" components. E.g. movement is likely tick based, camera rotation is very likely updated every frame in essentially every game ever. - Think about your frame-action correspondance contract (How old is the frame in relation to the inputs you capture? Will double or tripple buffering affect you?) Think about the game loop timeline, where you are sampling, how old the data you are reading is, and where the ticks are happening around you. Language models used to simply not have a model-environment contract, but even now with the model "living" in a designated harness, the contract still boils down to formatting, and tool implementation intrinsics. While also important, it is still quite a bit more obvious because the violations are in some way shape or form reflected as text you can actually see. - ffmpeg dropping frames cummulatively screws the model the further you get into the sequence because your targets are now shifted. If you can't encode the video in real-time, too bad. - Sodium has a frames in flight system different from vanilla Minecraft, which will also offset your targets from your frames. (there goes that data...) - Models are succeptible to latency. If there is too big of a delay between action and on-screen reflection, your performance degrades. At this point I realize ~100hours of gameplay is essentially no longer usable as a dataset. You can train on this data, but all you'll get is a mushy mess. However, some good news: - Making the model predict physics gamestate scalars helps the model generalize. For instantaneous events like jump, it's unreasonable to ask the model emit a short burst of jump=true at exactly the right time, however if you also predict your current y-velocity, the model has supervision signal for the "latent" from which that onground jump becomes apparent. Recovering x/z motion is also somewhat easier than unmixing it into plausible keystrokes for inertia-heavy player controller logic. - Regressing physics gamestate scalars also seems to make your dataset "bigger". While pure keystroke classification will overfit quickly, predicting exact physics gamestate scalars forces the model to generalize more and you can tolerate far more epochs before validation loss starts to stall out. This is the only reason why it was bearable to dump 100h+ of dataset hours and replace it with ~3 hours of gameplay after the 4th revision of the file format (yeah...) and somehow still have better performance. Now, you might be asking, "isn't this brittle?" and the answer is yesn't. Frame-action correspondance matters for training, but not so much during inference. So as long as you are sampling in roughly the same interval as your training data, you aren't violating any hard contract per-se. Somewhere around the frames ticks are happening, and during training you capture various tick-capture offset relations per random chance, so nothing is too obviously wrong here. HOWEVER, you will get screwed by gui scale, shaders, resource packs, "shit that recording is 1920x1040 because somebody doesn't know fullscreen exists" and other unfortunate edge cases of reality. But I suppose this is the role of dataset size. If all those "contract violations" that a youtube video has compared to the training data are addressed, I think this is a way to turn Youtube into a labeled dataset. I could never shake the feeling that VPT is a sound idea in practice, while never having been properly executed, and I think one reason why it hasn't is because that label boostrapping part is just a pain in the butt to get right. Now, what the player is doing is of course not the only label you can extract from video, but it has to be one of the targets predicted during pretraining to "align" the pretraining objective. Some notes on the video here, the colored dots on the analog visualizer are the ground truth, while the gray dot is the model prediction. Green means correct prediction, red means incorrect prediction at that frame. Model P(key) reports how wrong the prediction is from green (0.0) to red (1.0). You will also notice that during periods of rapid slow down, left and right actions become close to irrecoverable, because there is just that little motion. And some jump actions are not predicted correctly because I got the detection condition for jump events wrong... (duh) LMB/RMB for other than sustained events (like item-consume and block break) also seem to be hopelessly irrecoverable for now. Swing was supposed to do the same thing as motion y did for jump, but its too well behaved as an increasing counter. Maybe partial-tick interpolated values work better (v5 file format then... ugh..)](https://image.24vids.com/tw-2042731804780826849/amplify_video_thumb/2042721691844120576/img/yugYQfuXXQmJpdVp.jpg)