the fly brain can play beat saber

still getting the visual cortex reactivity trained, this is so far just the motor cortex overfit to a replay but it *will* learn to play properly lol

it can react already, but the actual play patterns are bad and that's undergoing RL atm

ok to be clear it is receiving input, just throughout its connectome and not strictly the visual cortex. it is overfit to one track, and has some replay data in the input, but it is not simply acting out a predefined replay. the motion is generated by the connectome the further training is to reduce reliance on external signals and allow it to play fully reactively with no input data - this is a render from somewhat early in training while I was still ramping down the teacher forced input hence the emphasis on motor control. the misses and vibrations are from the reaction training if I sent it directly into the RL deep end without replay distillation it would be much less resilient and train slower

what the fuck are you doing 😭😭😭😭😭

fun things :D

im genuinely crying 😭

This is cool as shit but what the fuck

because fly brain :D

So would RL training the ever living dogshit out of a fly's neural net, to where it's a Beat Saber pro, remove it's ability to even understand the concept of food? If you somehow made this real, would it starve to death trying to play Beat Saber in a world without FlyVR?

we will find out once the long RL runs currently taking place are done will put the tuned brain back into a normal env and see what happens

You get a fly brain to play beat saber and out of ALL THE THINGS YOU CURSE IT TO PLAY AMONG US

Yes

Who will be the first to run doom on a fly brain

this guy

@OffgridAlaskan

Give it some Camellia on Expert+. Need to see those fly reflexes in action

ok sure i'll give it something hard (its missing a lot of notes still, motor control isn't perfect. waiting on further RL to complete)

wen multiplayer?

people are torturing this fly like that fucking computer

The fuck is happening

File under: man-made horrors that fucking rip

I don’t know how I should I feel about it being better at the game than I am

the singularity is so much goofier than I ever imagined

@Sierealttv @Bizzy825 watch out you got competition

We got a fruit fly connectome playing Doom before GTA 6

ok but does it actually beat the human high score or just flail at the blocks

for now it just flails

U werent kidding when u said mostly pretraining and rl lol

thats a *different* project, more on it later when runs complete

New forms of art before our very eyes

This changes my perception on intelligence entierly.

Damn! 👀

How fast can you get the actual connectome simulation to run? If that is not the limiting factor, throw this entire thing into PufferLib. Our training infra can push upwards of 50M steps/second on a single GPU

Nice fly beat saber playing thing. I was looking into beat saber RL is there a project to do it already?

we are sorta regressing back to pigeon guided missiles, imagine training a fruit fly brain to chase everything that looks like a designated target and slapping it unto a drone

the fly brain can scroll tiktok

@AISafetyMemes

“will put the tuned brain back into a normal env and see what happens”

@ID_AA_Carmack you have competition

!bsr 25f

holy shit this is incredible

Yall gotta stop fucking with the fly cmon