Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

can a neural network learn to walk as a physical object in a physics simulation? here I train walking neural nets with an evolutionary algorithm. The input nodes/feet are activated by sine waves at learned phases & connections between two neurons extend based on their difference

339,340 görüntüleme • 3 yıl önce •via X (Twitter)

10 Yorum

Matt Henderson profil fotoğrafı
Matt Henderson3 yıl önce

aka “embodied neural networks”

Matt Henderson profil fotoğrafı
Matt Henderson3 yıl önce

Remember soda constructor?

Patrick Ꝺoyle profil fotoğrafı
Patrick Ꝺoyle3 yıl önce

Whatever the result, they seem to be enjoying themselves.

Eric Jang profil fotoğrafı
Eric Jang3 yıl önce

this is amazing. would you consider open-sourcing the code? I'd love to extend this to optimizing the architecture of the net itself, so it ends up having to trade off physical bulk with function approximation power

Tom profil fotoğrafı
Tom3 yıl önce

Looks kinda similar

Austen Lamacraft profil fotoğrafı
Austen Lamacraft3 yıl önce

Surely a CNN will work better because of the strides?

c7ddfc profil fotoğrafı
c7ddfc3 yıl önce

reminds me of this, also controlled by a neural net

Mike Vella profil fotoğrafı
Mike Vella3 yıl önce

How do you think of this stuff??

Matt Henderson profil fotoğrafı
Matt Henderson3 yıl önce

I saw a cool demo of a neural net controlling an inverted pendulum, and was thinking it would be cool to make a nnet control something. I was also thinking about that old game soda constructor. Then I thought of this idea like a bad joke about learning to walk

Connor McCormick profil fotoğrafı
Connor McCormick3 yıl önce

You should make it so that the ground is a treadmill with numbers on it, and the fitness function rewards it both for walking and for adding the numbers it's touching correctly.

Benzer Videolar

This video, created by my dear coauthor Mahdi E Kahou for our teaching and papers, shows how overparameterized neural networks produce smooth function approximations even in the context of the Runge phenomenon. Some background. Imagine you want to approximate the Runge function using polynomial interpolation at equally spaced points. It is well known that, despite targeting an infinitely differentiable function, such a polynomial approximation produces oscillatory behavior that worsens with the degree of the polynomial. In other words, higher-degree polynomial approximations might not improve accuracy. Instead, approximate the Runge function with a neural network (here, two layers are just to make the example concrete; nothing fundamental depends on it). As you increase the number of parameters well above the 11 training points (in our example, a two-layer neural network with 128 nodes each), you nicely converge to the target, without wild oscillations. Yes, this has much to do with double descent and benign overparameterization, but the main punchline of this post is that neural networks are really very different types of animals than polynomial approximations. And yes, Chebyshev nodes and splines exist, and in this case, they will prevent the oscillations. But that's not the point. Chebyshev nodes and splines still confront Faber’s theorem, which states that for any system of polynomial interpolation nodes, there exists a continuous function whose sequence of interpolating polynomials diverges as the number of nodes grows to infinity. Faber’s theorem does not apply to neural networks because they are not polynomials. The notebook, if you want to check the details, is here: Stay tuned for more on this 👀

Jesús Fernández-Villaverde

47,212 görüntüleme • 4 ay önce

$BRAIN is live. the open-source fly-brain bridge has a ticker now, and the ticker is becoming the input for a physical robot. CA: 9LuwgFQemAoV9rgVBBtwbRSxBmamcRRbysEK8yL2pump what’s already done: the neural bridge is working. camera input becomes activity across eight virtual neural populations, and that activity becomes left and right motor commands IMU data feeds movement back into the model. smoothing, speed limits and a 500 ms watchdog are already built in the synthetic demo runs locally today. the ESP32 scaffold is ready for hardware integration the entire project is open source and MIT licensed github: what’s next, in order: the on-chain listener goes live. every $BRAIN transaction becomes a stimulus sent directly into the neural model then the physical robot connects. the wallet address determines which neurons activate, the amount determines the strength of the impulse, and the brain converts that reaction into movement then the livestream. every transaction, neural impulse and physical response visible in real time then user commands. spend $BRAIN to trigger a stronger reflex, request movement, temporarily control the robot, name a neuron or place your name on the stream the loop, plain: a transaction enters the neurons react the robot moves a Proof of Reflex is created with the transaction hash, neural activity map and video of the physical response the current brain is a small fly-inspired simulation. the bridge and local demo work today. the blockchain connection, physical robot and livestream are being built now the internet becomes its sensory organ. the blockchain becomes its nervous system. $BRAIN makes the body move.

Frank

345,926 görüntüleme • 15 gün önce