Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Hopfield recall Spiking Neural network now this one is cool isn't it? -open source, link in comment- This is a Spiking Neural Network (SNN) that can learn and recall patterns through Hebbian learning, similar to a Hopfield network but using biologically-inspired spiking dynamics rather than energy-based settling.

echo.hive

13,966 subscribers

31,452 views • 7 months ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Implemented a visualization for the neural network today. This is a neural network being trained to learn the snake game in a terminal. It's built in Rust using Ratatui More input details in thread

Implemented a visualization for the neural network today. This is a neural network being trained to learn the snake game in a terminal. It's built in Rust using Ratatui More input details in thread

Bones

165,700 views • 2 years ago

I built a biologically inspired spiking neural network from scratch and it learned with %5 accuracy to do addition :) There is no backpropagation, no artificial loss functions - just spikes, synapses, and dopamine-like reward signals. it uses STDP -> "Spike-Timing-Dependent Plasticity" with modulated rewards This is super fun and I will try to get it to learn with better accuracy. I also need to better understand how all the moving parts fit together Link to source code in comment which has a detailed readme and html with animations explaining how it all works

I built a biologically inspired spiking neural network from scratch and it learned with %5 accuracy to do addition :) There is no backpropagation, no artificial loss functions - just spikes, synapses, and dopamine-like reward signals. it uses STDP -> "Spike-Timing-Dependent Plasticity" with modulated rewards This is super fun and I will try to get it to learn with better accuracy. I also need to better understand how all the moving parts fit together Link to source code in comment which has a detailed readme and html with animations explaining how it all works

echo.hive

447,573 views • 9 months ago

We built a Spiking Neural Network (SNN) to fully control a physical robot arm (6-DOF), and it's running entirely on a Raspberry Pi (no HAT). In our approach, the SNN starts untrained and drives the servos directly, learning in real time through local learning rules (no backprop or gradient descent). The goal with Twitch-y (the robot + SNN brain) is to let it explore and build an understanding of its own body until it can touch the plate on the mat, while also validating the SNN architecture and some of the math. In the video: - Top right: the SNN architecture - Bottom right: the mini-brain spiking in real time while controlling the arm - Left: Twitch-y (Hugging Face SO-101) If you want to learn more about Artificial Brains, come visit us this Friday (13th), at Founders Inc 👉

We built a Spiking Neural Network (SNN) to fully control a physical robot arm (6-DOF), and it's running entirely on a Raspberry Pi (no HAT). In our approach, the SNN starts untrained and drives the servos directly, learning in real time through local learning rules (no backprop or gradient descent). The goal with Twitch-y (the robot + SNN brain) is to let it explore and build an understanding of its own body until it can touch the plate on the mat, while also validating the SNN architecture and some of the math. In the video: - Top right: the SNN architecture - Bottom right: the mini-brain spiking in real time while controlling the arm - Left: Twitch-y (Hugging Face SO-101) If you want to learn more about Artificial Brains, come visit us this Friday (13th), at Founders Inc 👉

Alexander A. Wolf

30,367 views • 6 months ago

Does GPT understand the world? Here is what Ilya Sutskever, co-founder of OpenAI, says during a discussion with Jensen Huang, CEO of Nvidia: (1) When we train a large neural network to accurately predict the next word in lots of different texts from the internet, the AI is learning a world model. (2) On the surface, it may look like learning correlations in text, but it turns out that to 'just learn' statistical correlations in text, to compress information really well, what the neural network learns is some representation of the process that produced the text. (3) This text is a projection of the world...what the neural network is learning is aspects of the world, of people, of the human conditions, their hopes, dreams, motivations, their interactions...the situations we are in. The neural network learns a compressed, abstract, usable representation." Do you think learning representations = understanding? Are large language models simply stochastic parrots, or are they much more?

Does GPT understand the world? Here is what Ilya Sutskever, co-founder of OpenAI, says during a discussion with Jensen Huang, CEO of Nvidia: (1) When we train a large neural network to accurately predict the next word in lots of different texts from the internet, the AI is learning a world model. (2) On the surface, it may look like learning correlations in text, but it turns out that to 'just learn' statistical correlations in text, to compress information really well, what the neural network learns is some representation of the process that produced the text. (3) This text is a projection of the world...what the neural network is learning is aspects of the world, of people, of the human conditions, their hopes, dreams, motivations, their interactions...the situations we are in. The neural network learns a compressed, abstract, usable representation." Do you think learning representations = understanding? Are large language models simply stochastic parrots, or are they much more?

Alex Ker 🔭

1,367,097 views • 2 years ago

Canton Network developer documentation is now consolidated into a single entry point on One place to explore, build, test, and deploy, with role-based learning paths, open source contributions, and built-in AI tooling. Learn:

Canton Network developer documentation is now consolidated into a single entry point on One place to explore, build, test, and deploy, with role-based learning paths, open source contributions, and built-in AI tooling. Learn:

Canton Network

10,097 views • 2 months ago

A Neural Network Can Grow New Neurons Where It Is Confused? In 1994, Bernd Fritzke published A Growing Neural Gas Network Learns Topologies. He introduced a network that starts small, follows incoming data, and inserts new neurons where its error is highest. In the animation, the fog is the drifting data. The glowing nodes are neurons. The fibers are learned connections. The network grows into a living skeleton of the manifold.

A Neural Network Can Grow New Neurons Where It Is Confused? In 1994, Bernd Fritzke published A Growing Neural Gas Network Learns Topologies. He introduced a network that starts small, follows incoming data, and inserts new neurons where its error is highest. In the animation, the fog is the drifting data. The glowing nodes are neurons. The fibers are learned connections. The network grows into a living skeleton of the manifold.

Mathelirium

38,306 views • 3 months ago

I vibecoded this neural network visualization for my students and open sourced it. It shows a simple MLP trained on MNIST handwritten digits at several training steps. The visualization is using Three.js and it comes with training code in PyTorch . Link + repo 👇

I vibecoded this neural network visualization for my students and open sourced it. It shows a simple MLP trained on MNIST handwritten digits at several training steps. The visualization is using Three.js and it comes with training code in PyTorch . Link + repo 👇

David Finsterwalder | eu/acc

487,830 views • 9 months ago

With OpenAI, Figure 01 can now have full conversations with people -OpenAI models provide high-level visual and language intelligence -Figure neural networks deliver fast, low-level, dexterous robot actions Everything in this video is a neural network:

With OpenAI, Figure 01 can now have full conversations with people -OpenAI models provide high-level visual and language intelligence -Figure neural networks deliver fast, low-level, dexterous robot actions Everything in this video is a neural network:

Figure

5,103,035 views • 2 years ago

Watch Spot crouch, jump, climb boxes and leap across gaps, controlled by a neural network trained with reinforcement learning (RL) and multi-expert distillation. Multiple expert policies were trained and distilled together into a single policy that was fine tuned to improve performance over diverse terrains. This work was inspired by ANYmal’s parkour capabilities. The neural network processes depth data from Spot's sensors to construct an understanding of the environment.

Watch Spot crouch, jump, climb boxes and leap across gaps, controlled by a neural network trained with reinforcement learning (RL) and multi-expert distillation. Multiple expert policies were trained and distilled together into a single policy that was fine tuned to improve performance over diverse terrains. This work was inspired by ANYmal’s parkour capabilities. The neural network processes depth data from Spot's sensors to construct an understanding of the environment.

RAI Institute

14,768 views • 3 months ago

Motion planning in complex tasks is hard and still done via slow, explicit, traditional planners. We present a generalist Neural Motion Planner -- a single neural network that plans complex dynamic motions quickly and accurately at test time. Building upon our lab's sim2real efforts, the key idea is to create many complex scenes in simulation and then distill classical motion planner trajectories into a single reactive neural network policy. More details in the thread below! 👇 Open-sourced:

Motion planning in complex tasks is hard and still done via slow, explicit, traditional planners. We present a generalist Neural Motion Planner -- a single neural network that plans complex dynamic motions quickly and accurately at test time. Building upon our lab's sim2real efforts, the key idea is to create many complex scenes in simulation and then distill classical motion planner trajectories into a single reactive neural network policy. More details in the thread below! 👇 Open-sourced:

Deepak Pathak

28,642 views • 1 year ago

📁 Terence Tao, Fields Medalist mathematician, explains that neural networks do not understand concepts, but they uncover hidden patterns. In knot theory, a classical neural network discovered correlations between mathematical invariants no one had anticipated. It started as a black box, then became a real clue to deep structures humans had missed.

📁 Terence Tao, Fields Medalist mathematician, explains that neural networks do not understand concepts, but they uncover hidden patterns. In knot theory, a classical neural network discovered correlations between mathematical invariants no one had anticipated. It started as a black box, then became a real clue to deep structures humans had missed.

Jon Hernandez

204,985 views • 7 months ago

Bio inspired Hebbian probabilistic network learns in less than 5 minutes from a super sparse single reward per episode! also has imitation learning (manual control) system has 3 parallel competing networks which get sensory input from a 360 vision (27-direction sensory neuron array) link to code in comment each sub-network is responsible for a single motor action: forward, left and right. at each step whichever section has most neurons firing wins neurons fire probabilistically and mark themselves with a time-decay tag which happens when a neuron fires and diminishes with time. you can see this " tag countdown" on each neuron when a reward is attained(eating the cheese) eligible connections gets strengthened I included 2 runs in the video first was 15 minutes in real time and second was 5 minutes. red plot is the rolling average of last 10 time to cheese. it is really not possible for agent to achieve full control due to probabilistic neural firing. that is why it has to learn while jittering all over the place, which in itself is interesting in manual mode you can guide the cheese by stimulating its motor control networks ( still probabilistically ) and the rewards will still work ✅ Biologically Plausible Features: Stochastic firing (neurons in the brain fire probabilistically) Reward-based learning (dopamine-like neuromodulation) Hebbian plasticity (well-established biological mechanism) Eligibility traces (biological neurons have temporal credit assignment) Sparse sensory encoding (similar to place cells, grid cells) Competitive action selection (basal ganglia architecture) No backpropagation (which is biologically implausible) ❌ Missing Biological Features: No recurrent connections (real brains have extensive feedback loops) No inhibitory neurons (GABAergic neurons are ~20% of cortex) No spike timing (simplified from true spiking dynamics) Uniform layer structure (biological networks are more heterogeneous) Simple weight updates (real synaptic plasticity is more complex)

Bio inspired Hebbian probabilistic network learns in less than 5 minutes from a super sparse single reward per episode! also has imitation learning (manual control) system has 3 parallel competing networks which get sensory input from a 360 vision (27-direction sensory neuron array) link to code in comment each sub-network is responsible for a single motor action: forward, left and right. at each step whichever section has most neurons firing wins neurons fire probabilistically and mark themselves with a time-decay tag which happens when a neuron fires and diminishes with time. you can see this " tag countdown" on each neuron when a reward is attained(eating the cheese) eligible connections gets strengthened I included 2 runs in the video first was 15 minutes in real time and second was 5 minutes. red plot is the rolling average of last 10 time to cheese. it is really not possible for agent to achieve full control due to probabilistic neural firing. that is why it has to learn while jittering all over the place, which in itself is interesting in manual mode you can guide the cheese by stimulating its motor control networks ( still probabilistically ) and the rewards will still work ✅ Biologically Plausible Features: Stochastic firing (neurons in the brain fire probabilistically) Reward-based learning (dopamine-like neuromodulation) Hebbian plasticity (well-established biological mechanism) Eligibility traces (biological neurons have temporal credit assignment) Sparse sensory encoding (similar to place cells, grid cells) Competitive action selection (basal ganglia architecture) No backpropagation (which is biologically implausible) ❌ Missing Biological Features: No recurrent connections (real brains have extensive feedback loops) No inhibitory neurons (GABAergic neurons are ~20% of cortex) No spike timing (simplified from true spiking dynamics) Uniform layer structure (biological networks are more heterogeneous) Simple weight updates (real synaptic plasticity is more complex)

echo.hive

33,638 views • 9 months ago

A neural network can begin as a flat sheet and learn the shape of hidden data A self-organizing map turns learning into geometry. Each data point pulls one winning neuron toward it, but nearby neurons move too, and so the whole lattice bends without losing its neighborhood structure. The strange part is that the network is not given the roll shape. It discovers the shape through competition and local cooperation. Paper: Self-Organized Formation of Topologically Correct Feature Maps Authors: Teuvo Kohonen Year: 1982

A neural network can begin as a flat sheet and learn the shape of hidden data A self-organizing map turns learning into geometry. Each data point pulls one winning neuron toward it, but nearby neurons move too, and so the whole lattice bends without losing its neighborhood structure. The strange part is that the network is not given the roll shape. It discovers the shape through competition and local cooperation. Paper: Self-Organized Formation of Topologically Correct Feature Maps Authors: Teuvo Kohonen Year: 1982

Mathelirium

129,934 views • 3 months ago

Lockdown stocks are spiking. Oil infrastructure is burning in the UAE. Iran claims it hit a US warship. Daniel Davis Deep Dive says this energy crisis will be bigger than 1973, and something big is coming. He can feel it too.

Lockdown stocks are spiking. Oil infrastructure is burning in the UAE. Iran claims it hit a US warship. Daniel Davis Deep Dive says this energy crisis will be bigger than 1973, and something big is coming. He can feel it too.

Redacted

10,558 views • 3 months ago

Spiking Neural Network from scratch achieves 8% accuracy. no backpropagation or SGD I created a genetic hyper parameter optimizer and it now, on average, can get 8% accuracy which is ~3% above chance Link to source code with a detailed video and markdown explanations in comment it also usually starts lower than 5% and slowly improves then eventually can start dipping below 5%, all of which leads me to believe there is glimmers of learning taking place. sometims it is stabel around 7-8-9% for a long time there is no backpropagation or SGD. it learns via STDP (spike timing dependent plasticity) and a reward mechanism each example is presented n many times (500 in this case) which produces spike train which leads to eligibility list, at the end of a turn based on if the answer was correct or not we adjust the weights using the reward as a multiplier spike timing keeps track of the sequence of neuron firings and which ones were more likely to have lead to the correct answer let me know what you think

Spiking Neural Network from scratch achieves 8% accuracy. no backpropagation or SGD I created a genetic hyper parameter optimizer and it now, on average, can get 8% accuracy which is ~3% above chance Link to source code with a detailed video and markdown explanations in comment it also usually starts lower than 5% and slowly improves then eventually can start dipping below 5%, all of which leads me to believe there is glimmers of learning taking place. sometims it is stabel around 7-8-9% for a long time there is no backpropagation or SGD. it learns via STDP (spike timing dependent plasticity) and a reward mechanism each example is presented n many times (500 in this case) which produces spike train which leads to eligibility list, at the end of a turn based on if the answer was correct or not we adjust the weights using the reward as a multiplier spike timing keeps track of the sequence of neuron firings and which ones were more likely to have lead to the correct answer let me know what you think

echo.hive

225,484 views • 9 months ago

Ever wondered what’s happening inside an AI’s “brain”? This is a neural network in action, taking raw data and transforming it into decisions through thousands of layered calculations. Each layer extracts patterns, refines signals, and passes smarter information forward, slowly turning noise into meaning. It’s not thinking like a human but it is learning, adapting, and improving with every pass. What looks like chaos is actually pure math shaping intelligence in real time

Ever wondered what’s happening inside an AI’s “brain”? This is a neural network in action, taking raw data and transforming it into decisions through thousands of layered calculations. Each layer extracts patterns, refines signals, and passes smarter information forward, slowly turning noise into meaning. It’s not thinking like a human but it is learning, adapting, and improving with every pass. What looks like chaos is actually pure math shaping intelligence in real time

Kekius Maximus

37,481 views • 6 months ago

Using light as a neural network, as this viral video depicts, is actually closer than you think. In 5-10yrs, we could have matrix multiplications in constant time O(1) with 95% less energy. This is the next era of Moore's Law. Let's talk about Silicon Photonics... 1/9

Using light as a neural network, as this viral video depicts, is actually closer than you think. In 5-10yrs, we could have matrix multiplications in constant time O(1) with 95% less energy. This is the next era of Moore's Law. Let's talk about Silicon Photonics... 1/9

Deedy

725,424 views • 1 year ago

Training a Whole-Body Control Foundation Model -- new work from my team at Agility Robotics A neural network for controlling our humanoid robots which is robust to disturbances, can handle heavy objects, and is a powerful platform for learning new whole-body skills learn more in our blog post ->

Training a Whole-Body Control Foundation Model -- new work from my team at Agility Robotics A neural network for controlling our humanoid robots which is robust to disturbances, can handle heavy objects, and is a powerful platform for learning new whole-body skills learn more in our blog post ->

Chris Paxton

45,068 views • 11 months ago

💣 Lockdown stocks are spiking. Oil infrastructure is burning in the UAE. Iran claims it hit a US warship. Daniel Davis Deep Dive says this energy crisis will be bigger than 1973 and something big is coming.

💣 Lockdown stocks are spiking. Oil infrastructure is burning in the UAE. Iran claims it hit a US warship. Daniel Davis Deep Dive says this energy crisis will be bigger than 1973 and something big is coming.

Redacted

12,204 views • 3 months ago