正在加载视频...

视频加载失败

I built a biologically inspired spiking neural network from scratch and it learned with %5 accuracy to do addition :) There is no backpropagation, no artificial loss functions - just spikes, synapses, and dopamine-like reward signals. it uses STDP -> "Spike-Timing-Dependent Plasticity" with modulated rewards This is super fun...

447,188 次观看 • 9 个月前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Bio inspired Hebbian probabilistic network learns in less than 5 minutes from a super sparse single reward per episode! also has imitation learning (manual control) system has 3 parallel competing networks which get sensory input from a 360 vision (27-direction sensory neuron array) link to code in comment each sub-network is responsible for a single motor action: forward, left and right. at each step whichever section has most neurons firing wins neurons fire probabilistically and mark themselves with a time-decay tag which happens when a neuron fires and diminishes with time. you can see this " tag countdown" on each neuron when a reward is attained(eating the cheese) eligible connections gets strengthened I included 2 runs in the video first was 15 minutes in real time and second was 5 minutes. red plot is the rolling average of last 10 time to cheese. it is really not possible for agent to achieve full control due to probabilistic neural firing. that is why it has to learn while jittering all over the place, which in itself is interesting in manual mode you can guide the cheese by stimulating its motor control networks ( still probabilistically ) and the rewards will still work ✅ Biologically Plausible Features: Stochastic firing (neurons in the brain fire probabilistically) Reward-based learning (dopamine-like neuromodulation) Hebbian plasticity (well-established biological mechanism) Eligibility traces (biological neurons have temporal credit assignment) Sparse sensory encoding (similar to place cells, grid cells) Competitive action selection (basal ganglia architecture) No backpropagation (which is biologically implausible) ❌ Missing Biological Features: No recurrent connections (real brains have extensive feedback loops) No inhibitory neurons (GABAergic neurons are ~20% of cortex) No spike timing (simplified from true spiking dynamics) Uniform layer structure (biological networks are more heterogeneous) Simple weight updates (real synaptic plasticity is more complex)

echo.hive

33,638 次观看 • 8 个月前