正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Individual Neuron: Neural Network A neuron in a neural network performs a weighted sum of inputs, adds a bias, and applies an activation function like sigmoid, ReLU, or tanh, introducing non-linearity. This output helps the neuron learn and represent patterns in the data.

ₕₐₘₚₜₒₙ — e/acc

171,935 subscribers

47,467 次观看 • 2 年前 •via X (Twitter)

科学技术教育

Anya Rossi• Live Now

Private livecam show

10 条评论

ₕₐₘₚₜₒₙ — e/acc 的头像

ₕₐₘₚₜₒₙ — e/acc2 年前

3 minute data science.

Kiril 的头像

Kiril2 年前

I'd love to know how this sequence of mathematical methods was decided upon?

Max 的头像

Max2 年前

Full video

WikiBonsai 的头像

WikiBonsai2 年前

"neuron (neural network)" tldr: "A neuron in a neural network is a computational unit that processes input, applies an activation function, and produces output, mimicking biological neurons' functionality in artificial intelligence systems."

Shubhranshu Arya 的头像

Shubhranshu Arya2 年前

Such a beautiful and easy to understand visualisation😍

π 的头像

π2 年前

💯

ewe 的头像

ewe2 年前

@diegopatas_ obrigado, agora este perfil aparece com mais frequência para mim, estou até ponderando em seguir hahahahha

I'm Bob 的头像

I'm Bob1 年前

part two please 🙏

Adarsh Kumar 的头像

Adarsh Kumar1 年前

Where can I find the full video?

Scott Somerville 的头像

Scott Somerville1 年前

Can I use this model to describe a set of human interactions? Can something like this model describe the interaction of accounts here on X?

相关视频

Hugo Larochelle explains how a neuron computes its output: first, it calculates the preactivation, the sum of the bias and weighted inputs, and then applies an activation function.

Hugo Larochelle explains how a neuron computes its output: first, it calculates the preactivation, the sum of the bias and weighted inputs, and then applies an activation function.

tetsuo

29,234 次观看 • 7 个月前

The neuron. weighted sums, a bias, a nonlinear bend.

The neuron. weighted sums, a bias, a nonlinear bend.

tetsuo

22,978 次观看 • 20 天前

I've solidified a neural net perceptron into a physical circuit. 100 billion of these is ChatGPT. f(x)= wx+b = 1*1 + 1.5 = 2.5 output = weight * input + bias You can change the input, weight and bias and see the output neuron update. Learning ML can be fun!

I've solidified a neural net perceptron into a physical circuit. 100 billion of these is ChatGPT. f(x)= wx+b = 11 + 1.5 = 2.5 output = weight input + bias You can change the input, weight and bias and see the output neuron update. Learning ML can be fun!

Justin Angel

97,923 次观看 • 28 天前

Introducing Continuous Thought Machines New Blog: Modern AI is powerful, but it’s still distinct from human-like flexible intelligence. We believe neural timing is key. Our Continuous Thought Machine is built from the ground up to use neural dynamics as a powerful representation for intelligence. Thought takes time, and reasoning is a process. Biological brains inspire us with their complex neural activity, where neural timing is critical to intelligence. We’re exploring how to bring that power to AI. The Continuous Thought Machine (CTM) incorporates neuron-level temporal processing and neural synchronization, moving beyond current AI limitations. Our approach has two core innovations: (1) neuron-level temporal processing, where each neuron uses unique parameters to process a history of incoming signals for fine-grained temporal dynamics, and (2) neural synchronization, used as a direct latent representation to modulate data and produce outputs, encoding information directly in the timing of neural activity. Learn more about our approach: Interactive Report: Full Paper: GitHub :

Introducing Continuous Thought Machines New Blog: Modern AI is powerful, but it’s still distinct from human-like flexible intelligence. We believe neural timing is key. Our Continuous Thought Machine is built from the ground up to use neural dynamics as a powerful representation for intelligence. Thought takes time, and reasoning is a process. Biological brains inspire us with their complex neural activity, where neural timing is critical to intelligence. We’re exploring how to bring that power to AI. The Continuous Thought Machine (CTM) incorporates neuron-level temporal processing and neural synchronization, moving beyond current AI limitations. Our approach has two core innovations: (1) neuron-level temporal processing, where each neuron uses unique parameters to process a history of incoming signals for fine-grained temporal dynamics, and (2) neural synchronization, used as a direct latent representation to modulate data and produce outputs, encoding information directly in the timing of neural activity. Learn more about our approach: Interactive Report: Full Paper: GitHub :

Sakana AI

289,680 次观看 • 1 年前

Neuron cell communication Neurons connect to other neurons and transmit information via neurites. These cultured neurons also extend several neurites to connect with neighboring neurons, forming a neural network.

Neuron cell communication Neurons connect to other neurons and transmit information via neurites. These cultured neurons also extend several neurites to connect with neighboring neurons, forming a neural network.

Adrian Dittmann

3,661,004 次观看 • 1 年前

Implemented a visualization for the neural network today. This is a neural network being trained to learn the snake game in a terminal. It's built in Rust using Ratatui More input details in thread

Implemented a visualization for the neural network today. This is a neural network being trained to learn the snake game in a terminal. It's built in Rust using Ratatui More input details in thread

Bones

165,655 次观看 • 2 年前

We often hear that machine learning models "learn patterns in data". But what does that actually look like in geometry? If you dropped a little elastic mesh into a cloud of points and let it learn, how would it fold itself to match the shape of the data? In this scene we watch a self-organizing map...a simple unsupervised neural model...learn the shape of a two-dimensional dataset arranged in a spiral arm. On top of this, we lay down a square grid of neurons whose weights live in the same plane. At the start, this grid is just a flat net floating across the cloud...it knows nothing about the structure underneath. Learning is a repeated game: pick a random data point, find the neuron whose weight is closest, and then nudge that neuron and its neighbours toward the point. Do this again and again, while slowly shrinking how far the neighbourhood influence spreads. #MachineLearning #ManifoldLearning #UnsupervisedLearning #NeuralMaps #GeometricML

We often hear that machine learning models "learn patterns in data". But what does that actually look like in geometry? If you dropped a little elastic mesh into a cloud of points and let it learn, how would it fold itself to match the shape of the data? In this scene we watch a self-organizing map...a simple unsupervised neural model...learn the shape of a two-dimensional dataset arranged in a spiral arm. On top of this, we lay down a square grid of neurons whose weights live in the same plane. At the start, this grid is just a flat net floating across the cloud...it knows nothing about the structure underneath. Learning is a repeated game: pick a random data point, find the neuron whose weight is closest, and then nudge that neuron and its neighbours toward the point. Do this again and again, while slowly shrinking how far the neighbourhood influence spreads. #MachineLearning #ManifoldLearning #UnsupervisedLearning #NeuralMaps #GeometricML

Mathelirium

139,588 次观看 • 6 个月前

A neural network can begin as a flat sheet and learn the shape of hidden data A self-organizing map turns learning into geometry. Each data point pulls one winning neuron toward it, but nearby neurons move too, and so the whole lattice bends without losing its neighborhood structure. The strange part is that the network is not given the roll shape. It discovers the shape through competition and local cooperation. Paper: Self-Organized Formation of Topologically Correct Feature Maps Authors: Teuvo Kohonen Year: 1982

A neural network can begin as a flat sheet and learn the shape of hidden data A self-organizing map turns learning into geometry. Each data point pulls one winning neuron toward it, but nearby neurons move too, and so the whole lattice bends without losing its neighborhood structure. The strange part is that the network is not given the roll shape. It discovers the shape through competition and local cooperation. Paper: Self-Organized Formation of Topologically Correct Feature Maps Authors: Teuvo Kohonen Year: 1982

Mathelirium

129,242 次观看 • 1 个月前

Hopfield recall Spiking Neural network now this one is cool isn't it? -open source, link in comment- This is a Spiking Neural Network (SNN) that can learn and recall patterns through Hebbian learning, similar to a Hopfield network but using biologically-inspired spiking dynamics rather than energy-based settling.

Hopfield recall Spiking Neural network now this one is cool isn't it? -open source, link in comment- This is a Spiking Neural Network (SNN) that can learn and recall patterns through Hebbian learning, similar to a Hopfield network but using biologically-inspired spiking dynamics rather than energy-based settling.

echo.hive

31,452 次观看 • 5 个月前

neuron activation ?

neuron activation ?

alec

41,701 次观看 • 4 个月前

*neuron activation*

neuron activation

フブキ👑 Letourneau🫃(librarian)

411,812 次观看 • 1 年前

Neuron activation

Neuron activation

ibumuc

67,521 次观看 • 1 年前

NEURON ACTIVATION

NEURON ACTIVATION

Madokami | Watch Roll Over and Die ⚔️

174,137 次观看 • 5 个月前

neuron activation

neuron activation

crunch

17,178 次观看 • 1 年前

Inspired by Andrej Karpathy's practice of tinkering with smaller GPTs to gain intuition, I've been training small neural nets to play this simple 2d game I created. On the left is a visualization of the neural net firing in real time. Built with Claude, Three.js, and WebGPU and using JAX from Google DeepMind. I’m piping the neuron activation into Ableton as MIDI to trigger Serum 2.

Inspired by Andrej Karpathy's practice of tinkering with smaller GPTs to gain intuition, I've been training small neural nets to play this simple 2d game I created. On the left is a visualization of the neural net firing in real time. Built with Claude, Three.js, and WebGPU and using JAX from Google DeepMind. I’m piping the neuron activation into Ableton as MIDI to trigger Serum 2.

Aaron Lemke

22,307 次观看 • 2 个月前

doorman neuron activation

doorman neuron activation

SCHIZOPHRENIC69

190,358 次观看 • 2 个月前

We often hear that Machine Learning models learn patterns in data. But what does that actually look like in Geometry? If you dropped a little elastic mesh into a cloud of points and let it learn, how would it fold itself to match the shape of the data? In this scene we watch a Self-Organizing Map (SOM), a simple unsupervised neural model, learn the shape of a 3D datasets l, one static and the other dynamic. On top of this, we lay down a square grid of neurons whose weights live in the same plane. At the start, this grid is just a flat net floating across the cloud. It knows nothing about the structure underneath. Learning is a repeated game: Pick a random data point, find the neuron whose weight is closest, and then nudge that neuron and its neighbours toward the point. Do this again and again, while slowly shrinking how far the neighbourhood influence spreads. Python code is available for Subscribers. #MachineLearning #ManifoldLearning #UnsupervisedLearning #NeuralMaps #GeometricML

We often hear that Machine Learning models learn patterns in data. But what does that actually look like in Geometry? If you dropped a little elastic mesh into a cloud of points and let it learn, how would it fold itself to match the shape of the data? In this scene we watch a Self-Organizing Map (SOM), a simple unsupervised neural model, learn the shape of a 3D datasets l, one static and the other dynamic. On top of this, we lay down a square grid of neurons whose weights live in the same plane. At the start, this grid is just a flat net floating across the cloud. It knows nothing about the structure underneath. Learning is a repeated game: Pick a random data point, find the neuron whose weight is closest, and then nudge that neuron and its neighbours toward the point. Do this again and again, while slowly shrinking how far the neighbourhood influence spreads. Python code is available for Subscribers. #MachineLearning #ManifoldLearning #UnsupervisedLearning #NeuralMaps #GeometricML

Mathelirium

76,011 次观看 • 3 个月前

Andrej Karpathy summarizes how neural networks function, including the process of using a loss function in training and applying backpropagation for optimizing the network parameters through gradient descent.

Andrej Karpathy summarizes how neural networks function, including the process of using a loss function in training and applying backpropagation for optimizing the network parameters through gradient descent.

tetsuo

141,964 次观看 • 7 个月前

We often hear that Machine Learning models learn patterns in data. But what does that look like in geometry? Picture dropping an elastic mesh into a cloud of points and letting it adapt. How would it bend, stretch, and settle so it matches the shape hiding in the data? In this scene we watch a self-organizing map(SOM)...a classic unsupervised neural model...learn a 2D dataset arranged like a spiral arm. Over the points we place a square grid of neurons whose weights live in the same plane. At the start it’s just a flat net drifting across the cloud. No clue what the structure is. Fir the SOM, learning is a repeated game: Pick a random data point, find the neuron whose weight is closest, then nudge that neuron and its neighbours toward the point. Repeat, repeat, repeat...while gradually shrinking how wide the neighbourhood influence spreads. The result is satisfying...the grid stops being a grid and turns into a coordinate sheet wrapped onto the spiral. #MachineLearning #ManifoldLearning #UnsupervisedLearning #NeuralMaps #GeometricML #SelfOrganizingMap #Topology

We often hear that Machine Learning models learn patterns in data. But what does that look like in geometry? Picture dropping an elastic mesh into a cloud of points and letting it adapt. How would it bend, stretch, and settle so it matches the shape hiding in the data? In this scene we watch a self-organizing map(SOM)...a classic unsupervised neural model...learn a 2D dataset arranged like a spiral arm. Over the points we place a square grid of neurons whose weights live in the same plane. At the start it’s just a flat net drifting across the cloud. No clue what the structure is. Fir the SOM, learning is a repeated game: Pick a random data point, find the neuron whose weight is closest, then nudge that neuron and its neighbours toward the point. Repeat, repeat, repeat...while gradually shrinking how wide the neighbourhood influence spreads. The result is satisfying...the grid stops being a grid and turns into a coordinate sheet wrapped onto the spiral. #MachineLearning #ManifoldLearning #UnsupervisedLearning #NeuralMaps #GeometricML #SelfOrganizingMap #Topology

Mathelirium

23,021 次观看 • 4 个月前