正在加载视频...
视频加载失败
I’m thrilled to present the KAN Convolutional Layer, a promising neural architecture for image processing. Last week KANs came out, as an alternative to the MLP. We extended this idea to Convolutional Layers, creating the KAN Convolution. Join me in this thread to more about it🧵
200,285 次观看 • 2 年前 •via X (Twitter)
0 条评论
暂无评论
原始帖子的评论将显示在这里
![An image is nothing but a matrix of pixel values. Sending a photo through a pasta machine twice to obtain 4 understandable images from it, visualizing at the same time the principle on which Convolutional Neural Networks operate [📹 Kensuke Koike]](https://image.24vids.com/tw-1711754709722095798/ext_tw_video_thumb/1634986823804911616/pu/img/MLIBCkVc6Q3ZtQmh.jpg)
![Fukushima's video (1986) shows a CNN that recognises handwritten digits [3], three years before LeCun's video (1989). CNN timeline taken from [5]: ★ 1969: Kunihiko Fukushima published rectified linear units or ReLUs [1] which are now extensively used in CNNs. ★ 1979: Fukushima published the basic CNN architecture with convolution layers and downsampling layers [2]. He called it neocognitron. It was trained by unsupervised learning rules. Compute was 100 times more expensive than in 1989, and a billion times more expensive than today. ★ 1986: Fukushima's video on recognising hand-written digits [3]. ★ 1988: Wei Zhang et al had the first "modern" 2-dimensional CNN trained by backpropagation, and also applied it to character recognition [4]. Compute was about 10 million times more expensive than today. ★ 1989-: later work by others [5]. REFERENCES (more in [5]) [1] K. Fukushima (1969). Visual feature extraction by a multilayered network of analog threshold elements. IEEE Transactions on Systems Science and Cybernetics. 5 (4): 322-333. This work introduced rectified linear units or ReLUs, now widely used in CNNs and other neural nets. [2] K. Fukushima (1979). Neural network model for a mechanism of pattern recognition unaffected by shift in position—Neocognitron. Trans. IECE, vol. J62-A, no. 10, pp. 658-665, 1979. The first deep convolutional neural network architecture, with alternating convolutional layers and downsampling layers. In Japanese. English version: 1980. [3] Movie produced by K. Fukushima, S. Miyake and T. Ito (NHK Science and Technical Research Laboratories), in 1986. YouTube: [4] W. Zhang, J. Tanida, K. Itoh, Y. Ichioka. Shift-invariant pattern recognition neural network and its optical architecture. Proc. Annual Conference of the Japan Society of Applied Physics, 1988. First "modern" backpropagation-trained 2-dimensional CNN, applied to character recognition. [5] J. Schmidhuber (AI Blog, 2025). Who invented convolutional neural networks?](https://image.24vids.com/tw-1995875626092315116/amplify_video_thumb/1995874290957246464/img/eSqWV92Ig7PvvIiH.jpg)
