Загрузка видео...

Не удалось загрузить видео

На главную

Introducing Neural Developmental Programs (NDPs)🧬🧠Instead of neural networks with fixed architectures, we allow neural networks to grow through a dynamic self-organizing process, inspired by how biological nervous systems develop👇 PDF:

239,970 просмотров • 2 лет назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functions paper page: present a novel type of neural fields that uses general radial bases for signal representation. State-of-the-art neural fields typically rely on grid-based representations for storing local neural features and N-dimensional linear kernels for interpolating features at continuous query points. The spatial positions of their neural features are fixed on grid nodes and cannot well adapt to target signals. Our method instead builds upon general radial bases with flexible kernel position and shape, which have higher spatial adaptivity and can more closely fit target signals. To further improve the channel-wise capacity of radial basis functions, we propose to compose them with multi-frequency sinusoid functions. This technique extends a radial basis to multiple Fourier radial bases of different frequency bands without requiring extra parameters, facilitating the representation of details. Moreover, by marrying adaptive radial bases with grid-based ones, our hybrid combination inherits both adaptivity and interpolation smoothness. We carefully designed weighting schemes to let radial bases adapt to different types of signals effectively. Our experiments on 2D image and 3D signed distance field representation demonstrate the higher accuracy and compactness of our method than prior arts. When applied to neural radiance field reconstruction, our method achieves state-of-the-art rendering quality, with small model size and comparable training speed.

AK

194,469 просмотров • 2 лет назад

Your brain physically rewires itself every time you think a thought. Donald Hebb stumbled onto this principle in 1949 while studying memory formation in lab rats. He noticed something that should have been impossible: neurons that activated simultaneously began forming stronger connections over time, creating dedicated pathways where none existed before. Scientists called it Hebb's Law. The rest of us call it "neurons that fire together wire together." What Hebb discovered wasn't just a mechanism for learning. He had found the biological foundation of human transformation. Every habit, every skill, every automatic response in your body exists as a neural pathway carved by repetition. The route from your bedroom to your kitchen becomes a superhighway in your brain because you walk it every morning. The sequence of movements you use to tie your shoes becomes hardwired because you've done it thousands of times. But, this same process builds your personality. That tendency to check your phone when you feel anxious? Neural pathway. The automatic urge to argue when someone challenges your opinion? Neural pathway. The way you deflect compliments or seek validation or avoid difficult conversations? All neural pathways, strengthened every time you repeat the pattern. Your brain cannot distinguish between physical actions and mental habits. Both carve grooves in your neural architecture. Both become automatic responses when triggered. Both feel like "who you are" because they happen without conscious choice. But, most people spend decades accidentally building neural superhighways to behaviors they claim they want to change. You say you want to be confident, then practice self doubt every day. You say you want to be productive, then strengthen procrastination pathways by checking social media when work feels hard. You say you want authentic relationships, then wire yourself for people pleasing by avoiding conflict whenever it arises. The brain observes your actions and assumes this must be what you want. So it builds infrastructure to make these patterns easier to execute in the future. Neuroplasticity research reveals something most people find deeply unsettling: there is no "fixed self." The personality you think defines you is just a collection of neural pathways that have been reinforced more often than others. The pathways you travel most frequently become the widest roads. The thoughts you think most often become the loudest voices. The behaviors you repeat most consistently become your automatic responses. But the same mechanism that locks you into patterns can unlock you from them. Every time you catch yourself mid pattern and choose differently, you send a signal to your brain that the old pathway might not be serving you anymore. Every time you practice a new response instead of defaulting to the familiar one, you begin building new neural infrastructure. The process feels awkward at first because you're literally walking through mental wilderness, creating trails where no trails existed. But repetition turns trails into paths, paths into roads, roads into superhighways. This is why changing habits through willpower alone fails. You're trying to muscle through established neural superhighways instead of building alternative routes. The old pathways don't disappear just because you want them to. They have to be replaced through deliberate rewiring. The most sophisticated meditation practitioners in the world understand this intuitively. They don't just sit quietly hoping for peace. They systematically rewire their brains by repeatedly choosing calm responses instead of reactive ones. Ten thousand hours of practice creates neural pathways so robust that serenity becomes their default state. Professional athletes do the same thing with performance. They don't just practice their sport. They practice the mental patterns that support excellence until confidence, focus, and resilience become neurologically hardwired. The implications of neuroplasticity extend far beyond personal development. Every social bias, every cultural assumption, every automatic judgment you make exists as neural wiring built through repetition. The way you unconsciously categorize people, the assumptions you make about different groups, the stereotypes that feel "obviously true" are all learned pathways that can be unlearned. Societies change when enough individuals rewire their neural patterns around new ways of thinking and behaving. The brain you have right now is not the brain you're stuck with. It's the brain you've trained through repetition. Every thought you choose, every action you take, every response you practice is a vote for the kind of neural architecture you want to build. Most people cast these votes unconsciously, then wonder why their life feels automatic and unchangeable. The moment you realize you're the architect of your own neural patterns is the moment real transformation becomes possible. Your neurons are firing right now as you read this. What are you choosing to wire them toward?

Darshak Rana ⚡️

52,882 просмотров • 3 месяцев назад

Introducing Kaleido💮 from AI at Meta — a universal generative neural rendering engine for photorealistic, unified object and scene view synthesis. Kaleido is built on a simple but powerful design philosophy: 3D perception is a form of visual common sense. Following this idea, we formulate rendering purely as a sequence-to-sequence generation problem, successfully unifying neural rendering with the architecture principles behind modern language and video models. Unlike traditional neural rendering methods, Kaleido learns 3D purely in a data-driven way, without explicit 3D representations or structures. It acquires spatial understanding directly through large-scale video pretraining, then multi-view 3D data finetuning, inspired by how LLMs acquire textual common sense from large corpora before specialising in domains like coding. Through extensive ablations, we progressively modernised the architecture design and training strategies and tackled key scaling challenges in sequence-to-sequence generative rendering, arriving at a design that’s simple, versatile, and scalable. Kaleido significantly outperforms prior generative models in few-view settings, and remarkably is the first zero-shot generative method matches InstantNGP-level rendering quality in multi-view settings. We view Kaleido also as an alternative step towards world modeling that flexibly spans a spectrum of “realities": with many views, it faithfully reconstructs grounded reality; with fewer views, it imagines plausible unseen details. 🔗 Explore more results and paper:

Shikun Liu

22,332 просмотров • 9 месяцев назад

3D Gaussian Splatting for Real-Time Radiance Field Rendering paper page: Radiance Field methods have recently revolutionized novel-view synthesis of scenes captured with multiple photos or videos. However, achieving high visual quality still requires neural networks that are costly to train and render, while recent faster methods inevitably trade off speed for quality. For unbounded and complete scenes (rather than isolated objects) and 1080p resolution rendering, no current method can achieve real-time display rates. We introduce three key elements that allow us to achieve state-of-the-art visual quality while maintaining competitive training times and importantly allow high-quality real-time (>= 30 fps) novel-view synthesis at 1080p resolution. First, starting from sparse points produced during camera calibration, we represent the scene with 3D Gaussians that preserve desirable properties of continuous volumetric radiance fields for scene optimization while avoiding unnecessary computation in empty space; Second, we perform interleaved optimization/density control of the 3D Gaussians, notably optimizing anisotropic covariance to achieve an accurate representation of the scene; Third, we develop a fast visibility-aware rendering algorithm that supports anisotropic splatting and both accelerates training and allows realtime rendering. We demonstrate state-of-the-art visual quality and real-time rendering on several established datasets.

AK

633,532 просмотров • 3 лет назад