Загрузка видео...

Не удалось загрузить видео

На главную

Very excited to share that our DELiVR method is now open access published @NatureMethods. We created a simple, brain-wide cell analysis deep learning tool, no coding needed! Fiji Plugin makes it accessible to all. by Doris Kaltenecker Rami @moritz_negwer

56,904 просмотров • 2 лет назад •via X (Twitter)

Комментарии: 20

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

2/n DELiVR is a robust deep-learning pipeline for whole-brain cell mapping. It operates through a user-friendly Fiji plugin. Re-trainable on custom data, DELiVR simplifies and streamlines brain cell analysis.

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

3/n Background: Tissue clearing and fluorescent imaging have transformed how we view protein activities in whole brains, offering a detailed map of neuronal and cellular dynamics across entire systems.

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

4/n Challenges persist: Imaging whole mouse brains produces large datasets that require reliable analysis. While AI has immense potential, its use is often limited to specialized labs due to the need for extensive annotation and advanced coding skills.

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

5/n DELiVR is our answer to these challenges. A deep learning solution for brain-wide cell mapping, using VR-based annotation. Plus, it's all wrapped in a simple Fiji plugin interface.

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

6/n The VR Advantage: A major bottleneck in training robust deep learning is the volume of required annotated data, which traditional 2D methods struggle to supply quickly. By adopting VR, we have accelerated & enhanced the reliability of the annotation process. #VirtualReality

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

7/n VR not only sped up annotation but also enhanced the quality of our training data, providing a robust dataset for training deep learning models.

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

8/n In addition, DELiVR outperforms traditional segmentation methods for c-Fos, a marker for neuronal activity! #MachineLearning

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

9/n DELiVR offers complete brain segmentation in both original image and atlas space. Cells are mapped and color-coded based on Area IDs for precise regional analysis. Check out our @syGlassVR for a detailed view! #Neuroscience

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

10/n Available for use on any machine from PCs to clusters, DELiVR's compatibility with Docker and Fiji ensures a seamless experience for all researchers. Just plug and play! 🔗

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

11/n After community feedback, we added a Docker container, that also runs via Fiji for researchers to tailor deep learning models to their specific needs. We highlight this feature by segmenting cell bodies of microglia, the immune cells of the brain.

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

12/n The result output of DELiVR allows users to easily observe the color-coded AI segmentation in the original image in different brain sub-areas. Perfect for validating the results! #Imaging

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

13/n Case Study: Using DELiVR, we explored brain activity differences in cancer-associated weight changes in mice, revealing unique insights into neurophysiological adaptations. #CancerResearch

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

14/n Findings Highlight: Mice with weight-stable cancer showed increased neuronal activity, unlike their weight-losing counterparts. This highlights a previously unknown neurophysiological phenotype in cancer-related weight control. #Cachexia

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

15/n Many hyperactive areas were pinpointed in the cortex, highlighting the complex brain-body interactions in cancer dynamics.

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

16/n In Summary: DELiVR is not just a tool but a revolution in analyzing neuronal activity with ease and precision, thanks to its VR-trained, deep learning pipeline and user-friendly Fiji plugin.

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

17/n Beyond neuroscience, DELiVR's application can be a template for other fields, showing how integrating VR with AI annotation can drastically improve data quality and analysis speed.

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

18/n Explore more about DELiVR, access tools, and see it in action! GitHub 🔗Videos & More #OpenScience

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

19/n Read the accompanying paper, out now in Nature Methods!

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

20/n This was a team effort! We couldn't have done it without @Lu_h99 @neuronflow @shan_heather @MihailMuc @zhouyi_rong @jocpae Benedikt Wiestler @MariePiraud @DanielRueckert @JuliaZuber08 @MorignyPauline @RohmMaria @menze_group Stephan Herzig @BerrielDiaz

Фото профиля Ali Max Erturk
Ali Max Erturk2 лет назад

21/n Work done at @HelmholtzMunich, @LMU_Uniklinikum, @ISD_Research, @TU_Muenchen, @LMU_Muenchen, @kocuniversity and supported by @ERC_Research, and amazing @syGlassVR software.

Похожие видео

Today, we’re pushing a major update to Edison Analysis, our data analysis agent, which is tuned for scientific research and SOTA across data analysis benchmarks. In contrast to Kosmos, which runs for 6-12 hours and produces tens of thousands of lines of code, Edison Analysis runs for seconds to minutes and is best for specific, well-defined computational tasks. It is available both on our platform under the Analysis tab, and via API, and costs only one credit per run, so it is available to users on both free and paid tiers. Edison Analysis is a modified version of the data analysis agent Kosmos uses in its trajectories. Try it out! One of the most important improvements over our previous data analysis agents has been the addition of a specialized data retrieval tool. Edison Analysis can either use this tool to access data, or can pull data down directly via API. To evaluate this tool, we ranked the most commonly used public data repositories across recent papers from BioRxiv, and created a new benchmark that measures the ability of a language agent system to retrieve raw data from those sources. Edison Analysis gets 71% on this benchmark, and we’ll be working to increase this over time. You can read more about our benchmarks in the our blog post, link below. Some features worth highlighting: 1. Edison Analysis produces a report on the analysis it runs, along with a Jupyter notebook that you can download to reproduce the analysis yourself. Every figure it produces is linked back to the specific lines of code used to produce the figure, to make it easy to reproduce. 2. It works well with both Python and R. 3. One of the best uses for Edison Analysis is to use it to retrieve datasets that you can then analyze with Kosmos. We have a bunch of major improvements to Edison Analysis coming in the next few months that we’re excited to share. In the meantime, congratulations to the team, especially Ludovico Mitchener, Jon Laurent, Conor Igoe , Alex Andonian, and many more.

Sam Rodriques

62,018 просмотров • 10 месяцев назад

Introducing PC-ALM, a local-learning alternative to backpropagation. Our method trains 1000-layer neural nets using only local dynamics, and without backprop. Blog: Standard deep learning relies on backpropagation. The brain, however, cannot implement backpropagation, at least not exactly. How can a physical system, such as the brain, solve multilayer credit assignment without explicit use of backprop? We look for inspiration in two related fields: distributed optimization and NeuroAI. In NeuroAI, predictive coding asks each neuron activation to solve an energy-based inference problem instead of using a standard forward pass. That inference step can be implemented as energy-minimization dynamics on local prediction errors. This perspective -- each layer as a dynamical system -- has proven promising, but performance of predictive coding hasn't scaled well with depth. Credit signals at far ends of the network struggle to diffuse into internal layers. We turn to distributed optimization, generalizing predictive coding to use an augmented Lagrangian instead of energy. This motivation stems back to a classic 1988 paper by LeCun, showing that the Lagrange multipliers of a deep network can be identified with gradients of a supervised loss. The augmented Lagrangian then bridges LeCun's perspective to the standard predictive coding that is used in NeuroAI. We find that this new perspective yields a natural PC-like alternative to backpropagation, resulting in a method we call PC-ALM. PC-ALM differs from PC in that it introduces dual neurons (Lagrange multipliers) as part of the layer-local dynamics, resulting in each layer acting as a PI feedback control system to minimize local prediction errors. We find that PC-ALM is capable of propagating signals to seemingly arbitrary depth, especially in deep narrow networks where standard PC struggles to learn. Ultimately, our motivation here is to understand how distributed physical systems, such as the brain, can compute credit signals using only local coupling and local dynamics. PC-ALM may also inform deep learning in neuromorphic hardware, where dynamics are cheaper than on GPUs. Paper: Code:

Sakana AI

448,022 просмотров • 18 дней назад

🙌Meet Artifig: A Figma Plugin to Generate Figma Plugins Do you use Figma and ever feel like this: - Your mind is bursting with plugin ideas, but you can't bring them to life because you don't know how to code? - You want to focus on design, but repetitive tasks keep slowing you down? - You dream of creating custom tools for your team, but lack the time or resources? I’ve been there too. That’s why I created Artifig. ✨ What is Artifig? Artifig is an AI-powered Figma plugin that empowers anyone to build their own Figma plugins using just natural language. No coding needed—simply describe what you want, and watch as your idea transforms into a fully functional, real-time plugin. 🚀 Redefining Figma Plugin Development The core philosophy of Artifig is simple: Designers often have countless ideas and creative visions, but many of them remain unrealized due to a lack of technical skills. We believe designers shouldn’t be limited by their inability to code. You should focus on creating, not be held back by technical barriers or repetitive tasks. Artifig takes you directly from "description" to "implementation." 🛠️ How Does It Work? 1. Describe Your Needs: Tell Artifig what you want, like “Create a skew transformation tool for objects, supporting horizontal and vertical skew with real-time preview functionality.” 2. Generate and Run the Plugin: Artifig instantly generates the plugin and runs it right within Figma. For example, the generated plugin can apply skew transformations to objects, precisely controlled via matrix transformations, with an intuitive user experience. 3. Optimize and Iteration: Need adjustments? Simply describe them, and Artifig will Iterating the plugin step by step. 4. Share Your Creations: Publish your plugins to the Artifig community, or remix plugins shared by others to build on their ideas. No learning curve. No complex steps. It’s as simple as that. 🌟 Key Features - Zero Barrier to Entry: No coding experience needed—any Figma user can create plugins effortlessly. - Multilingual Support: Works in multiple languages, including English, Chinese, French, Japanese, and German. - What-You-See-Is-What-You-Get: Generated plugins run in real-time, so you can quickly validate and refine your ideas. - Open and Flexible: The generated plugin code is 100% yours—modify it, distribute it, even use it commercially. - Global Community: Share your plugins, explore others’ creations, and publish your plugins to the Figma community. 🎯 Why is Artifig a Game-Changer? 1. No More Repetitive Work Let AI handle the tedious, time-consuming tasks: batch renaming layers, auto-aligning elements, or applying styles in bulk. All you need to do is say, “Import a PDF and arrange each image on the canvas with 20px spacing.” 2. Quickly Bring Ideas to Life From color contrast checks to data imports and custom components, all your “what if we could” ideas can now become plugins. Just one natural language description, and Artifig makes it happen. 3. Custom Tools for Your Team Build tailored tools for your team, creating unique solutions to streamline your workflow. 4. Not Just a Tool, But a Learning Experience Artifig explains the logic behind the code it generates, helping you understand Figma APIs and JavaScript. Today, you’re a designer; tomorrow, you could also be a design engineer. 🧑‍🚀👩🏻‍💻🥷🏻 Who is Artifig For? - Beginners: No development experience needed—just describe your ideas and let Artifig do the rest. - Experts: Save time and focus on high-value tasks while Artifig handles the repetitive work. - Learners: Use Artifig as a bridge to deepen your understanding of development. - Teams: Build custom tools to enhance collaboration and efficiency. 🎉 Ready to Get Started? I believe designers’ time and focus should be spent on creating, not on wrestling with complex tools. Artifig is the first step toward realizing this vision. Try Artifig now and experience an unprecedented flow of creativity!

yancymin

21,326 просмотров • 1 год назад