Loading video...

Video Failed to Load

Go Home

Want to use deep learning for image analysis but lack the coding skills? We introduce DELiVR, a game-changer in brain-wide cell analysis. No coding required, our Fiji Plug-in does the magic. Hats off to Doris Kaltenecker, Rami, @moritz_negwer! 🧵👇🏼 1/n

244,498 views • 3 years ago •via X (Twitter)

16 Comments

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

2. What makes DELiVR stand out? It's a robust deep-learning pipeline for mapping cFos+ cells in whole brains. Combining tissue clearing, light-sheet microscopy, VR annotation & deep learning, it comes in an easy-to-use FIJI plugin and docker container!

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

3. Understanding the status quo: Tissue clearing and fluorescent imaging techniques have revolutionized protein expression analysis in whole specimens. By immunostaining for immediate early genes like c-Fos, we get a comprehensive view of neuronal activity.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

4. But there are challenges: Current methods often lack sensitivity and specificity, and while deep learning offers solutions, it requires a lot of training data. Moreover, many of the existing deep learning methods aren't user-friendly for biologists.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

5. Introducing DELiVR - our answer to these challenges: a deep learning solution for brain-wide cell analysis, it uses a more accurate and faster VR-based annotation and comes with a user-friendly FIJI plugin.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

6. The VR advantage: The bottleneck for training a powerful deep learning solution is often the amount of annotated data. Traditional 2D annotation methods are time-consuming, so we turned to VR for a faster and more reliable approach.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

7. The results? Our VR approach improved annotation accuracy and sped up the process by 7X on average! We fully annotated our training data in VR, revolutionizing the ground truth data generation process.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

8. Comparing DELiVR to existing solutions: Our method outperforms filter and threshold-based segmentation techniques. With 79.18% instance Dice (+38.66% increase) and 84.70% instance sensitivity (+57.79% increase), it clearly stands out.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

9. Next level with Allen Brain Atlas: DELiVR produces whole-brain segmentation output in the original image and atlas space. Cells are assigned values matching the Area ID of Allen Brain Atlas, enabling brain region-based color-coding. Dive into syGlass video for a closer look!

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

10. At your fingertips: With a docker and Fiji plugin, DELiVR can run on anything from PCs to clusters, creating a seamless workflow for researchers. Just plug in your raw data and output location - voila! Docker & Plugin: Github:

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

11. Real-world impact: Using DELiVR, we explored brain activity in tumor-bearing mice with stable weight and those with cancer-associated weight loss. The results? Fascinating insights into neurophysiological phenotypes related to weight control in cancer.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

12. Findings: We found an increase in neuronal activity in weight-stable cancer mice, a pattern absent in mice experiencing weight loss. This highlights a previously unknown neurophysiological phenotype in cancer-related weight control.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

13. Location matters: Many hyperactive areas were located in the cortex. We also saw an increase in c-Fos+ cells in various hypothalamic nuclei, including the lateral hypothalamic nucleus, known for its role in feeding and metabolism.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

14. Validate with ease: DELiVR makes it simple to validate quantifications & confirm c-Fos expression in anatomical sub-areas in the original image stacks. Color map of the segmentation output allows easy highlighting of cells in the area of interest using standard Fiji tools.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

15. In summary, DELiVR is a VR trained, deep learning pipeline for analyzing neuronal activity markers in mouse brains, in health and disease. Plus, it's user-friendly with an easy-to-launch FIJI plugin.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

16. Beyond neuroscience: DELiVR is more than a tool for neuroscientists. It provides a blueprint for integrating VR into the annotation of training data for AI across various fields, revolutionizing this critical step in machine learning.

Ali Max Erturk's profile picture
Ali Max Erturk3 years ago

17. Explore DELiVR: Preprint: Docker & Plugin & Test Dataset: Github: All videos:

Related Videos

Today, we’re pushing a major update to Edison Analysis, our data analysis agent, which is tuned for scientific research and SOTA across data analysis benchmarks. In contrast to Kosmos, which runs for 6-12 hours and produces tens of thousands of lines of code, Edison Analysis runs for seconds to minutes and is best for specific, well-defined computational tasks. It is available both on our platform under the Analysis tab, and via API, and costs only one credit per run, so it is available to users on both free and paid tiers. Edison Analysis is a modified version of the data analysis agent Kosmos uses in its trajectories. Try it out! One of the most important improvements over our previous data analysis agents has been the addition of a specialized data retrieval tool. Edison Analysis can either use this tool to access data, or can pull data down directly via API. To evaluate this tool, we ranked the most commonly used public data repositories across recent papers from BioRxiv, and created a new benchmark that measures the ability of a language agent system to retrieve raw data from those sources. Edison Analysis gets 71% on this benchmark, and we’ll be working to increase this over time. You can read more about our benchmarks in the our blog post, link below. Some features worth highlighting: 1. Edison Analysis produces a report on the analysis it runs, along with a Jupyter notebook that you can download to reproduce the analysis yourself. Every figure it produces is linked back to the specific lines of code used to produce the figure, to make it easy to reproduce. 2. It works well with both Python and R. 3. One of the best uses for Edison Analysis is to use it to retrieve datasets that you can then analyze with Kosmos. We have a bunch of major improvements to Edison Analysis coming in the next few months that we’re excited to share. In the meantime, congratulations to the team, especially Ludovico Mitchener, Jon Laurent, Conor Igoe , Alex Andonian, and many more.

Sam Rodriques

62,003 views • 10 months ago

Introducing PC-ALM, a local-learning alternative to backpropagation. Our method trains 1000-layer neural nets using only local dynamics, and without backprop. Blog: Standard deep learning relies on backpropagation. The brain, however, cannot implement backpropagation, at least not exactly. How can a physical system, such as the brain, solve multilayer credit assignment without explicit use of backprop? We look for inspiration in two related fields: distributed optimization and NeuroAI. In NeuroAI, predictive coding asks each neuron activation to solve an energy-based inference problem instead of using a standard forward pass. That inference step can be implemented as energy-minimization dynamics on local prediction errors. This perspective -- each layer as a dynamical system -- has proven promising, but performance of predictive coding hasn't scaled well with depth. Credit signals at far ends of the network struggle to diffuse into internal layers. We turn to distributed optimization, generalizing predictive coding to use an augmented Lagrangian instead of energy. This motivation stems back to a classic 1988 paper by LeCun, showing that the Lagrange multipliers of a deep network can be identified with gradients of a supervised loss. The augmented Lagrangian then bridges LeCun's perspective to the standard predictive coding that is used in NeuroAI. We find that this new perspective yields a natural PC-like alternative to backpropagation, resulting in a method we call PC-ALM. PC-ALM differs from PC in that it introduces dual neurons (Lagrange multipliers) as part of the layer-local dynamics, resulting in each layer acting as a PI feedback control system to minimize local prediction errors. We find that PC-ALM is capable of propagating signals to seemingly arbitrary depth, especially in deep narrow networks where standard PC struggles to learn. Ultimately, our motivation here is to understand how distributed physical systems, such as the brain, can compute credit signals using only local coupling and local dynamics. PC-ALM may also inform deep learning in neuromorphic hardware, where dynamics are cheaper than on GPUs. Paper: Code:

Sakana AI

431,727 views • 4 days ago