Loading video...

Video Failed to Load

Go Home

Very excited to share that our DELiVR method is now open access published @NatureMethods. We created a simple, brain-wide cell analysis deep learning tool, no coding needed! Fiji Plugin makes it accessible to all. by Doris Kaltenecker Rami @moritz_negwer

56,854 views • 2 years ago •via X (Twitter)

20 Comments

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

2/n DELiVR is a robust deep-learning pipeline for whole-brain cell mapping. It operates through a user-friendly Fiji plugin. Re-trainable on custom data, DELiVR simplifies and streamlines brain cell analysis.

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

3/n Background: Tissue clearing and fluorescent imaging have transformed how we view protein activities in whole brains, offering a detailed map of neuronal and cellular dynamics across entire systems.

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

4/n Challenges persist: Imaging whole mouse brains produces large datasets that require reliable analysis. While AI has immense potential, its use is often limited to specialized labs due to the need for extensive annotation and advanced coding skills.

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

5/n DELiVR is our answer to these challenges. A deep learning solution for brain-wide cell mapping, using VR-based annotation. Plus, it's all wrapped in a simple Fiji plugin interface.

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

6/n The VR Advantage: A major bottleneck in training robust deep learning is the volume of required annotated data, which traditional 2D methods struggle to supply quickly. By adopting VR, we have accelerated & enhanced the reliability of the annotation process. #VirtualReality

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

7/n VR not only sped up annotation but also enhanced the quality of our training data, providing a robust dataset for training deep learning models.

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

8/n In addition, DELiVR outperforms traditional segmentation methods for c-Fos, a marker for neuronal activity! #MachineLearning

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

9/n DELiVR offers complete brain segmentation in both original image and atlas space. Cells are mapped and color-coded based on Area IDs for precise regional analysis. Check out our @syGlassVR for a detailed view! #Neuroscience

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

10/n Available for use on any machine from PCs to clusters, DELiVR's compatibility with Docker and Fiji ensures a seamless experience for all researchers. Just plug and play! 🔗

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

11/n After community feedback, we added a Docker container, that also runs via Fiji for researchers to tailor deep learning models to their specific needs. We highlight this feature by segmenting cell bodies of microglia, the immune cells of the brain.

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

12/n The result output of DELiVR allows users to easily observe the color-coded AI segmentation in the original image in different brain sub-areas. Perfect for validating the results! #Imaging

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

13/n Case Study: Using DELiVR, we explored brain activity differences in cancer-associated weight changes in mice, revealing unique insights into neurophysiological adaptations. #CancerResearch

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

14/n Findings Highlight: Mice with weight-stable cancer showed increased neuronal activity, unlike their weight-losing counterparts. This highlights a previously unknown neurophysiological phenotype in cancer-related weight control. #Cachexia

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

15/n Many hyperactive areas were pinpointed in the cortex, highlighting the complex brain-body interactions in cancer dynamics.

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

16/n In Summary: DELiVR is not just a tool but a revolution in analyzing neuronal activity with ease and precision, thanks to its VR-trained, deep learning pipeline and user-friendly Fiji plugin.

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

17/n Beyond neuroscience, DELiVR's application can be a template for other fields, showing how integrating VR with AI annotation can drastically improve data quality and analysis speed.

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

18/n Explore more about DELiVR, access tools, and see it in action! GitHub 🔗Videos & More #OpenScience

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

19/n Read the accompanying paper, out now in Nature Methods!

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

20/n This was a team effort! We couldn't have done it without @Lu_h99 @neuronflow @shan_heather @MihailMuc @zhouyi_rong @jocpae Benedikt Wiestler @MariePiraud @DanielRueckert @JuliaZuber08 @MorignyPauline @RohmMaria @menze_group Stephan Herzig @BerrielDiaz

Ali Max Erturk's profile picture
Ali Max Erturk2 years ago

21/n Work done at @HelmholtzMunich, @LMU_Uniklinikum, @ISD_Research, @TU_Muenchen, @LMU_Muenchen, @kocuniversity and supported by @ERC_Research, and amazing @syGlassVR software.

Related Videos

Today, we’re pushing a major update to Edison Analysis, our data analysis agent, which is tuned for scientific research and SOTA across data analysis benchmarks. In contrast to Kosmos, which runs for 6-12 hours and produces tens of thousands of lines of code, Edison Analysis runs for seconds to minutes and is best for specific, well-defined computational tasks. It is available both on our platform under the Analysis tab, and via API, and costs only one credit per run, so it is available to users on both free and paid tiers. Edison Analysis is a modified version of the data analysis agent Kosmos uses in its trajectories. Try it out! One of the most important improvements over our previous data analysis agents has been the addition of a specialized data retrieval tool. Edison Analysis can either use this tool to access data, or can pull data down directly via API. To evaluate this tool, we ranked the most commonly used public data repositories across recent papers from BioRxiv, and created a new benchmark that measures the ability of a language agent system to retrieve raw data from those sources. Edison Analysis gets 71% on this benchmark, and we’ll be working to increase this over time. You can read more about our benchmarks in the our blog post, link below. Some features worth highlighting: 1. Edison Analysis produces a report on the analysis it runs, along with a Jupyter notebook that you can download to reproduce the analysis yourself. Every figure it produces is linked back to the specific lines of code used to produce the figure, to make it easy to reproduce. 2. It works well with both Python and R. 3. One of the best uses for Edison Analysis is to use it to retrieve datasets that you can then analyze with Kosmos. We have a bunch of major improvements to Edison Analysis coming in the next few months that we’re excited to share. In the meantime, congratulations to the team, especially Ludovico Mitchener, Jon Laurent, Conor Igoe , Alex Andonian, and many more.

Sam Rodriques

61,860 views • 7 months ago

🙌Meet Artifig: A Figma Plugin to Generate Figma Plugins Do you use Figma and ever feel like this: - Your mind is bursting with plugin ideas, but you can't bring them to life because you don't know how to code? - You want to focus on design, but repetitive tasks keep slowing you down? - You dream of creating custom tools for your team, but lack the time or resources? I’ve been there too. That’s why I created Artifig. ✨ What is Artifig? Artifig is an AI-powered Figma plugin that empowers anyone to build their own Figma plugins using just natural language. No coding needed—simply describe what you want, and watch as your idea transforms into a fully functional, real-time plugin. 🚀 Redefining Figma Plugin Development The core philosophy of Artifig is simple: Designers often have countless ideas and creative visions, but many of them remain unrealized due to a lack of technical skills. We believe designers shouldn’t be limited by their inability to code. You should focus on creating, not be held back by technical barriers or repetitive tasks. Artifig takes you directly from "description" to "implementation." 🛠️ How Does It Work? 1. Describe Your Needs: Tell Artifig what you want, like “Create a skew transformation tool for objects, supporting horizontal and vertical skew with real-time preview functionality.” 2. Generate and Run the Plugin: Artifig instantly generates the plugin and runs it right within Figma. For example, the generated plugin can apply skew transformations to objects, precisely controlled via matrix transformations, with an intuitive user experience. 3. Optimize and Iteration: Need adjustments? Simply describe them, and Artifig will Iterating the plugin step by step. 4. Share Your Creations: Publish your plugins to the Artifig community, or remix plugins shared by others to build on their ideas. No learning curve. No complex steps. It’s as simple as that. 🌟 Key Features - Zero Barrier to Entry: No coding experience needed—any Figma user can create plugins effortlessly. - Multilingual Support: Works in multiple languages, including English, Chinese, French, Japanese, and German. - What-You-See-Is-What-You-Get: Generated plugins run in real-time, so you can quickly validate and refine your ideas. - Open and Flexible: The generated plugin code is 100% yours—modify it, distribute it, even use it commercially. - Global Community: Share your plugins, explore others’ creations, and publish your plugins to the Figma community. 🎯 Why is Artifig a Game-Changer? 1. No More Repetitive Work Let AI handle the tedious, time-consuming tasks: batch renaming layers, auto-aligning elements, or applying styles in bulk. All you need to do is say, “Import a PDF and arrange each image on the canvas with 20px spacing.” 2. Quickly Bring Ideas to Life From color contrast checks to data imports and custom components, all your “what if we could” ideas can now become plugins. Just one natural language description, and Artifig makes it happen. 3. Custom Tools for Your Team Build tailored tools for your team, creating unique solutions to streamline your workflow. 4. Not Just a Tool, But a Learning Experience Artifig explains the logic behind the code it generates, helping you understand Figma APIs and JavaScript. Today, you’re a designer; tomorrow, you could also be a design engineer. 🧑‍🚀👩🏻‍💻🥷🏻 Who is Artifig For? - Beginners: No development experience needed—just describe your ideas and let Artifig do the rest. - Experts: Save time and focus on high-value tasks while Artifig handles the repetitive work. - Learners: Use Artifig as a bridge to deepen your understanding of development. - Teams: Build custom tools to enhance collaboration and efficiency. 🎉 Ready to Get Started? I believe designers’ time and focus should be spent on creating, not on wrestling with complex tools. Artifig is the first step toward realizing this vision. Try Artifig now and experience an unprecedented flow of creativity!

yancymin

21,222 views • 1 year ago

Bash is all you need! Which is why I'm introducing my holiday project: just-bash just-bash is a pretty complete implementation of bash in TypeScript designed to be used as a bash tool by AI agents. Because it turns out agents love exploring data via shell scripts, even beyond coding. It comes with grep, sed, awk and the 99th percentile features that an agent like Claude Code or Cursor would use. In fact, Claude Code can use it for secure bash execution. In the package - A bash-tool for AI SDK - A binary for use by yourself or your coding agents - An overlay filesystem to feed files to your agent securely - A Vercel Sandbox compatible API, so you can quickly upgrade to a real VM if you need to run binaries - An example AI agent that explores the just-bash code base using just-bash - I imported the Oils shell bash compatibility suite and just-bash passes a very good chunk What is interesting about this codebase: It was essentially entirely written by Opus 4.5. Coding agents love bash and they are good at reproducing it. They are also great at text-book recursive descent parsers and AST tweet-walk interpreters. That said, it is, like, a lot of code and I didn't read it all 😅. This is very much a hack, but it also seems to be _really_ useful. I haven't really found anything agents want to use that it doesn't support and it's fast and secure (caveats apply). It doesn't have write access to your computer and the filesystem is given a root that the agent cannot escape from. Find it at Related: Our recent blog post how we migrated our data analysis agent to bash tools and achieved incredible quality improvements The video shows the example agent investigating the just-bash code base

Malte Ubl

124,713 views • 6 months ago