Loading video...

Video Failed to Load

Go Home

🔬🤖Excited to share permittivity tensor imaging (PTI), a label-free computational imaging module for high-resolution 3D imaging of dry mass and 3D orientation of organelles, cells, and tissues! 🧬🧫 Just published in Nature Methods Shout out to Li-Hao Yeh , Talon Chandler, Ivan Ivanov, Janie Byrum, Bryant , Syuan-Ming Guo,...

16,611 views • 2 years ago •via X (Twitter)

14 Comments

Shalin Mehta's profile picture
Shalin Mehta2 years ago

Permittivity tensor is a physical property of soft matter that reports the distribution and alignment of biomolecules. For most biological materials, it is a square of the refractive index tensor. Here is a neat illustration, in collaboration with @DrLachie, that shows how a cylindrical lipid bilayer maps to the 3D distribution of the permittivity tensor when it scatters light. If you're curious about why the refractive index is a tensor, check out Feynman's lecture on the origin of the refractive index: 2/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

PTI acquires all of these label-free channels using a modular imaging path. 🔧 Here is a build video illustrating all the components involved in integrating PTI into an existing research microscope. 3/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

PTI encodes the invisible permittivity tensor into visible images using oblique illumination and a polarization-resolved camera. The permittivity tensor is decoded from the volumes with a physics-based image formation model and an inverse algorithm. The combined design of the optical path and algorithms lets us shift the design complexity from the atoms to the bits. 💡🙌 4/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

We share the image formation models and reconstruction algorithms through our vector diffraction library, waveOrder, implemented using PyTorch. Check it out here: Kudos to @talonchandler for his work in making this a performant and readable library that we use every day. 5/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

We are thrilled about the biological data we can obtain with PTI: it enabled high-resolution mapping of the cytopathic effects of SARS-CoV-2 infection on iPSC-derived cardiomyocytes in collaboration with the @BruceConklin lab. We see the 3D distribution of sarcomeres more accurately with PTI than with antibody labeling. 6/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

PTI enabled label-free imaging of changes in the nucleus, nucleoli, cytoskeleton, and cell membrane of epithelial cells (A549) caused by respiratory syncytial virus (RSV) in collaboration with our colleagues @czbiohub. 7/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

The state-of-the-art optical sectioning of PTI allowed 3D imaging of axons in mouse brain tissue sections, capturing architectural details from single axons to whole slices. 8/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

The 3D resolution of PTI is high enough to visualize the complex 3D distribution of axons. Some axons oriented along the z-axis are not visible with many other label-free imaging technologies. Here is an XY, XZ, and YZ fly-through of a volume. 9/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

PTI is easy to multiplex with fluorescence and H&E imaging, allowing label-agnostic mapping of cell and tissue architecture. In this movie, we image a standard H&E stained cardiac tissue slice. 10/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

As I mentioned before, the design complexity lies in the algorithms and calibration. @LiHao_Yeh validated the wave optical model of the microscope and the reconstruction algorithm with methodical simulations of isotropic beads and an anisotropic patterns. 🌊💡 11/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

We needed a calibration target to evaluate the measurements of 3D dry mass and 3D orientation made with PTI. In addition to biological structures of known architecture and isotropic beads, we used anisotropic glass targets built by the Peter Kazansky lab @orctweets. Intriguing side note: anisotropic glass is emerging as a solution for high-density storage. Learn more here: 12/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

@LiHao_Yeh @orctweets This is one of those projects that has taken several iterations and years to finish - look at the timestamps! Special thanks to @rita_strack for being an amazing editor throughout this process. 13/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

Successful execution required the integration of ideas across optics, algorithms, automation, high-performance computing, cell biology, and neuropathology. I am thankful to my colleagues for their expertise and for placing this bet with me. 14/n

Shalin Mehta's profile picture
Shalin Mehta2 years ago

Finally, thanks to Priscilla Chan and Mark Zuckerberg for their support, and to the leadership at @czbiohub for creating an environment where partnerships between technologists and biologists are the norm. /end

Related Videos

PHOTON COUNTING CT is NOT a better CT It is a NEW imaging modality Photon Counting CT (PCCT) represents a transformative leap in medical imaging, not only as a molecular imaging modality but also as a technology offering ultra-high resolution and functional imaging capabilities. It is fundamentally more than just an enhanced version of traditional CT—PCCT introduces new ways of seeing and understanding the human body, providing critical insights at the molecular, structural, and functional levels. This positions PCCT as a unique imaging modality that requires a fresh approach to technical implementation, operational workflows, and financial planning. Despite the larger upfront investment, PCCT’s ability to drastically reduce downstream healthcare costs makes it a highly valuable investment in the long run. 1. Technical Innovations • Molecular Imaging and Energy Discrimination: Unlike traditional CT, which simply measures the total absorbed energy, PCCT counts individual X-ray photons and differentiates their energy levels. This allows for precise molecular imaging, revealing the composition of tissues and materials at a biochemical level. By distinguishing between different tissue types and contrast agents, PCCT opens up new diagnostic possibilities, such as identifying molecular biomarkers in tumors or distinguishing between stable and unstable plaque in coronary arteries. This capability shifts the focus of imaging from purely anatomical to both anatomical and molecular, offering more comprehensive diagnostic information. • Ultra-High Spatial Resolution: PCCT features significantly smaller detector elements compared to conventional CT scanners, allowing for ultra-high resolution imaging. This means clinicians can visualize fine structures such as microcalcifications in arteries, small lesions in soft tissues, or the intricate architecture of bones. This level of detail was previously unattainable with traditional CT. When combined with molecular imaging, this ultra-high resolution allows for the precise localization and characterization of disease at very early stages, which is essential for early diagnosis and intervention. • Functional Imaging Capabilities: PCCT also excels as a functional imaging modality. By capturing energy-resolved information, PCCT can provide insights into tissue functionality and dynamic physiological processes. For instance, it can detect changes in blood flow, tissue perfusion, and oxygenation without the need for additional contrast agents or scans. This functionality allows for real-time assessment of physiological processes, making it particularly valuable in cardiology, oncology, and neurology for evaluating organ function and monitoring disease progression. • Reduced Noise and Artifact Reduction: Photon-counting technology dramatically reduces electronic noise and imaging artifacts, such as beam hardening, resulting in clearer and more accurate images. The ability to deliver ultra-high resolution images with minimal artifacts improves diagnostic accuracy, reducing the need for repeat scans and ensuring that even subtle abnormalities are detected. 2. Operational Considerations • New Workflow for Molecular, High-Resolution, and Functional Imaging: The integration of molecular, ultra-high resolution, and functional imaging into routine clinical workflows introduces complexity that requires adaptation. Radiologists and technicians need specialized training to interpret and analyze multi-energy datasets that include molecular and functional information. PCCT produces a vast amount of detailed data, requiring clinicians to adopt new imaging protocols and refine their diagnostic approaches to fully leverage its capabilities. • Post-Processing and Data Management: PCCT generates richer, more complex datasets, which necessitates advanced post-processing tools and data management systems. Existing PACS and imaging software may not be equipped to handle such large volumes of data or to process functional and molecular information effectively. This means healthcare institutions must invest in robust IT infrastructure, including upgraded software and storage solutions, as well as provide additional training for staff on new imaging analysis techniques. • Revised Clinical Protocols: The molecular, functional, and ultra-high resolution imaging capabilities of PCCT will likely prompt changes in clinical protocols. For instance, the need for contrast agents may be reduced, simplifying patient preparation and decreasing the risk of adverse reactions. Additionally, the ability to monitor physiological functions in real-time through functional imaging could lead to more dynamic diagnostic procedures, such as assessing the effectiveness of interventions or treatments in real-time. 3. Financial Impact • Higher Initial Investment: PCCT systems are more expensive than traditional CT scanners due to their advanced technology, which includes photon-counting detectors and the computational power required for high-resolution, molecular, and functional imaging. While this upfront cost is significant, it is crucial to view it in the broader context of the downstream benefits and cost reductions that PCCT offers. • Downstream Cost Reductions: Although the initial capital investment is higher, PCCT’s ability to combine molecular, functional, and ultra-high resolution imaging leads to substantial reductions in downstream healthcare costs. Its superior diagnostic accuracy minimizes the need for follow-up tests, repeat scans, or invasive diagnostic procedures, such as diagnostic coronary angiographies. For example, in cardiology, PCCT can precisely differentiate between types of coronary plaque, reducing the need for invasive procedures to assess risk. • Lower Overall Healthcare Expenditures: By enabling earlier, more accurate diagnoses, PCCT can reduce the overall cost of patient care. Early detection of disease, particularly through its molecular and functional imaging capabilities, allows for more targeted treatments, potentially preventing the need for more aggressive and expensive interventions down the line. For instance, early-stage tumor detection via molecular imaging could lead to less invasive treatments, reducing hospital stays and improving patient outcomes, ultimately driving down healthcare costs. • Increased ROI Through Enhanced Patient Outcomes: Over time, the combination of molecular, functional, and ultra-high resolution imaging enhances diagnostic precision, which translates into better patient outcomes. Improved diagnostic accuracy reduces the incidence of unnecessary procedures, minimizes treatment delays, and results in more personalized and effective care. This leads to increased patient satisfaction, better healthcare outcomes, and greater patient throughput—all factors that improve the institution’s return on investment (ROI). • Competitive Advantage and New Revenue Streams: By adopting PCCT, healthcare institutions position themselves at the forefront of advanced imaging technologies. The ability to offer molecular, functional, and ultra-high resolution imaging creates a competitive advantage, attracting more complex and high-value cases. This can boost the institution’s reputation for excellence in diagnostics, leading to increased referrals, new patient populations, and expanded revenue opportunities. Summary Photon Counting CT (PCCT) is not just an evolution of existing CT technology—it is a molecular, ultra-high resolution, and functional imaging modality that fundamentally transforms the diagnostic landscape. Its ability to capture detailed molecular data, visualize minute anatomical structures with ultra-high resolution, and provide real-time functional imaging opens new possibilities for earlier and more precise diagnoses. While the financial investment in PCCT is larger, the reduction in downstream healthcare costs through improved diagnostic accuracy, fewer unnecessary interventions, and earlier disease detection far outweighs the initial expense. For institutions committed to advancing patient care and improving long-term financial outcomes, PCCT is an essential investment in the future of medical imaging. The video attached shows a patient accessing the Hospital for ACS. PCCT can provide ALL the imaging information of the concurrent imaging modalities (CXR, CAG, Echo, CMR) that you see around it... that's a lot! #PhotonCountingCT #MolecularImaging #UltraHighResolution #FunctionalImaging #FutureOfImaging #AdvancedMedicalImaging #EarlyDiseaseDetection #InnovativeCT #CuttingEdgeHealthcare #PrecisionDiagnostics #HealthcareInnovation #MedicalTechnology #CostEffectiveImaging #NextGenCT #PatientCareRevolution

Dr. Filippo Cademartiri

11,820 views • 1 year ago