正在加载视频...

视频加载失败

Thick-tissue spatial transcriptomics w/ 3DEEP-HybISS in skin enabled pseudotemporal molecular mapping of hair follicle organogenesis via asynchrony of follicle development: Explore the data for urself: Congrats to Reza Kalhor +team

12,703 次观看 • 2 个月前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Excited to share TERRA, a tissue world model 🧬 Over ~1.5 years we ran a large data-generation + modelling effort to build a world model for human tissues, pretrained on 112M cells from spatial transcriptomics (mostly Xenium 5000-plex + public data). It's built on one of the largest human spatial transcriptomics corpora assembled to date, spanning 20 tissues across development, health and 26 disease conditions, ~two-thirds newly generated in-house. Why a "world model" for tissue? Images have universal representations (ViT/DINOv3), so do proteins (ESM, Alex Rives) and pathology (UNI, Faisal Mahmood). We've worked hard to build something similar for human tissue: one model that captures its multi-scale logic, genes → cells → their native microenvironments. Like the JEPA approach Yann LeCun has championed, TERRA learns by prediction in embedding space, but for human tissue. How it works: it tokenises each cell together with its nearest neighbours into one sequence while keeping every gene's identity, then masks part of a neighbourhood and predicts the representation of the hidden part, not raw noisy counts. From one backbone it reads out three scales, gene embeddings (what a gene is doing in a cell and its niche), cell embeddings (cell type and state) and neighbourhood embeddings (the niche), and because it keeps gene-level resolution it can knock a gene out in silico and predict the response. Applied entirely zero-shot, TERRA maps and perturbs human tissue across unseen organs, diseases and technologies, outperforming existing spatial approaches. Three take-homes: 1️⃣ One model, any tissue. A single pretrained backbone provides tissue representations zero-shot, handling genes, cells and niches across organs and platforms, off the shelf. 2️⃣ New biology, development to clinic. We built a new spatial atlas of the developing human pancreas and found an islet-associated capillary state that looks like a precursor of mature islet vasculature. In kidney, TERRA's in silico knockouts predicted the tissue-injury programme from cancer immunotherapy (checkpoint blockade), confirmed in treated kidneys, detected in blood, and linked to declining kidney function. 3️⃣ A grammar of tissue architecture. By coupling each cell's state to its niche, TERRA defines recurring cross-organ "archetypes" of macrophage neighbourhoods, including a tumour-boundary niche that tracks poor survival in kidney cancer. TERRA is already in use: it powered our recent skin atlas of hidden immune-memory niches ( with more studies coming soon. This was an amazing collaboration between clinicians, machine-learning scientists and cell biologists 🙏 Led by Sebastian Birk, Vali Sanian Amirhosein Vahidi, Samuel Ogden, Daniyal Jafree, Adib Miraki, Carlo Leonardi and Arpit Merchant, with Lassi Paavolainen, Menna Clatworthy, Omer Ali Bayraktar, Muzlifah Haniffa, Tom Mitchell and Mostafa Bakhti. Huge thanks too to everyone who shared data and helped along the way. What excites me most is seeing how the community builds on this. The model, code and tutorials are all public, so anyone can run TERRA on their own tissues, extend it, or build new models on top. Huge thanks to the whole team across Wellcome Sanger Institute and our many collaborators. 📄 Paper: 💻 Code: 🤗 Model: #SpatialTranscriptomics #SpatialGenomics #FoundationModels #AI4Science #MachineLearning #ComputationalBiology #SingleCell #WorldModels

Mo Lotfollahi

50,959 次观看 • 1 个月前

Excited to share our new work on building a multimodal atlas of human skin in health and inflammatory disease — a project I’m especially proud of, bringing together AI, high-throughput genomics, and clinical science to accelerate discovery. Over the past decade, single-cell genomics has transformed how we map cells in human tissues. But a major challenge remains: can we systematically decode how cells organize into functional niches in situ — including those invisible to standard histopathology? To address this, we integrated large-scale scRNA-seq, spatial transcriptomics, histopathology, and AI-driven modeling frameworks to build an in situ atlas of human skin across health and disease. Led by Lloyd Steele, an MD/PhD student working between Haniffa Lab and my lab at Wellcome Sanger Institute and Cambridge University . Another amazing collaboration with Muzz Haniffa, the mastermind behind the work as part of Human Cell Atlas. A key part of this study is that we didn’t build everything from scratch — we leveraged and combined AI methods that actually work! and showed how they can be used together to extract biological insight at scale. We used: • scArches to build and map into a reference scRNA-seq atlas of human skin: • NicheCompass to identify and characterize spatial niches: • MINT-Flow to extract microenvironment-induced cell states and gene programs: Together, these enabled an end-to-end workflow from atlas construction to spatial mapping, niche discovery, and cell state decoding. At scale, we integrated ~5 million cells and 100+ spatial sections, enabling a systematic view of tissue organization. Using this framework, we identified 26 niches in skin, including known histopathologic structures as well as hidden disease-associated niches not visible on H&E. Among the most striking findings were a resident memory T cell-rich sebaceous gland niche and a plasma cell-rich sweat gland niche, suggesting that appendageal structures act as active immunological microenvironments and may contribute to inflammatory memory and disease persistence. Importantly, this atlas is not just descriptive — it is usable. It can support mapping of new datasets, resolve finer cell types and niches, extract microenvironment-driven programs, and enable predictive analyses at scale. More broadly, this work shows what becomes possible when AI, spatial genomics, and atlas-scale data are integrated end-to-end: not just mapping tissues, but systematically decoding them. This was a massive collaboration, and I’m very grateful to the amazing scientists April Foster, Kenny Roberts, and Chloe Admane. Lloyd is an amazing scientist, and I’m especially excited for the community to see more of his work soon — stay tuned. The data and pre-trained models will be released soon. Preprint:

Mo Lotfollahi

11,832 次观看 • 5 个月前

PHOTON COUNTING CT is NOT a better CT It is a NEW imaging modality Photon Counting CT (PCCT) represents a transformative leap in medical imaging, not only as a molecular imaging modality but also as a technology offering ultra-high resolution and functional imaging capabilities. It is fundamentally more than just an enhanced version of traditional CT—PCCT introduces new ways of seeing and understanding the human body, providing critical insights at the molecular, structural, and functional levels. This positions PCCT as a unique imaging modality that requires a fresh approach to technical implementation, operational workflows, and financial planning. Despite the larger upfront investment, PCCT’s ability to drastically reduce downstream healthcare costs makes it a highly valuable investment in the long run. 1. Technical Innovations • Molecular Imaging and Energy Discrimination: Unlike traditional CT, which simply measures the total absorbed energy, PCCT counts individual X-ray photons and differentiates their energy levels. This allows for precise molecular imaging, revealing the composition of tissues and materials at a biochemical level. By distinguishing between different tissue types and contrast agents, PCCT opens up new diagnostic possibilities, such as identifying molecular biomarkers in tumors or distinguishing between stable and unstable plaque in coronary arteries. This capability shifts the focus of imaging from purely anatomical to both anatomical and molecular, offering more comprehensive diagnostic information. • Ultra-High Spatial Resolution: PCCT features significantly smaller detector elements compared to conventional CT scanners, allowing for ultra-high resolution imaging. This means clinicians can visualize fine structures such as microcalcifications in arteries, small lesions in soft tissues, or the intricate architecture of bones. This level of detail was previously unattainable with traditional CT. When combined with molecular imaging, this ultra-high resolution allows for the precise localization and characterization of disease at very early stages, which is essential for early diagnosis and intervention. • Functional Imaging Capabilities: PCCT also excels as a functional imaging modality. By capturing energy-resolved information, PCCT can provide insights into tissue functionality and dynamic physiological processes. For instance, it can detect changes in blood flow, tissue perfusion, and oxygenation without the need for additional contrast agents or scans. This functionality allows for real-time assessment of physiological processes, making it particularly valuable in cardiology, oncology, and neurology for evaluating organ function and monitoring disease progression. • Reduced Noise and Artifact Reduction: Photon-counting technology dramatically reduces electronic noise and imaging artifacts, such as beam hardening, resulting in clearer and more accurate images. The ability to deliver ultra-high resolution images with minimal artifacts improves diagnostic accuracy, reducing the need for repeat scans and ensuring that even subtle abnormalities are detected. 2. Operational Considerations • New Workflow for Molecular, High-Resolution, and Functional Imaging: The integration of molecular, ultra-high resolution, and functional imaging into routine clinical workflows introduces complexity that requires adaptation. Radiologists and technicians need specialized training to interpret and analyze multi-energy datasets that include molecular and functional information. PCCT produces a vast amount of detailed data, requiring clinicians to adopt new imaging protocols and refine their diagnostic approaches to fully leverage its capabilities. • Post-Processing and Data Management: PCCT generates richer, more complex datasets, which necessitates advanced post-processing tools and data management systems. Existing PACS and imaging software may not be equipped to handle such large volumes of data or to process functional and molecular information effectively. This means healthcare institutions must invest in robust IT infrastructure, including upgraded software and storage solutions, as well as provide additional training for staff on new imaging analysis techniques. • Revised Clinical Protocols: The molecular, functional, and ultra-high resolution imaging capabilities of PCCT will likely prompt changes in clinical protocols. For instance, the need for contrast agents may be reduced, simplifying patient preparation and decreasing the risk of adverse reactions. Additionally, the ability to monitor physiological functions in real-time through functional imaging could lead to more dynamic diagnostic procedures, such as assessing the effectiveness of interventions or treatments in real-time. 3. Financial Impact • Higher Initial Investment: PCCT systems are more expensive than traditional CT scanners due to their advanced technology, which includes photon-counting detectors and the computational power required for high-resolution, molecular, and functional imaging. While this upfront cost is significant, it is crucial to view it in the broader context of the downstream benefits and cost reductions that PCCT offers. • Downstream Cost Reductions: Although the initial capital investment is higher, PCCT’s ability to combine molecular, functional, and ultra-high resolution imaging leads to substantial reductions in downstream healthcare costs. Its superior diagnostic accuracy minimizes the need for follow-up tests, repeat scans, or invasive diagnostic procedures, such as diagnostic coronary angiographies. For example, in cardiology, PCCT can precisely differentiate between types of coronary plaque, reducing the need for invasive procedures to assess risk. • Lower Overall Healthcare Expenditures: By enabling earlier, more accurate diagnoses, PCCT can reduce the overall cost of patient care. Early detection of disease, particularly through its molecular and functional imaging capabilities, allows for more targeted treatments, potentially preventing the need for more aggressive and expensive interventions down the line. For instance, early-stage tumor detection via molecular imaging could lead to less invasive treatments, reducing hospital stays and improving patient outcomes, ultimately driving down healthcare costs. • Increased ROI Through Enhanced Patient Outcomes: Over time, the combination of molecular, functional, and ultra-high resolution imaging enhances diagnostic precision, which translates into better patient outcomes. Improved diagnostic accuracy reduces the incidence of unnecessary procedures, minimizes treatment delays, and results in more personalized and effective care. This leads to increased patient satisfaction, better healthcare outcomes, and greater patient throughput—all factors that improve the institution’s return on investment (ROI). • Competitive Advantage and New Revenue Streams: By adopting PCCT, healthcare institutions position themselves at the forefront of advanced imaging technologies. The ability to offer molecular, functional, and ultra-high resolution imaging creates a competitive advantage, attracting more complex and high-value cases. This can boost the institution’s reputation for excellence in diagnostics, leading to increased referrals, new patient populations, and expanded revenue opportunities. Summary Photon Counting CT (PCCT) is not just an evolution of existing CT technology—it is a molecular, ultra-high resolution, and functional imaging modality that fundamentally transforms the diagnostic landscape. Its ability to capture detailed molecular data, visualize minute anatomical structures with ultra-high resolution, and provide real-time functional imaging opens new possibilities for earlier and more precise diagnoses. While the financial investment in PCCT is larger, the reduction in downstream healthcare costs through improved diagnostic accuracy, fewer unnecessary interventions, and earlier disease detection far outweighs the initial expense. For institutions committed to advancing patient care and improving long-term financial outcomes, PCCT is an essential investment in the future of medical imaging. The video attached shows a patient accessing the Hospital for ACS. PCCT can provide ALL the imaging information of the concurrent imaging modalities (CXR, CAG, Echo, CMR) that you see around it... that's a lot! #PhotonCountingCT #MolecularImaging #UltraHighResolution #FunctionalImaging #FutureOfImaging #AdvancedMedicalImaging #EarlyDiseaseDetection #InnovativeCT #CuttingEdgeHealthcare #PrecisionDiagnostics #HealthcareInnovation #MedicalTechnology #CostEffectiveImaging #NextGenCT #PatientCareRevolution

Dr. Filippo Cademartiri

11,849 次观看 • 1 年前

Google presents Still-Moving Customized Video Generation without Customized Video Data Customizing text-to-image (T2I) models has seen tremendous progress recently, particularly in areas such as personalization, stylization, and conditional generation. However, expanding this progress to video generation is still in its infancy, primarily due to the lack of customized video data. In this work, we introduce Still-Moving, a novel generic framework for customizing a text-to-video (T2V) model, without requiring any customized video data. The framework applies to the prominent T2V design where the video model is built over a text-to-image (T2I) model (e.g., via inflation). We assume access to a customized version of the T2I model, trained only on still image data (e.g., using DreamBooth or StyleDrop). Naively plugging in the weights of the customized T2I model into the T2V model often leads to significant artifacts or insufficient adherence to the customization data. To overcome this issue, we train lightweight Spatial Adapters that adjust the features produced by the injected T2I layers. Importantly, our adapters are trained on "frozen videos" (i.e., repeated images), constructed from image samples generated by the customized T2I model. This training is facilitated by a novel Motion Adapter module, which allows us to train on such static videos while preserving the motion prior of the video model. At test time, we remove the Motion Adapter modules and leave in only the trained Spatial Adapters. This restores the motion prior of the T2V model while adhering to the spatial prior of the customized T2I model. We demonstrate the effectiveness of our approach on diverse tasks including personalized, stylized, and conditional generation. In all evaluated scenarios, our method seamlessly integrates the spatial prior of the customized T2I model with a motion prior supplied by the T2V model.

AK

40,485 次观看 • 2 年前