Multiphoton imaging with computational specificity

MSCA (Marie Skłodowska-Curie)HORIZON-TMA-MSCA-PF-GFID: 101103200
EC Contribution
€1,921
Consortium Size
2 orgs
Start Year
2023
Summary

Digital staining based on machine learning models can provide cellular specificity to label-free optical imaging. This concept is particularly interesting for in vivo applications in fundamental research of auto-immune diseases as well as for future clinical translations. In this project “MICS – Multiphoton imaging with computational specificity”, I will develop and implement computational specificity for label-free multiphoton microscopy (MPM) using artificial intelligence (AI). The direct outcome of this project will be two AI modules to perform (i) automated classification of mucosal inflammation based on 3D images from colon tissue and (ii) digital staining of un-stained immune cells. This integration of computational specificity to label-free multiphoton microscopy will allow direct investigation of global tissue alteration as well as specific immune cell localization during inflammatory tissue remodelling. Digital staining is an emerging concept in the field of computational microscopy but has not yet been implemented for immune cells based on label-free MPM images. Building on my previous expertise in label-free in vivo imaging via endomicroscopy, future implementations of multiphoton endomicroscopy would profit from tools for computational specificity, developed during this project.

Consortium (2)

Project Results (9)

Source: CORDIS, the EU research results database.

Publications (6)
EP96: TOWARDS AI-ASSISTED, ALL-OPTICAL ASSESSMENT OF IBD: CLASSIFICATION OF COLITIS USING LABEL-FREE MULTIPHOTON MICROSCOPY AND 3D CONVOLUTIONAL NEURAL NETWORKS
Gastroenterology· 2025DOI
Lucas Kreiß, Maryam Roohian, Amey Chaware, Oana-Maria Thoma, Birgitta Carlé, Oliver Friedrich, Sebastian Schürmann, Maximilian Waldner, Roarke Horstmeyer
Semi-supervised virtual staining using learned-illumination Fourier ptychography for high-speed label-free histopathology
Journal of Physics: Photonics· 2025DOI
Kyung Chul Lee, Hyesuk Chae, Jongho Kim, Lucas Kreiß, Hyeongyu Kim, Yong Guk Kang, Kevin C. Zhou, Amey Chaware, Kanghyun Kim, Shiqi Xu, Suki Kang, Geunbae Bang, Nam Hoon Cho, Dosik Hwang, Roarke Hors
Innovations in signal/image processing and data analysis in optical microscopy
· 2024DOI
Lucas Kreiss, Kevin C. Zhou, Clare B. Cook, Shiqi Xu, Amey Chaware, Roarke Horstmeyer
Rapid 3D imaging at cellular resolution for digital cytopathology with a multi-camera array scanner (MCAS)
npj Imaging· 2024DOI
Kanghyun Kim, Amey Chaware, Clare B. Cook, Shiqi Xu, Monica Abdelmalak, Colin Cooke, Kevin C. Zhou, Mark Harfouche, Paul Reamey, Veton Saliu, Jed Doman, Clay Dugo, Gregor Horstmeyer, Richard Davis, Ian Taylor-Cho, Wen-Chi Foo, Lucas Kreiss, Xiaoyin Sara Jiang, Roarke Horstmeyer
Digital staining in optical microscopy using deep learning -- a review
PhotoniX· 2023DOI
Kreiss, Lucas; Jiang, Shaowei; Li, Xiang; Xu, Shiqi; Zhou, Kevin C.; Mhlberg, Alexander; Lee, Kyung Chul; Kim, Kanghyun; Chaware, Amey; Ando, Michael; Barisoni, Laura; Lee, Seung Ah; Zheng, Guoan; Lafata, Kyle; Friedrich, Oliver; Horstmeyer, Roarke
SEMPAI: a Self‐Enhancing Multi‐Photon Artificial Intelligence for Prior‐Informed Assessment of Muscle Function and Pathology
Advanced Science· 2023DOI
Alexander Mühlberg, Paul Ritter, Simon Langer, Chloë Goossens, Stefanie Nübler, Dominik Schneidereit, Oliver Taubmann, Felix Denzinger, Dominik Nörenberg, Michael Haug, Sebastian Schürmann, Roarke Horstmeyer, Andreas K Maier, Wolfgang H Goldmann, Oliver F
Deliverables (2)
Other Results (1)
Periodic Reporting for period 1 - MICS (Multiphoton imaging with computational specificity)