The first edition of “Digital Spaces for Research and Medicine” will take place at Institut Curie on July 7th, 2022. This event will be dedicated to providing scientists and clinicians insight into Virtual Reality, Augmented Reality and Mixed Reality based tools that offer novel and powerful ways for visualizing and analysing data in research and medicine. This day will include presentations of the tools followed by hands-on demonstrations. The day will close with an open forum for questions and discussing future perspective. The following tools will be presented:

  • MorphoNet-VR (Serpico-STED, Inria-UMR144 Institut Curie and LIRMM): Visualizing live microscopy data (3D+T) in VR
  • Genuage (Team LOCCO, UMR168, Institut Curie): visualization and analysis of multidimensional point cloud data, such as single molecule data, in virtual reality
  • DIVA (Institut Pasteur, Institut Curie): 3D reconstructions of raw experimental image stacks that are integrated in virtual reality for volumetric analysis
  • Tamed Cloud (ENSADLab): immersive VR experience to interact with cloud of images
  • HoloTracks (TEAM INRAE-Unité MaIAGE / AVIZ Inria, Paris Saclay): Immersive (AR) visualization of dynamic compounds in living cells
  • UnityMol A&VR (UPR 9080, IBPC) : deep inside molecules – digital twins at the nanoscale

Presentations of the tools will be at amphitheater Burg and online (click here to join)

Registration is mandatory for hands-on demonstrations : register here to book your slot!

Program

9 – 9.15 am Welcome coffee

9.15 – 11.30 am Presentations of the tools

11.30 – 1 pm Demonstrations part 1

2 – 5 pm Demonstrations part 2

5 – 6 pm Discussion “Future and perspectives”

6pm Cocktail

Poster_DigitalSpacesforResearchandMedicineDownload

Cryogenic electron tomography (cryo-ET) visualizes the 3D spatial distribution of macromolecules at nanometer resolution inside native cells. However, automated identification of macromolecules inside cellular tomograms is challenged by noise and reconstruction artifacts, as well as the presence of many molecular species in the crowded volumes. 

To overcome these obstacles, an international team of scientists from France, Spain and Germany, under the leadership of Charles Kervrann, from France BioImaging BioImage Informatics Node, developed a deep learning-based framework to quickly identify multiple classes of macromolecules in cryo-ET volumes. This DeepFinder pro­gram, now published in Nature Methods, builds upon convolutional neural networks that have already proven highly valuable in the microscopy field.

Overview of DeepFinder (from Moebel, E., et al., Nat Methods 18, 1386–1394 (2021).

a) The DeepFinder workflow consists of a training stage (stage I) and an analysis (or inference) stage (stage II). These two stages correspond to five steps (represented by blue boxes) to locate macromolecular complexes within crowded cells.

b) Ribosome localization with DeepFinder in a cryo-electron tomogram of a C. reinhardtii cell.
Tomographic slice with superimposed segmented cell membrane (gray) and ribosomes classified with respect to their binding states: membrane-bound (blue) and cytosolic (yellow).

c) Tomographic slices showing coordinates
of detected ribosomes (colors correspond to b). The positions and classes were determined by analyzing the segmentation map shown in b. This
analysis used 48 tomograms for training, one for validation and eight for testing. Scale bar, 60 nm.

Once trained, the inference stage of DeepFinder is faster than template matching and performs better than other competitive deep learning methods at identifying macromolecules of various sizes in both synthetic and experimental datasets. On cellular cryo-ET data, DeepFinder localized membrane-bound and cytosolic ribosomes (roughly 3.2 MDa), ribulose 1,5-bisphosphate carboxylase–oxygenase (roughly 560 kDa soluble complex) and photosystem II (roughly 550 kDa membrane complex) with an accuracy comparable to expert-supervised ground truth annotations. DeepFinder is therefore a promising algorithm for the semiautomated analysis of a wide range of molecular targets in cellular tomograms. It also serves as a prime example illustrating the importance of developing efficient, customized AI tools to accelerate knowledge generation in the biomedical life sciences.

DeepFinder has been implemented as a free, open-source program with an accessible graphical user interface.

The team is currently working on adapting it to fluorescence microscopy.

Moebel, E., Martinez-Sanchez, A., Lamm, L. et al. Deep learning improves macromolecule identification in 3D cellular cryo-electron tomograms. Nat Methods 18, 1386–1394 (2021). https://doi.org/10.1038/s41592-021-01275-4

Contact