How to get a mesh from an MRI image?#

[1]:

import pyvista as pv

from polpo.preprocessing import ListSqueeze
from polpo.preprocessing.load.pregnancy import (
    PregnancyPilotMriLoader,
    PregnancyPilotSegmentationsLoader,
)
from polpo.preprocessing.mesh.conversion import PvFromData
from polpo.preprocessing.mri import (
    MeshExtractorFromSegmentedImage,
    MriImageLoader,
    SkimageMarchingCubes,
)

[KeOps] Warning : cuda was detected, but driver API could not be initialized. Switching to cpu only.

[2]:

STATIC_VIZ = True

if STATIC_VIZ:
    pv.set_jupyter_backend("static")

Loading data#

Following How to visualize MRI data?, we start by getting the image data.

[3]:

SESSION_ID = 1

[4]:

loader = PregnancyPilotMriLoader(subset=[SESSION_ID])

pipe = loader + ListSqueeze() + MriImageLoader()

[5]:

img_fdata = pipe()

INFO: Data has already been downloaded... using cached file ('/home/luisfpereira/.herbrain/data/pregnancy/mri/ses-01').

Marching cubes#

We now use marching cubes and transform the output to pyvista.PolyData for visualization.

[6]:

mesh_from_image = SkimageMarchingCubes()

[7]:

mesh = (mesh_from_image + PvFromData())(img_fdata)

Visualization#

[8]:

pl = pv.Plotter(border=False)

pl.show_axes()
pl.add_mesh(mesh, show_edges=True)
pl.show()
../../../_images/_notebooks_how_to_all_mri2mesh_13_0.png

Segmented data#

Load the segmented data.

[9]:

pipe = (
    PregnancyPilotSegmentationsLoader(subset=[SESSION_ID])
    + ListSqueeze()
    + MriImageLoader()
)

[10]:

img_fdata = pipe()

INFO: Data has already been downloaded... using cached file ('/home/luisfpereira/.herbrain/data/pregnancy/Segmentations/BB01').

The process changes only slightly when the data is segmented. (NB: encoding informs about the tool used for segmentation, which matters to map ids to tool ids and colors.)

[11]:

img2mesh = (
    MeshExtractorFromSegmentedImage(return_colors=True, encoding="ashs") + PvFromData()
)

mesh = img2mesh(img_fdata)

[12]:

pl = pv.Plotter(border=False)

pl.show_axes()
pl.add_mesh(mesh, show_edges=True)
pl.show()
../../../_images/_notebooks_how_to_all_mri2mesh_20_0.png

For example, we can select a particular subfield of the hippocampus.

[13]:

img2mesh = (
    MeshExtractorFromSegmentedImage(
        struct_id="PostHipp", return_colors=False, encoding="ashs"
    )
    + PvFromData()
)

mesh = img2mesh(img_fdata)

[14]:

pl = pv.Plotter(border=False)

pl.show_axes()
pl.add_mesh(mesh, show_edges=True)
pl.show()
../../../_images/_notebooks_how_to_all_mri2mesh_23_0.png

Further reading#