Real-time rendering (40ms/frame) of a 64GB brain tractogram containing 3 million of individual fibers (5.37 billion segments) compressed down to 7GB. From left to right, the figure shows the rendering using different shadings (solid color, fiber orientation, per-fiber color), the ability for our pipeline to perform interactions with occlusion meshes (here with a cube mesh), and the per-fiber interaction capabilities with a selection (combined here with an occlusion mesh)

Abstract

We present a method to render massive brain tractograms in real time. Tractograms model the white matter architecture of the human brain using millions of 3D polylines (fibers), summing up to billions of segments. They are used by neurosurgeons before surgery as well as by researchers to better understand the brain. A typical raw dataset for a single brain represents dozens of gigabytes of data, preventing their interactive rendering. We address this challenge with a new GPU mesh shader pipeline based on a decomposition of the fiber set into compressed local representations that we call fiblets. Their spatial coherence is used at runtime to efficiently cull hidden geometry at the task shader stage while synthesizing the visible ones as polyline meshlets in a warp-scale parallel fashion at the mesh shader stage. As a result, our pipeline can feed a standard deferred shading engine to visualize the mesostructures of the brain with various classical rendering techniques, as well as simple interaction primitives. We demonstrate that our algorithm provides real-time framerates on very large tractograms that were out of reach for previous methods while offering a fiber-level granularity in both rendering and interaction.

Video

Downloads

• Manuscript: high resolution PDF (36Mb), low resolution PDF (1.7Mb)
• Source code and executable: GitHub repository

Bibtex

@article{SMRB:2022:Fiblets, 
  title = "Fiblets for Real-Time Rendering of Massive Brain Tractograms", 
  author = "J\'er\'emie Schertzer and Corentin Mercier and Sylvain Rousseau and Tamy Boubekeur", 
  year = "2022", 
  journal = "Computer Graphics Forum (Proc. EUROGRAPHICS 2022)",
  number = "2",
  volume = "41",
  pages  = "447--460",
}