Sviluppo di Modelli Computazionali 3D

(3D Models Generation)

Information

• Lecturers: Dr. Francesco Banterle and Dr. Gianpaolo Palma
• Official e-mail: sviluppodimodelli3d@gmail.com
• Period: 2nd Term
• Time:
  • Tuesday: from 14:30 to 17:30; Room: A13 MS Teams
  • Wednesday: from 11:30 to 13:30; Room: SI3 MS Teams
• Building: School of Engineering, University of Pisa

Abstract

This course introduces methods and techniques for generating 3D models from medical images (CT, MRI, etc.),  2D photographs (structure-from-motion + densification), and depth images (e.g., 3D laser scanners, time-of-flight scanners, Microsoft Kinect, etc.).

Lectures

Week 1

• 03/03/2020 - Introduction.
• 03/03/2020 - 3D Taxonomy.
• 04/03/2020 - 3D Meshes.

Week 2

• 10/03/2020 - 3D from Volume Part I (lecture via Microsoft Teams).
• 11/03/2020 - Laboratory 1 text and code. Result code.

Week 3

• 17/03/2020 - 3D from Volume Part II (lecture via Microsoft Teams).
• 18/03/2020 - Laboratory 2 text: Volume Segmentation using 3D Slicer.

Week 4

• 24/03/2020 - 3D from Volume Part II (lecture via Microsoft Teams).
• 24/03/2020 - 3D from Volume Part II: Machine Learning (lecture via Microsoft Teams).
• 24/03/2020 - 3D from Volume Part III (lecture via Microsoft Teams).
• 25/03/2020 - Laboratory 3 text: Volume Segmentation using 3D Slicer.

Week 5

• 31/03/2020 - 3D from Photos Part I (lecture via Microsoft Teams).
• 31/03/2020 - 3D from Photos Part II (lecture via Microsoft Teams).
• 01/04/2020 - Laboratory 3 text: Volume Segmentation using 3D Slicer.

Week 6

• 07/04/2020 - 3D from Photos Part II (lecture via Microsoft Teams).
• 07/04/2020 - 3D from Photos Part III (lecture via Microsoft Teams).
• 08/04/2020 - Laboratory 4 text: 3D from Photographs using Regard3D.

Week 7

• 14/04/2020 - Easter break.
• 15/04/2020 - Easter break.

Week 8

• 21/04/2020 - 3D from Photos Part III (lecture via Microsoft Teams).
• 21/04/2020 - 3D from Photos Part IV (lecture via Microsoft Teams).
• 22/04/2020 - TBA.

Week 9

• 28/04/2020 - 3D from Photos Part IV (lecture via Microsoft Teams).
• 28/04/2020 - 3D from Photos Part V (lecture via Microsoft Teams).
• 29/04/2020 - Laboratory recap (lecture via Microsoft Teams).

Week 10

• 05/05/2020 - 3D from Range: Sensors. (lecture via Microsoft Teams).
• 05/05/2020 - 3D from Range: Optical Active. (lecture via Microsoft Teams).
• 06/05/2020 - 3D from Range: Surface Cleaning and Smoothing. (lecture via Microsoft Teams).

Week 11

• 12/05/2020 - 3D from Range: Surface Registration. (lecture via Microsoft Teams).
• 13/05/2020 - 3D from Range: Surface Reconstruction. (lecture via Microsoft Teams).

Week 12

• 19/05/2020 - 3D from Range: Simplification. (lecture via Microsoft Teams).
• 19/05/2020 - 3D from Range: Visual Appearance and Color. (lecture via Microsoft Teams).
• 20/05/2020 - Laboratory (lecture via Microsoft Teams).

Week 13

• 26/05/2020 - Laboratory (lecture via Microsoft Teams).
• 27/05/2020 - Laboratory (lecture via Microsoft Teams).

Past Years Webpages

• 2018/19.
• 2017/18.
• 2016/17.

Reference Books

• Digital Image Processing for Medical Applications, a image processing book by Geoff Dougherty.
• Computer Vision: Algorithms and Applications, a computer vision book by Richard Szeliski.
• Polygon Mesh Processing, a 3D mesh processing book by book by Mario Botsch, Leif Kobbelt, Mark Pauly, Pierre Alliez, Bruno Levy.
• MATLAB primer, a gentle introduction to MATLAB.

Other Books

• Image Processing in Radiology, a medical image processing book edited by Emanuele Neri, Davide Caramella, and Carlo Bartolozzi.

Software/Code

• MeshLab, an open source 3D meshes editor.
• MeshLab 2020 for Windows10, an open source 3D meshes editor.
• MeshLab 2020 for Apple MacOS, an open source 3D meshes editor.
• MeshLab 2020 for Linux, an open source 3D meshes editor.
• Slicer, an open source 3D software for visualization and medical image computing. Link to download 3D Slicer. Several useful tutorials can be found on youtube:
  • Lumbar Vertebrae segmentation.
  • GrowCut segmentation.
  • Generating models for 3D printing.
  • Heart Segmentation.
• Regard3D, an open source software for 3D reconstruction from photographs.
• COLMAP, an open source software for 3D reconstruction from photographs.
• Metashape, a commercial software (trial link) for 3D reconstruction from photographs.
• VisualSFM, an open source software for 3D reconstruction from photographs. Note a complete package can be downloaded at this webpage.
• Piccante, an open source software C++11 library for imaging.

Tutorials

• Mister P.'s Tutorials for MeshLab.
• 3D Slicer's Tutorials.

Datasets

• The Volume Library.
• OpenfMRI.org.
• Utah SCI CT datasets archive.
• Multi-View datasets.
• 3D Scanning Pipeline.
• Color Projection.
• Long Range Scanning.
• Gargoyle Auto-registration Example.