Live and Interactive 3D Photomanipulation under the Microscope using Virtual Reality

First Authors Jan Tiemann
Authors Jan Tiemann, Matthew McGinity, Ivo F. Sbalzarini, Ulrik Günther
Corresponding Authors Ulrik Günther
Last Authors Ulrik Günther
Conference Proceedings Volume Title CHI EA '24: Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems
Series Title
Conference Name CHI Conference on Human Factors in Computing Systems
Conference Location Honolulu, Hawaii, USA
Conference Start Date
Conference End Date
Chapter Number 228
Publisher ACM
Conference Proceedings Editors
ISBN
First Page 1
Last Page 7
Open Access true
Print Publication Date 2024-01-01
Online Publication Date 2024-01-01
Abstract State-of-the-art microscopes, as used in cell biology, are not only capable of capturing 3D images, but also permit manipulation of (sub-)cellular structures using techniques such as optical traps, optogenetics or laser ablation. However, such microscopes are still controlled using 2D interfaces, prohibiting actual 3-dimensional manipulation. We present microscenery, a virtual reality (VR) microscope control software, designed to facilitate 3D laser ablation experiments. We combine microscopy automation with VR rendering and intuitive controller-based input to empower biologists with the precision of laser-based techniques while providing the full 3D spatial context of their sample. We describe the design goals and architecture of the software and illustrate the potential of the system by conducting a brief expert review study for 3D ablation experiments. Our results suggest VR is not only an effective interface for microscopic manipulations, but can enable novel experiments which are either impossible with traditional 2D interfaces, or prohibitively time-consuming.
PDF Tiemann_2024_8717.pdf (6.8 MB)
Cover Image
Affiliated With Sbalzarini
Selected By
Acknowledged Services Light Microscopy Facility
Publication Status Published
Edoc Link
Sfx Link
DOI 10.1145/3613905.3651107
PubMed ID
WebOfScience Link
Alternative Full Text URL
Display Publisher Download Only false
Visible On MPI-CBG Website true
PDF Downloadable true
Created By sbalzari
Added Date 2024-05-17
Last Edited By sbalzari
Last Edited Date 2024-05-17 17:58:09.251
Library ID 8717
Document ID
Entry Complete false
eDoc Compliant false
Include in Edoc Report false
In Pure false
Ready for eDoc Export false
Author Affiliations Complete false
Project Name CASUS
Project URL
Grant ID
Funding Programme
Funding Organisation BMBF