MedAI

Описание: Title: CT-ScanGaze: A Dataset and Baselines for 3D Volumetric Scanpath Modeling

Speaker: Trong Thang Pham

Abstract:
Understanding radiologists' eye movement during Computed Tomography (CT) reading is crucial for developing effective interpretable computer-aided diagnosis systems. However, CT research in this area has been limited by the lack of publicly available eye-tracking datasets and the three-dimensional complexity of CT volumes. To address these challenges, we present the first publicly available eye gaze dataset on CT, called CT-ScanGaze. Then, we introduce CT-Searcher, a novel 3D scanpath predictor designed specifically to process CT volumes and generate radiologist-like 3D fixation sequences, overcoming the limitations of current scanpath predictors that only handle 2D inputs. Since deep learning models benefit from a pretraining step, we develop a pipeline that converts existing 2D gaze datasets into 3D gaze data to pretrain CT-Searcher. Through both qualitative and quantitative evaluations on CT-ScanGaze, we demonstrate the effectiveness of our approach and provide a comprehensive assessment framework for 3D scanpath prediction in medical imaging.

Speaker Bio:
Trong Thang Pham is a PhD candidate at the University of Arkansas, Fayetteville, working under the supervision of Dr. Ngan Le. His research focuses on the intersection of expert behavior analysis and deep learning, specifically applying human eye gaze analysis to transform and enhance deep learning models. Prior to his PhD, he was an R&D researcher at AIOZ Singapore, where he developed digital twin technologies, including talking face generation and 3D human models for metaverse applications. His work has resulted in strong publications across premier venues, including top-tier conferences such as CVPR, ICCV, ACM MM, WACV, and ICRA.


------

The MedAI Group Exchange Sessions are a platform where we can critically examine key topics in AI and medicine, generate fresh ideas and discussion around their intersection and most importantly, learn from each other.

We will be having weekly sessions where invited speakers will give a talk presenting their work followed by an interactive discussion and Q&A.

Our sessions are held every Monday from 1pm-2pm PST.

To get notifications about upcoming sessions, please join our mailing list: https://mailman.stanford.edu/mailman/...

For more details about MedAI, check out our website: https://medai.stanford.edu. You can follow us on Twitter @MedaiStanford

Organized by members of the Rubin Lab (http://rubinlab.stanford.edu) and Machine Intelligence in Medicine and Imaging (MI-2) Lab:
Nandita Bhaskhar (https://www.stanford.edu/~nanbhas)
Amara Tariq (  / amara-tariq-475815158  )
Avisha Das (https://dasavisha.github.io/)