Distilling Neural Representations of Data Structure Manipulation using fMRI and fNIRS
Data structures permeate many aspects of software engineering, but their associated human cognitive processes are not thoroughly understood. We leverage medical imaging and insights from the psychological notion of spatial ability to decode the neural representations of several fundamental data structures and their manipulations. In a human study involving 76 participants, we examine list, array, tree, and mental rotation tasks using both functional near-infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI).
We find a nuanced relationship: data structure and spatial operations use the same focal regions of the brain but to different degrees. They are related but distinct neural tasks. In addition, problem difficulty matters, inducing a higher cognitive load in computer science than in pure spatial reasoning. Finally, while fNIRS is less expensive and more permissive, there are some computing-relevant brain regions that only fMRI can reach.
Wed 29 May (GMT-04:00) Eastern Time (US & Canada) change
|16:00 - 16:20|
|16:20 - 16:30|
Need for Sleep: the Impact of a Night of Sleep Deprivation on Novice Developers' PerformanceIndustry ProgramJournal-First
|16:30 - 16:50|
|16:50 - 17:10|
|17:10 - 17:30|
Distilling Neural Representations of Data Structure Manipulation using fMRI and fNIRSTechnical Track
Yu HuangUniversity of Michigan, Xinyu LiuUniversity of Michigan, Ryan KruegerUniversity of Michigan, Tyler SantanderUniversity of California at Santa Barbara, Xiaosu HuUniversity of Michigan, Kevin LeachUniversity of Michigan, Westley WeimerUniversity of MichiganPre-print
|17:30 - 17:40|
Ricardo CouceiroUniversity of Coimbra, Gonçalo DuarteUniversity of Coimbra, João DurãesCISUC, Polytechnic Institute of Coimbra, João CastelhanoICNAS, University of Coimbra, Catarina DuarteICNAS, University of Coimbra, Cesar TeixeiraUniversity of Coimbra, Miguel Castelo BrancoICNAS/CIBIT, University of Coimbra, Paulo CarvalhoUniversity of Coimbra, Henrique MadeiraUniversity of Coimbra
|17:40 - 18:00|