Gender Imbalance in Instructional Dynamic Versus Static Visualizations: a Meta-analysis

Abstract

Studies comparing the instructional effectiveness of dynamic versus static visualizations have produced mixed results. In this work, we investigated whether gender imbalance in the participant samples of these studies may have contributed to the mixed results. We conducted a meta-analysis of randomized experiments in which groups of students learning through dynamic visualizations were compared to groups receiving static visualizations. Our sample focused on tasks that could be categorized as either biologically secondary tasks (science, technology, engineering, and mathematics: STEM) or biologically primary tasks (manipulative–procedural). The meta-analysis of 46 studies (82 effect sizes and 5474 participants) revealed an overall small-sized effect (g+ = 0.23) showing that dynamic visualizations were more effective than static visualizations. Regarding potential moderators, we observed that gender was influential: the dynamic visualizations were more effective on samples with less females and more males (g+ = 0.36). We also observed that educational level, learning domain, media compared, and reporting reliability measures moderated the results. We concluded that because many visualization studies have used samples with a gender imbalance, this may be a significant factor in explaining why instructional dynamic and static visualizations seem to vary in their effectiveness. Our findings also support considering the gender variable in research about cognitive load theory and instructional visualizations.