Lenard Dome

selected publications

1. 

   Lenard Dome, and Andy Wills (2023) g-distance: On the comparison of model and human heterogeneity. PsyArXiv

   Abs Bib DOI PDF

   Models are often evaluated when their behavior is at its closest to a single group-averaged empirical result, but this evaluation neglects the fact that both model and human behavior can be heterogeneous. Here we develop a measure, g-distance, which considers model adequacy as the extent to which models exhibit a similar range of behaviors to the humans they model. We demonstrate an application of this measure to five models of an irrational learning effect, the inverse base-rate effect. None of the five models we evaluate is substantially better than a random model on our metric. In the process of analyzing the human data, we also discovered that the group-level result was observed in less than 1% of individuals. We discuss the implications of our findings for model evaluation generally, and for models of the inverse base-rate effect specifically. We end by suggesting future avenues of research in computational modeling.

   @article{dome2023gdistance,
     title = {g-distance: On the comparison of model and human heterogeneity},
     publisher = {PsyArXiv},
     journal = {PsyArXiv},
     author = {Dome, Lenard and Wills, Andy},
     year = {2023},
     doi = {https://doi.org/10.31234/osf.io/ygmcj},
   }