Rxivist logo

Rxivist combines preprints from bioRxiv with data from Twitter to help you find the papers being discussed in your field. Currently indexing 59,744 bioRxiv papers from 265,577 authors.

Generalization guides human exploration in vast decision spaces

By Charley M. Wu, Eric Schulz, Maarten Speekenbrink, Jonathan D. Nelson, Bjöorn Meder

Posted 01 Aug 2017
bioRxiv DOI: 10.1101/171371 (published DOI: 10.1038/s41562-018-0467-4)

From foraging for food to learning complex games, many aspects of human behaviour can be framed as a search problem with a vast space of possible actions. Under finite search horizons, optimal solutions are generally unobtainable. Yet how do humans navigate vast problem spaces, which require intelligent exploration of unobserved actions? Using a variety of bandit tasks with up to 121 arms, we study how humans search for rewards under limited search horizons, where the spatial correlation of rewards (in both generated and natural environments) provides traction for generalization. Across a variety of different probabilistic and heuristic models, we find evidence that Gaussian Process function learning--combined with an optimistic Upper Confidence Bound sampling strategy--provides a robust account of how people use generalization to guide search. Our modelling results and parameter estimates are recoverable, and can be used to simulate human-like performance, providing novel insights about human behaviour in complex environments.

Download data

  • Downloaded 1,948 times
  • Download rankings, all-time:
    • Site-wide: 2,228 out of 59,744
    • In animal behavior and cognition: 20 out of 936
  • Year to date:
    • Site-wide: 3,794 out of 59,744
  • Since beginning of last month:
    • Site-wide: 8,396 out of 59,744

Altmetric data

Downloads over time

Distribution of downloads per paper, site-wide

Sign up for the Rxivist weekly newsletter! (Click here for more details.)