Distinct value computations support rapid sequential decisions

The value of the environment determines animals’ motivational states and sets expectations for error-based learning. How are values computed? Reinforcement learning systems can store or cache values of states or actions that are learned from experience, or they can compute values using a model of the environment to simulate possible futures. These value computations have distinct trade-offs, and...