<?xml version="1.0" encoding="UTF-8"?>
<mods xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.loc.gov/mods/v3" version="3.1" xsi:schemaLocation="http://www.loc.gov/mods/v3 http://www.loc.gov/standards/mods/v3/mods-3-1.xsd">
  <titleInfo>
    <title>Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective</title>
  </titleInfo>
  <name type="personal">
    <namePart>Giles W. Story</namePart>
    <role>
      <roleTerm authority="marcrelator" type="text">creator</roleTerm>
    </role>
    <role>
      <roleTerm type="text">author.</roleTerm>
    </role>
  </name>
  <name type="personal">
    <namePart>Ivo Vlaev</namePart>
    <role>
      <roleTerm type="text">author.</roleTerm>
    </role>
  </name>
  <name type="personal">
    <namePart>Ben Seymour</namePart>
    <role>
      <roleTerm type="text">author.</roleTerm>
    </role>
  </name>
  <name type="personal">
    <namePart>Ara Darzi</namePart>
    <role>
      <roleTerm type="text">author.</roleTerm>
    </role>
  </name>
  <name type="personal">
    <namePart>Raymond J. Dolan</namePart>
    <role>
      <roleTerm type="text">author.</roleTerm>
    </role>
  </name>
  <typeOfResource>text</typeOfResource>
  <genre authority="">Review articles.</genre>
  <originInfo>
    <place>
      <placeTerm type="code" authority="marccountry">xx</placeTerm>
    </place>
    <dateIssued encoding="marc">2014</dateIssued>
    <issuance>monographic</issuance>
  </originInfo>
  <language>
    <languageTerm authority="iso639-2b" type="code">eng</languageTerm>
  </language>
  <physicalDescription>
    <extent>1 online resource (1 article).</extent>
  </physicalDescription>
  <abstract>The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a "model-based" (or goal-directed) system and a "model-free" (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes.</abstract>
  <note type="statement of responsibility">Giles W. Story; Ivo Vlaev; Ben Seymour [and others].</note>
  <note>Publication type: Review article.</note>
  <note>Linked open-access copy: published version.</note>
  <note>Open access; no subscription required for the linked open-access version. Unrestricted online access star</note>
  <note xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://openalex.org/W2168922309">Creative Commons Attribution (licence family recorded by the source; version not supplied in metadata). https://openalex.org/W2168922309</note>
  <note>In English.</note>
  <subject>
    <topic>delay discounting</topic>
  </subject>
  <subject>
    <topic>hyperbolic discounting</topic>
  </subject>
  <subject>
    <topic>harmful habits</topic>
  </subject>
  <subject>
    <topic>reinforcement learning</topic>
  </subject>
  <subject>
    <topic>model-based learning</topic>
  </subject>
  <subject>
    <topic>model-free learning</topic>
  </subject>
  <subject>
    <topic>B. Sc. Artificial Intelligence</topic>
  </subject>
  <subject>
    <topic>UMUN open access collection</topic>
  </subject>
  <subject>
    <topic>reinforcement learning</topic>
  </subject>
  <relatedItem type="host">
    <titleInfo>
      <title>Frontiers in Behavioral Neuroscience</title>
    </titleInfo>
    <identifier type="issn">1662-5153</identifier>
    <part>
      <text>Vol. 8, (2014), pages/article 76</text>
    </part>
  </relatedItem>
  <identifier type="uri">https://www.frontiersin.org/articles/10.3389/fnbeh.2014.00076/pdf</identifier>
  <location>
    <url displayLabel="Read open-access publication">https://www.frontiersin.org/articles/10.3389/fnbeh.2014.00076/pdf</url>
  </location>
  <accessCondition type="restrictionOnAccess">Open access; no subscription required for the linked open-access version.</accessCondition>
  <accessCondition type="useAndReproduction">Creative Commons Attribution (licence family recorded by the source; version not supplied in metadata).</accessCondition>
  <recordInfo>
    <recordContentSource authority="marcorg">local</recordContentSource>
    <recordCreationDate encoding="marc">261005</recordCreationDate>
    <recordChangeDate encoding="iso8601">20261005174825.0</recordChangeDate>
    <recordIdentifier source="local">UMUN-OA-20261005-AI-030</recordIdentifier>
    <languageOfCataloging>
      <languageTerm authority="iso639-2b" type="code">eng</languageTerm>
    </languageOfCataloging>
  </recordInfo>
</mods>
