Simon, Bernardy & Cowie, 2020
Simon, Bernardy & Cowie, 2020
Simon, Bernardy & Cowie, 2020
https://doi.org/10.1007/s40614-020-00269-5
ORIGINAL RESEARCH Open Access
Abstract
The place of the concept of response strength in a natural science of behavior has been
the subject of much debate. This article reconsiders the concept of response strength for
reasons linked to the foundations of a natural science of behavior. The notion of
response strength is implicit in many radical behaviorists’ work. Palmer (2009) makes
it explicit by applying the response strength concept to three levels: (1) overt behavior,
(2) covert behavior, and (3) latent or potential behavior. We argue that the concept of
response strength is superfluous in general, and an explication of the notion of giving
causal status to nonobservable events like latent behavior or response strength is
harmful to a scientific endeavor. Interpreting EEG recordings as indicators of changes
in response strength runs the risk of reducing behavior to underlying mechanisms,
regardless of whether such suggestions are accompanied by behavioral observations.
Many radical behaviorists understand behavior as a discrete unit, inviting conceptual
mistakes reflected in the notion of response strength. A molar view is suggested as an
alternative that accounts for the temporally extended nature of behavior and avoids the
perils of a response-strength based approach.
The science of behavior focuses on functional relations among behavior and the
stimulating environment. As a natural science there is a focus on observable happen-
ings. Although this focus may seem simple enough at first glance, studying functional
relations among behavior and the stimulating environment involves a number of
nuanced complexities. One such complexity pertains to the alleged strength of a
behavior, whereby some behaviors are assumed to be strong (e.g., a loud vocalization,
* Carsta Simon
[email protected]
1
University of Agder, Postboks 422, 4604 Kristiansand, Norway
2
University of São Paulo, São Paulo, Brazil
3
University of Auckland, Auckland, New Zealand
678 Perspectives on Behavior Science (2020) 43:677–696
a forceful jump, or highly efficient lever presses in the animal lab) and others weak
(e.g., briefly thinking about something, smiling slightly, speaking with uncertainty).
The notion that behavior might have strength is not new; behavior analysts have
discussed the topic of response strength for many years (de Villiers & Herrnstein,
1976; Herrnstein, 1961; Meehl, 1950; Nevin, 1974). Skinner (1938, p. 15) defines
response strength as encompassing all static properties of the response. Measures
proposed as indications of a response’s strength are the rate, latency, and resistance
to extinction (e.g., Killeen & Hall, 2001), as well as the response’s force, prepotency
over assumed competing responses, and related neural activity, such as that measured
by electroencephalographic (EEG) activity (e.g., Palmer, 2009). Skinner (1938, 1953,
1974) discussed strength in some of his most influential writings. The notion of
strength is today implicit in many behavior analytic theories (e.g., Nevin & Grace,
2000) and treatments (e.g., Cowdery, Iwata, & Pace, 1990). A hallmark of response-
strength–based accounts is that they treat behavior as discretized units.
The history of the currently omnipresent concept of strength began with the
Associationists or Connectionists, who thought of the strength of a bond between
one thought or movement and another (Timberlake, 1988). This origin shows itself
in Skinner’s (1948) superstition paper and his following work. When bond strength was
then tied to frequency, contiguity, and effect, strength seemed to have a referent in
observable features of the environment. Following Thorndike, Skinner started with
reflexes and S-R bond, but when he conceived of operant behavior in the absence of an
antecedent stimulus, response strength became troublesome. First, Skinner tried to
equate response strength with the number of responses made in extinction, but when
this proved an unreliable measure, he continued to write of response strength with no
clear referent. Since then, the field has made various attempts to rescue the concept of
strength (e.g., Nevin & Grace, 2000; Palmer, 2009; see Meehl, 1950; Postman, 1947;
Shahan, 2017, for detailed discussion) with relatively limited success (e.g., see Craig &
Shahan, 2016). Nevertheless, response-strength approaches to understanding behavior
remain at the heart of much theory and application.
In this article, in line with other recent commentary (e.g., Cowie, 2019; Cowie &
Davison, 2016; Killeen & Jacobs, 2017; Shahan, 2010, 2017; Simon, 2020), we argue
that the notion of response strength brings us no closer to understanding behavior from
a natural science perspective because it is unclear what response strength applies to, or
how it should be measured. Does response strength apply only to overt behavior? If so,
is response strength absolute frequency, relative frequency, resistance to disruption, or
stimulus control? If yelling is considered strong and whispering weak, what about
whispering to the person next to you for the entire duration of a lecture, versus yelling
out the answer to the lecturer’s question so others can hear you just once in the course
of your entire 4-year degree? Does the relative strength of these two responses reverse,
depending on the timescale on which they are measured? Does response strength also
apply to latent behavior? If so, does it apply to neurobiological or private events, and
what are these? The concept of response strength may generate questions, but its
ambiguity is a major barrier to providing definitive answers.
Indeed, behavior analysts’ struggle with response strength is highlighted by a recent
discussion of the topic by prominent researchers in behavior analysis (e.g., Killeen &
Jacobs, 2017; Shahan, 2017). The field is divided in its opinion on the place of response
strength in a science of behavior. On the one hand, behavior analysts have criticized the
Perspectives on Behavior Science (2020) 43:677–696 679
notion of response strength (e.g., Baum, 2012; Bolles, 1975; Davison & Baum, 2006;
Longstreth, 1971; Rachlin, 1976; Shahan, 2010; Simon, 2020; Staddon, 1983, 2016;
Timberlake, 1988), largely as a result of its failure to predict or explain behavior. Other
behavior analysts regard strength as a necessary component. For example, Palmer
(2009) proposes that the notion of “response strength [does] more good than harm”
(p. 59). It is clear that there is need for discussion about the place of response strength in
a science of behavior.
Palmer (2009) suggests a way of overcoming the ambiguity considering both
measurement and definition of response strength. This conceptualization of response
strength attempts to account for control of behavior by multiple stimuli, and how
organisms handle time gaps between stimuli and responses. Palmer’s conceptualization
argues for response strength as a useful part of the explanation of behavior. Having
grown out of the discussion about limits to a simple conceptualization of response
strength, Palmer’s conceptualization is today likely to make explicit the mainstream
radical behavior analysts’ implicit views on response strength. Hence, in the following,
we discuss the perils of the concept of response strength per se, using Palmer’s
approach in particular because it is both one of the rare explications of implicit
mainstream views of response strength (Shahan, 2017) and an example of the adverse
consequences of adopting a response-strength–based approach. We first consider
Palmer’s conceptualization of strengthening by reinforcement in detail, and how it
might be used to bridge time gaps between explanatory variables by proposing
hypothetical latent events. The hazards of such an attempt are considered, including
why calling alleged latent events “behavioral” is not a workable resolution. Finally, we
consider a molar1 approach (Baum, 2013, 2016, 2018) as an alternative account of
behavior without response strength, and without the need to discretize behavior.
1
In this article, we speak of Baum’s approach as a molar view. Following a suggestion from Hineline (2001),
Baum refers to this view as a molar multiscale view in his later writings. Because a discussion of the multiscale
aspects of the position would distract from our arguments, we simply use the terminology of Baum’s earlier
writings by calling it the molar view.
680 Perspectives on Behavior Science (2020) 43:677–696
In this contiguity-based approach, the response and an event that is assumed to function
as a reinforcer are observed, and because the response (given the presence of the
relevant discriminative stimuli) occurs more frequently in the future, we talk about a
larger response probability or response strength. This simple concept is difficult to
apply to situations where behavior comes under control of one or more stimuli that are
temporally distant from the behavior (e.g., Cowie, Davison, & Elliffe, 2017). Palmer
(2009) suggests expanding the application of the notion of response strength across
three “levels of behavior” (see Figure 1) to address various problems, including the
effect of the sequential onset of multiple stimuli on an organism’s behavior.
The first level consists of overt behavior, that is, behavior observed by an external
observer. The second level consists of covert behavior, that is, events inferred from an
introspector’s verbal behavior (e.g., “I’m thinking about going to the gym”). The third
level consists of latent behavior, that is, events which have not occurred whatsoever
(i.e., behavior that is not occurring either overtly [level 1] or covertly [level 2]). Note
that a change in response strength can occur on the third level without postulating that
the response has been or will ever be emitted (see Palmer, 2009, p. 53).
Fig. 1 Arrangement of palmer’s (2009) figures 1 and 2 showing the location of the bottleneck metaphor in the
domain of latent responses
Perspectives on Behavior Science (2020) 43:677–696 681
Figure 1 shows a combination of Palmer’s (2009) Figures 1 and 2 in which the three
levels of behavior are depicted on the left. The proposed events on the third—latent—
behavioral level, in the gray box, are represented by his bottleneck metaphor on the
right. Circles on the bottom of the flask represent responses in an organism’s
behavioral repertoire. This repertoire has strong parallels to the idea of an
operant reserve, replacing the original idea of a reflex reserve (cf. Catania,
2005, 2017; Killeen, 1988; Timberlake, 1988; Skinner, 1940). Responses in the
repertoire are neither necessarily observed, nor emitted; they are only potential
behavior. If, owing to a history of exposure to contingencies of reinforcement,
an organism’s response has come under control of various independent vari-
ables, it becomes part of that organism’s repertoire. Palmer postulates a latent
competition of responses in the repertoire, the winner of which raises from the
latent behavior level to the overt or covert level, and is, thus, the emitted
response. The y-axis shows response strength, increasing from latent to covert
to overt responses and corresponding to response probability on the latent level.
Note that overt responses are not claimed to necessarily have a higher response
strength than covert or latent responses, as the arrangement in the figure might
imply. Whether or not a response with a certain strength is emitted depends
rather on the strength of the competing latent responses. The y-axis is not
supposed to imply that all responses are necessarily first latent and then covert
before becoming overt (Palmer, personal communication, July 2, 2016).
With growing response strength responses move to the emission threshold. When a
response is suddenly emitted, Palmer (2009) “believe[s] that the reason is that in many
contexts, the relevant responses already exist just below threshold strength. A small
increase in strength is sufficient for the response to be emitted” (p. 57). One-trial
learning may be explained as a result of this same process.
Palmer (2009) endorses and elaborates on the need for the concept of
response strength by suggesting that the concept has both practical value (i.e.,
in the prediction of behavior) and interpretative value (i.e., conceptualizing
behavior that is not observed). To Palmer, a response can have “a much higher
strength even though, in a sense, the response does not yet exist” (p. 50).
Behavior that is private or not yet observed is the source of much debate and
Fig. 2 A snapshot that is not enough to be sure what the rat is doing
682 Perspectives on Behavior Science (2020) 43:677–696
To Palmer (2009) the concept of response strength is, for example, useful for
explaining the notion of multiple control as exemplified by the sequential
occurrence of two stimuli leading to a different or faster occurring response
than the presentation of one of the stimuli alone. Priming studies, for instance,
show faster reactions to “robin” when the word “bird” was shown before. In
word association games, the answer “Darwin” might not be given when hearing
“famous male” alone but might occur when also hearing “natural selection.”
Thus, reading “bird” changes the response strength of “robin,” and reading
“famous male” and “natural selection” both have cumulative effects on the
response strength of “Darwin.”
The response strength notion applied to latent “behavior” allows the time gap
between stimulus and response occurrence to be bridged, maintaining the
assumption of momentary behavior change resulting from contiguous reinforce-
ment. If one is told in the morning to meet at the corner restaurant at 6 PM, the
stimulus in the morning is said to change the response strength of the (still)
latent response of going to the restaurant. Checking my watch at 5:45 PM
provides an additional stimulus, which increases the response strength of the
latent response of going to the restaurant until it becomes overt (Palmer,
personal communication, June 13, 2016). This example suggests that response
strength changes, especially when warranted by neurobiological events, repre-
sent a hypothesis about a mechanism at work in the organism, bridging the
time elapsing between stimulus presentation and response emission.
Perspectives on Behavior Science (2020) 43:677–696 683
This statement suggests that a per definition nonobservable response can contribute to
the control of overt behavior, which is problematic in a scientific endeavor aiming to
identify lawful relations between behavior and environmental factors. Palmer (2009)
also asserts that “there is presumably an important difference between a response that is
emitted and one that is not, regardless of their absolute levels of strength. Presumably
emitted responses have effects that can serve as controlling variables for subsequent
events” (p. 51; emphasis added). If latent events do not control subsequent events, the
question arises as to what function they do serve in our analysis.
To be sure, neither hypothetical constructs nor intervening variables are in general
problematic to explanations of behavior if used in a way that is logically consistent;
however, there should be no ambiguity about ontological assumptions of the response
strength concept. As Palmer (2009) is careful to point out:
Palmer (2009) explicitly states that “physical instantiations of response strength that do
indeed play a role in the control of behavior” (p. 59) persuade him of the importance of
response strength. He suggests changes in the N400 component of EEG recordings
(e.g., Barnes-Holmes et al., 2005; Haimson, Wilkinson, Rosenquist, Ouimet, &
McIlvane, 2009), which occur when words are repeatedly presented together, are
Perspectives on Behavior Science (2020) 43:677–696 685
brain is not responding; it carries out the subbehavioral activity that makes the more
molar concept of behavior possible. To be sure, there is empirical evidence that
behavior–environment interactions select activities measured by EEG (e.g., Miltner,
Larbig, & Braun, 1986; Sommer & Schweinberger, 1992), therefore perhaps EEG
activity could be satisfactorily treated as behavior. Nevertheless, EEG activity would
need to be activity of the whole organism, in the sense that such behavior is not
explained by other activities of or in the same organism and are instead part of
behavior–environment interactions. This is a theoretical premise that constrains the
concept of behavior: behavior is what the whole organism does, not what the brain does
using the whole organism (Bennett & Hacker, 2003). Furthermore, even if one is
interested in efficient causes of behavior, causation is not unidirectional from brain to
behavior but interactive from behavior-to-brain and the other way around (Schaal,
2003).
Even if we consider brain activity as behavior in the same sense as a lever press or
key peck, the brain’s behavior appears not to give any more insight into response
strength than nonbrain behavior. That is, regardless of one’s perspective on whether the
activity of the brain is behavior of the whole organism, to regard brain activity as an
indicator of response strength neither resolves the problem of observing latent response
competition nor the problems caused by the ambiguous use of the term “response
strength.”
We can be sure that the probability of a response’s emission has a physiological
correlate at any moment we may measure it, and with sufficient instrumentation, we
might at some point continuously identify neurobiological changes correlating with
changes in discriminative stimuli. However, hypothetical constructs serve to aggregate
correlated variables according to an underlying concept to reduce the dimensionality of
the data. It might be questionable whether a response’s rate, latency, force, resistance to
extinction, prepotency over assumed competing responses, and associated EEG data
should all be aggregated under an underlying concept of response strength. Rather, it
appears to be an empirical question to what extent rate, latency, force, and resistance to
extinction can be predicted by EEG images. Neurobiological patterns should be treated
as intervening variables with no surplus meaning.
Palmer’s bottleneck metaphor, illustrated in the lower right-hand corner of Figure 1,
suggests a competition of latent responses. This competition appears to result from a
conflation of ultimate and proximate explanations, in the sense that a mechanism,
which can at best explain how behavior comes about, is described in a behavior-
analytic vocabulary developed to answer the question why behavior occurs. Neuro-
physiology might outline the mechanisms someday, but will not be helped by hypo-
thetical neural mechanisms, running the risk of instantiation. Instead, identification of
electrophysiological mechanisms will require the study of function to know what such
mechanisms are trying to explain. After all, how does one know there are semantic
priming effects which correlate with distinctive N400 wave forms? The priming effect
is determined by the participant’s overt response to the overt stimuli.
It is evident that a behavioral scientist attempting to support the usefulness of the
concept of response strength by references to brain activity, as Palmer (2009) does,
would not go as far as suggesting that behavior does not constitute or contribute in any
way to what it means to have a mind (e.g., as Barrett, 2016, understands Berns, Brooks,
& Spivak, 2012). Neither would a behavior analyst subscribe to mind–body dualism or
Perspectives on Behavior Science (2020) 43:677–696 687
claim that a scan of a motionless dog’s brain is more informative about the nature of its
mind than any aspect of its world that involves physical activity (Berns et al., 2012).
Nevertheless, Palmer’s (2009) argument that considering response strength as a
neurobiological phenomenon is necessary to explain complex human behavior such
as problem solving implies that the brain is what matters, and what we need to
speculate about, because it takes inputs, processes information, and computes outputs.
Too much focus on brain activity as an explanation of behavior could suggest that
problems are solved by the brain. However, problem solving requires the behaving
body, including a brain, and the environmental structures that we use to augment,
enhance, and support whatever internal processes operate to help getting us through the
day. After all, beavers build dams (Kemp, Worthington, Langford, Tree, & Gaywood,
2012) and tuna can swim faster than their own physical capacities allow because they
find natural water currents and then use their tails to generate vortices (Triantafyllou &
Triantafyllou, 1995). We use post-its and computer files and we put the keys where we
cannot overlook them when we leave the house. Our habits arrange the environment to
simplifying what would otherwise be demanding tasks (Barrett, 2016; Kirsh, 1995). If
we do not want to limit ourselves to identifying physiological mechanisms, an impor-
tant part of what makes us perform the way we do may thus be found outside our heads,
rather than within them. The alternative selectionist approach suggested below does
not, as Mace (1977) formulates it, attempt to clarify “what’s inside your head, but what
your head’s inside of” (the title of Mace 1977).
A clear distinction between mechanism and function might help to understand our
argument. If a change in response strength is treated as a link in a chain of events, it is at
best a description or umbrella term for the effect of preceding events. Thus, response
strength is synonymous with response probability. If so, it is unnecessary to conjecture
of changes of strength on a level of “latent behavior.” Even when changes in neuro-
biological activity were not used as indicators of response strength (leaving room for
speculations of what other surplus meaning this notion might have) but were instead
identified with response strength, one would still have to explain why such changes in
neurobiological activity occur. Pointing to the physiological mechanisms at work
between the presentation of two sequential stimuli and a response might at best shed
light on an aspect of the question how the response is produced. The answer to why
those two stimuli have an additive effect on behavior can only be found in phylogenetic
and ontogenetic selection processes. Palmer (2009) mentions latent response competi-
tion as one of the indicators of response strength. It is unclear to what the metaphor of
the bottleneck, in which the responses of a repertoire compete, translates. Do latent
responses reside somewhere when not being emitted, and what causal factor—if not
their response strength—makes for the emission of some but not of others?
From an evolutionary perspective, the process by which behavior becomes more
likely to occur (i.e., operant selection), may be assumed to be naturally selected
(Skinner, 1981; Simon & Hessen, 2019). In general, both natural and operant selection
function to enhance an organism’s fitness. It seems reasonable to assume that rein-
forcers are effective due to their consequences on an organism’s fitness (Baum, 2012).
Because the organism’s contact with its environment consists of its overt behavior,
selection acts on, or at least through, overt behavior. Thus, potential changes in covert
or latent behavior need to result from the overt behavior–environment interaction.
Indeed, in Palmer’s (2009) paradigm, latent behavior arises from the reinforcement
688 Perspectives on Behavior Science (2020) 43:677–696
An Alternative
Neurobiological changes might be measured, but there is no need to relate them to the
ambiguous concept of response strength.
No researcher denies that all behavior takes time, but few use apparatuses that allow
for measurements of variables with temporal extension. Throughout their history
behavior analysists have used key pecks and lever presses, which discretize rats’ and
pigeons’ continuous flow of behavior into countable events forming the basis of
response rates. Had Skinner focused more on wheel running then pecking disks and
pressing levers to which microswitches where attached, a different tradition might have
developed. Sometimes a research question might be answered most straightforwardly
by an analysis of a response rate consisting of counts; however, all interaction between
an organism’s behavior and the environment—may it be the behavior of the
researcher—is based on temporally extended behavior because if we were to regard
behavior as momentary, an epistemological problem would arise. An example taken
from Baum (2002) illustrates this problem. Looking at our snapshot depicted in
Figure 2, can we tell what the rat is doing? Is it exploring? Is it sniffing the wall? Is
it pressing the lever? Is it doing all or none of those activities? If this capture is to be the
only controlling stimulus occasioning an observer’s verbal response, we will find the
observer to be unsure about what the rat is doing. If, however, more of an animated
sequence of which Figure 2 only is a part, is watched, certainty about the rat’s activity
will increase. If we see what the rat did before and what it will do next, our verbal
behavior will come under the control of those temporally extended stimuli. We do not
know if someone sitting in a room with music playing is listening, or deaf and
daydreaming, unless we observe them long enough to see if they, for example, start
moving according to the music’s rhythm, or if their behavior remains unaffected if the
music suddenly stops. The longer we observe the person’s activity, the more certain we
can be of the activity’s function. Our understanding of the function of someone’s
behavior does not only guide our everyday reactions but is also a prerequisite to
formally analyzing an activity’s interaction with the environment. Baum (1997) makes
an analogy with Heisenberg’s uncertainty principle. To know a pattern of behavior
means to observe behavior for a period, the duration of which depends on the pattern
being investigated. Exactly how much temporal precision and we need, or how much
averaging is appropriate, depends on the research question and the measurement
process.
According to the molar view, to analyze behavior means to analyze a sample of a
temporal extended activity. As Baum (1997, p. 49) states it, “We cannot decide what a
creature is doing without an adequate sample of its movement.” That is, in order to
observe behavior, we need to observe the ongoing activity of an organism in a context,
and that necessarily takes time. Carving behavior into discrete units may help to make it
more easily quantifiable, but discretizing is likely to detract from our ability as scientists
to explain and predict the behavior’s occurrence. To be sure, the concept of response
strengthening, which most radical behaviorists implicitly subscribe to and which
Palmer (2009) explicates, is a consequence of discrete response measurement, but
measurement of discrete responses is neither particular nor original to Palmer’s view.
A view of behavior in terms of discrete events has a direct impact on research.
Considering behavior as a discrete variable, even if implicit, affects research questions.
When facing time gaps between discrete events, they are sometimes filled with
hypothetical constructs such as “private events” and “response strength.” These events
Perspectives on Behavior Science (2020) 43:677–696 691
are allegedly present in the “changed organism” in some kind of presentism that
struggles with the extended nature of behavior. At best, these theories could lead us
to an empirical agenda based on physiological variables. At worst, they become
instances of dualism.
Does that mean Ryle is not a smoker when he is asleep or that smoking is
latent when lecturing? The assumption of momentary behavior inevitably drives
one to hypothetical constructs with only tenuous relations to actual behavior.
Understanding response strength as an intervening variable, synonymous with
response probability, would avoid the risk of reification. Then, a response’s rate
does not indicate its strength but instead determines it. Such conceptualization
as an intervening variable, rather than a hypothetical construct, would make
locating response strength on different “levels of behavior” superfluous. It could
not be positioned anywhere except from in the function of preceding variables.
Because we may classify responses by their function or their topography,
observed differences in force or resistance to extinction might be regarded as
dependent variables in their own right. After all, if one would like to under-
stand why one frequently talks silently or seldom talks loudly, it is of little
help to regard the loudness and rate of talk as resulting from a common
strength of a talking response. Whether we jump into a conversation depends
not only on whether we have a point to make, but also on social contingencies
requiring that we wait our turn. In this example, talking or not is not explained
by the response’s strength, but by the contingencies of both talking and
competing responses with so-called reinforcers.
692 Perspectives on Behavior Science (2020) 43:677–696
Conclusions
This article advocates that the concept of response strength is ambiguous and super-
fluous. Dividing a continuous behavior stream into discrete units may have been a
useful approach when trying to map out the basics of the interaction between behavior
and environment, but it has also brought about superfluous problems, such as how to
bridge time gaps between stimuli and responses. Response strength bridges time that
passes between stimuli and responses in terms of discrete events, but in doing so it
creates other problems for a science of behavior. In line with behavior analysis’ identity
as a selectionist science (Skinner, 1981) and the arguments presented above, we
suggest widening the search for explanatory variables in time rather than in space.
We might leave the search for intermediate controlling factors inside the organism to
neurologists and continue our outline of controlling variables by going further back in
an organism’s history. Describing neurobiological patterns at work in between dis-
criminative stimuli and responses, such as the N400 component, in behavior analytic
Perspectives on Behavior Science (2020) 43:677–696 693
Author note Special thanks to David C. Palmer and William M. Baum for constructive
feedback leading to valuable improvements of earlier versions of this manuscript. We
would also like to thank Henrique Pompermaier and Mitchell Fryling for their support.
Conflicts of interest The authors declare that they have no conflict of interest.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which
permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give
appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and
indicate if changes were made. The images or other third party material in this article are included in the
article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not
included in the article's Creative Commons licence and your intended use is not permitted by statutory
regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
694 Perspectives on Behavior Science (2020) 43:677–696
References
Barnes-Holmes, D., Staunton, C., Whelan, R., Barnes-Holmes, Y., Commins, S., Walsh, D., et al. (2005).
Derived stimulus relations, semantic priming, and event-related potentials: Testing a behavioral theory of
semantic networks. Journal of the Experimental Analysis of Behavior, 84(3), 417–433.
Barrett, L. (2016). Why brains are not computers, why behaviorism is not Satanism, and why dolphins are not
aquatic apes. The Behavior Analyst, 39(1), 9–23.
Baum, W. M. (1995). Introduction to molar behavior analysis. Mexican Journal of Behavior Analysis, 21, 7–
25.
Baum, W. M. (1997). The trouble with time. In L. J. Hayes & P. M. Ghezzi (Eds.), Investigations in
behavioral epistemology (pp. 47–59). Reno, NV: Context Press.
Baum, W. M. (2002). From molecular to molar: A paradigm shift in behavior analysis. Journal of the
Experimental Analysis of Behavior, 78(1), 95–116.
Baum, W. M. (2011a). Behaviorism, private events, and the molar view of behavior. The Behavior Analyst,
34(2), 185–200.
Baum, W. M. (2011b). Evasion, private events, and pragmatism: A reply to Moore's response to my review of
conceptual foundations of radical behaviorism. Journal of the Experimental Analysis of Behavior, 95(1),
141–144.
Baum, W. M. (2011c). No need for private events in a science of behavior: Response to commentaries. The
Behavior Analyst, 34(2), 237–244.
Baum, W. M. (2012). Rethinking reinforcement: Allocation, induction, and contingency. Journal of the
Experimental Analysis of Behavior, 97(1), 101–124.
Baum, W. M. (2013). What counts as behavior? The molar multiscale view. The Behavior Analyst, 36(2), 283.
Baum, W. M. (2015). The role of induction in operant schedule performance. Behavioural Processes, 114,
26–33.
Baum, W. M. (2016). Driven by consequences: The multiscale molar view of choice. Managerial & Decision
Economics, 37(4–5), 239–248.
Baum, W. M. (2017). Understanding behaviorism: Behavior, culture, and evolution (3rd ed.) John Wiley &
Sons.
Baum, W. M. (2018). Multiscale behavior analysis and molar behaviorism: An overview. Journal of the
Experimental Analysis of Behavior, 110(3), 302–322.
Baum, W. M., & Davison, M. (2014). Background activities, induction, and behavioral allocation in operant
performance. Journal of the Experimental Analysis of Behavior, 102(2), 213–230.
Bayer, H. M., & Glimcher, P. W. (2005). Midbrain dopamine neurons encode a quantitative reward prediction
error signal. Neuron, 47(1), 129–141.
Bennett, M., & Hacker, P. (2003). Philosophical foundations of neuroscience. UK: Blackwell.
Berns, G. S., Brooks, A. M., & Spivak, M. (2012). Functional MRI in awake unrestrained dogs. PLoS ONE, 7,
e38027–e38027. https://doi.org/10.1371/journal.pone.0038027.
Bolles, R. C. (1975). Theory of motivation. New York, NY: HarperCollins.
Catania, A. C. (2005). The operant reserve: A computer simulation in (accelerated) real time. Behavioural
Processes, 69(2), 257–278.
Catania, A. C. (2017). The ABCs of behavior analysis. Corn-wall on Hudson: Sloan.
Cowdery, G. E., Iwata, B. A., & Pace, G. M. (1990). Effects and side effects of DRO as treatment for self-
injurious behavior. Journal of Applied Behavior Analysis, 23, 497–506. https://doi.org/10.1901/jaba.
1990.23-497.
Cowie, S. (2019). Some weaknesses of a response-strength account of reinforcer effects. European Journal of
Behavior Analysis, 1–16.
Cowie, S., & Davison, M. (2016). Control by reinforcers across time and space: A review of recent choice
research. Journal of the Experimental Analysis of Behavior, 105(2), 246–269.
Cowie, S., Davison, M., & Elliffe, D. (2017). Control by past and present stimuli depends on the discriminated
reinforcer differential. Journal of the Experimental Analysis of Behavior, 108(2), 184–203.
Craig, A. R., & Shahan, T. A. (2016). Behavioral momentum theory fails to account for the effects of
reinforcement rate on resurgence. Journal of the Experimental Analysis of Behavior, 105(3), 375–392.
Davison, M., & Baum, W. M. (2006). Do conditional reinforcers count? Journal of the Experimental Analysis
of Behavior, 86(3), 269–283.
de Villiers, P. A., & Herrnstein, R. J. (1976). Toward a law of response strength. Psychological Bulletin, 83(6),
1131–1153.
Perspectives on Behavior Science (2020) 43:677–696 695
Haimson, B., Wilkinson, K. M., Rosenquist, C., Ouimet, C., & McIlvane, W. J. (2009). Electrophysiological
correlates of stimulus equivalence processes. Journal of the Experimental Analysis of Behavior, 92(2),
245–256.
Hayes, L. J., & Fryling, M. J. (2009). Overcoming the pseudo-problem of private events in the analysis of
behavior. Behavior & Philosophy, 37, 39–57.
Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement
1, 2. Journal of the Experimental Analysis of Behavior, 4(3), 267–272.
Hineline, P. N. (2001). Beyond the molar-molecular distinction: We need multiscaled analyses. Journal of
Experimental Analysis of Behavior, 75(3), 342–378.
Hineline, P. N. (2011). Private versus inner in multiscaled interpretation. The Behavior Analyst, 34(2), 221–
226.
Hollerman, J. R., & Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of
reward during learning. Nature Neuroscience, 1(4), 304–309.
Kantor, J. R. (1923). The organismic vs. the mentalistic attitude toward the nervous system. Psychological
Bulletin, 20, 684–692.
Kemp, P. S., Worthington, T. A., Langford, T. E., Tree, A. R., & Gaywood, M. J. (2012). Qualitative and
quantitative effects of reintroduced beavers on stream fish. Fish & Fisheries, 13(2), 158–181.
Killeen, P. R. (1988). The reflex reserve. Journal of the experimental analysis of behavior, 50(2), 319.
Killeen, P. R., & Hall, S. S. (2001). The principal components of response strength. Journal of the
Experimental Analysis of Behavior, 75(2), 111–134.
Killeen, P. R., & Jacobs, K. W. (2017). Coal is not black, snow is not white, food is not a reinforcer: The roles
of affordances and dispositions in the analysis of behavior. The Behavior Analyst, 40(1), 17–38.
Kirsh, D. (1995). The intelligent use of space. Artificial intelligence, 73(1), 31–68.
Kutas, M., & Federmeier, K. D. (2011). Thirty years and counting: finding meaning in the N400 component of
the event-related brain potential (ERP). Annual Review of Psychology, 62, 621–647.
Longstreth, L. E. (1971). A cognitive interpretation of secondary reinforcement. Paper presented at the
Nebraska symposium on motivation.
MacCorquodale, K., & Meehl, P. E. (1948). On a distinction between hypothetical constructs and intervening
variables. Psychological Review, 55, 95–107.
Mace, W. M. (1977). James J. Gibson’s strategy for perceiving: Ask not what’s inside your head, but what
your head’s inside of. In R. Shaw & J. Bransford (Eds.), Perceiving, acting, and knowing (pp. 43–65).
Hillsdale, NJ: Lawrence Erlbaum Associates.
Marr, J. (2011a). Has radical behaviorism lost its right to privacy? The Behavior Analyst, 34(2), 213–219.
Marr, J. (2011b). Some public perspectives on the problem of privacy. European Journal of Behavior
Analysis, 12(2), 447–459.
McGill, S., Buckley, J., Elliffe, D., & Corballis, P. M. (2017). Choice predicts the feedback negativity.
Psychophysiology, 54(12), 1800–1811.
Meehl, P. E. (1950). On the circularity of the law of effect. Psychological Bulletin, 47(1), 52–75.
Miltner, W., Larbig, W., & Braun, C. (1986). Biofeedback of visual evoked potentials. International Journal
of Neuroscience, 29(3–4), 291–303.
Mirenowicz, J., & Schultz, W. (1994). Importance of unpredictability for reward responses in primate
dopamine neurons. Journal of Neurophysiology, 72, 1024–1027.
Moore, J. (1995). Radical behaviorism and the subjective–objective distinction. The Behavior Analyst, 18(1),
33–49.
Moore, J. (2009). Why the radical behaviorist conception of private events is interesting, relevant, and
important. Behavior & Philosophy of Science, 37, 21–37.
Nevin, J. A. (1974). Response strength in multiple schedules. Journal of the Experimental Analysis of
Behavior, 21(3), 389–408.
Nevin, J. A., & Grace, R. C. (2000). Behavioral momentum and the law of effect. Behavioral and Brain
Sciences, 23(1), 73–90.
Palmer, D. C. (2009). Response strength and the concept of the repertoire. European Journal of Behavior
Analysis, 10(1), 49–60.
Palmer, D. C. (2011). Consideration of private events is required in a comprehensive science of behavior. The
Behavior Analyst, 34(2), 201–207.
Postman, L. (1947). The history and present status of the law of effect. Psychological Bulletin, 44(6), 489.
Rachlin, H. (1976). Behavior and learning. San Francisco, CA: W. H. Freeman.
Rachlin, H. (1991). Teleological behaviorism. In W. O'Donohue & R. Kitchener (Eds.), Handbook of
behaviorism (p. 23). San Diego, CA: Academic Press.
696 Perspectives on Behavior Science (2020) 43:677–696
Rachlin, H. (1995). Burrhus Frederic Skinner, 1904–1990: A biographical memoir. Washington DC: National
Academies Press.
Rachlin, H. (1999). Philosophical behaviorism: A review of things that happen because they should: A
teleological approach to action, by Rowland Stout. Journal of Experimental Analysis of Behavior, 72(2),
273–277.
Rachlin, H. (2000). Teleological behaviorism. In W. O'Donohue & R. Kitchener (Eds.), Handbook of
behaviorism (pp. 195–215). San Diego, CA: Academic Press.
Rachlin, H. (2003). Autonomy from the viewpoint of teleological behaviorism. Autonomy, 20(2), 245–264.
Rachlin, H. (2007). A behavioral science of mental life: Comments on Foxall's "Intentional behaviorism.".
Behavior & Philosophy, 35, 131–138.
Rachlin, H. (2011). Baum’s private thoughts. The Behavior Analyst, 34(2), 209–212.
Rachlin, H. (2012). Is the mind in the brain? A review of “Out of our heads: Why you are not your brain, and
other lessons from the biology of consciousness” by Alva Noë (2009). Journal of the Experimental
Analysis of Behavior, 98(1), 131–137.
Rachlin, H. (2014). The escape of the mind. New York, NY: Oxford University Press.
Rachlin, H. (2015). Choice architecture: A review of “Why nudge: The politics of libertarian paternalism”.
Journal of the Experimental Analysis of Behavior, 104, 198–203.
Rachlin, H., & Frankel, M. (2009). Taking pragmatism seriously: A review of William Baum's
“Understanding behaviorism: Behavior, culture, and evolution (2nd ed.)”. Journal of Experimental
Analysis of Behavior, 92(1), 131–137.
Ryle, G. (1949). The concept of mind. New York, NY: Barnes & Noble.
Schaal, D. W. (2003). Explanatory reductionism in behavior analysis. In K. A. Lattal & P. N. Chase (Eds.),
Behavior theory and philosophy (pp. 83–102). New York, NY: Kluwer Academic/Plenum.
Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science,
275(5306), 1593–1599.
Shahan, T. A. (2010). Conditioned reinforcement and response strength. Journal of the Experimental Analysis
of Behavior, 93(2), 269–289.
Shahan, T. A. (2017). Moving beyond reinforcement and response strength. The Behavior Analyst, 40(1),
107–121.
Simon, C. (2020). The ontogenetic evolution of verbal behavior. European Journal of Behavior Analysis, 1–
18.
Simon, C., & Hessen, D. O. (2019). Selection as a domain-general evolutionary process. Behavioural
Processes, 161, 3–16.
Skinner, B. F. (1938). The behavior of organisms: An experimental analysis. New York, NY: Appleton-
Century.
Skinner, B. F. (1940). The nature of the operant reserve. Psychological Bulletin, 37(423), 270–277.
Skinner, B. F. (1948). “Superstition” in the pigeon. Journal of Experimental Psychology, 38(2), 168–172.
Skinner, B. F. (1953). Science and human behavior. New York, NY: Macmillan.
Skinner, B. F. (1969). Contingencies of reinforcement: A theoretical analysis. Englewood Cliffs, NJ: Prentice
Hall.
Skinner, B. F. (1974). About behaviorism. New York, NY: Alfred A. Knopf.
Skinner, B. F. (1981). Selection by consequences. Science, 213(4507), 501–504.
Sommer, W., & Schweinberger, S. (1992). Operant conditioning of P300. Biological Psychology, 33(1), 37–
49.
Staddon, J. (2016). Where operant conditioning went wrong. Retrieved from https://www.psychologytoday.
com/blog/adaptive-behavior/201607/where-operant-conditioning-went-wrong
Staddon, J. E. R. (1983). Adaptive behavior and learning. Cambridge, UK: Cambridge University Press.
Thorndike, E. L. (1911/2000). Animal intelligence: Experimental studies. The Macmillan company: New
York.
Timberlake, W. (1988). The behavior of organisms: Purposive behavior as a type of reflex. Journal of the
Experimental Analysis of Behavior, 50(2), 305–317.
Triantafyllou, M. S., & Triantafyllou, G. S. (1995). An efficient swimming machine. Scientific American,
272(3), 64–71.
Turner, M. B. (1965). Philosophy and the science of behavior. New York, NY: Appleton-Century-Crofts.
Zuriff, G. E. (1985). Behaviorism: A conceptual reconstruction. New York, NY: Columbia University Press.
Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and
institutional affiliations.