Acf 02
Acf 02
Acf 02
For more than a decade there has been an extensive debate over both the
desirability and efficacy of public policy analysis. (See, e.g.. Rein and White
1977a.) On the one hand are scholars who claim that analysis has had very
little effect because it has been used primarily for partisan political purposes.
For example, Horowitz (1970) argues that analysis has become mere a politi-
cal tool used to justify preconceived policy decisions, while Rein and White
(1977-B) claim that analysis has proved to be impotent as a device with
which to correct or improve public policy. Other critics contend that policy
analysis serves merely to bury political debate under spurious complexity, or
to mask political interest under the guise of objective neutrality (Banfield
1980). On the other hand, defenders have rejoined that policy analysis can
and does provide an essential means to assess and balance competing claims
for increasingly scarce public resources, (Moore 1980) and that analysis does
lead to a gradual 'enlightenment' effect over time (Weiss 1977).' What is
interesting about this debate is that all sides are able to point to cases that
bear out their claims. In some instances, then, each of the positions seems to
have validity.
These conflicting views are a mainfestiation of the lack of consensus about
the role of policy analysis, a lack that has serious implications for the social
legitimacy of policy analysis, for expectations about its influence in policy
making, and for its practical conduct. Such conflicts reflect beliefs in funda-
264
Synthesis
One of the purposes of the conceptual framework of policy change and
leaming presented in the Sabatier and Jenkins-Smith articles (above) has
been to characterize long term policy change in a manner that synthesizes
these three models. It does so through its focus on the relationship between
the context of analysis and the kind of role analysis is likely to play on the
political process. The three models can be synthesized using three key ele-
ments in the policy change framework, including (1) the focus on interaction
between opposing advocacy coalitions, (2) the analysis of factors explaining
policy change, and (3) the explication of belief systems of opposing coali-
tions.
The framework's focus on interaction between opposing coalitions incor-
porates many of the elements put foreward by theorists of the interest group
school and carried over into the study of ideological conflict. This interaction
includes competition for control of resources and coalitions' efforts to gain
implementation of favorable policies. Interaction takes place through many
267
are bolstered by analysis (Leman 1982). Only in rare policy contexts those
characterized by highly analytically tractable issues subject to low levels of
conflict in a 'professionalized' forum will aneilysis be likely to contribute to
centralized, technocratic control.
The policy change framework also suggests that analysis is rarely likely to
foist a distorted picture of public preferences onto decision makers. As noted
above, analysis tends to be mobilized by all active interests in the subsystem.
The framework makes clear that, on major policy debates, advocacy analysis
will persist over an extended period of time up to a decade or more. Thus,
should policy analysis bias public expression, those slighted can anticipate
subsequent analytical fora in which to press for redress.
As a final point regarding the legitimacy of policy analysis, the framework
indicates that analyses can stimulate genuine leaming among policy sub-
system members. At worst, analysis stimulates intra-coalition leaming, an
elaboration of the secondary aspect related to an advocacy coalition's policy
core. At its best policy analysis stimulates cross-coalition leaming, leading to
modification of the policy core of one or more advocacy coalitions. In recent
years this process has been clearly evident in the airline and tmcking deregu-
lation issues (Derthick and Quirk 1985).
The advocacy role of policy analysis in the democratic policy making proc-
ess has similarities to the advocacy role of attomeys in the judicial process
and, indeed, to the advocacy role of scientists in debating opposing theories.
Such advocates abide by a set of mles appropriate to their endeavors, mles of
evidence, relevance and logic by which opponents can criticize and judge
each proposition. When policy analysis is used to advocate positions in the
policy process, similar mles stmcture the debate. The policy change frame-
work provides a way to determine the nature of such mles by examining the
content of the debate. It also provides the potential for understanding how
the context of the debate effects the role of policy analysis and other factors
in leading to policy oriented leaming and policy change. We now tum to an
examination of the context of policy debate and its implications for the prac-
tice of policy analysis.
What are the implications of the framework for the practice of policy anal-
ysis? In broad terms, the hypotheses drawn from the framework can be used
to depict those regions of the policy context that are hostile or hospitable to
the effective use of policy analysis in policy change. The relevant variables
underlying the policy context, as noted in the first two articles of this
volume, are (1) the intensity of conflict over the political issue as derived
from the level of conflict between belief systems of competing subsystem
269
coalitions, (2) the analytical tractability of the issue, and (3) the nature of the
forum in which the analytical debate takes place. These variables in combina-
tion pro\dde the context in which analysts attempt to shape the dimensions and
weights ofthe analytical policy space, as described in Jenkins-Smith (above).
Within subsystems, policy learning can take place within and/or across
advocacy coalitions. In the former case, a given coalition elaborates upon the
causal connections and relations within its belief system, or perhaps finds
more persuasive ways to defend its policy core and secondary aspect. In the
case of cross-coalition learning, however, one or both coalitions add to or
modify their policy cores or secondary aspects in response to the analytical
debate. Thus while both kinds of leaming involve adjustment of belief sys-
tems, intra-coalition leaming primarily involves reinforcement or elaboration
of preexisting beliefs, while cross-coalition learing involves genuine alteration
of beliefs. An important aspect of cross-coalition learning is the change in
beliefs of people who were not coalition members. Strong arguments can
convince the undecided to support a coalition's policy, perhaps even to join
and contribute resources.
To the extent that the policy context enhances prospects for cross-coali-
tion leaming, then, the context can be termed hospitible to policy analysis. A
hostile context, on the other hand, will inhibit cross-coalition learning,
although it may instead foster intra-coalition leaming. What then are the fac-
tors that lead to hostile or hospitable context for the application of policy
analysis?
Given the hypothesis developed in Sabatier (above), policy analysis can be
expected to generate cross coalition leaming under conditions in which:
1. conflict between subsystem coalitions is moderate. Moderate conflict typi-
cally stems from conflict between the policy core of one coalition and the
secondary aspect of another. The result is conflict sufficient to result in the
allocation of analytical resources, but conflict moderate enough to permit
both coalitions to contemplate change in their belief systems.
2. the policy problem at issue ranks fairly high on the dimension of analytical
tractability. Thus when the issue under debate has well developed theory,
is well conceptualized and operationalized, and adequate data exists, the
probability that analysis will contribute to cross-coalition leaming is
increased. Issues that are relatively new are tractable if these analytical
tools can be developed in a reasonable period, or carried over from a
related policy issue area. As a general rule, we would expect analytical
tractability to be highest among natural resource issues, and lowest in such
social issues as welfare and health care.
3. the forum in which the policy debate is conducted approximates the 'profes-
sionalized' forum. Thus when the participants of the debate share a com-
mon einalytical background, such that common bases for assessing the
270
Given the effect of the policy context on the role that analysis can be expect-
ed to play, how can (usually scarce) analytical resources be allocated in a
manner that enhances prospects for cross-coalition leaming? In answering
such a question, one must remember that analysts must respond to their pol-
icy making clients, usually officials in agencies or organized interest groups: it
is the client, after all, who has political legitimacy and authority (Foster
1980). Policy analysts usually have a weaker claim to represent the beliefs of
a policy coalition, except perhaps in professionalized fora devoted to anal-
ysis.
Because analysis must be responsive to the client's needs, the overall allo-
cation of analyticil resources frequently must take into account objectives
other than maximizing cross-coalition learning. Like it or not, analysis will
sometimes be called upon to delay decisions ('paralysis by analysis') or to
legitimize a preconceived policy position of the client (Marver 1979). In
essence, the range of free choice of over which analytical tasks to undertake
can vary significantly (Jenkins-Smith, 1982). Acknowledging that such
demands may need to be met to 'pay one's dues' within an organization, there
is often some degree of discretion over selection of issues and allocation of
analytical resources. What guides for allocation of analytical resources can be
discerned from the policy change framework?
Managers of policy analysis are faced with a variety of choices as they par-
ticipate in an extended analytical debate. They must decide which issues or
beliefs to analyze, whether to focus primarily on the beliefs of their own coa-
lition that are imder attack by the opposition or to focus on the beliefs of the
opposing coalition. The framework suggests that managers should, in part
272
Whatever the strategy, the manager should realize that changing the core
beliefs of opposing advocacy coalitions will take a considerable period of
time. But it can happen, as illustrated by the airline deregulation (Derthick
and Quirk 1985) and tobacco regulation (Fritschler 1983) cases. On the
other hand, when the debate is focused on secondary aspects, as illustrated
by the gas deregulation case recoimted above in Jenkins-Smith, results can be
expected to be evident much more quickly.
The policy framework also provides important insights for individual ana-
lysts. First and foremost, it is a mistake to view policy analysis as a discrete
act in which a problem is analyzed, options reviewed, ind advice given.
Viewed in isolation from the interactions of advocacy coalitions within policy
subsystems, 'success' and failure' of analysis are too often seen as wholly
contingent on the technical perfection of its content, and on whether policy
makers accept or reject its conclusions. Such a view fails to recognize that
analysis is more often one part of an extended, many-sided exchange about
how issues should be perceived, and what policy options merit consideration
by policy elites. Such a view may also fail to recognize that what counts as the
success of a particular analysis is at least partly contingent on the prevailing
policy context: to expect scrupulously objective, technically precise analysis
to make dent in a highly conflictual, intractable policy debate is to invite dis-
appointment and frustration.' On the other hand, to write a partial, even
adversarial, analysis that makes the case for an important but neglected pol-
icy perspective can be a significant corrective when the debate is conducted
in a closed and/or politicized forum.
More broadly, the framework sheds light on the question of the appro-
priate professional role for the policy analyst in democratic politics. A survey
of the literature reveals that three dominant roles for policy analysis are of-
fered as appropriate guides for professional behavior. (For a summary of that
literature, see Jenkins-Smith 1982.) The objective technician, operating in the
progressive mode, holds the primary objective to be provision of neutral,
objective and comprehensive analysis and then to retire from the field.*
Advocacy is not the game. The primary professional value is analytical integ-
rity. The issue advocate, on the other hand, does not object to joining the
political fray, and will use analysis to pursue some conception of the 'good
society.' It is probably the case that most issue advocates, by dint of training
in the fundamentals of policy analysis, are advocates for economic efficiency.
Alternatively, the client's advocate uses analysis to make the best case for his
political client's preferred option. For this analyst, it is the client who has
274
political legitimacy not the analyst and the analyst is obliged to sub-
ordinate values derived from a personal view of the good society or technical
integrity to service for the client (Foster 1980). Often, of course, such advo-
cates come to share their client's beliefs, either through self-selection or
socialization within the coalition.
The framework suggests that each of these roles has legitimacy, strengths
in particular kinds of policy contexts, and fatal weaknesses in others. The
objective technician may do well with regard to a low conflict issue debated
in a professionalized forum, but would be utterly at sea in an analytical brawl
over a high conflict-intractable issue in an open forum. Furthennore, the
advocate styles of analysis may be appropriate for analytical debates in which
analytical conflict is sufficient to assure that all relevant viewpoints are repre-
sented, but they may actually undermine the credibility of analysis when
employed in contexts of less (or uneven) conflict. Thus there is an inescap-
able and uncomfortable tension here: none of the styles of analysis seems
adequate in and of itself, and yet, applied indiscriminately, the various styles
of analysis could well undermine one another.
Of course, tailoring analytical practice to context would not be easy. Diffi-
culty may arise over determination of which context actually exists; the bulk
of the analytical contexts fall somewhere between extremes on dimensions of
analytical conflict, tractability, and types of fora. Different analysts could thus
quite conceivably perceive these factors differently, and therefore adopt and
apply incompatible styles of analysis in the same debate. Altematively, the
context may change as the analytical debate wears on, forcing periodic
assessment of which style of analysis is appropriate. It is nonetheless highly
likely that most analysts could, particularly in extreme cases, discern the
major characteristics of the analytical forum. Furthennore, as illustrated in
the case studies presented in Jenkins-Smith (above), analysts do as a matter
of course modify their perceptions of the policy context through experience
and adjust their styles of analysis accordingly.^ The problem is to determine
what the appropriate style would be in a given context.
On the basis of the framework of policy leaming, we offer a tentative reso-
lution to the problem. The three styles of analysis appear to best correspond
with three extremes in the policy context. The resolution calls for an explicit
adoption of a combination of styles of analysis, flexibly adapted to the policy
context. In a context in which the issue draws little analytical conflict, when
the forum is closed or not widely visible and approximates a professionalized
forum, participants should tend toward the objective technician style. Be-
cause of low levels of conflict, participants cannot count on the interests of
those aggrieved to readily correct for analysis that neglects or overempha-
sizes particular dimensions of value or beliefs. Furthermore, the closed or
low-profile forum may serve to screen participants who may otherwise have
275
added important dimensions and interests to the debate. The objective tech-
nicians' penchant for comprehensive neutral analysis, though unlikely to be
fully realized in practice, will serve to increase the likelihood that the most
important factors ait included.
Sometimes, however, the closed or low-visibility forum will already have a
distinctive pattem of expressed interests represented in analysis; analysis may
reflect the existence of 'client politics' (Wilson, 1980), in which a small group
of directly affected beneficiaries of a policy have incentives to join the debate
while the larger, more diffuse population of those bearing the costs of the
policy do not. In this context, objective analysis using the general concepts of
applied welfare economics could be expected to produce information con-
flicting with the positions of particular interests. If efficiency-oriented anal-
ysis is to be presented in such instances, an issue advocate role is hard to
escape. Stressing the costs of a special interest policy to the broader popula-
tion, especially within a coalition in which the special interest has substantial
power, requires a more assertive advocate style, but may entail some risks.
The issue advocate role may be appropriate as well in high conflict debates
waged in open, politicized fora. In those instances, a variety of interests to the
debate can be expected to be well represented by analysis. Because this mul-
tiplicity of interests is mobilized, each hammering home its own grievances,
rights and expectations, the prudent analyst could well assume the role of
partisan efficiency advocate without concem that the structure of values
represented to policy elites is unduly distorted.
The practicability of the role of the partisan efficiency advocate will often
be contingent, of course, on the analyst working for an uncommitted (or like-
minded) client. Because the latter cannot be counted on in high conflict pol-
icy issues, analysts employed by a client intensely committed to a particular
policy outcome will be pressed to adopt the role of client's advocate. For high
conflict issues debated in open fora, such a result is not as bad as critics have
suggested. The tendency of the analytic contribution to such policy contexts
to be pluralistic in character would serve to ameliorate advocacy for any par-
ticular partisan or position in the aggregate analysis produced. It is well for
the analyst to remember, too, that the publicly elected or appointed policy
maker has at least an indirect legitimacy in the positions taken by virtue of
representative electoral politics. Finally, service of the client's interests, con-
sonant with the prevailing analytical tractability of the issue at hand, may be
necessary in order to maintain the client's sympathetic ear on other issues.
For these reasons, the prudent analyst may on occasion assume the role of
the client's advocate.
Demands for service of the client's interest may become unreasonable,
however. In particular, the demand that analysis be shaded in the client's in-
terest to a degree that departs from the prevailing analytical consensus on the
276
Notes
1. To be sure, there are many uses of policy analysis some of which are overtly political
uses designed to legitimize preconceived policy positions. Furthermore, clients may seek
out analysts who will agree with the policy maker's policy perspective (often called 'hired
guns') to assure 'compatability' of analysis and the client's policy position. Marver (1979)
provides a provocative list of the full range of functions' of analysis. Nonetheless such uses
are typically perceived as abuses of analysis, and if widely employed will undermine the
credibility of all analysis.
2. For an extensive discussion of these criticisms of policy analysis, see Jenkins-Smith (1985),
Chapters 3 and 7.
3. Professionalized fora may be more common in European political systems. See, for exam-
ple, Brickman's (1984) discussion of the differences between pattems of formulation of
toxic waste policy in the United States and in European countries.
4. See Frischler (1983). Another case of analysis leading to forced change from outside the
policy subsystem concems airline regulatory policy. See Derthick and Quirk (1985).
5. Amold Meltsner quotes an analyst frustrated by the reception of his work at the U.S. Office
of Economic Opportunity (OEO) as saying: "That's what drove me out of OEO; the
leadership simply didn't understand the role of evaluation" (Meltsner 1976:23).
6. See Meltsner (1980) for a description of the technician model of analysis. Also see Jenkins-
Smith (1982) for a development ofthe 'objective technician' style of analysis, that typifies
the dominant paradigm in policy analysis.
7. In the Alaskan oil export case, it was after confronting advocacy for the maritime interests
on the part of MarAd analysts that the DOE analyst raised more uncertain issues that
would tug the analysis results back in the other direction. And in the Strategic Petroleum
Reserve case, it was after repeated experience with OMB analysts doggedly pursuing ana-
lytical results that would show a large SPR to be unjustified that analysts from DOE dug in
their heels and extracted a concession that permitted them to use their own, improved ana-
lytical approach.
8. See Weimer and Vining (1986), Chapter 2, for a very useful way of understanding the ethi-
cal dilemmas confronted by a policy analyst whose client demands analysis in support of a
preconceived policy position.
277
References