Descomposing Agricultural Multifunctionality
Descomposing Agricultural Multifunctionality
Descomposing Agricultural Multifunctionality
2, 2007, 218–241
Abstract
Agricultural multifunctionality is the recognition of the joint exercise of econo-
mic, environmental and social functions by this sector. Nevertheless, not all these
contributions to society are valued in markets, moreover a large share of them
are public goods. For this reason, in order to make this concept of multifunction-
ality operative for the design of public policies, it is necessary to estimate the
social demand of such functions. The objective of this article was to implement
an empirical application along these lines. For this purpose, the agricultural sys-
tem of cereal steppes in Tierra de Campos in Spain is taken as a case study.
The economic valuation technique used relies on a combined implementation of
contingent valuation and the analytical hierarchy process. The results obtained
demonstrate the existence of a significant demand for the different attributes
included in the multifunctionality concept, although this demand is heterogeneous
and is based on the socioeconomic characteristics of individual persons.
1
Jesús Barreiro Hurlé, Área de Economı́a y Sociologı́a Agrarias (AESA), Instituto de Investi-
gación y Formación Agraria y Pesquera (IFAPA), PO Box 2027, 18080 Granada, Spain.
E-mail: [email protected] for correspondence. Zein Kallas is at
CREDA-UPC-IRTA, Universitat Politécnica de Catalunya. José A. Gómez-Limón is at the
Agricultural Economics Department, E. T. S. II. AA. Palencia, Universidad de Valladolid.
This study was partly financed by the Spanish Commission for Science and Technology (CI-
CYT) through the MULTIAGRO project (AGL2003-07446-C03-01), by the Spanish National
Institute for Agricultural Research (INIA) through the DISOPTIPOL project (RTA2005-
000020) and by the Education Department of the Regional Government of Castilla y León
through project VA006A05. The authors wish to thank two anonymous reviewers and JAE’s
Associate Editor and Editor-in-Chief for their constructive comments, which have improved
the quality of the paper. The usual disclaimer applies.
Blackwell Publishing Ltd. 2007, 9600 Garsington Road, Oxford OX4 2DQ, UK and 350 Main Steet, Malden, MA 02148, USA.
Decomposing the Value of Agricultural Multifunctionality 219
partial values for each of the attributes. Second, we propose the combination of
two valuation techniques: contingent valuation (CV) and the analytical hierarchy
process (AHP), as alternatives to choice experiments (CE) (Bennett et al., 2004;
Yrjölä and Kola, 2004 or Colombo et al., 2005). The case study area is the agricul-
tural ecosystem of Tierra de Campos in Castilla y León (an Autonomous Region in
northern Spain). Although, our results cannot be directly transferred to other agri-
cultural ecosystems, the case study is relevant for two reasons. The selected eco-
system is representative of Mediterranean dry-land farming in marginal areas
(common in inland Spain, Portugal, Italy and Greece), where multifunctionality is a
key policy goal. Second, our results could help future studies develop benefit trans-
fers and also demonstrate alternative valuation techniques for complex multifunc-
tional goods.
The paper is structured as follows. Following this introductory section, section 2
describes the agricultural ecosystem of Tierra de Campos and its multifunctional
aspects. We then present and justify the methodological approach selected to esti-
mate the demand for multifunctionality: a combination of CV and AHP. Section 4
describes the main features of the application, followed by a presentation of the
results obtained. We conclude and offer insights for further research.
2. Case Study
2.1. Agriculture in the Tierra de Campos ecosystem
Pseudo-steppes are ecosystems characterised by scarce vegetation, an almost total
absence of trees, a plain relief and average rainfall below 450 mm (Suárez et al.,
1997). An important part of Castilla y León can be classified as pseudo-steppe, an
ecosystem associated with dryland extensive culture, cereals in particular, and they
are therefore referred to as ‘‘cereal steppes’’.
The focus is on the ‘‘cereal steppe’’ area in Castilla y León known as ‘Tierra de
Campos’; 1 million hectares (comprising two-thirds of the total area of steppe in
the region), located to the northeast of central Castilla y León, and including 267
municipalities in four provinces. The area shares common ecological, political,
social and economic characteristics, and can be classified as predominantly rural.
According to the latest available data (1999 Agricultural Census; INE, 2001), uti-
lised agricultural area accounts for 83.8% of the territory, and is mainly represen-
tative of marginal extensive agriculture, where the social and environmental
functions are often supposed to have greater importance than food and fibre
production.
3. Methodology
Valuation of non-marketed multifunctional goods and services can be undertaken
using various methodologies among which are:
(i) opinion polls and consumer surveys;
(ii) proxy analysis of public preferences;
2
Annual working unit, equivalent to full-time equivalent employment (corresponding to the
number of full-time equivalent jobs).
3
Other authors have used CV and AHP in combination before (Smith and Lantz, 2003;
McVittie et al., 2004; Wattage and Mardle, 2004; Zoppi, 2004). However, our study is an ori-
ginal application to agricultural multifunctionality.
4
As pointed out by Gómez-Limón and Atance (2004), these social preferences ‘would corres-
pond to the objective implicit in the concept of agricultural multifunctionality; that of guar-
anteeing an appropriate level of public goods provided by agriculture, in their productive,
social and environmental dimensions’.
5
This particular focus group was made up of leaders of local society (unions, cultural associ-
ations and neighbourhood communities).
6
During focus group sessions, the most controversial attribute was the contribution of agri-
culture to economic activity in rural areas. The adoption of the proxy variable ‘‘jobs gener-
ated by the agricultural sector’’ is based on its higher acceptance by the public as a clear
economic indicator rather than, say, agricultural total output or relative importance of the
agriculture in the whole economy. This assumption was confirmed by the pilot survey. How-
ever, interpretation of this variable is limited to the economic relevance of agriculture rather
than its social implications.
7
A decrease in the endangered species present in the area implies that the number of individuals
of these species grows to an extent where the species are no longer endangered: an improvement
of the ‘‘environmental factor’’ of agricultural multifunctionality in the area under study.
4 Health and food safety concerns (proxy variable: type of farm management: con-
ventional, integrated or organic).
The functions of multifunctionality here are: environmental (3), social (2) and
two economic (1 and 4), which are the attributes of our ‘‘agricultural multifunc-
tional package’’. Considering the historical records of the proxies, the same focus
groups met again to identify the most suitable combinations to define the improve-
ments in the multifunctional character of the agricultural ecosystem. Two options
were selected: one labelled ‘‘moderate’’ and another ‘‘significant’’. The characteris-
tics of these two improvements are presented in Table 1, which identifies the levels
attached to each attribute in each of the scenarios.
Table 1
Contingent valuation questionnaire using the ‘‘payment card’’ question format and
a compulsory increase in taxes as payment vehicle
Achieving these improvements implies an additional cost to society which must be funded by an increase in taxes. The
increase of taxes per capita was to be located among the figures in the following card:
0 5 10 15 20 25 30 35 40 45 50 >50
€/year €/year €/year €/year €/year €/year €/year €/year €/year €/year €/year €/year
My willingness to pay to achieve the “moderate” improvement is a maximum of: €/year
pilot survey (which used an open-ended format) to cover the central 90% of
observed distribution of WTP in the pilot (Cooper, 1993; Kaninen and Kriström,
1993). A compulsory payment vehicle, an increase in taxes,8 was selected to mini-
mise strategic bias associated with voluntary payments to conservation funds. This
format was used for both levels of improvement, and was presented in the question-
naire to interviewees as given in Table 1.
We obtained two values for the aggregate multifunctional bundle, WTPMOD, for
moderate improvement and WTPSIG, for significant improvement.
Agricultural multifunctionality
8
People surveyed were informed that a new levy on income tax would be implemented to col-
lect revenues to be devoted to the improvement of local public goods provided by agriculture.
This levy would be fixed specifically for each territory by local authorities, and would be col-
lected from all adult individuals (above 18 years old) living in the corresponding area.
9
Saaty (1980) or Golden et al. (1989) provide a detailed description of this methodology.
2 3
a11k a12k ... a1nk
6 a21k a22k ... a2nk 7
Ak ¼ 6
4 ...
7; ð8Þ
... aijk ... 5
an1k an2k ... annk
where aijk represents the value obtained from the comparison between attribute i
and attribute j for each individual (k). For consistent preferences, this matrix has
two fundamental properties:
(i) all elements of its main diagonal area take a value of 1 (aiik ¼ 1 "i); and (ii) all
other elements maintain that paired comparisons are reciprocal (if aijk ¼ x then
ajik ¼ 1/x).
In addition, aihk · ahjk ¼ aijk for all i, j and h, because for a perfectly rational
decision-maker aijk ¼ wik/wjk for all i and j. As a result, the Saaty matrix can also
be expressed as follows:
2 w1k w1k w1k 3
w1k w2k . . . wnk
6 w2k w2k w2k 7
6 w1k w2k . . . wnk 7
6 7 ð9Þ
6 . . . . . . wik . . . 7:
4 wjk 5
wnk wnk . . . wnk
w1k w2k wnk
Thus, if perfect consistency holds, n weights (wik) for each attribute can be deter-
mined from the n(n ) 1)/2 values for aijk elicited in the survey. Unfortunately, per-
fect consistency is seldom present in reality, where personal subjectivity plays an
important role. For Saaty matrices (Ak ¼ aijk) in which some degree of inconsis-
tency is present, alternative approaches have been proposed to estimate the weight
vector that best reflects the decision-maker’s preferences. Saaty (1980, 2003) pro-
posed two alternatives: the geometric mean and the main eigenvector. Other authors
have proposed alternatives based on regression analysis (Laininen and Hämäläinen,
2003) or goal programming (Bryson, 1995). No consensus has been reached regard-
ing any alternative that outperforms the other (Fichtner, 1986). As all criteria meet
the requirements, we chose the operationally simplest alternative, the geometric
mean (Aguarón and Moreno-Jiménez, 2000). Particular weights assigned by individ-
uals to each attribute are estimated as follows:
vffiffiffiffiffiffiffiffiffiffiffiffiffi
u i¼n
u Y
wik ¼ t aijk 8i; k:
n
ð10Þ
i¼1
The AHP has been extended as a valid technique for the analysis of group decisions
(Easley et al., 2000). The steps needed to obtain an estimate of the population’s
weights are as follows: (i) choice of a representative sample of the society; (ii) eli-
citation of paired comparisons and individual Saaty matrices for the sample (Ak ¼
aijk) and estimation of corresponding weights (wik); and (iii) aggregation and synthe-
sis of weights for society as a whole (wi).
where U(xj) is the total utility that alternative j provides to the decision-maker (or
group of decision-makers, as is our case), wi represents the attribute weights and
Ui(xj) the partial utilities provided by attribute i in alternative j.
Table 2
Attribute valuation for ‘‘moderate’’ and ‘‘significant’’ improvement alternatives
Contingent valuation
Contribution to wJOB 14,000 WTPJOB1 ¼ wJOB · WTPMOD 16,000 WTPJOB2 ¼ wJOB · WTPSIG
economic activity jobs jobs
in rural areas
Maintenance of wRES 80% WTPRES1 ¼ wRES · WTPMOD 90% WTPRES2 ¼ wRES · WTPSIG
population in rural Farmers with Farmers with
areas and cultural permanent permanent
heritage residence residence
Use of environmentally wEND 15 WTPEND1 ¼ wEND · WTPMOD 9 WTPEND2 ¼ wEND · WTPSIG
friendly agricultural endangered endangered
practices species species
Contribution to wMAN Integrated WTPMAN1 ¼ wMAN · WTPMOD Organic WTPMAN2 ¼ wMAN · WTPSIG
production of farming farming
healthier and safer
food products
This table shows that the joint implementation of CV and AHP can be either in terms of individual values (k), using individual wik and WTPMOD_K
and WTPSIG_K, or aggregated values, using sample mean values of wi, WTPMOD and WTPSIG. This dichotomy allows us to obtain average values
Zein Kallas, Jose´ A. Gómez-Limón and Jesús Barreiro Hurle´
for society as well as to investigate preference heterogeneity among individuals (see section 5.2).
Decomposing the Value of Agricultural Multifunctionality 229
4. Empirical Application
4.1. Target population, sample size and sample selection criteria
Focusing on the local demand for multifunctional agriculture, the target population
is all the adult population of Tierra de Campos, 213,749 people. We restrict atten-
tion to the local population because it is difficult to determine a priori the geogra-
phical limits of the relevant and interested population. Furthermore, selecting
non-residents increases the biases due to the embedding effect and scope sensitivity
(Carson and Mitchell, 1993). As there is likely to be a positive WTP for these goods
among non-residents (e.g. in the nearby cities of Valladolid, León and Salamanca),
our WTP estimates could be regarded as lower bounds.
A quota sampling approach was taken. Sampling quotas were based on: place of
residence, municipality population size, age and gender. A total of 120 categories
were determined (five places of residence · three municipality size · four age ranges
10
This additive approximation is also supported by psychological studies regarding human
behaviour, as pointed out by Dawes and Corrigan (1974), Einhorn and Hogart (1975) and
Dawes (1979).
11
As Hwang and Yoon (1981, p. 103) point out: ‘theory, simulation computations, and
experience all suggest that the additive method yields extremely close approximations to very
much more complicated non-linear forms, while remaining far easier to use and understand’.
12
This bias indicates that the valuation of a particular good can vary depending on whether
it is valued individually or embedded into complex goods (see Kahneman and Knetsch, 1992;
Loomis et al., 1993 or Randall and Hoehn, 1996).
13
This bias, to make a long story short, would imply that the value obtained for each func-
tion could be affected by the place in which the valuation question is presented within a valu-
ation sequence. A comprehensive review of these effects can be found in Bateman et al.
(2004).
· two genders) and sample quotas assigned proportionately to the target population
in each quota. Given these quotas, random routes were established in each district
of residence, determining the municipalities in which the effective sample extraction
should be made as well as the number of interviews to be carried out within each
category. Interviews were carried out face-to-face in the interviewees’ homes during
the period June to July 2005, with a total of 383 valid surveys.
5. Results
5.1. Aggregated results for the target population
5.1.1. CV results
Ninety-two people (24%) expressed a zero WTP for both improvement scenarios.
Following Halstead et al. (1992) and Hanley et al. (2002), a screening question was
included to identify ‘‘real’’ zeros (zero marginal utility or corner solution due to
lack of income) and ‘‘protest’’ zeros (individuals who do value the good in question,
but set their WTP equal to zero because they disagree with some of the assumptions
of the valuation scenario). Individuals were classified as protest bidders when the
reason behind their zero WTP was a ‘‘rejection of any further increase in taxes’’,
‘‘consider that they already pay sufficient taxes’’ or ‘‘the government should finance
these improvements’’. On the other hand, those arguing that they ‘‘were not interes-
ted in the subject being valued’’, or ‘‘multifunctionality is nor a priority for me’’ or
‘‘I cannot afford to pay any amount’’, were considered to be ‘‘real’’ zeros. Seventy
14
The survey instruments are available upon request from the authors.
Table 3
Willingness to pay (WTP) for improvements in agricultural multifunctionality
(€/year-inhabitants)
of the 92 zero bidders were classified as protest bidders and excluded from the ana-
lysis, the remaining 22 were retained in the sample, leaving 313 valid responses.
The average values of the improvements in multifunctionality (from the answers
provided to the open-ended valuation question) are shown in Table 3.
As these WTP estimates are based on a non-normal distribution,15 a Wilcoxon
rank test is applied. The mean WTP estimates are significant in both cases,16 the
significant improvement being valued more highly than the moderate improve-
ment.17
15
A Kolmogorv–Smirnov test was undertaken with sample values for WTPMOD and WTPSIG
and the null hypothesis of data following a normal distribution was rejected in both cases.
16
The Z-statistic values for the null hypothesis of mean WTPMOD equal to 0 and mean
WTPSIG equal to 0 are 14.82 and 14.84, respectively, with associated p-values below 0.001 in
both cases. Thus, we reject that WTP for these improvements is equal to zero.
17
The Z-statistic value for the null hypothesis of mean WTPMOD equal to mean WTPSIG is
11.06, with an associated p-value below 0.001. Thus, we confirm that both values are signifi-
cantly different from each other.
18
p-values for Kolmogorov–Smirnov Z-statistic are below 0.01 in all cases.
Table 4
Aggregated weights for multifunctionality attributes
Table 5
Mean willingness to pay (WTP) for the different functions and levels of agricultural
multifunctionality (€/year-inhabitants)
confirms significant differences between the mean values, except in the case of
wEND ) wRES, where differences are not significant.
Perhaps the most surprising finding of these results is the relatively low valuation
of new jobs in agriculture. This could be explained by two relevant factors: (1) The
rate of agricultural employment in the area is well above European levels (28.5% of
working people) and farming labour has a relative low productivity (lower and
decreasing incomes). Because of this, people might consider that rural development
should encourage diversification, creating jobs in the industrial and services sectors,
rather than increasing the number of agriculture-related jobs; and (2) Farming
activities have a poor social status (hard work and low pay). Considering the low
unemployment rate in this area, this means that new jobs in agriculture are mainly
covered by foreign workers, mostly from Africa and South America, a situation
that generates conflicts in predominantly conservative and elderly rural communi-
ties. In this particular context, more labour in the agricultural sector that would
involve an immigrant labour force is not particularly highly valued.
The estimated WTP for all attributes and levels is significantly different from
zero,19 confirming that there is a demand for all these non-commercial functions of
agriculture. Moreover, partial WTPs for each attribute are also significantly differ-
ent from each other (with the exception of WTPEND1 ) WTPRES1 in the ‘‘moder-
ate’’ improvement scenario and WTPEND2 ) WTPRES2 in the ‘‘significant’’
improvement scenario) showing that not all functions associated with multifunction-
ality are valued equally by society.
19
Non-normal distributions are also present for these data and Wilcoxon rank tests have
been carried out rejecting the null hypothesis of WTP equal to zero.
20
AGE, reference level is age below 35 years.
21
SIZE, reference level is municipality of residence with less than 500 inhabitants.
Table 6
OLS value functions for aggregated multifunctionality
WTPMOD WTPSIG
22
EDUC, reference level is primary education; this variable was identified alone in the factor
analysis.
23
INCOME, reference level for this variable is household income below 1,500 € per month.
24
It seems that variability in the WTP responses are due to many non-observed factors over-
looked in our survey. However, a review of published studies in which OE WTP OLS models
are used shows that our R2 results are not unusual, and are not among the lowest.
Table 7
Socio-demographic characteristics affecting individual attribute valuation
Notes: Significance levels: ***p < 0.01; **p < 0.05; *p < 0.10.
needs to be performed to identify these other factors. Following the earlier literature
(e.g. Van Liere and Dunlap, 1980; Scott and Willits, 1991; Burbank, 1995 or Cott-
rell, 2003), it would be worth analysing attitude- and/or belief-related factors as
demand determinants for agricultural multifunctionality.
Table 7 shows the coefficients and significance levels of the variables that affect
individuals’ valuation of the specific multifunctionality. Again, although all models
are significant (aggregated significance according to the F-statistic with p-values
below 0.01), R2 values are low (in only two cases above 0.10). As can be seen, edu-
cation, age and income are the variables which affect most attributes.
These results inform the findings shown in Table 6. The lower valuation attached
by women to the moderate improvement in multifunctionality seems to be associ-
ated with a significantly lower weight attached to the indicator of healthier and
safer food production. Older people (AGE2) seem to give lower salience to both
environmental protection and integrated or ecological production methods, which
they might consider as handicaps to ‘‘traditional’’ rural activities. The same holds
for inhabitants of medium-sized rural areas (SIZE1), who might, perhaps, view envi-
ronmental protection and food safety and quality as extra limits on their entrepre-
neurship, competitiveness and chances of development. The only attribute which
urban people (SIZE2) value less than rural people is agriculturally related employ-
ment in the moderate improvement scenario, possibly because the moderate increase
in employment is seen as insignificant for the viability of rural areas.
From our analysis, we can confirm that individuals value multifunctionality dif-
ferently although these differences cannot be explained in full by socio-demographic
variables. Higher education and income have been found to be positively correlated
with WTP for multifunctionality, while older people and residents of medium-sized
rural areas seem to be less willing to support those aspects of multifunctionality that
limit economic activities in rural areas.
6. Conclusions
Our results confirm the existence of a real demand for agricultural multifunction-
ality. This demand is not homogeneous, either among different functions considered
as part of the multifunctional bundle or among individuals. Functions related to a
more ‘‘private good’’ facet of multifunctionality (such as health and food safety)
seem to be more valued than those related to ‘‘public goods and services’’. This is
consistent with research on the motives for social valuation of organic farming,
which might be considered as another form of providing more multifunctionality
(Midmore et al., 2005).
Socio-demographic characteristics only partly explain the heterogeneity found in
the demand for multifunctionality. Income and education have positive effects on
the WTP for aggregate improvements in multifunctionality as well as for most of its
individual functions. Older people and residents in medium-sized rural villages are
less willing to value multifunctional functions, possibly related to limitations on
activity in rural areas (environmental protection and food safety and quality), while
residents of small villages place higher values on multifunctionality, probably believ-
ing that this concept is the only way to assure viable rural areas. Nevertheless, most
of the heterogeneity is not captured by these characteristics.
Our research provides support for the combination of valuation techniques
employed to obtain reliable estimates of attribute values for complex goods. Combi-
ning AHP and CV seems to be a promising alternative to CV alone and to CE.
Although both valuation techniques allow estimates of aggregated and attribute-spe-
cific values to be made, major methodological differences remain. First, from a psy-
chological point of view, the process of choosing alternative scenarios required by
the CE is quite different from that associated with revealing WTPs for the implemen-
tation of CV. This arises from the fact that choices required for CE implementation
are driven from reason and arguments to a greater extent than are pricing responses,
unlike the CV method. Thus, as pointed out by Irwin et al. (1993) and McKenzie
(1993), respondents may react differently when they answer similar questions in each
case. In addition, CV has been found to be prone to embedding and order effects
biases (Brown and Shogren, 1998; Bateman et al., 2004; Barriero et al., 2005),
although this problem has been partly tackled by CE (Bennett and Blamey, 2001;
Hensher et al., 2005). Furthermore, CV surveys usually have higher non-response
and protest behaviour rates than CE studies (Stevens et al., 2000). This could also
affect the estimates of value obtained by both techniques. No evidence has yet been
found to determine which method is more suitable to reveal the preferences of real
individuals. Future research should therefore aim to calibrate our results with CE
and other possible valuation techniques to further validate the methodological
approach. The application of different approaches to multifunctionality valuation in
the same area and to the same population seems to be a promising path.
Finally, our results should be treated with caution. They are only related to a
specific case study area and population, at a specific point in time. The area can be
regarded as a good example of marginal agriculture, which generates important pos-
itive externalities both in the social and environmental fields. Similar studies need to
be undertaken in other areas with different characteristics (type of externalities gen-
erated, degree of productivity and reference population considered) so as to obtain
a wider picture of social demand for multifunctionality.
References
Adamowicz, W., Boxall, P., Williams, M. and Louviere, J. ‘Stated preference approaches for
measuring passive use values: Choice experiments and contingent valuation’, American
Journal of Agricultural Economics, Vol. 80, (1998) pp. 65–75.
Dawes, R. M. ‘The robust beauty of improper linear models in decision making’, American
Psychology, Vol. 34, (1979) pp. 571–582.
Dawes, R. M. and Corrigan, B. ‘Linear models in decision making’, Psychological Bulletin,
Vol. 81, (1974) pp. 95–100.
DG AGRI (2006). Agriculture in the European Union. Statistical and Economic Information.
Available on-line at http://www.europa.eu.int/comm/agriculture/agrista/2005/table_en/2005
enfinal.pdf (Last accessed: 3/2006).
Easley, R., Valacich, J. and Venkataramanan, M. ‘Capturing group preferences in a
multicriteria decision’, European Journal of Operational Research, Vol. 125, (2000) pp. 73–
83.
EC. Contribution of the European Community on the Multifunctional Character of Agriculture
(Brussels: European Commission–DG Agriculture, September, 1998).
EC. Safeguarding the Multifunctional Role of Agriculture: Which Instruments? (Brussels: Euro-
pean Commission–DG Agriculture, September, 1999).
EC. Agriculture’s Contribution to Environmentally and Culturally Related Non-trade Concerns
(Brussels: European Commission–DG Agriculture, July, 2000).
EEA (European Environment Agency). High Nature Value Farmland. Characteristics, Chan-
ges and Policy Challenges (Luxembourg: Office for Official Publications of the European
Community, 2004).
Einhorn, H. J. and Hogart, R. M. ‘Unit weighting schemes of decision making’, Organiza-
tional Behavior and Human Performance, Vol. 13, (1975) pp. 171–192.
Fichtner, J. ‘On deriving priority vectors from matrices of pairwise comparisons’, Socio-
Economic Planning Science, Vol. 20, (1986) pp. 341–345.
Fishburn, P. C. The Foundations of Expected Utility (Dordrecht: Reidel Publishing Company,
1982).
Forman, E. and Peniwati, K. ‘Aggregating individual judgments and priorities with the
Analytic Hierarchy Process’, European Journal of Operational Research, Vol. 108, (1998)
pp. 165–169.
Franco, F. and Manero, F. ‘Valoración global y perspectivas de futuro’, in A. Blanco (ed.),
Envejecimiento y Mundo Rural en Castilla y León (Madrid: Fundación Encuentro, 2002,
pp. 68–79).
Golden, B., Wasil, E. and Harker, P. The Analytic Hierarchy Process: Applications and Studies
(Berlin: Springer-Verlag, 1989).
Goméz-Limón, J. A. and Atance, I. ‘Identification of public objectives related to agricultural
sector support’, Journal of Policy Modelling, Vol. 27, (2004) pp. 1045–1071.
Hall, C., McVittie, A. and Moran, D. ‘What does the public want from agriculture and the
countryside? A review of evidence and methods’, Journal of Rural Studies, Vol. 20, (2004)
pp. 211–225.
Halstead, J., Lulof, A. and Stevens, T. ‘Protest bidders in contingent valuation’, Northeastern
Journal of Agricultural and Resources Economics, Vol. 21, (1992) pp. 160–183.
Hanley, N., Ryan, M. and Wright, R. ‘Estimating the monetary value of health care:
Lessons from environmental economics’, Health Economics Review, Vol. 12, (2002)
pp. 3–16.
Hanley, N., Wright, R. and Adamowicz, V. ‘Using choice experiments to value the environ-
ment: Design issues, current experience and future prospects’, Environmental and Resource
Economics, Vol. 11, (1998) pp. 413–428.
Harvey, D. ‘Agri-environmental relationships and multi-functionality: Further considera-
tions’, The World Economy, Vol. 26, (2003) pp. 705–725.
Hensher, D. A., Rose, J. M. and Greene, W. H. Applied Choice Analysis: A Primer (Cam-
bridge: Cambridge University Press, 2005).
Hoehn, J. P. ‘Valuing the multidimensional impact of environmental policy: Theory and
methods’, American Journal of Agricultural Economics, Vol. 73, (1991) pp. 289–299.
Hoehn, J. P. and Loomis, J. ‘Substitution effects in the contingent valuation of multiple envi-
ronmental programs’, Journal of Environmental Economics and Management, Vol. 25,
(1993) pp. 56–75.
Hoehn, J. and Randall, A. ‘A satisfactory benefit cost indicator from contingent
valuation’, Journal of Environmental Economics and Management, Vol. 14, (1987) pp. 226–
247.
Hoehn, J. and Randall, A. ‘Too many proposals pass the benefit cost test’, American Econo-
mic Review, Vol. 79, (1989) pp. 544–551.
Hwang, C. L. and Yoon, K. Multi Attribute Decision Making (New York: Springer-Verlag,
1981).
INE. Censo Agrario 1999. Encuestas Sobre la Estructura de las Explotaciones Agrı´colas
(Madrid: Instituto Nacional de Estadı́stica, 2001).
INE. Contabilidad Regional de España 2003 (Madrid: Instituto Nacional de Estadı́stica,
2004).
Irwin, R., Slovic, P., Licktenstein, S. and McCelland, G. ‘Preference reversals and
the measurement of environmental values’, Journal Risk Uncertain, Vol. 6, (1993)
pp. 5–18.
Jin, J., Wang, Z. and Ran, S. ‘Comparison of contingent valuation and choice experiment
in solid waste management programs in Macao’, Ecological Economics, Vol. 57, (2006)
pp. 430–441.
Kahneman, D. and Knetsch, J. ‘Valuing public goods: The purchase of moral satisfaction’,
Journal of Environmental Economics and Management, Vol. 22, (1992) pp. 57–70.
Kamenetzky, R. ‘The relationship between the analytic hierarchy process and the additive
value function’, Decision Science, Vol. 13, (1982) pp. 702–713.
Kaninen, B. and Kriström, B. ‘Sensitivity of willingness to pay estimates to bid design in
dichotomous choice valuation models: Comment’, Land Economics, Vol. 69, (1993)
pp. 199–202.
Keeney, R. L. and Raiffa, H. Decisions with Multiple Objectives: Preferences and Value
Trade-offs (Cambridge: Cambridge University Press, 1993).
Laininen, P. and Hämäläinen, R. ‘Analysing AHP-matrices by regression’, European Journal
of Operational Research, Vol. 148, (2003) pp. 514–524.
Lima Santos, J. M. (2001). A Synthesis of Country Reports on Demand Measurement of Non-
commodity Outputs in OCDE Agriculture. Workshop on Multifunctionality, Directorate for
Food, Agriculture and Fisheries, OECD, Paris. Available on: http://www1.oecd.
org/agr/mf/doc/Santos.pdf (Last accessed 3/2006).
Loomis, J., Lockwood, M. and Delacy, T. ‘Some empirical evidence on embedding effects in
contingent valuation of forest protection’, Journal of Environment Economics and Manage-
ment, Vol. 25, (1993) pp. 45–55.
Madden, P. ‘A generzalization of Hicksian Q substitutes and complements with application
to demand rationing’, Econometrica, Vol. 59, (1991) pp. 1497–1508.
McKenzie, J. ‘A comparison of contingent preference models’, American Journal of Agricul-
tural Economics, Vol. 75, (1993) pp. 593–603.
McVittie, A., Moran, D., Allcroft, D. and Elston, D. ‘Beauty, beast and biodiversity: What
does the public want from agriculture?’ 78th Annual Conference of the Agricultural
Economics Society, AES, SouthKensington. Available on http://www.scotland.gov.uk/
Publications/2004/09/19892/42598 (Last accessed 3/2006).
Midmore, P., Naspetti, S., Sherwood, A., Vairo, D., Weir, M. and Zanoli, R. Consumer Atti-
tudes to Quality and Safety of Organic and Low Input Foods: A Review. Deliverable 1.2,
Subproject 1, Quality Low Input Food Project. Available at http://www.qlif.org/research/
sub1/QLIF_Review_Reanalysis_%200509.pdf (Last accessed 3/2006).
Mitchell, R. and Carson, R. Using Surveys to Value Public Goods (Washington, DC:
Resources for the Future, 1989).
Mogas, J., Riera, P. and Bennett, J. ‘A comparison of contingent valuation and choice
modelling with second-order interactions’, Journal of Forest Economics, Vol. 12, (2006)
pp. 5–30.
OECD. Multifunctionality: Towards an Analytical Framework (Paris: OECD, 2000).
OECD. Multifunctionality: Applying the OECD Analytical Framework. Guiding Policy Design
(Paris: OECD, 2001).
OECD. Multifunctionality: The Policy Implications (Paris: OECD, 2003).
Pérez, M. Agricultura y Medio Ambiente: Necesidades de Formación Medioambientales en el
Sector Agrı´cola (Valladolid: Instituto de Formación y Estudios Sociales de Castilla y León,
2001).
Peterson, J., Boisvert, R. and De Gorter, H. ‘Environmental policies for a multifunctional
agricultural sector in open economies’, European Review of Agricultural Economics, Vol. 29,
(2002) pp. 423–443.
Prety, J. ‘The externalities and multifunctionality of agriculture’, EuroChoices, Vol. 2, (2003)
pp. 40–44.
Randall, A. ‘Valuing the outputs of multifunctional agriculture’, European Review of Agricul-
tural Economics, Vol. 29, (2002) pp. 289–307.
Randall, A. and Hoehn, J. ‘Embedding in market demand systems’, Journal of Environmental
Economics and Management, Vol. 30, (1996) pp. 369–380.
Saaty, T. ‘A scaling method for priorities in hierarchical structures’, Journal of Mathematical
Psychology, Vol. 15, (1977) pp. 234–281.
Saaty, T. The Analytic Hierarchy Process (New York: McGraw HillInc., 1980).
Saaty, T. ‘The seven pillars of the analytic hierarchy process’, in M. Köksalan and S. Zionts
(eds), Multiple Criteria Decision Making in the New Millennium (Berlin, Springer-Verlag,
2001).
Saaty, T. ‘Decision-making with the AHP: Why is the principal eigenvector necessary?’ Euro-
pean Journal of Operational Research, Vol. 145, (2003) pp. 85–91.
Scott, D. and Willits, F. K. Environmental Concern of Pennsylvania Citizens: Data from a
Statewide Survey (Technical Report, A.E. and R.S. 219) (University Park, PA: Depart-
ment of Agricultural Economics and Rural Sociology, Pennsylvania State University,
1991).
Smith, H. and Lantz, V. A Methodology for Evaluating Public Values of New Brunswick
Forests (New Brunswick, UK: The Fundy Model Forest, 2003) Available at http://
www.fundymodelforest.net/pdf/socioeconomics/2003_public_values.pdf (Last accessed 12/
2005).
Stevens, T., Belkner, R., Dennis, D., Kittredge, D. and Willis, C. ‘Comparison of contingent
valuation and conjoint analysis in ecosystem management’, Ecological Economics, Vol. 32,
(2000) pp. 63–74.
Suárez, F., Naveso, M. A. and de Juana, E. ‘Farming in the drylands of Spain: Birds of
pseudosteppes’, in D. Pain and M. Pienkowski (eds), Farming and Birds in Europe: The
Common Agricultural Policy and Its Implications for Bird Conservation (London: Academic
Press, 1997, pp. 297–330).
Van Huylenbroeck, G. and Durand, G. Multifunctional Agriculture, A New Paradigm for
European Agriculture and Rural Development (London: Ashgate, 2003).
Van Liere, K. D. and Dunlap, R. E. ‘The social bases of environmental concern: A review of
hypotheses, explanations and empirical evidence’, The Public Opinion Quarterly, Vol. 44,
(1980) pp. 181–197.
Wattage, P. and Mardle, S. ‘Total economic value of fishery dependent area conservation
in Sri Lankan wetlands: Application of contingent valuation method (CVM) and
analytic hierarchy process (AHP) to identify use and non-use values’, in The XVIth
Annual Conference of the European Association of Fisheries Economists (Rome: UN-FAO,
2004).