Introduction
Gene technology has many and varied applications. People's reactions to it have been found to vary as well, depending on a number of factors, including area of application.1 The reactions and attitudes of the public to gene technology constitute important areas of research due to their relation to acceptance or rejection of policies. Genetically modified food (GMF) is an important case in point – a technology that is not well received by the European public.
Siegrist and Bühlmann (1999) performed a multidimensional scaling of various gene technology applications and found two factors: type of application (food vs medicine) and plants vs animals. The first factor appeared to be the most important one for technology acceptance, which was low for food and high for medicine [cp. Zechendorf (Zechendorf, 1994)]. Positive attitudes to medical applications of gene technology are common (Berth et al., 2002). Frewer et al. (1996, 1997) found low acceptance of GMF, perceived benefits counteracting this tendency, as well as perceived "naturalness". Frewer et al. stressed the variation of responses to different technologies. Fischhoff and Fischhoff (2001) also emphasized the varying responses to different types of biotechnology .
Other variables correlating with perceived risk and acceptance of gene technology were worldviews (Siegrist, 1999), gender and environmental attitudes (Siegrist, 1998), and moral concerns (Tanaka, 2004). Trust has often been mentioned as an important variable (Siegrist, 2000; Olofsson et al., 2006). Eiser et al. (2002) found evidence against the notion of trust and/or risk being factors causally related to technology acceptance. They suggested that trust, risk and acceptance all reflected similar notions.
Siegrist's work on trust is interesting but his conclusions may be somewhat misleading. First, some of the work shows modest relationships between trust and risk perception, some 15–20% explained variance, which is quite in line with most other work on this issue (Sjöberg, 2008). Second, in some applications the amount of explained variance was much higher, but in those cases perceived risk and trust were both measured by attitude scale items that were formally similar, having the same response scale (agree–disagree, a Likert scale). In a special methodological study, I obtained the same result (Sjöberg, 2002b). When both perceived risk and trust were measured by rating scales, the usual methodology, the relationship was found to be modest, about 15% explained variance. When both dimensions were measured by means of attitude scale items using the same response format, the explained variance was drastically increased to 30% .
Skeptical attitudes to some applications of gene technology seem to be more common in Europe (Siegrist, 2003) than in the USA (Gaskell et al., 1999; Madsen et al., 2003). The US public is still relatively little concerned about gene technology (Loureiro and Hine, 2004). At the same time, increased negative media coverage, starting in the end of the 1990s seemed to be bringing out worry and concern among some sectors of the American public (Shanahan et al., 2001). Madsen et al. point out that European consumers see little or no benefit to them from the use of GMF, while American producers may profit greatly. A large minority of farmers in New Zealand were found to be positively oriented towards the use of GM technology and intense production methods. Economic factors may benefit such farmers. Media reports about new hazards have also played an important role (Frewer et al., 2002; Olofsson, 2002), possibly because they give rise to fear (Laros and Steenkamp, 2004).
Eurobarometer 46.1 reported that people had little knowledge about and were negative towards biotechnology (data collected in 1996) (Biotechnology and the European Public Concerted Action Group, 1997), and subsequent work (Eurobarometer 52.1) has verified these findings (Gaskell et al., 2003). Moral issues, and "unnatural" risk, emerged as important aspects, and attitudes appeared to be declining (Bauer et al., 2000).
The survey questions used in the Eurobarometer program may be partly hard to understand for the lay public who was expected to understand the meaning of such scientific terms as "stem cell" or "cloning." In addition, relatively few questions were asked and in-depth understanding of attitudes was consequently hard to achieve. Only a relatively modest level of explained variance of gene technology attitudes was reached.
Models
Pardo et al. (2002) suggested a broad approach to gene technology attitudes (perceived risks and benefits) but did not devise a model of attitudes. They did construct models of perceived benefits and risks. The risk models failed to explain perceived risk, not even gender appeared to be an important explanatory factor. Only 5% of the perceived risk variance was accounted for. The benefit model explained 33% of the variance, mainly based on level of education, knowledge, and general and specific technology optimism. Savadori et al. (2004) reported a higher level of explained variance of gene technology risks, based on risk dimensions of the type used in the Psychometric Model (Fischhoff et al., 1978). Their models achieved, on the average, about 40% explained variance. However, the sample of non-experts was a small convenience sample of 58 persons (not described in any detail) and a regression model using 15 explanatory variables would seem to be questionable with such a small sample size.
Gaskell et al. (2004) reported models of attitude to GMF, based on Eurobarometer data, which reached a maximum of 27% explained variance. Their most powerful model included an interaction term reflecting a stronger effect of risk for respondents who saw a high degree of benefit of GMF. The main message of their article is that risk is not the major factor in GMF attitude, but that benefit is (cp. Chen and Li, 2007). However, both risk and benefit contributed to the explanation of attitude in their data, even if benefit was more important than risk.
The Eurobarometer work carried out in Sweden has been claimed to show that risk has no importance for the attitude to GMF (Öhman, 2002; Fjaestad et al., 2003). Possibly, this is a question of cultural differences, but the lack of an effect of risk could also be due to the methodology used. Gaskell et al. (2004) give a recent analysis of the Eurobarometer data, and risk does make an important contribution to the modelling of attitudes in their working. It may be pointed out, in addition, that much previous work in other countries has shown that risk is important for GMF attitudes; see for example Rosati and Saba (2000). Risk is not the whole story, but it is an important part of it. I further investigate the issue of risks vs benefits in the present study.
It should also be noted that the Eurobarometer work, where it was claimed that risk has no or a very small importance, partly used self-ratings of the importance of various factors. Are people able and willing to give valid ratings of the weights they have given to various attributes in their assessments of technologies? This is a highly controversial issue, and psychologists have argued for decades, on good grounds, that people often cannot give valid judgments of what influenced their behavior (Nisbett and Wilson, 1977). The issue obviously needs further research. Barlas (2003) found clear evidence that rated importance did not give a valid picture of real reasons for choices. People used importance ratings to justify their choices in terms of socially desirable dimensions. It is quite possible that a dimension such as "morality" fits in well with the need to manage impressions, while "riskiness" may have connotations of lack of rationality and a tendency to be "subjective" and "emotional," hence a less popular alternative as a reason for choice.
In summary, previous attempts at modelling factors in risk perceptions and attitudes toward GMF have resulted in models of only moderate power, as measured by the amount of variance accounted for. The main reason for this fact is probably that several factors known to be of potential importance, based on previous work on other technologies, were not measured and applied in the models. I mention especially epistemic trust (Sjöberg, 2001), morality (Sjöberg and Winroth, 1986) and Interference with Nature (Sjöberg, 2000), a factor that borders on religious beliefs and New Age convictions (Sjöberg and af Wåhlberg, 2002). It is also possible that affective and cognitive risk perceptions call for different explanatory factors (Townsend, 2006; Leikas et al., 2007).
Purpose
The purpose of the present study was to investigate attitudes towards GMF in depth, with a special focus on moral issues and risk attitudes. This work relies on our previous risk perception research, and it was designed to test and further develop the models of risk perception and attitudes, which have emerged in recent research.
It was important to study the opinions and beliefs of non-expert members of the public. It was also considered to be of interest to include a group of gene technology experts (Verbeke et al., 2007). The common view of experts as objective and qualitatively different from non-experts has been found to be unjustified (Rowe and Wright, 2001; Sjöberg, 2002a). A study comparing experts and the public is called for, because a gap between the two groups constitutes the basis for serious policy conflicts. It was the purpose of the present study to investigate the possible gap between experts and non-experts in order to inform policy on this matter and to form the basis for further work on risk communication and policy.
There have been many comparisons between experts and the public, in several different fields of technology (Sjöberg, 1999); see for example studies of nuclear waste experts by Flynn et al. (1993) and Sjöberg and Drottz-Sjöberg (in press). The large gap between experts and that of public has been well documented in this area (Kugo et al., 2005). Kraus et al. (1992) studied experts of toxicology, to name another example. The typical finding in such work is that experts judge risks as much lower than members of the public do. The difference is typically restricted to their area of expertise; they judge other risks in much the same way as members of the public. Furthermore, it seems that the difference is still more restricted than that: experts judged risks as small within their area of professional responsibility, not in their area of scientific expertise in general (Sjöberg and Drottz-Sjöberg, in press). Risk communication strategies must be carefully designed to take the gap between experts and the public into account (Beecher et al., 2005).
Summing up, the present study was carried out in order to analyze aspects of risk perceptions and attitudes towards GMF, and to model these data in terms of driving factors at the level of individual respondents. Differences between members of the public and experts were investigated and it was expected that experts would be much more positive and see fewer risks of gene technology than members of the public. The explanatory constructs measured were based on our previous work, which has been oriented towards finding powerful factors behind risk perceptions. It was expected that similar factors would work well also in the case of GMF.
The following hypotheses were formulated
- Perceived risk and attitudes towards GMF can be well accounted for by models including epistemic trust, morality and Interfering with Nature.
- Experts differ strongly in quantitative terms from the public when it comes to perceived risk, but not qualitatively, in terms of how their risk perception can be explained.
- Differences between experts and the public can be explained by models similar to those explaining risk perception and attitudes within the group of members of the public.
Method
Procedure
An extensive questionnaire,2 27 pages in A5 format, was mailed to 1,000 persons living in Sweden in September 2003. The names and addresses had been selected at random from the national population file administered by SPAR-DAFA. Incentives in the form of lottery tickets were promised to respondents. Two reminders were sent. The same questionnaire, minus a few sections and with some added background questions, was sent to 109 persons tentatively identified3 as experts in the field of gene technology, in March 2004. Two reminders were sent, but no incentives were promised to the experts.
Questionnaire
The design of the questionnaire sent to the public was as follows:
- Eleven initial questions dealing with attitude to gene technology in general
- Ten sections dealing with different specific applications of gene technology:
Modification of animal genes in pharmaceutical industry
Modification of plant genes in pharmaceutical industry
Modification of animal genes in food industry
Modification of plant genes in food industry
Gene diagnostics in family planning when there are reasons to suspect injury
Gene diagnostics of a foetus to inform an abortion decision when there are reasons to suspect injury
Gene diagnostics of a foetus in connection with "test tube" reproduction, to inform a decision about inserting a foetus in the uterus
Modification of human body cells in order to counteract illness
Modification of human sex cells in order to counteract illness
The use of gene technology by the police in their work to find the perpetrator of a certain crime.
Each of these 10 sections asked for five ratings of the technology in question, on five-category scales. These ratings asked whether the technology was
Good, on the whole
Morally correct
Useful
Risky
Associated with acceptable risk
- A section calling for rating 46 hazards in terms of personal risk, on category scales from 0 (no risk at all) to 7 (a very large risk)
- The same 46 hazards rated in terms of risk to people in general
- Five sections calling for the assessment of 18 technologies in terms of:
Should they be used more or less or kept at the present level
Risk
Moral status (acceptable – unacceptable)
Utility- If they could be replaced by other technology or were irreplaceable
- A section calling for judging 19 aspects of GMF risks
- Fifty-five attitude statements concerning GMF
- Five items measuring Neophobia4
- Nine statements measuring New Age beliefs
- Six fact statements, to be judged as true or false, concerning genetics and gene technology
- Eight ratings of trust in various organizations or groups
- Thirteen statements measuring general suspiciousness
- Background questions, including interest in technology, GMF and illness experience, assessment of the environmental situation in the world and the role of technology in that connection, a question tapping attitudes to the precautionary principle, place of residence, vegetarianism, political preference, knowledge of Swedish, if the respondent was the person who had received the questionnaire, if he or she had answered individually, as instructed, and interest in taking part in further studies
- Ten dimensions for rating the quality of the questionnaire and the study
- Time needed to complete the questionnaire
- Space was finally provided for written comments
The questionnaire sent to the experts was quite similar to the one sent to the public, with three exceptions:
- The New Age questions were deleted
- The questions measuring general suspiciousness were deleted
- The questions about elementary facts were deleted
- A few background questions about academic credentials and degree of expertise were added, and some questions about willingness to take part in further studies, and the like, were deleted
The total number of items of the questionnaire was 383. The median time to fill out the questionnaire, by the public sample, was still not excessive, 40 minutes. The time reported by the experts (median) was 35 minutes. Only a subset of the results is reported in the present article. For a more complete account, see a technical report (Sjöberg, 2004b).
There were 10 questions about the quality of the questionnaire. The evaluations of the study and the questionnaire were positive. In particular, few aspects seem to have been missed, according to the views of the respondents, and the study was clearly seen as meaningful. The experts made similar assessments of the questionnaire, only somewhat less positive. It can be noted, in particular, that the experts were more prone to find some questions and formulations to be unclear. This is a common finding in a group of experts and is probably partly caused by their having much more, and much more detailed, knowledge of the field. They want nuances, which the public would not have appreciated. Exactly the same questions to experts and the public were a necessity, however, in order for meaningful comparisons to be made.
Respondents
Public
Filled out questionnaires were returned by 469 persons, yielding a response rate of 47.8% . (Nineteen addresses were unusable). There was also about 2% internal data loss since not all respondents answered to all questions.
There was an even gender distribution among the respondents in the public sample: 49.3% male and 50.7% female. The age distribution was quite similar to the national statistics, with a few percentage units too few in the youngest age groups. There was a bias with regard to education; 8 percentage units too many had college or graduate education. With regard to place of residence, there were a few percentage units too few respondents from the four largest cities and from purely rural areas. The proportion of vegetarians was 2% , as compared to 5% in the population. The political preferences of the respondents were in good agreement with polls conducted during the time period.
About 14% of the public sample answered a question about their knowledge of Swedish with some hesitation about how well they knew the language; this figure resembles the number of immigrants in the country, which was at that level. Only a few percent indicated that they were not the person the survey had been addressed to or that they had filled out the questionnaire after discussions with others.
A check was made on the importance of level of education, since this was the only salient source of possible bias. Educational level was scored in five categories, and correlated with attitude to gene technology (good–bad on a seven-step scale, see below), risk of gene technology (also a seven-step scale) and moral acceptability of gene technology (another seven-step scale). The resulting correlations were quite small: 0.20, 0.08 and 0.14, indicating that people with a higher level of education tended to be only a little more positive to gene technology than others, and to judge the risk as slightly lower. The effects were quite weak, so the education bias factor can probably be ignored. If any effect can be discerned it is that, the present sample gave a somewhat too positive picture of the general population's views regarding gene technology.
Experts
Sixty-five of the 109 experts answered, so the response rate in that group was higher than in the public: 59.6% . Of the 65 respondents, 16 were deleted because they checked, in a question about their degree of expertise, that they were not experts of gene technology. Hence, all data analysis of the expert group was based on 49 respondents.
Experts were predominantly male: 69% . They were also older than the public sample, the most common category being 55–64 years, and none younger than 35. Eighty-eight percent had a Ph.D. or its equivalent.5 The year they got their Ph.D. varied between 1961 and 2000. Their faculty associations were dominated by Natural Science, Medicine and Veterinary Medicine. These categories comprised 87% of the respondents; the few remaining reported either Social Science or Humanities as their faculty association. Sixty-five percent had published 21 or more scientific articles; only two had no such publications. Twenty-nine percent reported formal competence as a "docent" (associate professor) and 46% as full professor.
Their self-assessed degree of expertise in some area of gene technology was rather or very large in 72% of the cases and their self-assessed degree of knowledge of the current scientific development of gene technology was reported as rather or very good by 96% .
Results
GMF risk perception
Both personal and general risks of GMF were rated in a context of 46 hazards. The public rated the personal GMF risk as no. 12 (M=3.34). Experts rated the personal GMF risk as no. 45 (M=1.15). The public rated the general GMF risk as no. 21 (M=3.46), while the experts rated it as smallest of all 46 risks (M=1.17). Distributions of personal and general risk ratings of GMF are given in Figure 1, which refers to the data from the public sample.
The two distributions are quite similar, suggesting that this is a risk beyond one's control and hard to protect oneself from, in agreement of results reported by Hunt and Frewer (2001). In connection with uncertainty of risk assessments, the perceived lack of control could be a cause of alarm and lead to seeing the risk as severe (Miles and Frewer, 2003).
The "non-finding" above should be stressed – there was no clear difference between personal and general risk. Large positive differences are often observed between general and personal risk. The same was true in the present study, for a large number of hazards (see Figure 2). These hazards were of the same type as in many previous studies, not related to gene technology.
Figure 2.
Plot of mean general vs mean personal risk of 42 hazards, data from the public.
Full figure and legend (46K)The response distributions of experts and the public are compared in Figure 3 for general risk. Results for personal risk were very similar to those in Figure 3. The two groups were strikingly different in both cases, and the differences were highly significant according to chi-square tests.
Figure 3.
Ratings of general risk of GMF, data from experts and the public.
Full figure and legend (47K)The GMF risks were rated on 19 risk dimensions, on scales from 1 to 7. Some of the risk dimensions were based on the Psychometric Model (Fischhoff et al., 1978) but several were added. The results were as shown in Table 1. It is clear that GMF technology was rated as very risky in most respects. The risk was considered new, Interfering with Nature, unfair and immoral. Interestingly, the most salient risk aspect was that there could be negative effects unknown today. This is an aspect of the limitations of scientific knowledge (Sjöberg, 2001).
Table 1 - Ratings of the 19 psychometric factors, means and standard deviations, and t-tests of differences between experts and the public.
Table 1 shows dramatically large differences between experts and the public. The members of the public saw much larger risks in GMF than the experts, and they did so in all the studied aspects.
It is common to find very large differences between experts and the public when it comes to the level of perceived risk (Krystallis et al., 2007), especially in domains where the experts have professional responsibility (Sjöberg, 1999). The present results are well in line with such findings.
In order to test models of GMF risk perception, the 19 risk aspects were used to construct five indices. The traditional Psychometric Model reduced the number of crucial risk factors to two overarching factors: Dread and new risk. The present design made it possible to measure three more factors: Interfering with Nature, immoral risk, and severity of consequences, yielding an Extended Psychometric Model. Thus, five factors were estimated in the form of indices; see Table 2 for their properties. Note that Dread was measured by emotion items only. Another explanatory variable was added: risk sensitivity. This is a variable measuring a general tendency to rate the risks as large.6 It was estimated separately for personal and general risks as the average of all risk ratings, except the GMF risk. The alpha values of the two resulting indices are given in Table 2.
The five risk factors, risk sensitivity, and demographic variables were used as explanatory variables in models of the perceived risk. The results are given in Table 3.
A high level of explained variance was achieved. The most important variable was risk sensitivity. It is interesting that the traditional factors of the Psychometric Model had no explanatory power when the new factors were added.7 In particular, the factor immoral risk was an important explanatory variable.
Early in the history of risk perception and Psychometric Model research, it was asserted that experts make risk judgments on the basis of objective facts, while members of the public are affected by the various subjective factors of the model (Fischhoff et al., 1982; Slovic et al., 1985). This assertion has been challenged (Rowe and Wright, 2001; Sjöberg, 2002a). Table 4 shows correlations between personal and general risk judgments of GMF, and the factors of the Extended Psychometric Model, for both experts and members of the public.
Table 4 - Correlations between risk perception ratings and the psychometric factors for the public and experts.
The table shows that for personal risk, the correlations were similar for experts and the public. For general risk, data from experts gave lower correlations, especially for the two traditional psychometric factors of new risk and Dread.
It is interesting to note that the low correlations between perceived risk and psychometric factors are found for (a) general risk, and (b) the two traditional basic psychometric dimensions. When personal risk and/or a broader sample of dimensions are studied, the picture is different. Experts no longer appeared to be unaffected by "subjective" factors.
Attitudes toward GMF
Attitude data were available in two formats: comparisons with several other technologies and ratings of GMF attitudes per se.
Attitudes toward GMF in a context of technologies
In this section, results are presented from ratings of 18 technologies on five dimensions. The results for GMF, as judged by members of the public and by experts, are given in Table 5.
Table 5 - Mean ratings of GMF in five dimensions, by members of the public and by experts.
These results show very clearly that for members of the public, genetic modification of food is a technology, which is rated in a very negative manner with low utility, high risk and as morally little acceptable. The experts had a more complex view. They thought that GMF should be used more, yet it was not judged as irreplaceable. They found its risk to be low, and that it was morally acceptable, yet it was relatively speaking low in utility. However, the latter impression may be somewhat misleading since they rated all technologies as very useful. It is possible that their assessments were partly because GMF is still a new technology and has yet to be put to large-scale use in Sweden.
GMF attitudes per se
The present section reports the results on the attitude questions regarding GMF, data from the public sample. Indices of various factors were mainly based on the set of attitude items. There were three dimensions used as dependent variables in the analyses:
- Overall attitude towards GMF
- GMF policy acceptance
- Consumer intention with regard to GMF
To measure attitudes towards GMF, the ratings of gene technology used for food production, plants and animals were combined (10 items). A few items from other sections in the questionnaire were also added. Items measuring consumer intention expressed a will to buy and consume GMF, while policy items were about voting or not voting for a GMF friendly political party, or other aspects of GMF policy.
The explanatory variables were as follows
- The five factors of the Extended Psychometric Model (see the section on risk perception)
- Risks of GMF
- Benefits of GMF
- Trust in GMF science (epistemic trust)
- Social trust in GMF experts and regulators
- Neophobia
- New Age beliefs
- Suspiciousness.
Four Likert items and three risk ratings of GMF were combined, after standardization, to one risk index. Social trust was measured based on the ratings of trust and items in the list of Likert type attitude items. These items were combined to a measure of social trust.
Psychometric properties of all indices are given in Table 6. See Table 2 for corresponding information about the factors of the Extended Psychometric Model.
Results of regression analyses are given in Tables 7 and 8.
Table 7 - Regression models of attitudes to genetically modified food (GMF), standardized weights, public sample.
Table 8 - Reduced regression model of attitudes to genetically modified food (GMF), standardized weights, public sample.
The results show that all three models reached a high level of explanatory power. Demographic effects were weak, but there was a trend for women to be more negative. Demographics accounted for less than 5% of the variance of two of the dependent variables, 7% for in the case of attitudes to GMF. The traditional Psychometric Model factors contributed to some extent to policy attitudes, but significantly in only one of six tests. Moral acceptability and Interfering with Nature were the most important factors of the Extended Psychometric Model. They contributed strongly. Benefit was a very important explanatory construct, risk somewhat less but still important. Both epistemic trust and social trust had some impact, epistemic trust more than social trust for policy attitudes. Moral value and trust in science were of particular importance for policy. Benefits, risks, Interfering with Nature and social trust were most important for consumer intention. For overall attitude, benefits, interference with nature and risks were the most important factors. Other variables contributed to some extent. Neophobia made a contribution in one case and suspiciousness in two others. In simple models, which eliminated all explanatory variables except demographics, risks and benefits, risks emerged as about equal in importance to benefits. The reduced models fitted almost as well as the full models in two cases, but somewhat less well in the case of policy acceptance.
Summing up, benefits and risks were the most powerful explanatory variables, followed by moral acceptability, Interfering with Nature, trust (both epistemic and social) and suspiciousness.
Comparison of experts and the public in GMF attitude dimensions
The experts were compared to members of the public with regard to attitudes toward GMF, acceptance of GMF policies and consumer intentions, as well as the explanatory variables used in the regression models applied to data from the public. All differences were highly significant. The standardized means are given in Table 9. The table shows that the mean differences were very large.
The differences between the two groups remained after controlling statistically for gender, age and level of education. Regression models were fitted and the resulting standardized residuals differed 1.08, 1.48 and 1.13 for attitudes, acceptance of policy and consumer intentions, respectively. The group differences remained highly significant. Then the explanatory variables from the regression analysis of the sample from the public were entered, see Table 6 for a list of explanatory variables. New Age attitudes and suspiciousness were deleted from these analyses since no data were available in the group of experts. The result was a drastic reduction in the differences between the two groups. The standardized residuals differed 0.062, 0.370 and 0.140 for attitudes, acceptance of policy and consumer intentions, respectively. The difference was significantly different from 0 only in the case of acceptance of policy (p=0.013), but even in that case it was reduced to about 1/4 of the non-adjusted difference.
The significant explanatory variables were as follows, in order of importance:
- For attitudes: benefit, risk, gender, age
- For acceptance of policy: epistemic trust, risk, benefit, moral acceptance, new risk, social trust, Neophobia
- For consumer intention: benefit, risk, moral acceptance, Interfering with Nature, social trust
Hence, group differences were most accounted for by benefit and risk. Moral acceptance, epistemic trust, and Interfering with Nature were also important. The traditional explanatory variables of new risk and social trust had some importance, but they did not have a major influence. Dread was of no importance in these models.
Discussion
The hypotheses formulated in the Introduction were as follows:
- Perceived risk and attitudes toward GMF can be well accounted for by models including epistemic trust, morality, and Interfering with Nature.
- Experts differ strongly in quantitative terms from the public when it comes to perceived risk, but not qualitatively, in terms of how their risk perception can be explained.
- Differences between experts and the public can be explained by models similar to those explaining risk perception and attitudes within the group of members of the public.
Hypotheses 1 and 3 were supported by the results. Hypothesis 2 was supported with regard to personal risk but not for general risk. In the latter case, and especially for Dread and Novelty, the traditional view that experts' risk perception is not affected by "subjective" factors was supported.
GMF was rated as a very undesirable technology in the present study by members of the public. This is by no means a unique finding, but there has been some discussion in the literature about just how unacceptable GMF is, and what factors account for attitudes towards it. Townsend et al. (2004) studied attitudes and risk perception of GMF in a context of other concerns, such as nuclear war and cancer. They found that GMF was not rated among the top concerns, an unexpected finding according to them. However, other work and the results of the present study do place GMF in the bottom of the list of technologies. This does not imply that it is also among the very worst concerns generally. Townsend, Clarke, and Davis did not compare GMF with other technologies.
One striking finding was that the risk of GMF was at the same level when rated as a personal or a general risk. Previous work on the risk of genetic engineering showed, on the contrary, a clear difference between personal and general risk (Sjöberg, 2004c). That finding could have been caused by differences in wording of the hazard. It is also possible that perceived control was different in the two studies. Anything we consume can be seen to be under control, as long as we know what we consume. A prime example is alcohol, where people typically give low ratings of personal risk and high ratings of risk to others (Sjöberg, 1998). It is possible that some people perceive the GMF risk as being under control. Yet, GMF could be in our food without our knowing about it. It would be interesting to study risk perception and perceived control under special conditions, such as explicit labelling of genetically modified food.
The group of experts studied here had dramatically different attitudes and risk perceptions than members of the public, except that they also tended to see GMF as a replaceable technology. The large differences between the public and the experts could be well explained by the attitudes and risk-related variables investigated here, in particular overall risks and benefits, morality, Interfering with Nature, epistemic and to some extent social trust. Demographics accounted for very little of the differences between the public and the experts.
Summing up the results of the model analyses, it was found that traditional factors used in many previous studies of risk perception, that is, Novelty and Dread, contributed little beyond the set of dimensions introduced here. Similarly, social trust – which is the dominating trust aspect studied in previous work by other researchers – had a relatively weak influence as compared to epistemic trust, defined in our previous work with regard to policy (Sjöberg, 2001).
The factors introduced here accounted for a very large share of attitudes and risk perceptions, approaching a full explanation if error variance is taken into account.8 Other work with a similar orientation is scarce so far, but a study by Saba and Vassallo (2002) is interesting . They found that consumer intention was explained to 41% with their attitude models,9 considerably less than the present results. Townsend and Campbell (2004) found, in an experimental study, that risk factors explained 46% of the variance of consumer intention. Eurobarometer work reported a lower level of explained variance (Gaskell et al., 2004).
Statements about the importance of various dimensions for "acceptance" are found in the report by Fjaestad et al. (2003), being an analysis of Swedish Eurobarometer data, but no data analysis is described or otherwise reported. Among other things, they claimed that risk is unimportant. This statement seems to build upon data from a single dimension of "riskiness to society." This is a matter that needs careful consideration of what risk dimensions are investigated. Hunt and Frewer (2001), among others, have found very clearly that risk is an important factor in attitudes to GMF, just as in the present study.
It has been claimed that benefit is by far the most important factor in GMF attitudes and risk perceptions (Gaskell et al., 2004). In the data reported here, we have also found that benefit dominated the picture for consumer intention and overall attitudes, but for policy acceptance, it was epistemic trust, which was most important. More powerful models were made possible by our design, which included about three times as many questions as the Eurobarometer design.
The often-stated conclusion from early risk perception research that experts make objective risk judgments not affected by the psychometric factors was not supported by the present data. The results suggest why that conclusion was suggested in the early work. Experts' risk judgments were not correlated with the traditional psychometric factors of Novelty and Dread as far as general risk was concerned. These were the factors studied in the seminal work of Fischhoff et al. (1978). The present results showed that experts' risk ratings had properties very similar to those of the public sample, when personal risk was studied and when the factors of the Extended Psychometric Model were considered, that is, morality, Interfering with Nature and severity of consequences.
There is of course a huge difference between experts and most members of the public when it comes to knowledge. However, this "knowledge gap" does not tell the whole story of the differences between the two groups, as argued by Dietrich and Schibeci (2003), Hansen et al. (2003) and Frewer (2004), and shown here. Previous work on experts and the public has shown that experts were likely to judge risks as smaller with regard to hazards within their area of responsibility (Sjöberg and Drottz-Sjöberg, in press; Sjöberg et al., 1997). A check on the present data showed that there were no significant risk judgments differences between experts and the public, within genders, for risks other than GMF.
Conclusions
GMF ranked very low in trust and attitudes and high in risk. Different demographic strata had similar views. Moral issues played a very big role. In addition, trust in science per se was of importance, and so was perceived benefit. In the present study, experts were much more positive than members of the public to GMF, in almost all respects. This was so in spite of their judgments of other risks being at the same level as the one given by the public sample.
In view of results such as the present ones, acceptance of GMF seems unlikely in the short or medium run. People doubt that science knows well enough the crucial properties of GMF, and beliefs about the dangers inherent in Interfering with Nature are widely spread. In addition, there are grave moral doubts as to the appropriateness of gene modification in the food processing industry.
The conclusions reached in other research are partially supported here, but new aspects appeared and explained variance doubled as compared to Eurobarometer work. In a policy-related discussion, notions as to the benefits of technology and validity of science must be carefully attended to and explained. In discussions of consumer behavior and preferences, social trust appears to be of some importance. However, this is a factor of limited importance, and it has been overrated in previous work. Moral issues are of primary importance, and the closely related notions about interference with nature play an important role as well. These are risk dimensions. Further research on the structure and dynamics of these beliefs could be of great importance for understanding the attitudes and beliefs of the public with regard to GMF.
The experts studied here differed sharply from the public as to the level of perceived risks and benefits, but not with regard to structure of their ratings of personal risk. In addition, their risk perceptions in other areas were much like those of the public. The dramatic difference between experts and the public was well accounted for by the models formulated and tested here, although some variance remained unexplained in the case of policy acceptance.
Notes
1 This study was supported by the Knut and Alice Wallenberg Foundation. Johnny and Lena Drottz and Caroline Nordlund contributed to the administration of the study.
2 Available at http://www.dynam-it.com/institute (see tab "gene technology study").
3 Names and addresses were obtained from several knowledgeable informants. Most of the people approached were associated with universities or government research institutes, but a few were employed by industry. For reasons of respondent integrity, no data on institutional association were entered in the file, and all responses were anonymous.
4 Neophobia is the reluctance to eat unfamiliar foods, see for example Knaapila et al. (2007).
5 This number includes regular Ph.D.s and a few who had a "licentiate" degree, which is somewhere in between an M.Sc. and a Ph.D.
6 See Sjöberg (2004a) for further discussion of this variable, which has turned out to be very important in risk perception models.
7 Note that the Dread factor as defined here is purely emotional. In previous work on the Psychometric Model, severity of consequences has often been combined with a single emotion item, which has given its name to the mixture (Sjöberg, 2003).
8 It is likely that another 15% , approximately, is true variance, which could be accounted for if new constructs were to be introduced in the models. It is an interesting challenge to try to formulate hypotheses about such additional explanatory factors. One obvious possibility is that of political values and preferences. Some personality factors, especially emotional instability (Källmén, 2000), may also be of importance. Other work has found some evidence for the importance of control and self-identity (Sparks et al., 1995). The effect, if any, of the latter variable was very weak, however. In future work, it would be interesting to also study questions about the nature/nurture controversy (Singer et al., 1998).
9 They applied the Theory of Reasoned Action and the Theory of Planned Behavior (Ajzen and Fishbein, 1980; Ajzen, 1991), which seldom give better results than they achieved. These are common-sense models, which are not flexible enough to incorporate additional factors, which may be called for in special applications. Typical variance accounted for in food applications are 30% or less (Bagozzi et al., 2000).
References
- Ajzen, I. (1991). The Theory of Planned Behavior. Organizational Behavior and Human Decision Processes. Vol. 50, pp 179–211. | Article | ISI |
- Ajzen, I. and Fishbein, M. (1980). Understanding Attitudes and Predicting Social Behavior. Englewood Cliffs, NJ: Prentice-Hall.
- Bagozzi, R.P., Wong, N., Abe, S. and Bergami, M. (2000). Cultural and Situational Contingencies and the Theory of Reasoned Action: Application to Fast Food Restaurant Consumption. Journal of Consumer Psychology. Vol. 9, No. 2, pp 97–106. | Article |
- Barlas, S. (2003). When Choices Give into Temptations: Explaining the Disagreement among Important Measures. Organizational Behavior & Human Decision Processes. Vol. 91, No. 2, pp 310–321. | Article |
- Bauer, M.W., Gaskell, G., Allum, N. and Durant, J. (2000). Biotechnology and the European Public. Nature Biotechnology. Vol. 18, No. 9, pp 935–938. | Article | PubMed | ChemPort |
- Beecher, N., Harrison, E., Goldstein, N., McDaniel, M., Field, P. and Susskind, L. (2005). Risk Perception, Risk Communication, and Stakeholder Involvement for Biosolids Management and Research. Journal of Environmental Quality. Vol. 34, No. 1, pp 122–128. | PubMed | ChemPort |
- Berth, H., Balck, F. and Dinkel, A. (2002). Attitudes Toward Genetic Testing in Patients at Risk for Hnpcc/Fap and the German Population. Genetic Testing. Vol. 6, No. 4, pp 273–280. | Article | PubMed |
- Biotechnology and the European Public Concerted Action Group (1997). Europe Ambivalent on Biotechnology. Nature. Vol. 387, No. 6636, pp 845–847. | Article | PubMed | ISI | ChemPort |
- Chen, M.F. and Li, H.L. (2007). The Consumer's Attitude Toward Genetically Modified Foods in Taiwan. Food Quality and Preference. Vol. 18, No. 4, pp 662–674. | Article |
- Cohen, J. (1988). Statistical Power Analysis for Behavioral Sciences. (2nd ed.). Hillsdale, NJ: Erlbaum.
- Dietrich, H. and Schibeci, R. (2003). Beyond Public Perceptions of Gene Technology: Community Participation in Public Policy in Australia. Public Understanding of Science. Vol. 12, No. 4, pp 381–401. | Article | PubMed |
- Eiser, J.R., Miles, S. and Frewer, L.J. (2002). Trust, Perceived Risk, and Attitudes toward Food Technologies. Journal of Applied Social Psychology. Vol. 32, No. 1, pp 1–12. | Article |
- Fischhoff, B. and Fischhoff, I. (2001). Publics' Opinions About Biotechnologies. AgBioForum. Vol. 4, No. 3&4, pp 155–162.
- Fischhoff, B., Slovic, P. and Lichtenstein, S. (1982). Lay Foibles and Expert Fables in Judgments About Risk. American Statistician. Vol. 36, pp 240–255. | Article |
- Fischhoff, B., Slovic, P., Lichtenstein, S., Read, S. and Combs, B. (1978). How Safe is Safe Enough? A Psychometric Study of Attitudes Towards Technological Risks and Benefits. Policy Sciences. Vol. 9, No. 2, pp 127–152. | Article | ISI |
- Fjaestad, B., Olofsson, A. and Öhman, S. (2003). Svenskarna Och Gentekniken. Rapport Från 2002 Års Eurobarometer Om Bioteknik. (Swedes and Gene Technology. Report from Eurobarometer 2002 on Biotechnology). Stersund: Mitthögskolan, Department of Social Science.
- Flynn, J., Slovic, P. and Mertz, C.K. (1993). Decidedly Different: Expert and Public Views of Risks from a Radioactive Waste Repository. Risk Analysis. Vol. 13, pp 643–648. | Article |
- Frewer, L.J. (2004). The Public and Effective Risk Communication. Toxicology Letters. Vol. 149, No. 1–3, pp 391–397. | Article | PubMed | ChemPort |
- Frewer, L.J., Howard, C. and Shepherd, R. (1996). The Influence of Realistic Product Exposure on Attitudes Towards Genetic Engineering of Food. Food Quality and Preference. Vol. 7, pp 61–67. | Article |
- Frewer, L.J., Howard, C. and Shepherd, R. (1997). Public Concerns in the United Kingdom About General and Specific Applications of Genetic Engineering: Risk, Benefit and Ethics. Science, Technology, & Human Values. Vol. 22, pp 98–124. | Article |
- Frewer, L.J., Miles, S. and Marsh, R. (2002). The Media and Genetically Modified Foods: Evidence in Support of Social Amplification of Risk. Risk Analysis. Vol. 22, No. 4, pp 701–711. | Article | PubMed |
- Gaskell, G., Allum, N. and Stares, S. (2003). Europeans and Biotechnology in 2002 (Eurobarometer 58.0). Brussels: DG Research.
- Gaskell, G., Allum, N., Wagner, W., Kronberger, N., Torgersen, H., Hampel, J. and Bardes, J. (2004). Gm Foods and the Misperception of Risk Perception. Risk Analysis. Vol. 24, No. 1, pp 185–194. | Article | PubMed |
- Gaskell, G., Bauer, M., Durant, J. and Allum, N. (1999). Worlds Apart? The Reception of Genetically Modified Food in Europe and the United States. Science. Vol. 295, pp 384–387. | Article |
- Hansen, J., Holm, L., Frewer, L.J., Robinson, P. and Sandoe, P. (2003). Beyond the Knowledge Deficit: Recent Research into Lay and Expert Attitudes to Food Risks. Appetite. Vol. 41, No. 2, pp 111–121. | Article | PubMed | ISI |
- Hunt, S. and Frewer, L.J. (2001). Impact of Bse on Attitudes to Gm Food. Risk, Decision & Policy. Vol. 6, No. 2, pp 91–103. | Article |
- Källmén, H. (2000). Manifest Anxiety, General Self-Efficacy and Locus of Control as Determinants of General and Personal Risk Perception. Journal of Risk Research. Vol. 3, No. 2, pp 111–120. | Article |
- Knaapila, A., Tuorila, H., Silventoninen, K., Keskitalo, K., Kallela, M., Wessman, M., Peltonen, L., Cherkas, L.F., Spector, T.D. and Perola, M. (2007). Food Neophobia Shows Heritable Variation in Humans. Physiology & Behavior. Vol. 91, No. 5, pp 573–578. | Article | PubMed | ChemPort |
- Kraus, N., Malmfors, T. and Slovic, P. (1992). Intuitive Toxicology: Expert and Lay Judgments of Chemical Risks. Risk Analysis. Vol. 12, pp 215–232. | Article |
- Krystallis, A., Frewer, L.J., Rowe, G., Houghton, J., Kehagia, O. and Perrea, T. (2007). A Perceptual Divide? Consumer and Expert Attitudes to Food Risk Management in Europe. Health Risk & Society. Vol. 9, No. 4, pp 407–424. | Article |
- Kugo, A., Yoshikawa, H., Shimoda, H. and Wakabayashi, Y. (2005). Text Mining Analysis of Public Comments Regarding High-Level Radioactive Waste Disposal. Journal of Nuclear Science and Technology. Vol. 42, No. 9, pp 755–767. | Article | ChemPort |
- Laros, F.J.M. and Steenkamp, J. (2004). Importance of Fear in the Case of Genetically Modified Food. Psychology & Marketing. Vol. 21, No. 11, pp 889–908. | Article |
- Leikas, S., Lindeman, M., Roininen, K. and Lähteenmäki, L. (2007). Food Risk Perceptions, Gender, and Individual Differences in Avoidance and Approach Motivation, Intuitive and Analytic Thinking Styles, and Anxiety. Appetite. Vol. 48, No. 2, pp 232–240. | Article | PubMed |
- Loureiro, M.L. and Hine, S. (2004). Preferences and Willingness to Pay for Gm Labeling Policies. Food Policy. Vol. 29, No. 5, pp 467–483. | Article |
- Madsen, K.H., Lassen, J. and Sandoe, P. (2003). Genetically Modified Crops: A Us Farmer's Versus an Eu Citizen's Point of View. Acta Agriculturae Scandinavica Section B-Soil and Plant Science. Vol. 53, No. (Suppl 1), pp 60–67. | Article |
- Miles, S. and Frewer, L.J. (2003). Public Perception of Scientific Uncertainty in Relation to Food Hazards. Journal of Risk Research. Vol. 6, No. 3, pp 267–283. | Article |
- Nisbett, R.E. and Wilson, T.D. (1977). Telling More Than We Can Know: Verbal Reports on Mental Processes. Psychological Review. Vol. 84, No. 3, pp 231–259. | Article | ISI |
- Öhman, S. (2002). Public Perceptions of Gene Technology – on the Edge of Risk Society? Unpublished Ph. D. Thesis, Umeå, Sweden: University of Umeå;.
- Olofsson, A. (2002). Waves of Controversy. Gene Technology in Dagens Nyheter 1973–96. Umeå: University of Umeå;.
- Olofsson, A., Ohman, S. and Rashid, S. (2006). Attitudes to Gene Technology: The Significance of Trust in Institutions. European Societies. Vol. 8, No. 4, pp 601–624. | Article |
- Pardo, R., Midden, C. and Miller, J.D. (2002). Attitudes Toward Biotechnology in the European Union. Journal of Biotechnology. Vol. 98, No. 1, pp 9–24. | Article | PubMed | ChemPort |
- Rosati, S. and Saba, A. (2000). Factors Influencing the Acceptance of Food Biotechnology. Italian Journal of Food Science. Vol. 12, No. 4, pp 425–434.
- Rowe, G. and Wright, G. (2001). Differences in Expert and Lay Judgments of Risk: Myth or Reality. Risk Analysis. Vol. 21, pp 341–356. | Article | PubMed | ChemPort |
- Saba, A. and Vassallo, M. (2002). Consumer Attitudes Toward the Use of Gene Technology in Tomato Production. Food Quality and Preference. Vol. 13, pp 13–21. | Article |
- Savadori, L., Savio, S., Nicotra, E., Rumiati, R., Finucane, M.L. and Slovic, P. (2004). Expert and Public Perception of Risks from Biotechnology. Risk Analysis. Vol. 24, No. 5, pp 1289–1299. | Article | PubMed |
- Shanahan, J., Scheufele, D. and Lee, E. (2001). Attitudes About Agricultural Biotechnology and Genetically Modified Organisms. Public Opinion Quarterly. Vol. 65, pp 267–281. | Article | PubMed | ChemPort |
- Siegrist, M. (1998). Belief in Gene Technology: The Influence of Environmental Attitudes and Gender. Personality and Individual Differences. Vol. 24, pp 861–866. | Article |
- Siegrist, M. (1999). A Causal Model Explaining the Perception and Acceptance of Gene Technology. Journal of Applied Social Psychology. Vol. 29, No. 10, pp 2093–2106. | Article |
- Siegrist, M. (2000). The Influence of Trust and Perceptions of Risks and Benefits on the Acceptance of Gene Technology. Risk Analysis. Vol. 20, No. 2, pp 195–204. | Article | PubMed | ChemPort |
- Siegrist, M. (2003). Perception of Gene Technology, and Food Risks: Results of a Survey in Switzerland. Journal of Risk Research. Vol. 6, No. 1, pp 45–60. | Article |
- Siegrist, M. and Bühlmann, R. (1999). Die Wahrnehmung Verschiedener Gentechnischer Anwendungen: Ergebnisse Einer Mds-Analyse. Zeitschrift für Sozialpsychologie. Vol. 30, pp 32–39. | Article |
- Singer, E., Corning, A. and Lamias, M. (1998). The Polls-Trends: Genetic Testing, Engineering and Therapy: Awareness and Attitudes. Public Opinion Quarterly. Vol. 62, pp 633–664. | Article |
- Sjöberg, L. (1998). Risk Perception of Alcohol Consumption. Alcoholism: Clinical and Experimental Research. Vol. 22, pp 277S–284S. | Article |
- Sjöberg, L. (1999). Risk Perception by the Public and by Experts: A Dilemma in Risk Management. Human Ecology Review. Vol. 6, No. 2, pp 1–9.
- Sjöberg, L. (2000). Perceived Risk and Tampering with Nature. Journal of Risk Research. Vol. 3, No. 4, pp 353–367. | Article |
- Sjöberg, L. (2001). Limits of Knowledge and the Limited Importance of Trust. Risk Analysis. Vol. 21, No. 1, pp 189–198. | Article | PubMed |
- Sjöberg, L. (2002a). The Allegedly Simple Structure of Experts' Risk Perception: An Urban Legend in Risk Research. Science Technology & Human Values. Vol. 27, No. 4, pp 443–459.
- Sjöberg, L. (2002b). Attitudes to Technology and Risk: Going Beyond What Is Immediately Given. Policy Sciences. Vol. 35, No. 4, pp 379–400. | Article |
- Sjöberg, L. (2003). Risk Perception, Emotion, and Policy: The Case of Nuclear Technology. European Review. Vol. 11, No. 1, pp 109–128. | Article |
- Sjöberg, L. (2004a). Explaining Individual Risk Perception: The Case of Nuclear Waste. Risk Management: An International Journal. Vol. 6, No. 1, pp 51–64.
- Sjöberg, L. (2004b). Gene Technology in the Eyes of the Public and Experts. Moral Opinions, Attitudes and Risk Perceptions. (SSE/EFI Working Paper Series in Business Administration 2004: 7), Stockholm: Stockholm School of Economics.
- Sjöberg, L. (2004c). Principles of Risk Perception Applied to Gene Technology. EMBO Reports. Vol. 5, Special Issue, pp 47–S51. | Article | ChemPort |
- Sjöberg, L. (2008). Antagonism, Trust and Perceived Risk. Risk Management: An International Journal. Vol. 10, No. 1, pp 32–55. | Article |
- Sjöberg, L. and af Wåhlberg, A. (2002). New Age and Risk Perception. Risk Analysis. Vol. 22, No. 4, pp 751–764. | Article | PubMed |
- Sjöberg, L. and Drottz-Sjöberg, B.-M. (in press). Attitudes Towards Nuclear Waste and Siting Policy: Experts and the Public. In Lattefer, A.P. (ed.) Nuclear Waste Research: Siting, Technology and Treatment. New York: Nova Publishers.
- Sjöberg, L., Oskarsson, A., Bruce, Å. and Darnerud, P.O. (1997). Riskuppfattning Hos Experter Inom Området Kost Och Hälsa. (Experts' Risk Perception with Regard to Food and Health) (Rapport 24/97). Uppsala: Statens Livsmedelsverk.
- Sjöberg, L. and Winroth, E. (1986). Risk, Moral Value of Actions, and Mood. Scandinavian Journal of Psychology. Vol. 27, pp 191–208. | Article |
- Slovic, P., Fischhoff, B. and Lichtenstein, S. (1985). Characterizing Perceived Risk. In Kates, R.W., Hohenhemser, C. and Kasperson, J.X. (eds) Perilous Progress: Managing the Hazards of Technology. pp 92–125. Boulder, CO: Westview.
- Sparks, P., Shepherd, R. and Frewer, L.J. (1995). Assessing and Structuring Attitudes Toward the Use of Gene Technology in Food Production: The Role of Perceived Ethical Obligation. Basic & Applied Social Psychology. Vol. 16, No. 3, pp 267–285. | Article |
- Tanaka, Y. (2004). Major Psychological Factors Affecting Acceptance of Gene-Recombination Technology. Risk Analysis. Vol. 24, No. 6, pp 1575–1583. | Article | PubMed |
- Townsend, E. (2006). Affective Influences on Risk Perceptions of, and Attitudes toward, Genetically Modified Food. Journal of Risk Research. Vol. 9, No. 2, pp 125–139. | Article |
- Townsend, E. and Campbell, S. (2004). Psychological Determinants of Willingness to Taste and Purchase Genetically Modified Food. Risk Analysis. Vol. 24, No. 5, pp 1385–1393. | Article | PubMed |
- Townsend, E., Clarke, D.D. and Travis, B. (2004). Effects of Context and Feelings on Perceptions of Genetically Modified Food. Risk Analysis. Vol. 24, No. 5, pp 1369–1384. | Article | PubMed |
- Verbeke, W., Frewer, L.J., Scholderer, J. and De Brabander, H.F. (2007). Why Consumers Behave as They Do with Respect to Food Safety and Risk Information. Analytica Chimica Acta. Vol. 586, No. 1–2, pp 2–7. | Article | PubMed | ChemPort |
- Zechendorf, B. (1994). What the Public Thinks About Biotechnology. Bio/Technology. Vol. 12, pp 870–875.
MORE ARTICLES LIKE THIS
These links to content published by Palgrave Macmillan are automatically generated.
RESEARCH
Genetically Modified Food in The Eyes of the Public and ExpertsRisk Management Article
Emotions and Risk PerceptionRisk Management Article
Antagonism, Trust and Perceived RiskRisk Management Article
Consumer Acceptance of Genetically Modified Food (GM) in Spain: A Structural Equation ApproachRisk Management Article
Exploring the Triangular Relationship Between Trust, Affect, and Risk Perception: A Review of the LiteratureRisk Management Article
See all 13 matches for Research
