INFORMATION

Psicothema was founded in Asturias (northern Spain) in 1989, and is published jointly by the Psychology Faculty of the University of Oviedo and the Psychological Association of the Principality of Asturias (Colegio Oficial de Psicología del Principado de Asturias).
We currently publish four issues per year, which accounts for some 100 articles annually. We admit work from both the basic and applied research fields, and from all areas of Psychology, all manuscripts being anonymously reviewed prior to publication.

PSICOTHEMA
  • Director: Laura E. Gómez Sánchez
  • Frequency:
         February | May | August | November
  • ISSN: 0214-9915
  • Digital Edition:: 1886-144X
CONTACT US
  • Address: Ildelfonso Sánchez del Río, 4, 1º B
    33001 Oviedo (Spain)
  • Phone: 985 285 778
  • Fax: 985 281 374
  • Email:psicothema@cop.es

Psicothema, 2005. Vol. Vol. 17 (nº 2). 325-331




A META-ANALYTIC REVIEW OF FRAMMING EFFECT: RISKY, ATTRIBUTE AND GOAL FRAMING

Adelson Piñon and Hilda Gambara

Universidad Autónoma de Madrid

This work reports the results of a meta-analytic study about framing effect. An exhaustive literature search identified 51 independent primary studies, published between 1997 and 2003, that fulfilled the selection criteria. The studies produced 151 estimations of the effect size with nearly 13,500 subjects. The effect, measured as d index, was 0.437 for risky frame, 0.260 for attribute frame, and 0.444 for goal frame. The influence of other moderating variables was also analysed, such as gender of participants, design, or response mode. Finally, alternative explanations of the findings and implications are discussed.

Una revisión meta-analítica del efecto del marco: marco de riesgo, atributo y objetivo. En este trabajo se presentan los resultados de un estudio meta-analítico sobre el efecto del marco. Una búsqueda exhaustiva de la literatura nos permitió identificar 51 estudios primarios independientes, publicados entre 1997 y 2003, que cumplían con los criterios de selección establecidos, y que dieron lugar a 151 estimaciones del tamaño del efecto con cerca de 13.500 sujetos. El efecto, mediante el índice d, fue de 0.437 en el caso del marco de riesgo, 0.260 en el marco de atributo y 0.444 en el marco de objetivo. Se analizó la influencia de diversas variables moderadoras, como el género de los participantes, el diseño, el modo de respuesta, etc. Finalmente, se discuten las posibles explicaciones de los resultados y sus implicaciones.

PDF

Research on judgment and decision making has identified important violations of rational choice theory (Mellers, Schwartz and Cooke, 1998). In the early 1980s, Tversky and Kahneman (1981) initiated framing effect research in psychology, and it has since gained great popularity and recognition (León and Botella, 2003). Applications can be found in diverse areas, such as consumer behavior, organization, health or politics (e.g. Druckman, 2001a; Krishnamurthy, Carter and Blair, 2001).

In view of the fact that the scientific literature defines the framing effect in an informal way, confusing the term with what we call the «risky framing effect», it would seem appropriate to state a formal definition of the phenomenon, before defining the three different frame types. We suggest the following: given a task expressed in certain terms T+ (that is, set out in an F+ frame), and given another task formally identical but semantically manipulated T- (that is, set out in an F- frame), framing effect is defined as the significant difference observed in subjects’ responses to F+ and F-.

In our meta-analysis we will follow the taxonomy of Levin, Schneider and Gaeth (1998), distinguishing between risky, attribute and goal framing. This classification facilitates understanding of the framing phenomenon. What is the risky framing effect? Given a certain situation S+ set out in positive terms (e.g., live, win, etc.), with n response options implying different final results with different uncertainty levels r1, r2, …, rn, and given the same situation set out in negative terms (e.g., die, lose, etc.), denoted by S-, with the same number of response options, n, and the same final results r1, r2, …, rn, we define risky framing effect as the subjects’ trend for choosing the lower uncertainty option at S+, and the higher uncertainty option at S-. In other words, it refers to the tendency to prefer the sure option in a positive frame and the risky option in a negative frame (Tversky and Kahneman, 1981). The prototypical task is their Asian disease problem: the majority of subjects who are given the positively-framed version problem (a sure saving of one-third of the lives versus a one-third chance of saving all the lives and a two-thirds chance of saving no lives) select the option with the certain outcome, whereas the majority of subjects who are given the negatively framed version (a sure loss of two-thirds the lives versus a one-third chance of losing no lives and a two-thirds chance of losing all the lives) select the risky option.

What is attribute framing effect? Given a certain attribute (object or event) A+ set out in positive terms (e.g., success, lean, etc.) with n response options implying different degrees of attraction d1, d2, …, dn, and given the same attribute set out in negative terms (e.g., failure, fat, etc.), denoted by A-, with the same number of response options, n, and the same degrees of attraction d1, d2, …, dn, we define attribute framing effect as the subjects’ trend for evaluating A+ with higher degrees of attraction level and A- with lower degrees of attraction. In other words: it refers to subjects’ inclination to make more positive evaluations of items framed positively (Levin et al., 1998). By way of example, Levin and Gaeth (1988) found that ground beef is rated as more tasty when it is labelled in a positive valence (75% lean) than when it is labelled 25% fat.

The principal differences between risky framing and attribute framing are that the latter does not involve risk manipulation, and the task goal does not consist in choosing between two independent response options, but rather in evaluating the acceptance (either on a several-values scale or on an accept-refuse dichotomic scale) of a certain item (Levin et al., 1998).

What is goal framing effect? Given a certain message M+ set out from a positive frame (opportunity to make a gain or avoid a loss), and given the same message set out from a negative frame (opportunity to make no gain or suffer a loss), denoted by M-, we define goal framing effect as the difference in persuasive impact between M+ and M- for achieving a certain behavior. Here, the question is which valence frame is more powerful for persuading the subjects (Levin et al., 1998). Levin et al. (1998) hold that in risky and attribute framing the item is defined from a positive or negative valence (e.g., live vs. die). However, in goal framing the item valence is considered –from the persuader’s perspective– as always positive or negative (e.g., mammography screening). In this latter case, the consequences are described from a positive or negative valence (more possibilities of detecting a tumour vs. less possibilities of detecting a tumour).

Why do subjects prefer a certain option depending on the valence? The most important model is the prospective theory (risky frame focused), an alternative to classical utility theory for describing human choice behavior, that incorporates sensitivity to differences in magnitude rather than the absolute magnitude of stimuli. Prospect theory focuses on the difference between an asset position of an option and a reference point (Fagley and Miller, 1997). It postulates that valence manipulation (positive or negative) determines the way that presented information is perceived (gain or loss), which affects decision making (Tversky and Kahneman, 1981). In risky framing, subjects are risk-prone when options are evaluated in cost terms (subjective value is a convex function of utility), whereas they show conservative behavior, that is, risk-averse, when options are evaluated in benefit terms (subjective value is a concave function of utility). The S-shape value function predicts that an item will be perceived as more unpleasant from a negative valence than pleasant from a positive valence.

In his meta-analysis, Kühberger (1998) found that diverse operational, methodological and task-specific features made it impossible to speak of a single framing effect. As a consequence, his results were biased (Levin et al., 1998). To solve this problem, we have proposed a formal definition for framing effect, and we have distinguished between risky, attribute and goal framing, following Levin et al. (1998) taxonomy. We used Kühberger’s (1998) meta-analysis as a reference paper for the coding of the study characteristics, searching papers from 1997 since his data pool ended in 1996. We added 2 new variables: gender (variable which appears in literature with contradictory results) and study source. So, in this meta-analysis, our goals are: (1) To integrate risky, attribute and goal framing study results; and (2) To analyse the influence of diverse moderator variables in each type of framing.

Method

Database

To locate the relevant studies we carried out: a) Computer searches (Psycinfo, Medline, Business Source Premier, Regional Business News and Econlit) with the key terms choice, decision making, framing, prospect theory, reflection, Tversky and Kahneman; b) direct review of specialized journals and their references, and c) informal e-mail enquiry to the Society for Judgment and Decision Making.

To be included in the meta-analysis, studies needed to fulfil two criteria: (1) to deal with decision making in risky, attribute or goal framing; and (2) to be experimental articles with human adults between 1997 and 2003. Our search yielded 51 papers (151 effect sizes) that reported framing experiments with 13,343 participants.

Coding

Three higher order moderator variables were examined. Methodological Variables included: (a) participants (students, other); (b) gender (% of women in the sample); (c) experimental design (between-subjects, within-subjects); (d) unit of analysis (individual behavior, group behavior). Context Variables included: (a) year of publication; (b) study source (Psychology, Politics, Economics). Task Variables included: (a) frame type (risky, attribute, goal); (b) number of options (single risky option, multiple risky options for risky frame; single option, multiple options for attribute and goal framing); (c) framing manipulation (gain/loss terms, other terms); (d) response mode (choice, judgment); (e) domain (economic, social, health); (f) problem (Asian disease, gambling, tax, clinical reasoning, product, message, investment, evaluation of objects, social dilemma, other). For details, readers may e-mail the authors.

A reliability study for coding and d calculation was carried out, in which two other researchers codified independently a sample of the studies. The level of agreement reached was highly satisfactory. Inconsistencies were solved by consensus.

Data analysis

Calculations of effect size were based on the procedures proposed by Hedges and Olkin (1985) using Cohen’s d, defined as the standarized mean difference. We used Lipsey and Wilson’s (2001) Excel macro, which calculates d from a wide variety of inputs: means and SDs, proportions, frequencies, etc. In risky framing, the sign is positive when subjects are more risk-averse with gains and more risk-seeking with losses. In attribute framing, the sign is positive when subjects make better evaluations with positive valences. In goal framing, d is positive when different responses between frames occur, or zero if there are no differences. We used the pooled standard deviation both in between-subjects and within-subjects design.

After the description of study characteristics, a weighted mean effect was calculated for each class of frame. Next, we tested the homogeneity of the effect size and we analyzed the influence of moderator variables using a categorical model (ANOVA analogous) and weighted regression analysis (fixed-effects model) with the macros for SPSS 10.0 (Lipsey and Wilson, 2001).

Results

Description of studies

Moderator variables description is presented in Table 1. With regard to methodological variables, student samples (83.4%), between-subjects design (88.7%) and individual analyses (96.7%) dominate framing research. Most samples came from Psychology (53%) and Economics (33.8%).

The data for task variables indicate that most of the effect sizes were related to risky framing (57.6%), with similar proportions in attribute framing (19.9%) and goal framing (22.5%). Single option was prevalent (78.1%), as was gain/loss frame (94.7%). Choice response mode was used in 60.3% of cases. The most common domains were health (35.8%), economic (33.1%) and social (20.5%). As regards the problem, the Asian disease was the most common task (47.7%), ahead of evaluation of objects (16.6%) or messages (10.6%).

Finally, in relation to context variables, Psychology studies reported gender most frequently (59%), and used most women (2.3 women per man). Gender was not usually reported in Politics (68%) or Economics studies (65%), but proportion of men-women in their samples was similar. We found 51 articles, implying approximately 7 articles per year (SD= 2.14).

Average effect sizes

Overall average effect sizes are presented in Table 2. We obtained from small to moderate effect sizes, with similar values for risky and goal framing (d= 0.44), whereas attribute framing had a value of d= 0.26. Variability of the effect sizes is significant (p<.0001), and the relevant test statistic shows clear heterogeneity of the effect sizes.

Potential moderator variables

The results for risky, attribute and goal framing are presented in Table 3. In risky framing, student samples with between-subjects design were frequent (d= 0.50). Although individual analysis was prevalent, data show a possible higher effect with group analysis (k= 4; d= 0.72). Effect sizes for Psychology and Economics studies were lower than those for Politics (d= 0.71). All tasks used gain/loss-wording, preferentially with single option (d= 0.45) and choice as response mode (d= 0.45). As regards problem domains, higher effects were found for mixed domains (d= 0.62). Tasks related to products appeared to be most effective (k= 4; d= 0.89), although the Asian disease problem was the most frequent (d= 0.43).

As for quantitative variables, a regression analysis showed significant associations, both for gender -% of women- (QR(1)= 11.923, p= 0; R2= 0.191) and year of publication (QR(1)= 7.428, p= 0.006; R2= 0.015). Effect size was higher with more women in the sample, and/or with recent studies. We selected a regression model with gender, year, source, design, unit of analysis, options, response mode and problem that obtained R2= 0.290 (gender: β= 0.40, p= 0.025; options: β= -0.40, p= 0.046).

In attribute framing, student samples and between-subjects design were more common, but showed lower effect sizes (d= 0.22; d= 0.24). There was no group analysis or choice response mode in this frame type. Most of the studies came from Economics (d= 0.42), and, surprisingly Psychology studies appear to show ineffective results (d= -0.25). Multiple option (d= 0.37) was clearly more effective than single option (d= 0.19). Tasks were frequently expressed in gain/loss-wording (d= 0.25). Economic and social domains were prevalent (d= 0.34; d= 0.35), evaluation of objects being the prototypical task in this frame (d= 0.21).

Neither gender (QR(1)= 0.953; p= 0.329; R2= 0.018) nor year (QR(1)= 3.674; p= 0.055; R2= 0.020) were significant. A selected regression model of 7 variables was found (study source, number of options, participants, gender, year, framing manipulation and problem) with R2= 0.465 (gender: β= 1.09, p= 0.001; year: β= 0.91, p= 0.003; framing manipulation: β= 0.68, p= 0.049; problem: β= 0.85, p< 0.001).

Finally, none of the variables, except options number, had a significant homogeneity test (p>.05) in goal framing. In contrast to previous frames, in this case 50% used target or mixed samples, with similar results (QB(2)= 1.08, p>.05). All experimental designs were between-subjects, and nearly all performed individual analysis (d= 0.44). Psychology and Economics studies were the most common (d= 0.45). Multiple option was clearly more effective (d= 0.60). As in the case of attribute frame, gain/loss-wording (d= 0.45) and judgment response mode (d= 0.48) were prevalent. Health and social domains were the most common (k= 15; k= 12), with message (d= 0.52) and clinical reasoning (d= 0.42) the frequent tasks.

Gender (QR(1)= 0.657; p= 0.418; R2= 0.020) and year (QR(1)= 0.507; p= 0.477, R2= 0.010) were not statistically significant. A selected regression model of 8 variables (options, framing manipulation, mode, problem, study source, participants, gender and year) showed a goodness of fit of R2= 0.569 (options: β= 1.47, p< 0.001; year: β= 1.07, p= 0.014; source: β= -0.94, p= 0.010; problem: β= -0.76, p= 0.018).

Questions of validity

Taking into account the fact that our meta-analysis included only two unpublished articles, the results reported here may be biased (Rosenthal, 1979). Therefore, we calculated the number of unpublished studies we should consider in order to change our findings. The result (1 – α= 0.95) was 12,377 studies for risky framing, 413 studies for attribute framing and 1,376 studies for goal framing. All cases fulfil Ns > 5k + 10, so that we believe our meta-analysis to be safe from this validity threat (Rosenthal, 1991).

As regards within-study independence (Rosenthal and Rubin, 1986), we used more than a single effect size in several studies, when each effect size implied different subjects and different experimental conditions We therefore do not think this threat poses a real risk to the meta-analysis.

Discussion

In risky framing effect (d= 0.437), the most important characteristics were gender and number of options. Effect size was greater with samples including women and a single risky option. The most frequent task was the Asian disease problem. Researchers most frequently used student samples, with individual data between-subjects design, and tasks in gain/loss terms with choice response mode. All of these characteristics showed large effect sizes (except for individual vs. group analysis).

The regression model only obtained R2= 0.290, so that it is necessary to investigate new possible moderator variables in order to explain this complex phenomenon. We think uncertainty level of options may be one of these. The different semantic combinations discussed in Levin et al. (1998) may also be important. Given the importance of gender in this frame type, we believe that part of the variance may be explained by other subjects variables, such as neuroticism or self-esteem (more neuroticism or less self-esteem could imply more risk aversion).

The attribute framing effect had the smallest size (d= 0.260), and the prototypical task was evaluation of objects. Here, gender, year and problem explained most of the variance. The data show a surprising finding: except for response mode (all research carried out in this frame was with judgment response mode), researchers preferred the same characteristics as risky framing, but all of them showed lower effect sizes (student samples, between-subjects design, individual unit of analysis, single option and gain/loss terms). It is empirically clear that attribute framing is a different type of framing effect, and should be studied with different methodological options. Most probably, future research will obtain higher d values when analyzing attribute frame with multiple options tasks in target samples.

The goal framing effect size is d= 0.444. Message and clinical reasoning were the most common tasks, while number of options was the most important variable. The data show another surprising finding: the test of homogeneity did not find significant inter-characteristics differences for other variables. This does not, of course, mean that the variables chosen are not important. In fact, the regression model with 8 variables (options, framing manipulation, response mode, problem, study source, participants, gender and year) showed a medium goodness of fit (R2= 0.569).

In goal framing effect, single vs. multiple option was the most important. Why was this? Our view is that the information processing for multiple options produces higher cognitive overload than the information processing for single options. In order to reduce cognitive overload, subjects simplify the decision process using heuristics (Kahneman, Slovic and Tversky, 1988; Gambara, 1990), and this explains a higher persuasive impact of message.

Behind the apparent conceptual similarities, data from risky, attribute and goal framing offer completely different results. The taxonomy has proved to be useful for examining the literature on the framing effect. There is now a need for more theoretical and empirical papers to explain the heterogeneity found and the different processes underlying the three framing types.

Finally, we believe there is a need to explore the framing effect using within-subjects design, not only since it is uncommon in the literature, but also because of its usefulness for analyzing whether a subject is «incoherent» (valence frame manipulation elicits different responses) or not. Differences between «coherent» and «incoherent» subjects could prove fundamental to a better explanation of the framing effect.

Acknowledgments

We acknowledge the collaboration of Jesus Garrido and Graciela Ponte in the coding reliability study, Dr. Botella and an anonymous reviewer for the comments on an earlier version of this paper.

References preceded by an asterisk were included in the meta-analysis.

*Bless, H., Betsch, T. and Franzen, A. (1998). Framing the framing effect: the impact of context cues on solutions to the ‘Asian disease’ problem. European Journal of Social Psychology, 28, 287-291.

*Braun, K.A., Gaeth, G.J. and Levin, I.P. (1997). Framing effects with differential impact: the role of attribute salience. Advances in Consumer Research, 24, 405-411.

*Chang, C.J., Sin-Hui, Y. and Rong-Ruey, D. (2002). An empirical examination of competing theories to explain the framing effect in accounting-related decisions. Behavioral Research in Accounting, 14, 35-64.

*Copeland, P.V. and Cuccia, A.D. (2002). Multiple determinants of framing referents in tax reporting and compliance. Organizational Behavior and Human Decision Processes, 88, 499-526.

*Dijk, E. and Wilke, H. (1997). Is it mine or is it ours? Framing property rights and decision making in social dilemmas. Organizational Behavior and Human Decision Processes, 71(2), 195-209.

*Donovan, R.J. and Jalleh, G. (1999). Positively vs. negatively framed product attributes: the influence of involvement. Psychology and Marketing, 17, 613-630.

*Druckman, J.N. (2001a). On the limits of framing effects: who can frame? The Journal of Politics, 63(4), 1.041-1.066.

*Druckman, J.N. (2001b). Evaluating framing effects. Journal of Economic Psychology, 22, 91-101.

*Druckman, J.N. (2001c). Using credible advice to overcome framing effects. The Journal of Law, Economics and Organization, 17, N.º 1, 62-82.

*Fagley, N.S. and Miller, P.M. (1997). Framing effects and arenas of choice. Your money or your life? Organizational Behavior and Human Decision Processes, 71, 355-373.

Gambara, H. (1990) El exceso de confianza en la toma de decisiones: un análisis del paradigma de la calibración. Madrid Autonomous University. Doctoral thesis.

*Gurm, H.S. and Litaker, D.G. (2000). Framing procedural risks to patients: is 99% safe the same as a risk of 1 in 100? Academic Medicine, 75(8), 840-842.

*Hasseldine, J. and Hite, P.A. (2003). Framing, gender and tax compliance. Journal of Economic Psychology, 24, 517-533.

Hedges, L.V. and Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.

*Hodgkinson, G.P., Bown, N.J., Maule, A.J., Glaister, K.W. and Pearman, A.D. (1999). Breaking the frame : an analysis of strategic cognition and decision making under uncertainty. Strategic Management Journal, 20, 977-985.

*Holladay, C.L., Knight, J.L., Paige, D.L. and Quiñones, M.A. (2003). The influence of framing on attitudes toward diversity training. Human Resource Development Quarterly, 14(3), 245-264.

*Janiszewski, C., Silk, T. and Cooke, A.D.J. (2003). Different scales from different frames: the role of subjective scales and experience in explaining attribute-framing effects. Journal of Consumer Research, 30, 311-325.

Kahneman, D., Slovic, P. and Tversky, A. (Eds.) (1988). Judgment under uncertainty: heuristics and biases. Cambridge: Cambridge University Press.

*Keren. G. and Gerritsen. L.E.M. (1999). On the robustness and possible accounts of ambiguity aversion. Acta Psychologica, 103, 149-172.

*Knippenberg, D and Knippenberg, B. (2000). Who takes the lead in risky decision making? Effects of group members’ risk preferences and prototypicality. Organizational Behavior and Human Decision Processes, 83(2), 213-234.

*Krishnamurthy, P., Carter, P. and Blair, E. (2001). Attribute framing and goal framing effects in heath decisions. Organizational Behavior and Human Decision Processes, 85(2), 382-399.

Kühberger, A. (1998). The influence of framing on risky decisions: a meta-analysis. Organizational Behavior and Human decision Processes, 75(1), 23-55.

*Kühberger, A., Schulte-Mecklenbeck, M. and Perner, J. (1999). The effects of framing, reflection, probability, and payoff on risk preference in choice tasks. Organizational Behavior and Human Decision Processes, 78(3), 204-231.

*Kühberger, A., Schulte-Mecklenbeck, M. and Perner, J. (2002). Framing decisions: hypothetical and real. Organizational Behavior and Human Decision Processes, 89, 1.162-1.175.

*Kuhn, K.M. (1997). Communicating uncertainty: framing effects on responses to vague probabilities. Organizational Behavior and Human Decision Processes, 71(1), 55-83.

*LeBouef, R.A. and Shafir, E. (2003). Deep thoughts and shallow frames: on the susceptibility to framing effects. Journal of Behavioral Decision Making, 16, 77-92.

*Lenton, A.P. (2003). Running head: social influences on risky decision making. Non published article.

León, O. and Botella, J. (2003). Daniel Kahneman. Un psicólogo premio Nobel 2002. Psicothema, 15(3), 341-344.

Levin, I.P. and Gaeth, G.J. (1988). Framing of attribute information before and after consuming the product. Journal of Consumer Research, 15, 374-378.

*Levin, I.P; Gaeth, G.J., Schreiber, J. and Lauriola, M. (2002). A new look at framing effects: distribution of effect sizes, individual differences and independence of types of effects. Organizational Behavior and Human Decision Processes, 88(1), 411-429.

Levin, I.P., Schneider, S.L. and Gaeth, G.J. (1998). All frames are not created equal: a typology and critical analysis of framing effects. Organizational Behavior and Human Decision Processes, 76(2), 149-188.

*Li, S. (1998). Can the conditions governing the framing effect be determined? Journal of Economic Psychology, 19, 133-153.

Lipsey, M. and Wilson, D. (2001). Practical meta-analysis. USA: Sage Publications.

*Mandel, D.R. (2001). Gain-loss framing and choice: separating outcome formulations from descriptor formulations. Organizational Behavior and Human Decision Processes, 85(1), 56-76.

*Mayhorn, C.B., Fisk, A.D. and Whittle, J.D. (2002). Decisions, decisions: analysis of age, cohort, and time of testing on framing of risky decision options. Human Factors, 44, N.º 4, 515-521.

*McElroy, T. and Seta, J.J. (2003). Framing effects: an analytic-holistic perspective. Non published article.

Mellers, B.A., Schwartz, A. and Cooke, D.J. (1998). Judgment and decision making. Annual Review of Psychology, 49, 447-77.

*Mittal, V. and Ross, W.T. (1998). The impact of positive and negative affect and issue framing on issue interpretation and risk taking. Organizational Behavior and Human Decision Processes, 76(3), 298-324.

*Mueller, J.M. and Anderson, J.C. (2002). Decision Aids for generating analytical review alternatives: the impact of goal framing and audit-risk level. Behavioral Research in Accounting, 14, 157-177.

*Nygren, T.E. (1998). Reacting to perceived high- and low-risk win-lose opportunities in a risky decision making task: is it framing or affect or both? Motivation and Emotion, 22, N.º 1, 73-98.

*Park, E.-S. (2000). Warm-glow versus cold-prickle: a further experimental study of framing effects on free- riding. Journal of Economic Behavior & Organization, 43, 405-421.

*Perrin, B.M., Barnett, B.J., Walrath, L. and Grossman, J.D. (2001). Information order and outcome framing: an assessment of judgement bias in a naturalistic decision making context. Human Factors, 43, N.º 2, 227-238.

Rosenthal, R. (1979). The «file drawer problem» and the tolerance for null results. Psychological Bulletin, 86, 638-641.

Rosenthal, R. (1991). Meta-analytic procedures for social research. Newbury Park. C.A.: Sage.

Rosenthal, R. and Rubin, R.D. (1986). Meta-analytic procedures for combinig studies with multiple sizes. Psychological Bulletin, 3, 400-406.

*Shiloh, S., Jaffe, N., Ben-Neria, Z. and Sagi, M. (2001). Framing of prenatal screening test results and women’s health-illness orientations as determinants of perceptions of fetal health and approval of amniocentesis. Psychology and Health, 16, 313-325.

*Shiloh, S., Salton, E. and Sharabi, D. (2002). Individual differences in rational and intuitive thinking styles as predictors of heuristic responses and framing effects. Personality and Individual Differences, 32, 415-429.

*Shiomura, K. and Atsumi, A. (2001). Induced mood states and the framing effect: a comparison of systematic and heuristic processing. Perceptual and Motors Skills, 93, 609-610.

*Shiv, B., Edell, J.A. and Payne, J.W. (1997). Factors affecting the impact of negatively and positively ad messages. Journal of Consumer Research, 24, 285-295.

*Sieck, W. and Yates, F. (1997). Exposition effects on decision making: choice and confidence in choice. Organizational Behavior and Human Decision Processes, 70(3), 207-219.

*Slattery, J.P. and Ganster, D.C. (2001). Determinants of risk taking in a dynamic uncertain context. Journal of Management, 28(1), 89-106.

*Smith, G.E. and Berger, P.D. (1998). Different message-framing for different direct response marketing goals: choice versus attitude formation. Journal of Interactive Marketing, 12(2), 33-48.

*Smithson, M. (1999). Conflict aversion: preference for ambiguity versus conflict in sources and evidence. Organizational Behavior and Human Decision Processes, 79(3), 179-198.

*Stanovich, K.E. and West, R.F. (1998). Individual differences in framing and conjunction effects. Thinking and Reasoning, 4(4), 289-317.

*Stoddard, J.E. and Fern, E.F. (2002). Buying group choice: the effect or individual group member’s prior decision frame. Psychology and Marketing, 19(1), 59-90.

*Stuart, A.E. and Blanton, H. (2003). The effects of message framing on behavioral prevalence assumptions. European Journal of Social Psychology, 33, 93-102.

Tversky, A. and Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science, 211, 453-458.

*Weber, E.U. and Milliman, R.A. (1997). Perceived risk attitudes: relating risk perception to risky choice. Management Science, 43, N.º 2, 123-144.

*Weber, M., Keppe, H.J. and Meyer-Delius, G. (2000). The impact of endowment framing on market prices: an experimental analysis. Journal of Economic Behavior & Organization, 41, 159-176.

*Welkenhuysen, M., Evers-Kiebooms, G. and Ydewalle, G. (2001). The language of uncertainty in genetic risk communication: framing and verbal versus numerical information. Patient Education and Counseling, 43, 179-187.

*Wright, G. and Goodwin, P. (2002). Eliminating a framing bias by using simple instructions to ‘think harder’ and respondents with managerial experience: comment on ‘breaking the frame’. Strategic Management Journal, 23, 1.059-1.067.

*Yamagishi, K. (2002). Effects of valence and framing in decision making: assessing decisions-makers’ perceived domains of choice. Japanese Psychological Research, 44, N.º 4, 204-227.

*Zhang, Y. and Buda, R. (1999). Moderating effects of need for cognition on responses to positively versus negatively framing advertising messages. Journal of Advertising, vol. XXVIII, N.º 2, 1-15.

*Zickar, M.J. and Highhouse, S. (1998). Looking closer at the effects of framing on risky choice: an item response theory analysis. Organizational Behavior and Human Decision Processes, 75(1), 75-91.

Impact Factor JCR SSCI Clarivate 2023 = 3.2 (Q1) / CiteScore SCOPUS 2023 = 6.5 (Q1)