ABSTRACT
This study develops a short, general scale to measure sustainable product involvement. This is done in a Costa Rican context, via a relatively large sample, demographically similar to the national population. The study also evaluates the viability of the C-OAR-SE scaling technique for this purpose. A five-item instrument is developed, its reliability and validity psychometrically confirmed. The scale addresses the levels and types of involvement that consumers might have. It suits not only academic researchers, but also practitioners in different areas. We conclude that C-OAR-SE is a viable technique. It complements traditional psychometric methods well, to be considered by researchers in the different fields of business.
KEY WORDS
SCALE, CONSUMER, INVOLVEMENT, SUSTAINABLE, PRODUCTS, COSTA RICA.
RESUMEN
Este estudio desarrolla una escala corta y general para medir el involucramiento con productos ecológicos. Se realiza en un contexto costarricense, mediante una muestra relativamente amplia y demográficamente similar a la población nacional. El estudio también evalúa la viabilidad de la técnica escalar C-OAR-SE para este fin. Una medida de cinco ítems es desarrollada, su fiabilidad y validez psicométricamente confirmadas. La escala mide los niveles y tipos de involucramiento que puedan tener los consumidores. No sólo le sirve a investigadores académicos, sino que también a profesionales en diferentes áreas. Concluimos que C-OAR-SE es una técnica viable. Complementa bien los métodos psicométricos tradicionales, a ser considerada por investigadores en los diferentes campos de la administratición.
PALABRAS CLAVE
ESCALA, INVOLUCRAMIENTO, CONSUMIDOR, PRODUCTOS, ECOLÓGICOS, COSTA RICA.
RÉSUMÉ
Cette étude développe une petite échelle générale pour mesurer l’implication dans des produits écologiques. Elle est réalisée dans un contexte costaricien, sur base d’un échantillon relativement large et démographiquement similaire à la population nationale. L’étude évalue également la viabilité de la technique d’échelle C-OAR-SE à cette fin. Une mesure de cinq éléments est développée, et sa fiabilité et validité confirmées de manière psychométrique. L’échelle mesure les niveaux et les types d’implication possibles des consommateurs. C’est utile non seulement pour les chercheurs académiques mais aussi pour les professionnels dans différents domaines. Nous concluons que C-OAR-SE est une technique viable. Elle complémente bien les techniques psychométriques traditionnelles et peut être prise en considération par les chercheurs dans les différents domaines de l’administration.
MOTS CLES
ÉCHELLE, IMPLICATION, CONSOMMATEUR, ECOLOGIQUE, PRODUITS, COSTA RICA.
RESUMO
Este estudo desenvolve uma escala curta e geral para medir o envolvimento com produtos ecológicos. É realizado em um contexto costarriquenho, por meio de uma amostra relativamente ampla e demograficamente semelhante à população nacional. O estudo também avalia a viabilidade da técnica escalar C-OAR-SE para esse fim. Uma medida de cinco itens é desenvolvida, sua fiabilidade e validade confirmadas psicometricamente. A escala mede os níveis e tipos de envolvimento que os consumidores possam ter. Não é útil apenas para pesquisadores acadêmicos, mas também para profissionais de diferentes áreas. Concluímos que C-OAR-SE é uma técnica viável. Complementa bem as técnicas psicométricas tradicionais a ser considerada pelos pesquisadores nas diferentes áreas da administração.
PALABRAS CHAVE
ESCALA, ENVOLVIMENTO, CONSUMIDOR, ECOLÓGICO, PRODUTOS, COSTA RICA.
INTRODUCCIÓN
As consumers worldwide become more ecologically minded, it becomes vital to understand their behavior with respect to sustainable products (Dahlstrom & Crosno, 2018). A key aspect of this behavior is product involvement. The latter generally refers to the interest that consumers place upon certain goods, services, or categories thereof (Solomon, 2020). This interest then affects their behavior. It impacts how consumers search for, perceive, and process information; and which products they consider, prefer, and purchase (Michaelidou & Dibb, 2008).
However, and despite its importance, research into sustainable product involvement remains sparse. Notably absent are instruments specifically developed to measure involvement towards this category.
One might think that the scales measuring personal sustainability would serve this purpose. An example might be the widely-used New Ecological Paradigm scale, see e.g. Dunlap (2008). Yet sustainability scales present a significant limitation. They tend to focus on individuals’ sustainability knowledge and attitudes. While they do address the antecedents of sustainable consumption, sustainability scales ignore the resultant behaviors. The latter are arguably more accurate involvement indicators given the attitude-behavior gap so oft encountered within sustainability research: Whereas a great majority of consumers claims grave concern for the environment, few actually follow through with concrete action, e.g. (Carrington, Neville, & Whitwell, 2010; Peattie, 2010). Personal sustainability scales are thus inadequate to gauge sustainable product involvement.
One might also think that extant involvement scales apply to the sustainable product category. An example might be Zaichkowsky’s (1985) seminal Product Involvement Inventory. However, these scales tend to be rather general. They do not consider the peculiarities of specific categories. This issue was experienced by e.g. Alvarez-Milán (2018) while trying to measure involvement towards social causes. Moreover, these scales tend to conceive involvement in terms of personal importance. This focus makes them attitudinal measures, susceptible to the aforementioned attitude-behavior gap. Extant involvement instruments are thus also suboptimal to gauge sustainable products.
Without denying its cognitive-affective origins, this study uses broad behaviors to operationalize involvement towards sustainable products. A valid and reliable involvement scale is developed, its robustness psychometrically confirmed. The scale is purposely general. Before specific involvement aspects are evaluated, the overall inclination towards sustainable products must be ascertained. The scale is also intentionally short. Its scant five items make it quick and easy to administer. This allows incorporating the scale into studies where other involvement measures might not be viable due to their length.
Two characteristics distinguish the scale offered. First, that its development follows Rossiter’s (2002, 2011, 2016) C-OAR-SE technique. The latter is rationalist instead of empirical. It seeks to maximize content validity, not reliability. Doing so ensures that items represent the construct adequately and efficiently. Initially developed for Marketing research, C-OAR-SE has started to be applied across the social sciences. Within sustainability research, it has been used by e.g. De Carvalho and colleagues (2015, 2016). However, the approach fundamentally breaks with how measures are conventionally developed, via psychometric techniques, e.g. Churchill (1979). C-OAR-SE remains controversial, which is why it needs empirical testing - as here done.
Second, that the scale was developed in an unusual setting, Costa Rica, via a relatively large sample, demographically similar to the national population. Sustainability research stems mainly from the US and Europe. While useful, its insights do not necessarily reflect other locales. Moreover, as developing countries grow in global economic importance, it becomes necessary to understand how their consumers are evolving (Bangsa & Schlegelmilch, 2020). Costa Rica is ideal for this. Having one of Latin America’s highest human development levels (UNDP, 2020), the country indicates where the region’s consumption might be headed towards. Costa Rica is also widely recognized for its conservation efforts (HAC, 2021; UNEP, 2019), making this research setting topically relevant.
The authors hope that the scale developed adds to consumer behavior research. This, not only for academic purposes. Understanding the penchant for sustainable products will also help the public and private sectors improve their respective efforts. Beyond the scale’s practical value, the authors also hope to make a methodological contribution. It is important that students, professionals, and researchers gain awareness, and ideally discuss the different scale development options available, beyond conventional psychometric methods. Doing so is essential so that research in the different business administration fields advances towards new directions.
CONCEPTUAL BACKGROUND
Product involvement derives from the psychological notion of ego-involvement. The latter emerged in the early 20th-Century and referred to the interest that an individual might develop towards a given object. Said object may come to play an important role in the person’s life. In extreme cases, it becomes an essential part of the individual’s identity, see e.g. Allport (1943) or Sherif and Cantril (1947). Ego-involvement was initially a conceptual notion. It then started to be used experimentally. Its application came to relate involvement to various other constructs, contributing to psychology’s theoretical corpus (Iverson & Reuder, 1956).
Post-war marketing was characterized by a socio-psychological interest (Conejo & Wooliscroft, 2015). This drew the ego-involvement notion into marketing, albeit directed towards products. Pioneering its application was Krugman (1965), who suggested tailoring product messages to audience involvement levels. Doing so enhanced message effectiveness. Involvement research continued, gained momentum in the mid-1980s, and grew thereafter. This generated a diverse body of literature, which related involvement various marketing aspects. Today, the involvement notion is a staple in consumer behavior textbooks, e.g., Schiffman and Wisenblit (2019), even mentioned in basic marketing texts, e.g., Kotler and Armstrong (2016).
In marketing, product involvement generally refers to the interest that an individual has in a given product or category (Solomon, 2020). This prominence derives from factors that are personal, like interests or values; or situational, such as occasions or needs. The interest might also be the product of external stimuli like peer pressure, reference/membership groups, or marketing communications. Regardless of origin, a higher involvement results in complex purchase behaviors. These comprise more information gathering and processing, as well as more complex and extensive purchase processes. Involvement thereby becomes an important segmentation variable for marketers (Michaelidou & Dibb, 2008).
However, involvement is not a dichotomous variable. It instead spans an intensity continuum, consumers to different degrees involved with a product. At one end of the spectrum, individuals show little interest in the product. Their behavior toward it is habitual and lacking effort. At the other end of the spectrum, consumers are passionate about the product. This penchant activates an intense motivational state, which then drives behavior concerning the product (Solomon, 2020). In the particular case of sustainable products, Atkinson and Rosenthal (2014) found involvement to moderate product perceptions, trust, and purchase intentions.
High involvement products tend to be more expensive and durable. Also, products that allow consumers to express their identity or which are prone to social evaluation. The heightened involvement derives from the personal or social risk tied to making the wrong choice (Solomon, 2020). However, Antil (1984) clarifies that products are not involving per se. Their involvement instead derives from the personal or social meanings that individuals give products. This semiotic attribution is consistent with more current consumption paradigms: Products are consumed not only for what they are or do, but increasingly, for what they mean (Conejo & Wooliscroft, 2015).
Noteworthy is the distinction between temporal and enduring involvement. Temporal involvement refers to a heightened, albeit short-lived, interest. It occurs when individuals focus more on the surrounding consumption context than on the product itself. An example would be when someone looks for a product to gift or address an emergency. Though once the situation is resolved, involvement levels diminish. Conversely, enduring involvement refers to a heightened interest over an extended time. It occurs when individuals focus more on the product than on the surrounding consumption context. This type of involvement is more stable, irrespective of situation Richins & Bloch (1986). The present study adopts an enduring involvement notion towards sustainable products.
Product Involvement Measures
Involvement has been assessed in various ways over the years. Early approaches include ranking products based on importance, e.g., Sheth and Venkatesan (1968), or rating their relative importance, e.g., Hupfer and Gardner (1971). Involvement then became measured via rated statements. However, many of these statements were either single items or multiple ad-hoc ones. Their reliability and validity were either unreported or low in the best of cases.
Given this situation, Zaichkowsky (1985) developed the seminal Product Involvement Inventory (PII). This unidimensional measure comprises 20 bipolar items, all psychometrically robust. Until then, involvement research had progressed somewhat haphazardly. But the PII formalized this field, applied in numerous studies since its publication.
Other involvement measures have since been developed. These are often multidimensional. However, Mittal’s (1995) or Michaelidou and Dibb’s (2008) reviews highlight these instruments’ lack of consensus. Their number of dimensions differs. The nature of dimensions also varies. Given this disagreement, and instruments’ marginal impact, the PII may still be considered the measurement standard within the field. Its use continues to this day. According to Google Scholar (2021), the article presenting this instrument has accrued about 8,900 citations, almost 200 of these in 2021 alone. In the particular case of sustainable products, the scale was used by e.g. Rahman (2018).
However, and despite its widespread use, the PII presents limitations. On the one hand, it conceives involvement in terms of personal importance. Being an attitudinal measure, similar to the sustainability scales mentioned earlier, it becomes susceptible to the attitude-behavior gap. This makes the PII suboptimal to assess sustainable products.
On the other hand, the PII is highly redundant. It evaluates the importance of a product via a series of near-synonyms like important, of interest, relevant, fundamental, matters to me, or means a lot to me, among others. This redundancy results in an unnecessarily long instrument. Zaichkowsky (1994) streamlined the PII from 20 to 10 items. However, and despite this reduction, the instrument remained redundant. Subsequent studies thus use even more condensed PII versions. E.g., Russell-Bennett, McColl-Kennedy, and Coote (2007), Kim, Jeon, and Hyun (2012), and Rahman (2018) use just four of its items to measure involvement.
These limitations indicate the need for new involvement scales: Ones explicitly developed for the sustainable product category; ones that are not attitudinal but behaviorally-based; and ones short enough to be conveniently applied. Hence the present scale development effort.
METHODOLOGY
Traditional scale development is empirical-statistical. It begins by generating an initial item set. After collecting data from large samples that reflect the population of interest, items are statistically reduced to those most reliable. This is done via techniques like factor analysis. The remaining items are finally verified/optimized through different validation procedures (De Vellis, 2012).
The present study breaks with psychometric tradition. It uses Rossiter’s (2002, 2011, 2016) C-OAR-SE scaling procedure. The latter is rationalist instead of empirical. But what makes this technique particularly controversial is that initial items are reduced before collecting data. The reduction is furthermore done via experts, not consumer samples. Finally, the reduction strives to maximize content validity, not item reliability (Rossiter, 2002).
C-OAR-SE follows six steps: 1) Construct Definition, 2) Object Classification, 3) Attribute Classification, 4) Rater Identification, 5) Scale Formation, and 6) Enumeration and Reporting. Following, each of these steps, applied towards developing a short and general sustainable product involvement scale.
1) Construct Definition
C-OAR-SE requires that the construct’s focal object, attribute, and raters be precisely defined. Conceiving constructs in general terms, frequent within psychometric scaling, not only leads to divergent interpretations. It also muddles operationalization, reducing scale validity (Rossiter, 2002). A precise definition is particularly important in the case of involvement. The construct has been approached from a variety of perspectives. This has resulted in various definitions, some even conflicting (Michaelidou & Dibb, 2008).
In C-OAR-SE, a group of experts specifies the construct’s object, attribute, and raters (Rossiter, 2002). Two focus groups/workshops were thus conducted. Each lasted 90 minutes and comprised six Costa Rican social science academics. The participation of academics, not practitioners or consumers, allowed discussions to address the more theoretical/abstract definitional aspects. Participants were recruited via convenience/snowball sampling: Invited academics were asked about other colleagues that might participate. This was done until having enough participants for both focus groups. The latter followed generally accepted guidelines, e.g. those of Stewart and Shamdasani (2015).
Two weeks before sessions, participants received Rossiter’s (2002) C-OAR-SE paper to acquaint themselves with the technique. Sessions were conducted via Zoom, one each weekend, to reduce inconvenience. Sessions began with brief overviews of the present project, the C-OAR-SE technique, and the product involvement construct. Participants then used Rossiter’s (2002, p. 321) evaluation form to individually specify the construct’s object, attributes, and raters. Participants later discussed and reconciled their specifications until reaching certain informational saturation, reflected by a relative consensus.
2) Object Classification
C-OAR-SE requires to specify and classify the definitional object. Doing so determines the type of items subsequently developed. There are three types of objects: Concrete-singular ones are unique or highly homogenous. Abstract-collective objects are heterogeneous but still group into an overarching category. Abstract-formed objects are also heterogeneous but do not group into an overarching category (Rossiter, 2002).
Focus group participants agreed that the definitional object was sustainable products. They mostly classified this object (92% agreement) as abstract-collective: While sustainable products were diverse, they still grouped into a broad overarching category characterized by environmental preservation. Participants added that this broad classification also prevented the scale from being excessively specific. It thereby captured the different notions that respondents might have of this product category. This observation is consistent with Witkowski (2010), who notes that research sometimes neglects the individual meanings that ordinary people give to their consumption. It is also compatible with Dolan (2002), who indicates that sustainable consumption also comprises a socio-cultural context.
3) Attribute Classification
C-OAR-SE requires to specify and classify the object attribute. Doing so further determines the types of items subsequently developed. Attributes come in three types: Concrete ones refer to a single, evident characteristic. Formed attributes refer to an abstract and multifaceted characteristic. Together, their different aspects conform the overarching characteristic. Eliciting attributes also refer to an abstract characteristic. But the latter is manifested by the mental and physical consequences it generates (Rossiter, 2002).
Participants agreed that the definitional attribute referred to involvement. However, they did not agree as to whether it was formed or eliciting. Upon discussion, and without denying involvement’s multifaceted nature, participants preferred to classify it (75% agreement) as eliciting. They considered involvement as an internal disposition. Specifically, as the prevalence of sustainable products in people’s lives, manifested cognitively, emotionally, and physically.
4) Rater Identification
C-OAR-SE requires that those who rate the object attribute be specified. Doing so is necessary as evaluations vary according to whose perspective they capture. There are three types of raters: Individuals are used when the attribute is an internal personal difference. Groups comprise homogenous individuals, say managers. They evaluate external attributes based on their perceptions. Experts comprise more homogenous and qualified individuals. They also assess external attributes, but based on technical criteria (Rossiter, 2002).
Participants indicated (83% agreement) that raters ought to be individuals. They justified this by noting that raters would be disclosing their personal propensity towards sustainable products.
Based on focus group results, the present study defines sustainable product involvement as the prevalence (attribute) of sustainable products (object) within individuals’ (raters) everyday life (enduring notion), as manifested by mental or physical behaviors (operationalization).
5) Scale Formation
Scale items should reflect the object and attribute types defined. Focus groups classified the object as abstract-collective. Only one item part therefore needed to represent the sustainable product category. However, focus groups categorized the attribute as eliciting. Multiple items thus needed to capture the construct’s different manifestations (Rossiter, 2002).
Focus groups acknowledged that involvement elicited cognitive, emotional, and behavioral responses. However, participants also noted that to develop a short, general scale, involvement’s multifaceted nature needed to be ignored. The construct would be better operationalized through behavioral items only. Doing so would make the resulting instrument less abstract, and thereby, easier to apply, understand, and interpret. Such an operationalization is consistent with researchers for decades using behaviors as involvement indicators (Zaichkowsky, 1985). It is also compatible with eliciting attributes best operationalized via physical and mental activities (Rossiter, 2002). Given the above, involvement-related behaviors were compiled from the literature. The search resulted, after eliminating redundancies, in 19 preliminary items. These were reduced to those most relevant as follows.
Items sourced from the literature were often formatted as personal behaviors. However, sustainable products are socially-desirable. Their consumption, especially when public, generates approval (Atkinson & Rosenthal, 2014; Naderi & Strutton, 2015). Asking respondents about their sustainable behaviors would have thus likely compromised the data.
To lessen this possibility, items were reformatted per Schwartz, Melech, Lehmann, Burgess, Harris, and Owens (2001): Instead of asking respondents about their sustainable behaviors (e.g., I currently buy many sustainable products), items asked respondents how similar they were to a hypothetical person engaged in those behaviors (The person currently buys many sustainable products: Nothing similar to me - Totally similar to me.) Formatting items in terms of others’ behavior reduced social desirability. Yet it still allowed to infer respondents’ sustainable product involvement levels.
C-OAR-SE centers on content validity to select scale items. A panel of expert judges determines the latter (Rossiter, 2002). This study used Lawshe’s (1975) well-known content validity measures to assess how well items reflected sustainable product involvement. In them, the degree to which expert ratings coincide reflects items’ content validity. If ratings strongly agree, there is little basis to refute the consensus. The use of experts also prevents higher authorities from challenging results. (It is acknowledged that this process remains somewhat subjective. Expert ratings are still the product of human judgment, which remains fallible.)
The type of experts used to rate items depends on the construct operationalization. Abstract items require a greater inferential leap as to how well they reflect the construct. Experts with deep/broad knowledge, say academics, become necessary. Concrete items require a lesser inferential leap. Sound judgments may be obtained from professionals familiar with the construct (Lawshe, 1975). Since involvement was operationalized through behaviors, and these are fairly concrete, a panel of 36 Costa Rican marketing professionals was used to evaluate potential items. Like with focus groups, these professionals were recruited via convenience/snowball sampling.
Nevertheless, panelists were still prequalified. They first needed to be experienced, having worked in marketing for at least ten years. They secondly had to be familiar with the involvement construct, having applied it on the job. Unlike the academics that participated in the focus groups, the use of experienced professionals in this phase allowed to capture a more practical involvement notion, geared towards developing a short, general, and easily applicable scale.
Each panelist received an evaluation form. The latter asked how well the 19 proposed behaviors reflected sustainable product involvement. Raters then indicated whether behaviors were a) essential, b) useful, but not essential, or c) unnecessary. The evaluation form also allowed to add any behaviors not mentioned. None were added, suggesting comprehensiveness.
The Content Validity Ratio (CVR) of each item was calculated. This ratio derives from the number of essential attributions vis-à-vis total attributions. (CVR = (ne-N/2)/N/2, where ne is the number of panelists considering the item essential, and N is the total number of panelists.) CVR values range from -1 to +1. Content validity emerges with positive values, when over half the panelists consider an item essential. Validity increases as more panelists deem an item essential.
The level of agreement between raters determined whether items were rejected or retained. Hardesty and Bearden (2004) indicate that most studies deem a 75% agreement as the minimum for item retention. Since this study intended to develop a short scale, the minimum agreement was increased to 90%. Items with CVRs thereunder were excluded from the scale. Table 1, below, shows the results of this validation procedure.
Behavior | CVR | Essential | Useful | Unnecessary |
---|---|---|---|---|
The person… | ||||
1…currently buys many sustainable products* | 1.000 | 36 | 0 | 0 |
2…frequently recommends buying sust. prods to friends & family | 0.944 | 35 | 1 | 0 |
3…talks a lot about sustainable products with friends & family | 0.889 | 34 | 2 | 0 |
4…plans to buy many sustainable products in the future | 0.889 | 34 | 2 | 0 |
5…thinks about how sustainable products help the environment | 0.889 | 34 | 1 | 1 |
Content Validity Index | 0.922 | |||
6…pays higher prices for products that are sustainable | 0.833 | 33 | 2 | 1 |
7…travels longer distances to get products that are sustainable | 0.778 | 32 | 3 | 1 |
8…spends more time searching for products that are sustainable | 0.778 | 32 | 2 | 2 |
9…searches for information on products that are sustainable | 0.778 | 32 | 3 | 1 |
10…closely analyzes sustainable product features | 0.667 | 30 | 3 | 3 |
11…considers the ingredients/components of sustainable prods. | 0.611 | 29 | 4 | 3 |
12…pays attention to sustainable product ads/marketing materials | 0.611 | 29 | 3 | 4 |
13…shares his/her knowledge of sustainable products w. others | 0.500 | 27 | 4 | 5 |
14…is loyal to a single sustainable product brand | 0.333 | 24 | 5 | 7 |
15…distinguishes between different sustainable product brands | 0.222 | 22 | 7 | 7 |
16…considers the national/regional origin of sustainable prods. | 0.167 | 21 | 7 | 8 |
17…prefers certain sustainable product brands over others | 0.167 | 21 | 6 | 9 |
18…pays attention to the manufacturing processes of sust. prods. | 0.056 | 19 | 5 | 12 |
19…takes advantage of sustainable product discounts | -0.167 | 15 | 4 | 17 |
*In Costa Rica, as elsewhere, sustainable products are known as ecological/green products.
Five items qualified for the involvement scale. This number might seem insufficient to measure the construct adequately. However, Rossiter (2002) notes how psychometric canons have accustomed researchers to unnecessarily long instruments. They generally consider that more items necessarily increase reliability and validity. Yet this not always occurs. Sometimes, a higher number of items actually decreases scale validity. Several researchers thus recommend using concise instruments: Among others, Peterson’s (1994) meta-analysis shows how Alphas do not systematically increase after three scale items. Burisch (1997) shows how just four items suffice to measure constructs effectively. Rossiter (2002) indicates that five items are generally enough to measure eliciting attributes, as here the case.
Moreover, in Lawshe’s (1975) framework the number of items retained is irrelevant. The goal is to identify items with the highest content validity to thereby maximize scale validity. For academic purposes, the number of items might be higher. This allows to represent the theoretical domain in more detail. But for practical purposes, fewer items suffice. With this in mind, and the goal of developing a short, general scale, the five items retained were deemed sufficient.
The five items’ Content Validity Index (CVI) was calculated. The latter refers to the extent to which items in aggregate, i.e. the scale, represent the construct (Lawshe, 1975). This was done by averaging the CVR values of the items retained. The five items’ CVI averaged 0.922, indicating strong validity. Lawshe offers critical values for CVRs. For 35 raters, similar to the present case, a CVR of .310 has a 5% probability of being the product of chance. The CVRs of the retained items are all ≥ .900. It is thus improbable that the scale obtained is the product of chance, supporting results.
Data Collection
A survey was conducted to assess the scale further. The five involvement items were mixed with 20 personal value items from Sandy, Gosling, Schwartz, and Koelkebeck (2017). Doing so masked the survey’s intent. A third of the items were presented in negative form. Doing so reduced the acquiescence bias and helped detect response patterns. Items were also order inverted, and two questionnaire versions were used. Doing so reduced response biases derived from the item order. Responses were anonymous. However, general demographic questions were asked. The survey was purposely brief, able to be completed in about five minutes.
Involvement and value items were formatted alike. Both had respondents indicate their similarity to the persons portrayed. This further masked the survey’s intent. Modified Likert responses provided the data. Based on Miller (1956), six answer options were offered: 1-nothing, 2-a little, 3-somewhat, 4-quite, 5-very, and 6-totally similar. These categories provided detail yet kept cognitive response loads low. Numerical-verbal labels enhanced responses (Windschitl & Wells, 1996). An even number of response options forced committed answers. The lack of a neutral option produced less ambiguous responses, reducing the level of error in the data (Suchman, 1950).
Sustainability research sometimes uses self-selected samples. However, doing so skews results. It reflects more environmentally-inclined consumers (McDonald, Oates, Young, & Hwang, 2006). On the other hand, involvement scales sometimes derive from student samples, most notably that of Zaichkowsky (1985). However, the literature warns against using student samples. These differ demo-psychographically from the general population, and therefore, are usually inadequate to conduct research (James & Sonner, 2001; Peterson, 2001). Because of this, and to give this study more credence, a sample that demographically approximated the Costa Rican adult population was used.
A brief pretest with 20 consumers ensured that items were understood and easily answered. The primary data collection followed a snowball sampling approach, per Cleveland, Laroche, and Papadopoulos (2009): As part of a class project, students from four marketing courses at a private Costa Rican university surveyed adults of predetermined ages, genders, education levels, and social classes. The use of quotas ensured that the national demographic characteristics were approximated.
Surveys were paper-based, given respondents’ socioeconomic diversity. Of particular concern were differences in online access. Upon finishing their surveys, respondents referred students to further potential participants, which were then contacted. This was done until students filled their assigned quotas. Students followed an administration protocol. The latter had been explained and practiced beforehand in class. Student data was complemented with data collected by the researchers, which also followed a snowball/quota procedure.
Collection yielded 1,169 responses. Incomplete or patterned ones, e.g. all answers marked 3-Somewhat, were excluded to improve data (Tabachnick & Fidell, 2013). This left 1,036 usable responses. The sample, described in Table 2, below, approximates the national population in age, gender, education level, and socioeconomic class, per INEC (2018, 2020a, 2020b).
Age Cohort | % | Gender | % | Education Level | % | Socio-Eco Class | % |
---|---|---|---|---|---|---|---|
18-24/Z | 16.51 | Male | 47.68 | Primary | 25.58 | Low | 22.39 |
25-39/M | 31.56 | Female | 52.32 | Secondary | 36.10 | Low-Mid | 36.87 |
40-54/X | 23.07 | Technical | 6.85 | Mid-Hi* | 30.69 | ||
55-74/B | 21.91 | University | 31.47 | Hi* | 10.05 | ||
75+/S | 6.95 | Total | 100 | 100 | 100 | 100 |
Age range = 18-82, mean = 43.59, median = 42.00, s.d. = 18.15. For comparative purposes, age brackets reflect the cohorts defined by Pew Research (2019). *Educational and socioeconomic groups slightly over-represent upper levels.
Analysis
To verify the internal consistency of eliciting scales, as here the case, Rossiter (2002) recommends calculating coefficient Beta. The latter is the minimum value of a split-halves analysis, and therefore, a more conservative indicator than Alpha, see Revelle (1979) or John and Roedder (1981). A Beta of at least .700 is needed to infer internal consistency (Rossiter, 2002). To calculate it via SPSS v26, Guttman's (1945) Lambda coefficient was used. Specifically, Lambda-4, which is the lower bound reliability of all splits. Its value for the five items was .839, suggesting robust internal consistency.
To assess items in more conventional terms, Alphas were calculated. Unlike Beta, Alpha is the average of all split halves. It is thus a more optimistic indicator. Alphas of at least .800 are needed for eliciting scales (Rossiter, 2002). Its value for the five items was .895. This confirms internal consistency, especially given the low item number (Nunnally & Bernstein, 1994).
Rossiter (2002) suggests using Alphas to delete items with low item-total correlations. The scale’s internal consistency might thereby be improved. The five items were assessed. Table 3, below, summarizes their characteristics. Item 5 showed a slightly low item-total correlation of .682. However, it was retained. Its deletion would have otherwise reduced the scale’s mean, variance, and Alpha below initial values.
Involvement Item The person… | Scale mean if item deleted | Scale variance if item deleted | Item-total co-rrelation | Scale Alpha if item deleted |
---|---|---|---|---|
1…currently buys many sustainable products | 11.94 | 25.640 | .709 | .880 |
2…frequently recommends buying sust. prods. to friends & fam. | 13.31 | 24.397 | .787 | .863 |
3…talks a lot about sustainable products with friends & family | 13.75 | 23.452 | .776 | .856 |
4…plans to buy many sustainable products in the future | 13.34 | 23.874 | .761 | .868 |
5…thinks about how sustainable products help the environment | 12.31 | 25.264 | .886 |
For the 5-item scale, range = 5-30, mean = 16.16, variance = 37.344, Alpha = .895.
Research sometimes considers involvement as multidimensional. However, the present objective was to develop a short, general scale. The construct was thus approached from a broad perspective, assumed to be unidimensional.
Exploratory Factor Analyses (EFA) suffice to test unidimensionality (Gorsuch, 1997). However, psychometric scaling usually adds Confirmatory Factor Analyses (CFA) to verify/fine-tune exploratory results (Ahmetoglu, Leutner, & Chamorro-Premuzic, 2011). EFA/CFA on the five involvement items were therefore conducted. Doing so methodologically validated results through a different scaling technique, one more amenable with traditional psychometric practice.
EFA extraction was done via principal components. The number of components was not pre-established. Rotation was also dispensed with to obtain non-optimized results. Eigenvalues (EVs) > 1 determined the number of components to retain. Only Component 1, worth 3.531 EVs and 70.611% variance, met the criterion. Other components were well thereunder. The scree plot’s drop-off (Component 2 = 0.528 EVs) confirmed retaining only Component 1. Table 4, below, shows how the five involvement items loaded onto Component 1. Loads range from .794 to .872 and average .839. These values suggest a well-defined single underlying construct. The compact load range further indicates content homogeneity (Tabachnick & Fidell, 2013). Strong sample adequacy, KMO = .843, indicates robust modeling.
To verify results, CFAs using maximum likelihood estimation were conducted. The ideal solution was again a single factor. Factors should be statistically independent, indicated by item loads of at least .700 (Hair, Black, Babin, & Anderson, 2009). Table 4, below, also shows the standardized regression weights for the five items. Ranging from .704 to .860, and averaging .793, all loads comply with the criterion. Different fit indicators support the above results (see Hair et al. (2009) for specifics): GFI = .945, AGFI = .834, Chi-square = 160.222, DF = 5, and probability level = 0.000. These values confirm a clearly defined unidimensional involvement construct.
Involvement Item The person… | EFAComponent 1 Loads | CFA Factor 1 Loads |
---|---|---|
3…talks a lot about sustainable products with friends & family | .872 | .857 |
2…frequently recommends buying sust. prods to friends & family | .867 | .860 |
1…currently buys many sustainable products | .852 | .806 |
5…thinks about how sustainable products help the environment | .814 | .739 |
4…plans to buy many sustainable products in the future | .794 | .704 |
Average .839 | 793 |
The Scale Formation step led to items of strong content validity. Though how well items related to an external criterion remained to be ascertained. The literature indicates that product involvement is co-determined by personal values, e.g. Zaichkowsky (1985). The five involvement items were thus related to Universalism. Data on this and other values had been collected with those on involvement, allowing correlations.
Universalism derives from the collective need to survive and thrive. Its ideal is a life where the welfare of humanity is enhanced. This includes preserving nature and its scarce resources (Schwartz et al., 2001), precisely what sustainable products strive to do.
Universalism is part of Schwartz’s (1992) value framework. Unlike others used in marketing, say Rokeach’s (1973) or Kahle’s (1983), Schwartz’s framework is cross-cultural. It derives from samples of 20 different countries, some from Latin America. The latter makes it especially suited for present purposes. Schwartz obtained a near-universal structure comprising ten fundamental life-guiding values. What varied between nations/individuals were differences in degree, not kind. Given its versatility, Schwartz’s framework has become one of the most widely used (Datler, Jagodzinski, & Schmidt, 2013; Parks-Leduc, Feldman, & Bardi, 2015).
Universalism was operationalized via two items from Schwartz’s (2001) Portrait Values Questionnaire (PVQ). While developing their brief PVQ version, Sandy et al. (2017) found the two items to effectively encapsulate the Universalism dimension (Alpha = .765, retest reliability = .810, external validities similar to the original instrument. Present Alpha = .739). Table 5, below, shows how the five involvement items/scale average correlate with the two Universalism items/dimensional average.
The person… | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 |
---|---|---|---|---|---|---|---|---|---|
1…thinks about how sustainable products help the environment | 1 | ||||||||
2…talks a lot about sustainable products with friends & family | .632** | ||||||||
3…frequently recommends buying sust. prods to friends & family | .610** | .769** | 1 | ||||||
4…currently buys many sustainable products | .580** | .653** | .712** | 1 | |||||
5… plans to buy many sustainable products in the future | .613** | .592** | .528** | .629** | 1 | ||||
6 Involvement Average | .811** | .867** | .866** | .855** | .799** | 1 | |||
7…considers equality very important. (S/he) always tries that everyone has the same opportunities in life. | .453** | .338** | .382** | .301** | .278** | .416** | 1 | ||
8…considers peace between different groups very important. (S/he) believes that one should always live in harmony. | .463** | .339** | .415** | .321** | .318** | .441** | .586** | 1 | |
9 Universality Average | .514** | .380** | .448** | .350** | .335** | .481** | .886** | .895** | 1 |
A moderate, albeit significant relationship emerged between both instrument averages, r = .481, p < 0.01. As peoples’ Universalism increases, so does their sustainable product involvement. These results are consistent with what would be expected from the literature. The above notwithstanding, involvement is a complex phenomenon. It derives from multiple variables, situational moderators, and individual characteristics (Atkinson & Rosenthal, 2014). By no means is it suggested that personal values, much less Universalism alone, drive sustainable product involvement. Nonetheless, the correlation obtained externally validates, at least preliminarily, the proposed involvement items/scale.
Given the positive and significant external relation, coupled with the robust reliability and dimensionality values obtained, we conclude that the five C-OAR-SE items developed comprise a reasonable measure of sustainable product involvement.
6) Enumeration
The final C-OAR-SE step involves explaining how items produce a total scale score. Doing so is necessary given the different object and attribute types possible (Rossiter, 2002).
Total scale scores may derive from various summed, averaged, or weighted procedures (Diamantopoulos & Winklhofer, 2001). However, enumeration was kept simple to develop a practical instrument. As mentioned in the external validation section, the five item scores were averaged to produce an overall score. Item and total scores would then be based on the same six-point scale, facilitating application, analysis, and interpretation.
However, a six-point scale is admittedly awkward. Rossiter (2002) suggests that in cases like these, scores be transformed to a 0 to 10 scale. The 0 value corresponds to the absolute construct absence and the scale’s psychological null-point. The 10 value corresponds to the maximum possible score. This 0-10 range is also intuitive for users as people have grown accustomed to evaluating objects in deciles. Rescaling responses into a common, natural format improves how results are analyzed, interpreted, and compared. An intuitive design is particularly important for non-technical scale users.
Answers were thus rescaled from a 1-6 to a 0-10 format. Doing so is mathematically valid. Data matrices may be transformed via additive or multiplicative constants, provided that items’ relative intensity is respected (Guttman, 1950b). The first answer option was anchored at 0 = nothing similar to me. The other five answer options were spaced in two-point increments (2 = a little, 4 = somewhat, 6 = quite, 8 = very, and 10 = totally similar to me.) Using six answer options instead of eleven kept them cognitively manageable, facilitating responses; kept the number of answer options even, forcing committed responses; and increased inter-option spacing, distinguishing options better.
In hindsight, this new answer format should have been implemented during the item development stage, before collecting data. This post-hoc improvement was deemed to not significantly impact results. However, the rescaled data was nevertheless reanalyzed to ascertain this. The response range and scale average naturally varied. These went from 1-6 to 0-10, and from 2.693/6 to 4.465/10, respectively. But the factorial item loadings and external correlations were nearly identical to those initially obtained. Given its multiple advantages, we recommend implementing the 0-10 answer format instead of the original 1-6 one. Table 6, below, shows the Sustainable Product Involvement Scale.
The person… | 0 nothing similar to me | 2 a little similar to me | 4 somewhat similar to me | 6 quite similar to me | 8 very similar to me | 10 totally similar to me |
---|---|---|---|---|---|---|
1…currently buys many sustainable products | 0 nothing | 2 a little | 4 somewhat | 6 quite | 8 very | 10 totally |
2…frequently recommends buying sust. prods to friends & family | 0 nothing | 2 a little | 4 somewhat | 6 quite | 8 very | 10 totally |
3… talks a lot about sustainable products with friends & family | 0 nothing | 2 a little | 4 somewhat | 6 quite | 8 very | 10 totally |
4… plans to buy many sustainable products in the future | 0 nothing | 2 a little | 4 somewhat | 6 quite | 8 very | 10 totally |
5… thinks about how sustainable products help the environment | 0 nothing | 2 a little | 4 somewhat | 6 quite | 8 very | 10 totally |
*Instructions to be adjusted according to the total survey item number.
REFERENCES
Ahmetoglu, G., Leutner, F., & Chamorro-Premuzic, T. (2011). EQ-nomics: Understanding the relationship between individual differences in trait emotional intelligence and entrepreneurship. Personality and Individual Differences, 51(8), 1028-1033.
Allport, G. W. (1943). The ego in contemporary psychology. Psychological Review, 50(5), 451-478.
Alvarez-Milán, A. (2018). Medición del involucramiento del consumidor en causas sociales. CLADEA, 1(1), 1-4.
Antil, J. H. (1984). Conceptualization and operationalization of involvement. Advances in Consumer Research, 11(1), 203-209.
Atkinson, L., & Rosenthal, S. (2014). Signaling the green sell: the influence of eco-label source, argument specificity, and product involvement on consumer trust. Journal of Advertising, 43(1), 33-45.
Bangsa, A. B., & Schlegelmilch, B. B. (2020). Linking sustainable product attributes and consumer decision-making: Insights from a systematic review. Journal of Cleaner Production, 245(1), 1-17.
Brislin, R. W. (1970). Back-Translation for Cross-Cultural Research. Journal of Cross-Cultural Psychology, 1(3), 185-216.
Burisch, M. (1997). Test length and validity revisited. European Journal of Personality, 11(4), 303-315.
Carrington, M. J., Neville, B. A., & Whitwell, G. J. (2010). Why ethical consumers don’t walk their talk: Towards a framework for understanding the gap between the ethical purchase intentions and actual buying behaviour of ethically minded consumers. Journal of Business Ethics, 97(1), 139-158.
Cha, E. S., Kim, K. H., & Erlen, J. A. (2007). Translation of scales in cross‐cultural research: issues and techniques. Journal of Advanced Nursing, 58(4), 386-395.
Churchill, G. A. (1979). A Paradigm for Developing Better Measures of Marketing Constructs. Journal of Marketing Research, 16(1), 64-73.
Cleveland, M., Laroche, M., & Papadopoulos, N. (2009). Cosmopolitanism, consumer ethnocentrism, and materialism: An eight-country study of antecedents and outcomes. Journal of International Marketing, 17(1), 116-146.
Conejo, F. J., & Wooliscroft, B. (2015). Brands Defined as Semiotic Marketing Systems. Journal of Macromarketing, 35(3), 287-301.
Conejo, F. J., Wooliscroft, B., & Insch, A. (2017). Exploring Brand Personality Scale Development Using Rasch Modelling. Marketing Bulletin, 27(1), 1-23.
Conejo, F. J., Young, C. E., Wooliscroft, B., & Parthasarathy, M. (2019). Addressing Construct Intensity in Entrepreneurship: Log-Transformed Guttman Scaling with Need for Achievement as Exemplar. Entrepreneurship Research Journal, 11(1), 1-15.
Dahlstrom, R., & Crosno, J. L. (2018). Sustainable Marketing. Chicago, IL: Chicago Business Press.
Datler, G., Jagodzinski, W., & Schmidt, P. (2013). Two theories on the test bench: Internal and external validity of the theories of Ronald Inglehart and Shalom Schwartz. Social Science Research, 42(3), 906-925.
Davis, D. F., Golicic, S. L., Boerstler, C. N., Choi, S., & Oh, H. (2013). Does marketing research suffer from methods myopia? Journal of Business Research, 66(9), 1245-1250.
De Carvalho, B. L., Salgueiro, M. d. F., & Rita, P. (2015). Consumer Sustainability Consciousness: A five dimensional construct. Ecological Indicators, 58(1), 402-410.
De Carvalho, B. L., Salgueiro, M. d. F., & Rita, P. (2016). Accessibility and trust: the two dimensions of consumers’ perception on sustainable purchase intention. International Journal of Sustainable Development & World Ecology, 23(2), 203-209.
De Vellis, R. F. (2012). Scale Development – Theory and Applications (3rd Ed.). Thousand Oaks, CA: Sage Publications.
Diamantopoulos, A. (2005). The C-OAR-SE procedure for scale development in marketing: A comment International Journal of Research in Marketing, 22(1), 1-9.
Diamantopoulos, A., & Winklhofer, H. M. (2001). Index construction with formative indicators: An alternative to scale development. Journal of Marketing Research, 38(2), 269-277.
Dolan, P. (2002). The sustainability of "sustainable consumption". Journal of Macromarketing, 22(2), 170-181.
Dunlap, R. E. (2008). The new environmental paradigm scale: From marginality to worldwide use. The Journal of Environmental Education, 40(1), 3-18.
Florek, M., & Conejo, F. J. (2007). Export flagships in branding small developing countries: The cases of Costa Rica and Moldova. Place Branding and Public Diplomacy, 3(1), 53-72.
GoogleScholar. (2021). Search: Measuring the Involvement Construct. Retrieved from https://scholar.google.com/citations?user=oDOQyd4AAAAJ&hl=en&oi=sra#d=gs_md_cita-d&u=%2Fcitations%3Fview_op%3Dview_citation%26hl%3Den%26user%3DoDOQyd4AAAAJ%26citation_for_view%3DoDOQyd4AAAAJ%3Au5HHmVD_uO8C%26tzom%3D420
Gorsuch, R. L. (1997). Exploratory Factor Analysis: Its Role in Item Analysis. Journal of Personality Assessment, 68(3), 532-560.
Guttman, L. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10(4), 255-282.
Guttman, L. (1950b). The Basis for Scalogram Analysis. In S. A. Stouffer, L. Guttman, E. A. Suchman, P. F. Lazarsfeld, S. A. Star, & J. A. Clausen (Eds.), Measurement and Prediction (pp. 60-90). Princeton, NJ: Princeton University Press.
HAC. (2021). Home Retrieved from https://www.hacfornatureandpeople.org/
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2009). Multivariate Data Analysis. Upper Saddle River, NJ: Prentice Hall/Pearson.
Hardesty, D. M., & Bearden, W. O. (2004). The use of expert judges in scale development: Implications for improving face validity of measures of unobservable constructs. Journal of Business Research, 57(2), 98-107.
Hupfer, N. T., & Gardner, D. M. (1971). Differential involvement with products and issues: An exploratory study. Advances in Consumer Research, 1(1), 262-270.
INEC. (2018). Costa Rica En Cifras. Retrieved from San José, CR:
INEC. (2020a). Estadísticas demográficas. 2011 – 2050. Proyecciones nacionales. Población por años calendario, según sexo y grupos especiales de edades. Retrieved from https://www.inec.cr/poblacion/estimaciones-y-proyecciones-de-poblacion
INEC. (2020b). Ingresos y Gastos de Hogares. Retrieved from www.inec.cr/ingresos-y-gastos-de-hogares/ingresos-de-los-hogares
Iverson, M. A., & Reuder, M. E. (1956). Ego involvement as an experimental variable. Psychological Reports, 2(3), 147-181.
James, W. L., & Sonner, B. S. (2001). Just say no to traditional student samples. Journal of Advertising Research, 41(5), 63-72.
John, G., & Roedder, D. L. (1981). Reliability assessment: coefficients alpha and beta. In K. Bernhardt & W. J. Kehoe (Eds.), The changing marketing environment: New theories and applications (pp. 354-357). Chicago, IL: American Marketing Association.
Kahle, L. R. (1983). Social Values and Social Change: Adaptation to Life in America. New York, NY: Praeger Publishers.
Kim, I., Jeon, S. M., & Hyun, S. S. (2012). Chain restaurant patrons’ well-being perception and dining intentions: The moderating role of involvement. International Journal of Contemporary Hospitality Management, 24(3), 402-429.
Kotler, P., & Armstrong, G. (2016). Principles of Marketing. Boston, MA: Pearson.
Krugman, H. E. (1965). The impact of television advertising: Learning without involvement. Public Opinion Quarterly, 29(3), 349-356.
Laurent, G., & Kapferer, J.-N. (1985). Measuring consumer involvement profiles. Journal of Marketing Research, 22(1), 41-53.
Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575.
McDonald, S., Oates, C., Young, W., & Hwang, K. (2006). Toward Sustainable Consumption: Researching Voluntary Simplifiers. Psychology and Marketing, 23(6), 515-534.
Michaelidou, N., & Dibb, S. (2008). Consumer involvement: a new perspective. The Marketing Review, 8(1), 83-99.
Miller, G. A. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63(2), 81-97.
Mittal, B. (1995). A comparative analysis of four scales of consumer involvement. Psychology & Marketing, 12(7), 663-682.
Most, F., Conejo, F. J., & Cunningham, L. F. (2018). Bridging past and present entrepreneurial marketing research: A co-citation and bibliographic coupling analysis. Journal of Research in Marketing and Entrepreneurship, 20(2), 229-251.
Naderi, I., & Strutton, D. (2015). I support sustainability but only when doing so reflects fabulously on me: can green narcissists be cultivated? Journal of Macromarketing, 35(1), 70-83.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric Theory (3rd ed.). New York, NY: McGraw-Hill.
Parks-Leduc, L., Feldman, G., & Bardi, A. (2015). Personality traits and personal values: A meta-analysis. Personality and Social Psychology Review, 19(1), 3-29.
Peattie, K. (2010). Green Consumption: Behavior and Norms. Annual Review of Environment and Resources, 35(1), 195–228.
Peterson, R. A. (1994). A meta-analysis of Cronbach's coefficient alpha. Journal of Consumer Research, 21(2), 381-391.
Peterson, R. A. (2001). On the use of college students in social science research: Insights from a second-order meta-analysis. Journal of Consumer Research, 28(3), 450-461.
PewResearch. (2019, 01/17/19). Defining generations: Where Millennials end and Generation Z begins. Retrieved from https://www.pewresearch.org/fact-tank/2019/01/17/where-millennials-end-and-generation-z-begins/
Rahman, I. (2018). The interplay of product involvement and sustainable consumption: An empirical analysis of behavioral intentions related to green hotels, organic wines and green cars. Sustainable Development, 26(4), 399-414.
Revelle, W. (1979). Hierarchical cluster analysis and the internal structure of tests. Multivariate Behavioral Research, 14(1), 57-74.
Richins, M. L., & Bloch, P. H. (1986). After the new wears off: The temporal context of product involvement. Journal of Consumer Research, 13(2), 280-285.
Rokeach, M. (1973). The Nature of Human Values. New York, NY: The Free Press.
Rossiter, J. R. (2002). The C-OAR-SE procedure for scale development in marketing. International Journal of Research in Marketing, 19(4), 305-335.
Rossiter, J. R. (2011). Marketing measurement revolution: The C‐OAR‐SE method and why it must replace psychometrics. European Journal of Marketing, 45(11), 1561-1588.
Rossiter, J. R. (2016). How to use C-OAR-SE to design optimal standard measures. European Journal of Marketing, 50(11), 1924-1941.
Russell-Bennett, R., McColl-Kennedy, J. R., & Coote, L. V. (2007). Involvement, satisfaction, and brand loyalty in a small business services setting. Journal of Business Research, 60(12), 1253-1260.
Salzberger, T., Sarstedt, M., & Diamantopoulos, A. (2016). Measurement in the social sciences: where C-OAR-SE delivers and where it does not. European Journal of Marketing, 50(11), 1942-1952.
Sandy, C. J., Gosling, S. D., Schwartz, S. H., & Koelkebeck, T. (2017). The Development and Validation of Brief and Ultrabrief Measures of Values. Journal of Personality Assessment, 99(5), 545-555.
Schiffman, L., & Wisenblit, J. (2019). Consumer Behavior. New York, NY: Pearson.
Schwartz, S. H. (1992). Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. Advances in Experimental Social Psychology, 25(1), 1-65.
Schwartz, S. H., Melech, G., Lehmann, A., Burgess, S., Harris, M., & Owens, V. (2001). Extending the cross-cultural validity of the theory of basic human values with a different method of measurement. Journal of Cross-Cultural Psychology, 32(5), 519-542.
Sherif, M., & Cantril, H. (1947). The Psychology of Ego Involvements: Social Attitudes and Identifications. New York, NY: John Wiley & Sons.
Sheth, J. N., & Venkatesan, M. (1968). Risk-reduction processes in repetitive consumer behavior. Journal of Marketing Research, 5(3), 307-310.
Solomon, M. R. (2020). Consumer Behavior: Buying, Having, and Being. Hoboken, NJ: Pearson.
Stewart, D. W., & Shamdasani, P. N. (2015). Focus Groups: Theory and Practice. Thousand Oaks, CA: Sage Publications.
Suchman, E. A. (1950). The Scalogram Board Technique for Scale Analysis. In S. A. Stouffer, L. Guttman, E. A. Suchman, P. F. Lazarsfeld, S. A. Star, & J. A. Clausen (Eds.), Measurement and Prediction (pp. 91-121). Princeton, NJ: Princeton University Press.
Tabachnick, B. G., & Fidell, L. S. (2013). Using Multivariate Statistics (6th ed.). Boston, MA: Pearson Education.
UNDP. (2020). Overview - Human Development Report 2020. Retrieved from http://hdr.undp.org/sites/default/files/hdr_2020_overview_english.pdf
UNEP. (2019). Costa Rica: the ‘living Eden’ designing a template for a cleaner, carbon-free world. Retrieved from www.unenvironment.org/news-and-stories/story/costa-rica-living-eden-designing-template-cleaner-carbon-free-world
Windschitl, P. D., & Wells, G. L. (1996). Measuring psychological uncertainty: Verbal versus numeric methods. Journal of Experimental Psychology, 2(4), 343 -364.
Witkowski, T. H. (2010). A brief history of frugality discourses in the United States. Consumption, Markets and Culture, 13(3), 235-258.
Zaichkowsky, J. L. (1985). Measuring the Involvement Construct. Journal of Consumer Research, 12(3), 341-352.
Zaichkowsky, J. L. (1994). The Personal Involvement Inventory: Reduction, Revision, and Application to Advertising. Journal of Advertising, 23(4), 59-70.