- By FYH News Team
[ad_1]
Citation: Kelley A, McCoy T, Skye M, Singer M, Craig Rushing S, Perkins T, et al. (2022) Psychometric evaluation of protective measures in Native STAND: A multi-site cross-sectional study of American Indian Alaska Native high school students. PLoS ONE 17(5):
e0268510.
https://doi.org/10.1371/journal.pone.0268510
Editor: Richard Huan XU, The Hong Kong Polytechnic University, HONG KONG
Received: October 18, 2021; Accepted: May 3, 2022; Published: May 17, 2022
Copyright: © 2022 Kelley et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data cannot be shared publicly because American Indian youth are a vulnerable population and the study does not allow for data sharing. Data are available by contacting Dr. Craig and going through the appropriate IRBs and Ethics Committees for researchers who meet the criteria for access to confidential data. The Portland Area Indian Health Service IRB contact is Rena Macy, Co-Chair, Portland Area IHS IRB Portland Area IHS 1414 NW Northrup St Suite 800 Portland, OR 97209 Phone: 503-414- 5540 It should be noted that all shareable data are within the paper and its Supporting Information files. Data sharing is not appropriate for this small sample of AI/AN youth. Data could potentially be identified and AI/AN youth populations are considered vulnerable populations due to the historical and unethical research practices conducted by universities and the US government on AI/AN populations. If a reader would like access to the data used in this study they would need to submit a request to Dr. Stephanie Craig Rushing, the corresponding author and she would present this information to the tribe and IRBs involved in the Native STAND study.
Funding: This work was supported in part by the award number 5 U48DP005006-05 from the Centers for Disease Control and Prevention, Cooperative Agreement. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Centers for Disease Control. There was no additional external funding received for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The 577+ American Indian and Alaska Native (AI/AN) tribes and communities throughout the U.S. are diverse in their language, culture, traditions, spiritual practices, and heritage. This diversity must be considered when developing and utilizing measures to assess the effectiveness of health and educational programs, interventions, and policies. AI/AN youth under 18 years old make up about 29% of the AI/AN population–too many experience poor mental health outcomes resulting from disproportionate exposure to historical trauma and other social, structural, political, and environmental factors [1]. As a result, AI/AN youth are placed at greater risk for suicide, poor mental health, depression, and substance misuse [2].
Culturally-adapted evidence-based interventions (EBIs) are emerging as an essential tool for building health equity in AI/AN populations [3]. Assessing the validity of instruments that document the characteristics of program participants and program impact is essential. Without valid instrumentation, it is nearly impossible to know if an intervention worked, for whom, and in what context. For decades, researchers, policymakers, educators, and interventionists have been challenged with data collection in AI/AN populations, including restricted data access, limited capacity to analyze data, difficulty finding comparison groups, limited quality data, small sample sizes, lack of national AI/AN samples, limited comparison groups, lack of cultural validity, and varying levels of programmatic capacity [4–5]. Researchers often use assessment instruments designed for the general population in AI/AN contexts–often, these lack cultural context or community feedback [5]. Developing valid instruments with AI/AN communities requires an understanding of differences in views about what determines health and wellness and the unique community and cultural practices that protect youth. The language and terms used to define health outcomes in mainstream survey tools may be based on western medialized constructs that have little relevance in AI/AN community settings [5]. Researchers working with AI/AN communities to evaluate health programs and interventions need to reliably measure risk and protective factors among program participants. In this review, protective factors refer to conditions or variables that may increase positive health outcomes in AI/AN youth.
Research suggests that self-esteem, social support, community connections, and culture may be protective [6]. Self-esteem has been associated with school success, internal locus of control, perceptions of competence, social support, and coping skills [7]. Peer and family social support has been inversely correlated with AI/AN youth substance misuse [8]. Family caring has been associated with positive AI/AN youth mental health [9]. Cultural connectedness has been associated with academic success and resilience [10]. One study found that AI/AN youth with an interest in their culture were less likely to display violent behaviors [11]. Stable community conditions may foster healthy connections and safety [8, 12], which may be protective against substance misuse and suicide ideation. Such research demonstrates forward progress in understanding what determines health in AI/AN youth. Still, more work is needed to capture the strengths of AI/AN youth and communities through the development of valid survey measures.
Attempts to measure protective factors such as self-esteem, social support, community, and culture are evident in standardized assessments, but few have been developed with AI/AN youth in mind. First, Rosenberg’s self-esteem scale has been used to assess participant self-esteem characteristics in the general population [13]. Second, Zimet and colleagues developed a Multidimensional Perceived Social Support scale [14]–which is widely used in the health programming milieu. Unlike social support and self-esteem, where standard mental health assessments are used or adapted, assessing aspects of culture and ethnic identity requires a different approach. Snowshoe and colleagues developed the Cultural Connectedness Short Scale (CCSS) to measure culture in First Nations youth [15]. The CCSS is meant to be adapted by First Nations and Native communities based on their unique culture, traditions, and context. Importantly, culture and community depend on values, history, traditions, customs, sense of belonging, and membership–the construct of culture is often defined and conceptualized with a specific community in mind [16].
Much has been done to develop and evaluate culturally-relevant health interventions that build on the strengths and resilience of AI/AN youth. Less has been done to assess the effectiveness of these interventions using validated survey tools appropriate for the AI/AN community and population. The objective of this study was to validate the measurement properties of the Native Students Together Against Negative Decisions (Native STAND) survey instrument among AI/AN high school students.
About Native STAND
Native STAND is a comprehensive sexual health curriculum for Native high school students that supports healthy decision-making through interactive discussions and activities that promote self-esteem, goals and values, team building, negotiation and refusal skills, and effective communication. The 90-minute lessons contain stories from Tribal communities that ground learning in cultural teachings. Results from previous Native STAND evaluations demonstrate it to be an effective approach for addressing healthy relationships, STDs, and teen pregnancy [17]. The original STAND intervention was designed and evaluated among rural youth in the southern United States and found to promote condom self-efficacy, STI risk behavior knowledge, and conversations with peers about other sexual health topics among participating students. Previous evaluations of the Native STAND curriculum conducted from 2010 to 2012 with a sample of 90 students reported positive results, with increases in STD/HIV knowledge, reproductive health, and healthy relationships [17]. The original survey tool was developed by the Centers for Disease Control and focused heavily on sexual health knowledge, attitudes, and behavior. For the present study, we cut back the survey tool, updated the demographic questions, and expanded the protective measures. No prior studies have established the reliability and validity of the tool’s protective measures.
Methods
The Native STAND D&I research study was a collaboration between [REMOVED FOR BLINDED REVIEW] and 48 Tribes and Native-serving organizations located across the U.S. The study protocol was reviewed and approved by OHSU (IRB00000734) and the Portland Area Indian Health Service Institutional Review Board (659942).
Procedure
In 2014 the study team began revising the Native STAND survey tool, which was adapted from the Native Youth Survey and other questionnaires [17]. During the first round of site recruitment, the study team asked educators to review and discuss the survey instrument during an in-person orientation/training. Changes to the initial survey tool included reducing the number of self-esteem items, eliminating positive outlook, morals, and values, adaptability, and some measures on cultural pride and identity, to focus the instrument on the most important measures and minimize survey fatigue [18]. Facilitator feedback and literature reviews were used to establish the content validity of the survey measures. The final survey tool was utilized with three cohorts of students at 48 sites and assessed a broad range of health knowledge, attitudes, beliefs, intentions, behaviors, and skills relating to physical, sexual, mental, and psycho-social health. This study focuses on four protective measures included in the updated Native STAND survey tool: self-esteem, culture, social support, and community safety.
Parental consent and youth assent were obtained prior to data collection. To ensure the confidentiality of survey responses, each youth received a paper survey labeled with a unique study ID and a manila envelope. After the youth completed their survey, they sealed them in the envelope and returned them to the educator on site. Educators then mailed their class’s surveys to the Native STAND project office for data entry and cleaning. Once received, researchers would immediately scan the survey for any safety concerns. If a safety concern was noted, educators would be notified that a safety concern was noted among their students so they could address it with safety protocols they had in place within their institution.
Measures
Self-esteem.
Participants were asked their level of agreement with seven statements based on questions selected from the Rosenberg Self-esteem scale [13] by the study team and reviewed with participating health educators (e.g., I take a positive attitude toward myself). The team examined the VOICES survey [7] and the original Rosenberg Self-esteem scale, including ten items, five positively worded and five negatively worded. The study team reduced the number of items on the scale from 10 to seven and omitted one negatively worded item [7, 13,18]. Previous research reports the potential low reliability of negatively worded items in youth and culturally-diverse populations [7]. Response options were based on a Likert-style scale where 1 = Strongly Disagree to 5 = Strongly Agree.
Data analysis
Item analyses were first performed for descriptive statistics of item ratings (mean (M), standard deviation (SD)) and sample size of youth with complete responses. Inter-item correlations among responses as well as corrected item-total correlations were estimated. Exploratory factor analysis (EFA) was performed using principal axis factoring exaction with an oblique promax rotation. The number of factors extracted was based on parallel analysis [19]. An item was considered to load onto a factor if its factor loading was at least 0.40. Non-loading items and items loading on more than one factor were removed and the EFA re-ran. Internal consistency reliability was estimated for each factor using Cronbach’s alpha (α). All analyses were performed in SPSS v26 (IBM Corp., Armonk, NY) and Mplus v8.3 [20]. A two-sided p-value < 0.05 was considered statistically significant.
Results
Sample characteristics
Our sample included 1,456 students, with a median age of 15, and were 50.2% female, 45.7% male, and 1.2% transgender (Table 1). Students represented 48 sites from throughout the US, most (84.9%) were American Indian.
Descriptive results
Table 2 displays descriptive results of the Native STAND student participants. Mean scores ranged from 2.5 to 4.4.
Self-esteem.
Item ratings varied from 3.4 for “calling” to 4.3 for “best” on average (SD ranged from 0.72 to 0.95) with a sample size of 1,373 youth with complete item responses. Inter-item correlations ranged from 0.213 to 0.329 (average = 0.278) and corrected item-total correlations ranged from 0.361 to 0.628. Two factors of self-esteem resulted based on parallel analysis, which explained 53.9% of the variance in the seven self-esteem items (see Fig 1). The two reverse scored (negatively worded) items loaded on their own factor (Negative Self-esteem) while the remaining five not reverse scored loaded onto their own factor (Positive Self-esteem), with a correlation between them of 0.442. Factor loadings ranged from 0.47 to 0.63 for Positive Self-esteem (Cronbach’s α = 0.655) and 0.77 to 0.81 for Negative Self-esteem (α = 0.771).
Culture.
Item ratings varied from 3.8 for “history” and “native strengths” to 4.2 for “native identity” on average (all SD = 1.0) with a sample size of 1,390 youth with complete item responses. Inter-item correlations ranged from 0.565 to 0.692 (average = 0.636) and corrected item-total correlations ranged from 0.661 to 0.759. One factor of AI/AN Culture resulted based on parallel analysis which explained 75.8% of the variance in the three culture items (Fig 2). Factor loadings ranged from 0.73 to 0.89, and internal consistency was high (α = 0.840).
Social support.
Item ratings varied from 3.6 for “talk problems” to 4.0 for “support” on average (SD ranged from 0.94 to 1.1) with a sample size of 1,422 youth with complete item responses. Inter-item correlations ranged from 0.286 to 0.759 (average = 0.439) and corrected item-total correlations ranged from 0.588 to 0.758. Two factors of social support resulted based on parallel analysis, which explained 83.7% of the variance in the four social support items (Fig 3). The two “family” related items loaded on their own factor (Family social support) while the two “friends” related items loaded onto their own factor (Friends social support), with a correlation between them of 0.475. Factor loadings ranged from 0.865 to 0.874 for Family social support (α = 0.732) and 0.759 to 0.770 for Friends social support (α = 0.862).
Community and community safety.
Ratings varied from 3.9 for “would miss” and “feel safe” to 4.4 for “home” on average (SD range 0.77 to 1.1) with a sample size of 1,416 youth with complete item responses. Inter-item correlations ranged from 0.279 to 0.439 (average = 0.382) and corrected item-total correlations ranged from 0.405 to 0.538. One factor of Community resulted based on parallel analysis, which explained 59.0% of the variance in the three community items (Fig 4). Factor loadings ranged from 0.52 to 0.82, and internal consistency was high (α = 0.635).
Discussion
The Native STAND survey scales reported here demonstrate the validity and reliability of strength-based survey measures in AI/AN youth participating in the Native STAND multi-site cross sectional study. The participatory process used to develop the survey tool and implement the intervention with diverse AI/AN communities added to the content validity of survey questions and provides a framework for other communities and researchers moving forward.
Previous research on the psychometric properties of strength-based scales have not been specific to AI/AN populations or the Native STAND intervention. Findings fill an essential gap in the literature–documenting the validity and reliability of strength-based measures in a national sample of AI/AN youth. Results presented here are a starting point for researchers, communities, and programs as they continue developing surveys with solid psychometric priorities for documenting the effectiveness of various programs, policies, and interventions. Results from the factor analysis and internal consistency provide guidance on creating and using sum scores for each factor/subscale.
Future efforts can build on this preliminary work, measuring protective factors in AI/AN youth that promote health and healthy decision-making [21]. For example, researchers may consider more comprehensive survey measures that define and operationalize culture and Native American identity, for example, creating culture-specific questions about involvement in history, traditions, and customs of a specific tribal group. At the individual level, future protective and strength-based surveys may include questions about healthy coping and problem-solving skills, emotional self-regulation, academic achievement, and positive physical development [7]. At the community level, additional questions could expand on the role of school, neighborhood, and community while documenting the presence of mentors, support, positive norms, behavior expectations, and safety [6]. Family strengths and protective factors are also essential, and documenting how the family provides structure, limits, rules, monitoring, predictability, supportive relationships, and behavior expectations is warranted. The Native STAND team encourages researchers, policymakers, programs, communities, clinicians, and educators to consider what is protective and what questions are essential to a program or study. Meeting with communities and members of the focus population can help define what wellness, health, culture, and community looks like and create surveys that build on these strengths and resources [5]. Although the Native STAND survey does not capture every strength-based measure possible, it is a starting point for documenting the strengths and needs of AI/AN youth throughout the life course.
References
- 1.
National Congress of American Indians [Internet]. Demographics. ND.—[cited 2021 July 8]. Available from: https://www.ncai.org/about-tribes/demographics - 2.
D’Amico EJ, Dickerson DL, Brown RA, Klein DJ, Agniel D, Johnson C. Unveiling an ‘invisible population’: Health, substance use, sexual behavior, culture, and discrimination among urban American Indian/Alaska Native adolescents in California. Ethn Hlth 2019; 11:1–8. pmid:30626198. - 3.
Dickerson D, Baldwin JA, Belcourt A, Belone L, Gittelsohn J, Kaholokula JK, et al. Encompassing cultural contexts within scientific research methodologies in the development of health promotion interventions. Prev Sci 2020; 21(1):33–42. pmid:29959716. - 4.
Stratford B. [Internet]. American Indian and Alaska Native communities face unique challenge when it comes to public health data. Child Trends 2021.—[cited 2021 July 8]. Available from: https://www.childtrends.org/blog/american-indian-alaska-native-communities-face-unique-challenges-comes-public-health-data - 5.
Kelley A, Piccione C, Fisher A, Matt K, Andreini M, Bingham D. Survey development: community-involvement in the design and implementation process. J Public Health Manag Pract 2019; 25:S77. pmid:31348193 - 6.
Henson M, Sabo S, Trujillo A, Teufel-Shone N. Identifying Protective Factors to Promote Health in American Indian and Alaska Native Adolescents: A Literature Review. J Prim Prev 2017; 38(1–2):5–26. pmid:27826690 - 7.
Whitesell N, Mitchell C, Spicer P, The Voices of Indian Teens Project Team longitudinal study of self-esteem, cultural identity, and academic success among American Indian adolescents. Cultur Divers and Ethnic Minor Psychol 2009; 15(1), 38–50. pmid:19209979. - 8.
Kelley A, Witzel M, Fatupaito B. Preventing Substance Use in American Indian Youth: The Case for Social Support and Community Connections. Subst Use Misuse 2019; 16;54(5):787–95. pmid:30574816. - 9.
Cummins J, Ireland M, Resnick M, Blum R. Correlates of Physical and Emotional Health Among Native American Adolescents. J Adolesc Health 1998; 38, 38–44. - 10.
LaFromboise T, Hoyt D, Oliver L, Whitbeck L. Family, Community, and School Influences on Resilience Among American Indian Adolescents in the Upper Midwest. Am J Community Psychol 2006; 32(2), 193–209. - 11.
Pu J, Chewing B, St. Clair I, Kokotailo P, Lacourt J, Wilson D. Protective Factors in American Indian Communities and Adolescent Violence. Matern and Child Health J 2013; 17, 1199–1207. ISSN: 1573-6628. pmid:22926269 - 12.
Kenyon D, Carter J. Ethnic identity, sense of community, and psychological well‐being among northern plains American Indian youth. J Com Psych 2011; 39(1):1–9. - 13.
Rosenberg M. Rosenberg self-esteem scale (RSE). Acceptance and commitment therapy. Measures package;1965; 61(52):18. doi-org.libproxy.uncg.edu/10.1002/jcop.20412 - 14.
Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the multidimensional scale of perceived social support. J Person Assess 1990; 1;55(3–4):610–7. pmid:2280326 - 15.
Snowshoe A, Crooks CV, Tremblay PF, Craig WM, Hinson RE. Development of a Cultural Connectedness Scale for First Nations youth. Psychol Assess 2015; 27(1):249. pmid:25222432 - 16.
Walls ML, Whitesell NR, Barlow A, Sarche M. Research with American Indian and Alaska Native populations: measurement matters. J Ethn Subst Abuse 2019; 2;18(1):129–49. pmid:28441113 - 17.
Rushing SN, Hildebrandt NL, Grimes CJ, Rowsell AJ, Christensen BC, Lambert WE. Healthy & empowered youth: a positive youth development program for native youth. Am J Prev Med 2017; 1;52(3):S263–7. - 18.
Marsh HW. Positive and negative global self-esteem: A substantively meaningful distinction or artifactors? J Pers Soc Psychol;1996; 70(4), 810. pmid:8636900 - 19.
Horn J. A rationale and test for the number of factors in factor analysis. Psychometrika 1965; 30(2), 179–185. pmid:14306381 - 20.
Dunn T, Baguley T, Brunsden V. From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. Br J Psychol 2014; 105(3), 399–412. pmid:24844115 - 21.
Mackin J, Perkins T, Furrer C. The Power of Protection: A Population-based comparison of Native and non-Native Youth Suicide Attempts. American Indian & Alaska Native Mental Health Research 2012; 19(2), 20–54. pmid:22875471
[ad_2]
Source link
Trending Topics
Features
- Drive Toolkit
Download and distribute powerful vaccination QI resources for your community.
- Health Champions
Sign up now to support health equity and sustainable health outcomes in your community.
- Cancer Early Detection
MCED tests use a simple blood draw to screen for many kinds of cancer at once.
- PR
FYHN is a bridge connecting health information providers to BIPOC communities in a trusted environment.
- Medicare
Discover an honest look at our Medicare system.
- Alliance for Representative Clinical Trials
ARC was launched to create a network of community clinicians to diversify and bring clinical trials to communities of color and other communities that have been underrepresented.
- Reducing Patient Risk
The single most important purpose of our healthcare system is to reduce patient risk for an acute event.
- Jessica Wilson
- Jessica Wilson
- Jessica Wilson
















