Research Article
Psychometric Assessment and Cross-Cultural Adaptation of the Grit-S Scale among Omani and American Universities’ Students

Amal Alhadabi , Said Aldhafri, Hussain Alkharusi, Ibrahim Al-Harthy, Hafidha AlBarashdi, Marwa Alrajhi


APA 7th edition
Alhadabi, A., Aldhafri, S., Alkharusi, H., Al-Harthy, I., AlBarashdi, H., & Alrajhi, M. (2019). Psychometric Assessment And Cross-Cultural Adaptation Of The Grit-S Scale Among Omani And American Universities’ Students. European Journal of Educational Research, 8(4), 1175-1191. https://doi.org/10.12973/eu-jer.8.4.1175

Harvard
Alhadabi A., Aldhafri S., Alkharusi H., Al-Harthy I., AlBarashdi H., and Alrajhi M. 2019 'Psychometric Assessment And Cross-Cultural Adaptation Of The Grit-S Scale Among Omani And American Universities’ Students', European Journal of Educational Research, 8(4), pp. 1175-1191.
Chicago 16th edition
Alhadabi Amal, Aldhafri Said, Alkharusi Hussain, Al-Harthy Ibrahim, AlBarashdi Hafidha, and Alrajhi Marwa. "Psychometric Assessment And Cross-Cultural Adaptation Of The Grit-S Scale Among Omani And American Universities’ Students," European Journal of Educational Research 8, no. 4 (2019): 1175-1191. https://doi.org/10.12973/eu-jer.8.4.1175

Abstract

The current study aimed to adopt and assess the psychometric properties and measurement invariance of Grit-S among Omani and American students (N = 487) using Exploratory Factor Analysis (EFA) and Multi-Group Confirmatory Factor Analysis (CFA). The scale’s construct validity was estimated by investigating its associations with achievement goal orientations (AGOs). EFA results suggested that a two-factor solution (i.e., perseverance of effort [G_PE] and consistency of interest [G_CI]) was the best factorial structure, explaining 47.74% and 51.02% of the variance in the Omani and American samples, respectively. The factors had good reliability coefficients in the two samples. Related to the intercultural differences, G_PE explained more variance among Omanis (31.02%) relative to American sample, whereas G_CI explained a larger proportion of variance among Americans (36.86%) compared with Omani sample. The first level of measurement invariance, configural invariance, was not supported, necessitating the investigation of the other levels of measurement invariance using a new sample. Grit correlated positively with mastery and performance-approach goals (r = .29 and .12, respectively) and negatively with avoidance goals (r = -.25), supporting the scale’s construct validity. These findings showed that Grit-S scale can be used as valid and reliable assessment tool to assess student interest and perseverance in the academic context in Arabic/Omani and American cultures.

Keywords: Grit, psychometric properties, achievement goal orientations, cross-cultural study.


References

Adesope, O., Gress, C., & Nesbit, J. (2008, May). Validating the psychometric properties of Achievement Goal Questionnaire using Item Response Theory. Paper presented at the Annual Meeting of the Canadian Society for the Study of Education, Vancouver, Canada.

Akin, A., Abaci, R., Arici, N., Uysal, R., & Uysal, C. (2011, September). Revised grit scale: The validity and reliability study. Paper presented at the National Education Symposium, Burdur, Turkey.

Akin, A., & Arslan, S.  (2014). The relationships between achievement goal orientations and grit. Education and Science Tedmem, 39(175), 267-274.

AL-Baddareen, G., Ghaith, S., & Akour, M. (2015). Self-efficacy, achievement goals, and metacognition as predicators of academic motivation. Procedia - Social and Behavioral Sciences, 191(27), 2068-2073. doi:10.1016/j.sbspro.2015.04.345

Al-Harthy, I. (2016). Contemporary motivation learning theories: A review. International Journal of Learning Management Systems, 4(2), 1-6. doi:10.18576/ijlms/040205.

Al-Harthy, I. & Was, C. (2013). Knowledge monitoring, goal orientation, self-efficacy, and academic performance: A path analysis. Journal of College Teaching & Learning, 10(4), 263- 277.

Arouty, D. (2015). Does character matter? The role of grit and resilience in predicting academic success (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No: 3734780)

Arslan, S., Akin, A., & Citemel, N.  (2013). The predictive role of grit on metacognition in Turkish university students. Studia Psychological, 55(4), 311-320.

Bodmann, S. (2008). Achievement goal systems: Implications for research and educational policy (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No: 334849)

Brannen, M. (2009). Culture in context: New theorizing for today’s complex cultural organizations. In Nakata, C. (Ed.), Beyond Hofstede: Culture frameworks for global marketing and management (pp. 81-100). New York, NY: Palgrave Macmillan.

Burisch, M. (1984). You don't always get what you pay for: Measuring depression with short and simple versus long and sophisticated scales. Journal of Research in Personality, 18(1), 81-98. doi:10.1016/0092-6566(84)90040-0

Buttle, F. (1996). SERVQUAL: Review, critique, research agenda. European Journal of Marketing, 30(1), 8-32. doi:10.1108/03090569610105762

Costello A., & Osborne, J. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1-9.

Crocker, L., & Algina, J. (2008). Introduction to classical & modern test theory (2nd ed.). Independence, KY: Cengage Learning.

Chang, W. (2014). Grit and academic performance: Is being gritter better? (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No: 3681407)

Datu, J., Valdez, J., & King, R. (2016). Perseverance counts but consistency does not! Validating the short grit scale in a collectivist setting. Current Psychology, 35(1), 121-130.

Duckworth, A., Peterson, C., Matthews, M., & Kelly, D. (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92(6), 1087-1101. 

Duckworth, A., & Quinn, P. (2009). Development and validation of the short grit scale (Grit-S). Journal of Personality Assessment, 91(2), 166-174. doi:10.1080/00223890802634290

Duff, A. (2004). Understanding academic performance and progression of first-year-accounting and business economics undergraduates: The role of approaches to learning and prior academic achievement. Accounting Education, 13(4), 409–430. doi:10.1080/0963928042000306800

Dull, R., Schleifer, L., & McMillan, J. (2015). Achievement goal theory: The relationship of accounting students’ goal orientations with self-efficacy, anxiety, and achievement. Accounting Education, 24(2), 152-174. doi:10.1080/09639284.2015.1036892

Dweck, C., & Leggett, E. (1988). A social-cognitive approach to motivation and personality. Psychological Review, 95(2), 256-273.

Elliot, A. (1999). Approach and avoidance motivation and achievement goals. Educational Psychologist, 34(3), 169-189.

Elliot, A., & Church, M. (1997). A hierarchical model of approach and avoidance achievement motivation. Journal of Personality and Social Psychology, 72(1), 218-232.

Elliot, A., & Murayama, K. (2008). On the measurement of achievement goals: Critique, illustration, and application. Journal of Educational Psychology, 100(3), 613-628.  doi:10.1037/0022-0663.100.3.613

Eskreis-Winkler, L., Shulman, E., Beal, S., & Duckworth, A. (2014). The grit effect: Predicting retention in the military, the workplace, school and marriage. Frontiers in Personality Science and Individual Differences, 5(36), 1–12.

Field, A. (2009). Discovering statistics using SPSS. London, UK: SAGE Publications.

Fillmore, E. (2015). Grit and beliefs about intelligence: The relationship and role these factors play in the self-regulatory process involved in medical students learning across anatomy (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No: 3703778)

Fleckenstein, J., Schmidt, F., & Moller, J.  (2014). Who’s got grit? Perseverance and consistency of interest in preservice teacher: A German adaptation of the 12-Item Grit Scale. Psychology Education and Teaching / Psychologiein Erziehung und Unterricht, 61(4), 281-286.

Gorman, R. (2015). An examination of academic grit in urban high schools (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No: 10029744).

Gorodnichenko, Y., & Roland, G. (2012). Understanding the individualism-collectivism cleavage and its effects: Lessons from cultural psychology. In M. Aoki, T. Kuran & G. Roland (Eds.), Institutions and comparative economic development (pp. 213-236). New York, NY: St. Martin's Press.

Guerrero, L., Chung, P., Dosanjh, K., & Wong, M.  (2016). Grit: A potential protective factor against substance use and other risk behaviors among Latino adolescents and self-control as predictors of first-year student success. Academic Pediatrics, 16(3), 275-281.

Hambleton, R. (2005). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R. K. Hambleton, P. F. Merenda & C. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 3-38). Mahwah, NJ: Lawrence Erlbaum Publishers.

Havewala, M. (2012). The effects of perceived parenting styles on psychopathology, attachment, self-esteem and grit in American and Indian students (Master thesis). Available from ProQuest Dissertations and Theses database (UMI No. 1531065).

Hofstede, G. (2001). Culture’s consequences: Comparing values, behaviors, institutions and organizations across nations. Thousand Oaks, CA: Sage.

Hofstede Insight (2017, November 1). National culture. Retrieved from https://www.hofstede-insights.com/models/national-culture.

Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55.  doi:10.1080/10705519909540118

Huang, C. (2016). Achievement goals and self-efficacy: A meta-analysis. Educational Research Review, 19(1), 119-137. doi:10.1016/j.edurev.2016.07.002

International Test Commission. (2017). The ITC guidelines for translating and adapting tests (2nd ed.). Retrieved from https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdf

Kannangara, C., Allen, R., Waugh, G., Nahar, N., Khan, S., Rogerson, S., & Carson, J. (2018). All that glitters is not grit: Three studies of grit in university students. Frontiers in Psychology, 9(1), 1-9. doi:10.3389/fpsyg.2018.01539

Kleiman, E., Adams, L., Kashdan, T., & Riskind, J. (2013). Gratitude and grit indirectly reduce risk of suicidal ideations by enhancing meaning in life: Evidence for a mediated moderation model. Journal of Research in Personality, 47(5), 539–546

Kremelberg, D. (2009). Practical statistics. Thousand Oaks, CA: SAGE Publications Inc.

Lau, K., & Lee, J. (2008). Validation of a Chinese achievement goal orientation questionnaire. British Journal of Educational Psychology, 78(2), 331-353.

Linnenbrink-Garcia, L., Middleton, M., Ciani, K., Easter, M., Keefe, P., & Zusho, A. (2012). The strength of the relation between performance-approach and performance-avoidance goal orientations: Theoretical, methodological, and instructional implications. Educational Psychologist, 47(4), 281-301. doi:10.1080/00461520.2012.722515

Luo, W., Paris, S., Hogan, D., & Luo, Z. (2011). Do performance goals promote learning? A pattern analysis of Singapore students' achievement goals. Contemporary Educational Psychology, 36(2), 165-176. doi: 10.1016/j.cedpsych.2011.02.003.

McGahee, T., & Ball, J. (2009). How to read and really use an item analysis. Nurse Educator, 34(4), 166-171.

Milfont, T., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111-121.

Nakata, C. (2009). Beyond Hofstede: culture frameworks for global marketing and management. New York, NY: Palgrave Macmillan.

Niemivirta, M. (2002). Motivation and performance in context: The influence of goal orientations and instructional setting on situational appraisals and task performance. Psychologia, 45(4), 250-270. doi:10.2117/psysoc.2002.250

Nishikawa, K., Okugami, S., & Amemiya, T.  (2016). Development of the Japanese Short Grit Scale (Grit-S). The Japanese Journal of Personality Assessment, 24(2), 167-169

Office of Educational Assessment (2019). Understanding item analyses. Retrieved from https://www.washington.edu/assessment/scanning-scoring/scoring/reports/item-analysis/ 

Patil, V., Singh, S., Mishra, S., & Donovan, D. (2008). Efficient theory development and factor retention criteria: Abandon the 'eigenvalue greater than one' criterion. Journal of Business Research, 61(2), 162-170. 

Pett, M., Lackey, N., & Sullivan, J. (2003). Making sense of factor analysis: The use of factor analysis for instrument development in health care research. Thousand Oaks, CA: Sage Publications, Inc.

Pintrich, P. (2000). An achievement goal theory perspective on issues in motivation terminology, theory, and research. Contemporary Educational Psychology, 25(1), 92–104. doi:10.1006/ceps.1999.1017

Putnick, D., & Bornstein, M. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41(1), 71–90. doi:10.1016/j.dr.2016.06.004

Ranellucci, J., Hall, N., & Goetz, T. (2015). Achievement goals, emotions, learning, and performance: A process model. Motivation Science, 1(2), 98-120.

Reed, J.  (2014). A Survey of grit and exercise behavior. Journal of Sport Behavior, 37(4), 390-406.

Salles, A., Cohen, G., & Mueller, C. (2014). The relationship between grit and resident well-being. The American Journal of Surgery, 207(2), 251-254.

Schumacker, R., & Lomax, R. (2016). A beginner’s guide to structural equation modeling (4th ed.). New York, NY: Taylor & Francis Groups.

Soyer, M., & Kirikkanat, B. (2019). Undergraduates’ achievement goal orientations, academic self-efficacy and hope as the predictors of their learning approaches. European Journal of Educational Research, 8(1), 99-106. doi:10.12973/eu-jer.8.1.99

Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Washington, DC: American Psychological Association.

Ting-Toomey, S., & Chung, L. (2012). Understanding intercultural communication. Oxford, NY: Oxford University Press.

Uyar, R., Genc, M., & Yasar, M. (2018). Prospective preschool teachers’ academic achievements depending on their goal orientations, critical thinking dispositions and self-regulation skills. European Journal of Educational Research, 7(3), 601-613. doi:10.12973/eu-jer.7.3.601

Wolter, C., & Hussain, M. (2015). Investigating grit and its relations with college students' self-regulated learning and academic achievement. Springer Science & Business Media, 10(3), 293-311.