'psychometric validation' Search Results
Test Anxiety: Do Gender and School-Level Matter?
test anxiety gender differences school year levels primary school middle school...
The study investigated differences in students’ reported overall test anxiety before, during, or after test taking among two school-levels and gender. Differences among three test anxiety components (thoughts, off-task behaviors, and autonomic reactions) were also examined. Participants were 725 primary (349 females, 376 males) and 375 middle (180 females, 195 males) school students from a metropolitan city in Turkey. Turkish students’ reported overall test anxiety declined from primary to middle school, with females showing higher test anxiety throughout school years. Whereas students rated thoughts high, autonomic reactions were rated low; followed by off-task behaviors. Female and male students did not differ in thoughts and autonomic reactions. School-level differences were found in off-task behaviors and autonomic reactions. The pattern of Turkish students’ overall test anxiety derived as a combination of thoughts, off-task behaviors, and autonomic reactions was discussed, and educational implications were offered.
13
Psychometric Properties of Adaptation of the Social Efficacy and Outcome Expectations Scale to Turkish
social efficacy and outcome expectations scale validity reliability; turkish university students...
The aim of this study was to examine the psychometric properties of the Social Efficacy and Outcome Expectations Scale (SEOES) on Turkish. The sample group included two groups of university students (ns= 440, 359). The validity of the scale was assessed using exploratory factor analysis, confirmatory factor analysis and concurrent validity, and the reliability was assessed using Cronbach Alpha’s internal consistency coefficient, test-retest method and item discrimination. The findings obtained from the exploratory factor analysis showed that 51.2 percent of total variance of the scale was explained and the scale consisted of two sub-dimensions like the original one. Confirmatory factor analysis indicated an acceptable fit to the data. The concurrent validity of the SEOES was respectively studied using (.65) Scale of Perceived Social Self-Efficacy; (.29) Satisfaction With Life Scale; and (-.36) UCLA Loneliness Scale. As for the scale’s reliability, the internal consistency was determined to be .91; .92 for Social Efficacy Scale; and .81 for Outcome Expectations Scale. The results of test-retest result (.90) and the findings of item analysis showed that the items in Turkish version of the scales were compatible with the original one. The present results provide evidence supporting the validity and reliability Turkish version of the SEOES.
9
Investigation of the 5th Grade Students’ Engagements in Mathematics Course towards Student Opinions
maths secondary school cognitive engagement social engagement emotional engagement...
The research was conducted to determine the opinions of students (10-11 years) on their engagement to mathematics course. These students are 5th grade students at a secondary school in Turkey. Qualitative research method was used in the research. At the study, designed as case study, a total of seven secondary school students were participated the research. The study group was constituted with “snowball sampling” technique of purposeful sampling methods. The data was collected by a semi-structured interview form. Sixteen-page interviews obtained from the interviews were transferred to the computer. Data analysis was performed in content analysis. Codes were listed as a result of analysis. Common themes were constituted from the codes. As a result of the research, three themes, (cognitive, social and emotional engagement) eleven sub-themes and eighty nine codes were determined. It was seen that the students’ most preferred superficial strategies in terms of cognitive engagement; negative opinions towards group work in terms of social engagement; value given to math course in terms of emotional engagement. Students preferred least getting support sub-theme in terms of cognitive engagement; competitive sub-theme in terms of social engagement; value to the mathematics teacher sub-theme in terms of emotional engagement.
Psychometric Assessment and Cross-Cultural Adaptation of the Grit-S Scale among Omani and American Universities’ Students
grit psychometric properties achievement goal orientations cross-cultural study...
The current study aimed to adopt and assess the psychometric properties and measurement invariance of Grit-S among Omani and American students (N = 487) using Exploratory Factor Analysis (EFA) and Multi-Group Confirmatory Factor Analysis (CFA). The scale’s construct validity was estimated by investigating its associations with achievement goal orientations (AGOs). EFA results suggested that a two-factor solution (i.e., perseverance of effort [G_PE] and consistency of interest [G_CI]) was the best factorial structure, explaining 47.74% and 51.02% of the variance in the Omani and American samples, respectively. The factors had good reliability coefficients in the two samples. Related to the intercultural differences, G_PE explained more variance among Omanis (31.02%) relative to American sample, whereas G_CI explained a larger proportion of variance among Americans (36.86%) compared with Omani sample. The first level of measurement invariance, configural invariance, was not supported, necessitating the investigation of the other levels of measurement invariance using a new sample. Grit correlated positively with mastery and performance-approach goals (r = .29 and .12, respectively) and negatively with avoidance goals (r = -.25), supporting the scale’s construct validity. These findings showed that Grit-S scale can be used as valid and reliable assessment tool to assess student interest and perseverance in the academic context in Arabic/Omani and American cultures.
Development of Interpersonal Mindfulness Scale-TR (IMS-TR): Validity and Reliability
mindfulness interpersonal mindfulness validity analysis reliability analysis mindfulness scale...
The purpose of this study is to develop an Interpersonal Mindfulness Scale-TR (IMS-TR) for Turkish culture. For the data collection process, four different sample groups participated in the study. To test the construct validity of the scale an exploratory factor analysis was performed. Results suggested a 13-item, two-factor solution as (1) awareness and (2) being in the moment. Two-factor structure explains 50.65% of the variance. A confirmatory factor analysis results showed good fit for two-factor solution. The Mindfulness in Parenting Questionnaire and the Mindfulness in Marriage Scale were used to examine a convergent validity and positive significant relationships were found between the scales. To test the reliability of the scale Cronbach's Alpha reliability coefficient of the overall scale was determined to be .826. To determine the stability coefficient of the IMS-TR, test-retest method was used and according to result there is a positive relationship between the scales. According to all of these results, it can be said that the IMS-TR has a validity and reliability.
Psychometric and Structural Evaluation of the Physics Metacognition Inventory Instrument
psychometric evaluation physics metacognition inventory problem solving...
The purpose of this study is to evaluate the psychometric and structural instruments of the Physics Metacognition Inventory (PMI) developed by Taasoobshirazi, Bailey, and Farley (2015). The PMI consists of 26 items in six factors. The English and Indonesian versions were tested on an English course (N = 37) in the Geophysics study program at Tadulako University. The trials were conducted separately within a two-week interval. The data collected from 364 students of the Physics Education Department, University of Tadulako were analyzed using the Exploratory Factor Analysis (EFA). Later, data were collected from 351 students of some Indonesian universities which have physics education study programs, and the data were analyzed using the Confirmatory Factor Analysis (CFA). The EFA result reveals six factors based on the rotation result with the maximum loading factor. The CFA result shows the RMSEA values of .018, 2 (284) = 316.32 (χ2 / df = 1,11), GFI = .93, CFI = .99, AGFI = .92 and NFI = .93 which meet the cut-off statistic value, and therefore, the model is considered fit, with the Construct Reliability Estimation (CR) of .93, Composite Reliability of = .95, and maximum reliability of Ω = .96. The results obtained reveal that the PMI scale has good, valid and reliable psychometric properties. Therefore, PMI can be used to measure the level of metacognition of students when solving physics problems. Future studies using PMI are also discussed.
An Explanation of Happiness with Secure Attachment, Basic Psychological Needs and Hope: The Case of Turkish University Students
happiness hope psychological needs attachment university students...
In this study we aimed to investigate the role of hope, secure attachment with the parents, and satisfaction levels of the basic psychological needs (autonomy, competence and relatedness) of university students in predicting their happiness levels. A total of 558 university students were recruited and 70% of them were female and 30% of them were male. Ages of the participants ranged from 18 to 29. The data were collected in classroom settings using personal information form, the Oxford Happiness Scale, the Attachment with the Parents Scale, the Basic Psychological Needs Scale, and the Dispositional Hope Scale. Results indicated that that the satisfaction levels of the competence needs were the most powerful predictor of happiness among university students. The satisfaction levels of autonomy, relatedness needs, and a secure attachment to the father, along with hope contributed little to the explanation of happiness; whereas, a secure attachment to the mother was not a predictor of happiness of the university students. The findings were discussed within the framework of the developmental characteristics of university students and the characteristics of collectivist societies.
The Spanish Version of the Teacher Efficacy for Inclusive Practice (TEIP) Scale: Adaptation and Psychometric Properties
teacher efficacy for inclusion teip scale spanish adaptation cross-validation studies preservice teacher education...
The Teacher Efficacy for Inclusive Practice (TEIP) scale is an instrument created by Sharma et al. to assess efficacy of instruction in inclusive settings. Despite its increase in use, the TEIP has not been validated with a Spanish teacher population. The aim of this study was to: (1) analyze the psychometric properties and factor structure of the TEIP scale in a sample of Spanish preservice teachers (N = 475; 80% female, 20% male), and (2) examine the level of self-efficacy for inclusive practices that teachers experience when they graduate from their training programs. Exploratory and confirmatory factor analyses indicate that a Spanish version (TEIP-ES) consisting of 15 items with a three-factor construct explains 61.34 percent of total variance. Item total-correlations ranged from .488 to .778, and factor loadings from .590 to .790. Convergent validity with measures of quality of teacher education (TE) programs and self-report of preparedness to teach in inclusive settings was good. In contrast, self-efficacy for inclusive practices was rated moderately low. Overall, these findings support the construct and convergent validity of the TEIP-ES and suggest that it is a useful instrument to measure self-efficacy for inclusion in Spanish preservice teacher populations. This manuscript reports the findings, discusses the implications for the improvement of TE programs, and suggests possible avenues for future related research.
Development and Psychometric Assessment of the Social Media Motives Scale among University Students
social media self-actualization self-enhancement motives scale development and validation...
Social media (SM) use is a rapidly growing phenomenon among Millennials. Thus, a growing body of studies have explored the beneficial applications and negative consequences of their use in an increasingly virtual world. The current study aimed to develop and validate a scale that measures university students’ motives for using SM from a psychological and social perspective. In Study 1 (N = 316), the psychometric properties of SM motives were examined. The estimated factorial structure was validated in Study 2 (N = 200). The Study 1 results showed two active personal motives scales (i.e., self-actualization and purposive motives), one passive motive scale (i.e., enjoyment), one active contextual motive scale (i.e., self-enhancement), and a contextual (neither active nor passive) motive scale (i.e., a factor of convenience). Study 2 findings confirmed this factorial structure. Construct validity was supported with significant differences between three types of users (i.e., productive, consuming, and disinterested) on their motives (151 words).
Motivation and Learning Strategies: Student Motivation Affects Student Learning Strategies
learning strategies metacognition motivation self-regulated learning student...
Despite being a popular research subject internationally, self-regulated learning is relatively under-investigated in the Indonesian context. This article examined student learning motivation and its use as an indicator to predict student learning strategies in an Indonesian school context. This article applied quantitative research design, with Motivated Strategies for Learning Questionnaire (MSLQ) used to collect the data. This questionnaire was completed by 408 public high secondary students randomly selected from the population in Lampung Province schools, and multiple regression was used to analyze the obtained data. Results show that student motivation and learning strategies were positively and significantly correlated; three predictor variables of student motivation could significantly predict learning strategies; and value components of student motivation best predicted learning strategies. In conclusion, these findings indicate that, when teachers apply learning strategies, such variables as motivation including value, expectancy, and affective components should be strongly considered to be in place. It is hoped finally that the students will be self-regulated learners for their success.
A Critical Thinking Assessment Model Integrated with Science Process Skills on Chemistry for Senior High School
assessment model critical thinking science process skills...
Every school should be able to equip students to have the ability to integrate the knowledge gained with real life in responding to global challenges. Assessment of learning outcomes in the form of cognitive and skill aspects must go hand in hand. This study aims to produce: (1) a critical thinking model integrated with the science process, (2) construct validity and reliability instruments that measure the integrated critical thinking skills of science process skills in high school chemistry learning. This assessment model uses the Design and Development approach which refers to the Ellis & Levy model, namely: (1) problem (2) goal setting, (3) model design and development, (4) model testing, (5) evaluation of the test result model, and (6) application model. The validity assessment consisted of 3 measurement and measurement experts, 2 chemistry education experts, and 2 treatments. The trial sample described 289 high school students in Sleman Regency. Proving the validity of the content using the Aiken formula gets a value of 0.923 in the good category. Internal instrument reliability is included in the reliable category with a value of 0.886 (> 0.7), while the Composite Reliability ranges from 0.88 to 0.90. Confirmatory factor analysis showed that the value of the Root Mean Square Error of Approximation (RMSEA) was 0.021 <0.08, the Chi-Square obtained from <2df testing was 38.29 <2 (34) and the Goodness of fit Index (GFI) was 0.97. > 0.90 or a model declared according to the data obtained in the field and can be used in extensive measurements.
Adaptation of the Epistemological Belief Scale to Kosovo
epistemological beliefs epistemological beliefs scale scale adaptation linguistic validity...
The investigation of epistemological beliefs has become important in both pre-service and in-service education of teachers. Different scales have been developed to determine teachers’ epistemological beliefs. The same scale yields different results in different cultures especially due to the cultural aspects of education. Therefore, testing the scales in different cultures contributes to their use. Within this framework, the scale developed by Schommer and adapted to Turkish culture by Deryakulu and Büyüköztürk was adapted to Kosovo culture. In the study, whether the Albanian, Bosnian and Turkish versions of the scale support the same factor structure was tested by employing the quantitative research method. First, the Epistemological Belief Scale was translated into Albanian and Bosnian and expert opinion was received. The scale was applied to 200 teachers who serve in schools where education languages are Albanian, Bosnian and Turkish. The scale comprised 35 items and 3 factors. Linguistic equivalence was prioritized, as the study was carried out in Kosovo. The Confirmatory Factor Analysis was employed to confirm the suitability of the three-factor structure of the scale. The analyses were carried out separately for each language and revealed acceptable fit indices. Reliability analysis produced satisfactory results.
Strategies for Parental Involvement during Emergency Remote Teaching Scale: Its Psychometric Properties
emergency remote teaching home and school collaboration parental involvement epstein's typology...
Recently, Emergency Remote Teaching (ERT) has caused a considerable interest in the school community due to the wide-scale lockdown brought about by the COVID-19 pandemic. The curriculum's alteration necessitated a call to explore mechanisms for effective remote instruction delivery—including parental involvement. This research determined the psychometric properties of the "Strategies for Parental Involvement during Emergency Remote Teaching - Scale (SPIERT-S). The tool assesses the strategies used by teachers to facilitate parental involvement during ERT. Through a thorough literature review, 22 items about home and school collaboration and ERT were initially developed. Evidence related to content validity was established through two-round expert consultation, while data related to construct validity were gathered through factor analyses. The content validity analysis resulted in the deletion of four (4) items; hence, 18 items were retained. A three-factor structure was yielded from Exploratory Factor Analysis (parents as facilitators of learning, parents as sources of information, and parents as collaborators), and a total of 15 items were retained. The confirmatory factor analysis indicated an acceptable level of the goodness-of-fit indices measured. The internal consistency of the factors and the whole scale showed excellent reliability. The results suggest that the SPIERT-S has good, valid, and reliable psychometric qualities and can be used to examine the strategies for parental involvement that teachers utilize during emergency remote teaching. Recommendations and limitations of the study are discussed.
Fostering Artistic Reflection Skills in Student Pre-School Educators Seen as Artistic Competence Development
artistic reflection higher education student pre-school educators technology of artistic reflection and image creation...
The purpose of the study is to identify how the instructional model influences students’ reflective disposition and how the students perceived the intervention. The study addressed the research questions through the ‘Artistic Reflection Scale’ for student pre-school educators that consisted of four domains such as students’ observation skills, critical analysis skills, evaluation skills, and the occupation application of artistic reflection, and the course satisfaction questionnaire. The study found that the technology of artistic reflection and image creation was effective in fostering students’ artistic reflective thinking comprising observation skills, critical analysis, their art output evaluation skills with a focus on sharing their reflective experience with the preschoolers. The artistic reflection scale was proved to be a reliable instrument in measuring students’ reflective thinking skills. The study found a change in the artistic reflective skills of the experimental group students was substantially greater than in the students of the control group. After the intervention, there was a shift from the basic level of artistic reflection to the higher levels in the experimental group students, and the proportion of the students being at this stage reduced, while the other proportions increased.
Assessment of the Validity and Reliability of Mental Health Instruments of High School Student in Indonesia
validity reliability mental health item measurement adolescence indonesia...
This study aims to develop a standard instrument for measuring mental health among urban adolescents in Indonesia. The objective is to produce valid and reliable school adolescent mental health instruments to be used by agencies or schools to identify students' mental health. The survey was conducted in Jakarta and South Tangerang with a total of 1007 respondents divided into two experiments where the first trial was conducted on 597 students and the second trial was conducted on 410 students. Measurements were made using a Likert scale questionnaire. Instrument testing begins with a theoretical validity test by 4 experts and 20 panelists who test the instrument material in terms of construction, content and language. Experts analyze and correct the instrument qualitatively. The instrument was then reviewed and analyzed quantitatively by panelists using the Aiken index. At this stage, 44 items, 9 indicators and 3 variable dimensions were obtained. The next test is done by testing the validity empirically, by analyzing the measurement model using Confirmatory Factor Analysis (CFA) with the LISREL 8.80 Full Version program. By using the criteria for the SLF value ≥0.30 and t-value ≥1.96, and calculating the reliability with the construct reliability (CR) at the level> 0.70, the results of the second trial showed that 35 items were valid. The observations of the model fitness through Goodness-of-Fit test showed that there is a fitness between the theoretical model and the empirical model for the mental health instruments in this study.
A Rasch Model Analysis of the Psychometric Properties of the Student-Teacher Relationship Scale among Middle School Students
student-teacher relationship psychometric properties rasch analysis adolescents middle and high school...
The current study investigated Student-Teacher Relationship Measure (STRM) psychometric properties using Rasch analysis in a sample of middle school female students (N = 995). Rasch Principal Components Analysis revealed psychometric support of two subscales (i.e., Academic and Social Relations). Summary statistics showed good psychometric properties. The category structure and individual statistics (i.e., items and person infit and outfit) were not ideal. Category structure showed that the distances between adjacent thresholds were lower than optimal criteria. Even though findings indicated that items mean square statistics (MNSQ) were optimal, standardized fit statistics (i.e., ZSTD) reflected many misfit persons and items in each subscale. After eliminating the misfit persons and items, the two subscales met the Rasch optimal criteria. The updated short 22-item scale had good psychometric properties, high item and person separation, and good item and person reliability for the two subscales and can be used as a reliable and valid scale.
Adaptation and Evaluation of Psychometric Properties of Students’ Approaches to Learning in a Sample of Mexican High School Students
approaches to learning high school students learning scale...
The reason of to be of any educational model is to ensure that its students are self-regulated, which implies the setting of objectives, the monitoring of their actions in order to reach them, the control of their cognitive processes, the use of diverse learning and motivation skills. One way to collaborate in this is to evaluate the student's current situation in order to intervene. Due to the above, the purpose of the study is to determine validity and reliability of the scale Students’ Approaches to Learning (SAL) in Mexican students. The SAL was applied to 894 high school students. Considering the results, the SAL presents good functioning and acceptable psychometric properties. In relation to the internal structure, the results support the composition of the 14 sub-factors of SAL, which is consistent with the original study. The results obtained have enough empirical support to interpret the construct of learning approaches from a multidimensional point of view.
Exploring the Multicomponent Structure of Acceptance Attitudes in Portuguese Children Using the Modified Chedoke-McMaster Attitudes toward Children with Handicaps scale
children with disabilities attitudes catch confirmatory factor analysis measurement invariance...
Social participation represent one of the major outcomes of inclusive education. Students with additional support needs often encountered negative attitudes of social acceptance exhibited by their typically developing peers hindering their social participation in the educational context. This study explored the multicomponent structure of Portuguese children’s attitudes toward their peers with disabilities using a modified short form of the Chedoke-McMaster Attitudes toward Children with Handicaps scale (CATCH). In particular, this study aimed to (a) determine the factor structure of the CATCH and (b) evaluate the measurement invariance across age and gender. To identify the CATCH factor structure, exploratory and confirmatory factor analyses were conducted on data collected from 1,038 children aged 8–18 years. Analyses revealed that a modified short form of the CATCH consisting of a 20-item measure with a three-factor structure displayed acceptable fit and internal consistency indices. This model proved to be invariant across groups. The Portuguese-modified short form of the CATCH, in which cognitive, affective, and behavioral dimensions are represented, has acceptable psychometric properties and the potential to evaluate the effectiveness of educational programs designed to improve children’s attitudes.
The Indonesian Version of the Physics Metacognition Inventory: Confirmatory Factor Analysis and Rasch Model
confirmatory factor analysis physics metacognition inventory psychometric evaluation rasch model scale adaptation...
Metacognition inventory supports increased awareness and self-control to improve student’s academic success, including physics. However, there are limitations to revealing the Physics Metacognition Inventory (PMI), especially in Indonesia. This study aims to explore and evaluate the psychometric properties of PMI. This survey research has involved 479 students from three high schools in Indonesia. The psychometric properties of the I-PMI were evaluated using a Confirmatory Factor Analysis and Rasch Model approach. The results show that the Indonesian Physics Metacognition Inventory (I-PMI) is collected in 6 constructs from 26 items. The validity, reliability, and compatibility tests have also been analyzed with good results. The five rating scales used have adequate functionality. This research has also presented more comprehensive information about the Physics Metacognition Inventory in the context of Indonesian culture. This study has implications for using I-PMI to assess students’ metacognition at the high school level in Indonesia and recommendations for future research.
The Development of Historical Thinking Assessment to Examine Students’ Skills in Analyzing the Causality of Historical Events
causality historical events historical thinking skills...
This research aimed to develop a historical thinking assessment for students' skills in analyzing the causality of historical events. The development process of Gall and colleagues and Rasch analysis models were used to develop an assessment instrument consisting of two processes, including the analysis of the framework of cause and consequence, the validity, reliability, and difficultness test. This research involved 150 senior high school students, with data collected using the validation sheet, tests, and scoring rubric. The results were in the form of an essay test consisting of six indicators of analyzing cause and consequence. The instruments were valid, reliable, and suitable for assessing students’ skills in analyzing the causality of historical events. The developed instruments were paired with a historical thinking skills assessment to improve the accuracy of the information about students' level of historical thinking skills in the learning history.