University of Twente Student Theses

Login

Measuring the Impact of the International Fellowships Program (IFP) in the Area of Education: Development of a Valid and Reliable Measurement Instrument

Kone, Assane (2013) Measuring the Impact of the International Fellowships Program (IFP) in the Area of Education: Development of a Valid and Reliable Measurement Instrument.

[img] PDF
1MB
Abstract:This present study was conducted on behalf of the Center for Higher Education Policy Studies (CHEPS) as a pilot study in order to develop a valid and reliable instrument that could measure the impact of the International Fellowships Program (IFP) in the area of education of countries selected in the program. IFP is an educational program that provides fellowships for graduates who lack access to post-graduate education and who are resident of developing countries or territories. The instrument (IFP Ed-instrument) was developed through four steps. In the first step, 11 indicators and 23 variables were pre-selected from literature and interviews conducted with academics and practitioners specialized in the field of education as well as experts in the field of impact assessment. A two rounds Delphi method was used in the second step to evaluate the relevance and measurability of the pre-selected indicators and variables. Evaluations were conducted with experts through mail questionnaires in the first round and through structured interviews in the second round. Content validity indexes (I-CVI) and content validity ratio’s (CVR) were then computed for each of these individual indicators and variable. The content validity of the overall IFP Ed-instrument was estimated in the third step by experts through mail questionnaires. The Fleiss multiple rater kappa was then computed to estimate the degree of agreement between experts during the third step. Following refinement the IFP Ed-instrument was further field tested through mail questionnaires in Senegal in the fourth step. Results of this sudy show that seven indicators and 21 variables are content valid measures of outcomes and impacts of IFP with I-CVI values higher than 0,78 and CVR values higher than 0,75. The developed IFP Ed-instrument was found content valid by consulted expert with a multiple rater Fleiss kappa value of 0,36. It is recommended to further field test the IFP Ed-instrument in triangulation studies in order to establish its construct validity and its reliability.
Item Type:Essay (Master)
Faculty:BMS: Behavioural, Management and Social Sciences
Subject:81 education, teaching
Programme:Educational Science and Technology MSc (60023)
Link to this item:https://purl.utwente.nl/essays/64280
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page