|
Sign In to gain access to subscriptions and/or personal tools.
|
Development and test—retest reliability of a research instrument designed to evaluate school-based HIV/AIDS interventions in South Africa and Tanzania
Wanjir Mkoma
Division of Child and Adolescent Psychiatry, University of Cape Town, Red Cross War Memorial Children's Hospital, South Africa, Adolescent Health Research Institute, University of Cape Town, South Africa
Alan J. Flisher
Division of Child and Adolescent Psychiatry, University of Cape Town, Red Cross War Memorial Children's Hospital, South Africa, alan.flisher{at}uct.ac.za, Adolescent Health Research Institute, University of Cape Town, South Africa, Research Centre for Health Promotion, Faculty of Psychology, University of Bergen, Norway
Arnfinn Helleve
Centre for Prevention of Global Infections, Faculty of Medicine, University of Oslo, Norway
Leif Edvard Aarø
Research Centre for Health Promotion, Faculty of Psychology, University of Bergen, Norway, Division of Mental Health, Norwegian Institute of Public Health, Oslo, Norway
Catherine Mathews
Adolescent Health Research Institute, University of Cape Town, South Africa, Health Systems Research Unit, Medical Research Council, South Africa
Sylvia Kaaya
Department of Psychiatry, Muhimbili University College of Health Sciences, Dar es Salaam, Tanzania
Knut-Inge Klepp
Centre for Prevention of Global Infections, Faculty of Medicine, University of Oslo, Norway
Aims: This article reports on the development and psychometric properties of an instrument to evaluate school-based HIV/ AIDS interventions aimed at adolescents in three African sites. Methods: The instrument was developed in a series of steps that involved a review of existing instruments; use of empirical data and secondary literature supporting an association between the variables of interest and sexual intercourse or condom use; operationalizing the constructs of the theoretical model employed; and using the objectives of the intervention. Test—retest reliability studies were conducted at each site. Results: The questionnaire demonstrated good internal consistency and adequate test—retest reliability. Cronbach's alpha was higher than 0.50 for all the 10 psychosocial scales, while Cohen's kappa showed poor to substantial test—retest reliability on the sexual behaviour items ( = 0.14 to 0.69). Conclusions: We conclude that the instrument had sufficient test—retest reliability and internal consistency.
Key Words: Reliability • evaluation • school • adolescents • HIV/AIDS • Sub-Saharan Africa
References
- Basen-Engquist K., Coyle KK, Parcel GS, Kirby D., Banspach SW, Carvajal SC, Baumler E. Schoolwide effects of a multicomponent HIV, STD, and pregnancy prevention program for high school students. Health Educ Beh 2001; 28:166-85.[CrossRef]
- Coyle KK, Kirby DB, Marin BV, Gomez CA, Gregorich SE Draw the Line/Respect the Line: a randomized trial of a middle school intervention to reduce sexual risk behaviors. Am J Public Health 2004;94:843-51.[Abstract/Free Full Text]
- Gallant M., Maticka-Tyndale E. School-based HIV prevention programmes for African youth. Soc Sci Med 2003;58: 1337-51.[CrossRef][Web of Science]
- Fawole I., Asuzu M., Oduntan S., Bieger W. A school-based AIDS education programme for secondary school students in Nigeria: a review of effectiveness. Health Educ Res 1999; 14:675-83.[Abstract/Free Full Text]
- Harvey B., Stuart J., Swan T. Evaluation of a drama-in-education programme to increase AIDS awareness in South African high schools: a randomized community intervention trial. Int J STD AIDS 2000;11:105-11.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Kirby D. Effective approaches to reducing adolescent unprotected sex, pregnancy, and child-bearing. Int J Sex Res 2002;39:51-7.
- Klepp K.-I, Ndeki SS, Seha AM, Hannan P., Lyimo BA, Msuya MH, et al. AIDS education for primary school children in Tanzania: an evaluation study. AIDS 1994; 8:1157-62.[Web of Science][Medline]
[Order article via Infotrieve]
- Kaaya SF, Mkoma W., Flisher AJ, Klepp K.-I. School-based health interventions in Sub-Saharan Africa. A review. Soc Dynamics 2002;28:64-88.
- Mkoma W., Flisher AJ A systematic review of school-based AIDS prevention programmes in South Africa. In: Klepp K-I, Flisher AJ, Kaaya S. (Eds.). Promoting adolescent sexual and reproductive health in Eastern and Southern Africa. HSRC Press, South Africa. 2008.
- Plummer ML, Ross DA, Wight D., Changalucha J., Mshana G., Wamoyi J., et al. ``A bit more truthful'': the validity of adolescent sexual behaviour data collected in rural northern Tanzania using five methods. Sex Trans Inf 2004; 80:49-56.[Web of Science]
- Flisher AJ, Ziervogel CF, Chalton DO, Leger PH, Robertson BA Risk-taking behaviour of Cape Peninsula high-school students. Part VIII. Sexual behaviour. South African Med J 1993;83:495-7.
- Klepp KI, Ndeki SS, Leshabari MT, Hannan PJ, Lyimo BA AIDS education in Tanzania: promoting risk reduction among primary school children. Am J Public Health 1997; 87:1931-6.[Abstract/Free Full Text]
- Hearn KD, O'Sullivan LF, Dudley CD Assessing reliability of early adolescent girls' reports of romantic and sexual behaviour. Arch Sex Beh 2003;32:513-21.[CrossRef]
- Lintonen T., Ahlström S., Metso AL The reliability of self-reported drinking in adolescence. Alc Alcohol 2004; 39:362-8.[Abstract/Free Full Text]
- Windsor R., Baranowki T., Clark N., Cutter G. Evaluation of health promotion. Health education and disease prevention programs, 2nd edn. California: Mayfield, 1994.
- Aarø LE, Flisher AJ, Kaaya S., Onya H., Fuglesang M., Klepp K.-I. Schaalma H. Promoting sexual and reproductive health in early adolescence in South Africa and Tanzania: development of a theory- and evidence-based intervention programme. Scand J Public Health 2006;34:150-8.[Abstract/Free Full Text]
- Bartholomew LK, Parcel GS, Kok G. Intervention Mapping: a process for developing theory- and evidence-based health education programmes. Health Educ Beh 1998;25:564-8.[CrossRef]
- Bartholomew LK, Parcel GS, Kok G., Gottlieb NH Planning health promotion programs: an intervention mapping approach. San Francisco: Jossey-Bass, 2006.
- Kok G., Schaalma H., Ruiter RAC, van Empelen P. Intervention mapping: a protocol for applying health psychology theory to prevention programmes. J Health Psychol 2004;9:85-98.[Abstract/Free Full Text]
- Schaalma HP, Kok G., Bosker RJ, Parcel GS, Peters L., Poelman J., Reinders J. Planned development and evaluation of AIDS/STD education for secondary school students in The Netherlands: short-term effects. Health Educ Quart 1996;23:469-87.[Web of Science][Medline]
[Order article via Infotrieve]
- Schaalma HP, Kok G., Poelman J., Reinders J. The development of AIDS education for Dutch secondary schools: a systematic approach based on theory, research and cooperation. In: Rutter DR, Quine L, editors. Social psychology and health: European perspectives. Aldershot/Brookfield: Avebury/Ashgate, 1994. pp. 175-94.
- Wight D., Abraham C. From psychosocial theory to sustainable classroom practice: developing a teacher-delivered sex education programme. Health Educ Res 2000;15:25-38.[Abstract/Free Full Text]
- Kirby DB, Baumler E., Coyle KK, Basen-Engquist K., Parcel GS, Harrist R., Banspach SW The ``Safer Choices'' intervention: its impact on the sexual behaviors of different subgroups of high school students. J Adolesc Health 2004; 35:442-52.[Web of Science][Medline]
[Order article via Infotrieve]
- World Health Organization. Global School-based Student Health Survey (GSHS) 2004 Core questionnaire Module Rationale; 2004. http://www.who.int/school_youth_health/media/en/gshs_modules_rationale.pdf
- Vergnani T., Flisher AJ, Blignaut R. Factors affecting condom use by South African adolescents. 14th International AIDS Conference, Barcelona, Spain, 7-12 July 2002.
- Seha AM, Klepp KI, Ndeki SS Scale reliability and construct validity: a pilot study among primary school children in Northern Tanzania. AIDS Education and Prevention 1994;6:524-34.[Web of Science][Medline]
[Order article via Infotrieve]
- Kugler KC, Komro KA, Stigler MH, Mnyika KS, Masatu M., Aastrom AN, Klepp KI The reliability and validity of self-report measures used to evaluate adolescent HIV/AIDS prevention programs in Sub-Saharan Africa. AIDS Education & Prevention 2007;19:365-82.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Mkoma W., Mathews C., Flisher AJ, Seebregts C., Jansen S., Ahmed N., Klepp K-I., et al. Use of electronic questionnaires on handheld devices to evaluate the effects of a school-based HIV prevention programme on adolescent sexual behaviour. International AIDS conference, Bangkok, Thailand, 11-16 July 2004.
- Zwarenstein M., Seebregts CJ, Mathews C., Fairall L., Flisher AJ, Seebregts C., et al., PDACT Working Group. Handheld computers for survey and trial data collection in resource-poor settings: development and evaluation of PDACT, a PalmTM pilot interviewing system. Int J Med Informatics. [In press.].
- Ware JE, Gandek B. Methods for testing data quality, scaling assumptions, and reliability: the IQOLA project approach. J Clin Epidemiol 1998;51:945-52.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Landis JR, Koch GG The measurement of observer agreement for categorical data. Biometrics 1977; 33:159-74.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Bland JM, Altman D. Statistics notes: Cronbach. BMJ 1997;314:572.[Free Full Text]
- Maclure M., Willett WC Misinterpretation and misuse of the kappa statistic. Am J Epidemiol 1987;126:161-9.[Free Full Text]
- Kaaya SF, Flisher AJ, Mbwambo JK, Schaalma H., Aarø LE, Klepp K.-I. A review of studies of sexual behaviour in school students in Sub-Saharan Africa. Scand J Public Health 2002;30:148-60.[Abstract/Free Full Text]
- Flisher AJ, Evans J., Muller M., Lombard C. Test-retest reliability of self-reported adolescent risk behaviour. J Adolesc 2004;27:207-12.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
Scandinavian Journal of Public Health, Vol. 37, No. 2 Suppl,
7-15 (2009)
DOI: 10.1177/1403494809103995
 CiteULike  Complore  Connotea  Del.icio.us  Digg  Reddit  Technorati  Twitter What's this?
This article has been cited by other articles:
|
|
|
|
 
H. Schaalma, L. E. Aaro, A. J. Flisher, C. Mathews, S. Kaaya, H. Onya, A. Ragnarson, and K.-I. Klepp
Correlates of intention to use condoms among Sub-Saharan African youth: The applicability of the theory of planned behaviour
Scand J Public Health,
June 1, 2009;
37(2_suppl):
87 - 91.
[Abstract]
[PDF]
|
|
|
|
|
|
|
F. S. Namisi, A. J. Flisher, S. Overland, S. Bastien, H. Onya, S. Kaaya, and L. E. Aaro
Sociodemographic variations in communication on sexuality and HIV/AIDS with parents, family members and teachers among in-school adolescents: A multi-site study in Tanzania and South Africa
Scand J Public Health,
June 1, 2009;
37(2_suppl):
65 - 74.
[Abstract]
[PDF]
|
|
|
|
|
