Framework for Avahan programme evaluation
| Evaluation question | Indicator | Data source |
|---|---|---|
| 1. Is coverage of Avahan adequate? | A. Scale | |
| a. Geographical coverage—Description of rollout in number of districts and change in number of implementing NGOs over time | CMIS | |
| b. Proportion of high risk men who have sex with men (HR-MSM)/male-to-female transgenders (TG) ever contacted and ever visited clinic—number of HR-MSM/TG ever contacted by Avahan peer educators or ever visited Avahan programme STI clinics divided by the estimated size of HR-MSM/TG as of March 2009 | CMIS | |
| c. Proportion of HR-MSM/TG contacted monthly by peer educators o r visited programme STI clinics for STI consultations—number of HR-MSM/TG contacted monthly by peer educators or visited programme STI clinics monthly divided by the estimated size of HR-MSM/TG as of March 2009 | CMIS | |
| d. Proportion of HR-MSM/TG contacted in last month—percentage of HR-MSM/TG from IBBA who reported that they had been contacted by Avahan peer educators in the month preceding the survey | IBBA | |
| B. Intensity | ||
| a. Number of peer educator/outreach worker and ratio of HR-MSM/TG to peer educators—the total number of active outreach workers and peer educators in the Avahan intervention areas across implementation districts in Andhra Pradesh; and number of estimated MSM/TG covered per peer educator in the coverage area | CMIS | |
| b. Condom distribution and availability—absolute number of free condoms distributed by Avahan programme annually | CMIS | |
| 2. Has there been an increase in condom use in MSM/TGs? | Change in condom use pattern | |
| a. Proportion of HR-MSM/TGs reporting last time condom use with paying male partners from two rounds of IBBAs | IBBA | |
| b. Proportion of HR-MSM/TGs reporting last time and consistent condom use with paid male/hijra partners from two rounds of IBBAs | IBBA | |
| c. Proportion of HR-MSM/TG reporting last time and consistent condom use with regular male partners from two rounds of IBBAs | IBBA | |
| d. Proportion of HR-MSM/TG reporting last time and consistent condom use with other non-commercial male/hijra partners from two rounds of IBBAs | IBBA | |
| 3. Has there been reduction in STIs and HIV prevalence? | Change in STI prevalence and visits to clinic with STI symptoms | |
| STI prevalence (reactive syphilis serology, high-titer syphilis, Neisseria gonorrhoeae NG), chlamydia (CT) | IBBA | |
| Change in HIV prevalence | ||
| a. HIV prevalence among HR-MSM/TGs aggregated from all districts in two rounds of IBBAs | IBBA | |
| 4. Is Avahan exposure associated with increase in condom use and declining STIs? | Association of programme exposure with intermediate outcomes and STIs | IBBA |
| a. Programme exposures, defined as exposure to any one of ever contacted by peer, ever visited programme clinic and ever received condoms from peer educators. Its association with consistent condom use with commercial and non-commercial partners across two rounds of IBBA | ||
| b. Programme exposure, as defined above, its association with having any STI (NG, CT or high-titre syphilis) |
CMIS,Computerized Management Information System; HR-MSM/TGs,high risk men who have sex with men/transgender; IBBA,integrated biological and behavioural assessment; STI,sexually transmitted infection.