Fundamentals of Program Evaluation familiarizes learners in different types of program evaluation, needs assessment, formative research, process evaluation, monitoring of outputs and outcomes, impact assessment, and cost analysis. Learners gain practical experience through a series of exercises involving the design of a conceptual framework, development of indicators and development of an evaluation plan to measure impact. The course is completely online with real-time interactive lectures, assignments, and pre-readings.
Course delivered by Professor Samar Ahmed:
Professor Samar Ahmed, MSc, MD, JMHPE is the Director at Ain Shams Middle East North Africa FAIMER Regional Institute for Health Professions Education. Chair of the Centre of excellence in Forensic Psychiatric Research at Ainshams University. Associate Professor in the Department of Forensic Medicine and Toxicology at Ain Shams University. Certified UNESCO Trainer Ain Shams University Faculty of Medicine. Director Quality assurance unit ASU-FOM. Global commercial adviser to Universities and medical schools. Professor Samar Ahmed has tremendous leadership and execution skills that enable her to lead people in integrated projects. She understands what it takes to deliver and supports people perform to their best ability. She has a well-developed capacity to communicate with different cultures and to establish partnerships for education development.
The course provides a framework to assess educational and service initiatives and create evaluation documents to follow-up on their achievements and where possible to publish their work progress in educational initiatives.
By the end of this course, learners will be able to:
1. Explain the major concepts in program evaluation:
- Types of evaluation and their purpose
- Levels of measurement: population-based vs. program-based
- Sources of data
2. Conduct a mock program evaluation:
- Design of a conceptual framework
- Develop objectives and indicators
- Design a focus group
- Pretest of a communication
- Use of participatory evaluation techniques
3. Develop an evaluation plan
Topics to cover in each section are as follows:
- Defining the problem and describing the intervention
- Development of indicators
- Process evaluation
- Summative evaluation
Note: the evaluation plan will be designed on a learner selected intervention/program.
- Overview of evaluation concepts lecture.
- Developing a conceptual framework and introduction to formative research lecture.
- Communication pretesting, needs assessment: An overview lecture.
- Development of indicators and participatory evaluation methods lecture; Assignment 1 due.
- Process evaluation lecture.
- Monitoring outputs and outcomes lecture.
- Using qualitative methods for monitoring and evaluation lecture.
- Cost effectiveness analysis lecture.
- Monitoring and evaluation in action panel discussion.
- Submit final paper Assignment 4 due.
Assessment/ Course Requirements:
Each learner will prepare an evaluation plan to fulfill the requirements for this class. The plan will contain four parts, each of which represents a separate assignment counting 25% toward the final grade.
Assignment 1: Defining the Problem and Describing the Intervention
Purpose: Develop the skill of presenting a program or project from an evaluation perspective.
Topics to cover:
1. Background on the public health problem
2. Objectives of the program (project)
3. Description of the intervention intended to achieve the objectives
4. Design of a conceptual framework that shows how the intervention is expected to achieve the objectives.
Assignment 2: Development of Indicators
Purpose: Translate the concepts from your conceptual framework (assignment #1) into measurable indicators.
Assignment 3: Process Evaluation
Purpose: Familiarize students will the importance of conducting process evaluation and a wide-range of quantitative and qualitative methodologies used to this end.
Topics to cover:
1. Objectives of process evaluation (in general terms)
2. Summary description of two proposed methodologies
3. Quantitative methodology
Assignment 4: Summative Evaluation to Measure Program Impact.
Purpose: To test your understanding of issues related to study design, including threats validity, in relation to the evaluation of an actual field program (the Baltimore TB Control program or Stop AIDS Love Life).
Topics to cover:
1. Purpose of summative evaluation (in general terms)
2. Objectives of the selected program (reiterate from previous assignments)
3. Identify one indicator (each) relevant to the selected program to measure