Transcript Evaluation and Monitoring of Country

Evaluation and Monitoring of
Country Implementation of Work:
Addressing Common Problems
WHO/UNICEF Technical Briefing Seminar
22 September 2005
Helen Tata
Department of Technical Cooperation for
Essential Drugs and Traditional Medicines
World Health Organization
Why Monitor & Evaluate

Track progress for all activities for the
time period of the POA

Facilitate stringent reporting
requirements and accountability to
donors
Monitoring and Evaluation Tools:
POA Monitoring and Evaluation Monthly Report
Country: Uganda
Responsible Officer: Joseph SERUTOKE, EDM/NPO
ACP
Code
Country Expected
Result/Activity
Country Indicator
POLICY
1.2


Monthly Report (Excel file)
 Report against POA
 Additional activities possible
Monthly Monitoring and
Evaluation Checklist (Word file)
 Report work not in POA, i.e.
staff meetings, studies
participated in, missions
6.2
2.1
2.1
2.3
1. Indicators and tools for
monitoring the NDP adopted
1.1 Identify areas of NDP to
monitor
1.2 Adapt WHO Indicators and
field test them
1.3 Adopt and disseminate
indicators and tools
2. Trained national capacity
for drug policy and
management
2.1 Identify course(s) for drug
policy and/or management
2.2 Organise attendance of
course(s)
3. S takeholder sensitisation
and promotion of public health
aspects of trade agreements to
maximise access to quality
essential medicines
Availability of monitoring tool
for the NDP
List of areas to be monitored
Period: May-Dec 2004
Date: 05 September 2004
Timeline Source of Budget Budget Imple
June 2004
funds (RB, allocated obligated mentat
Progress this month/next
EB) If EB, (USD)
to date
ion
steps/comments
specify
(USD) status (Please report on indicator status at
EC, DFID,
code
the completion of each activity)
Other
(see
$23,000
$8,800
Jun-Nov
2004
$0
Results of field test
(Number of) survey packages
disseminated
1. (Number of) drug managers Jun-Nov
trained
2004
2. Availability of end of training
reports
(Note: will need to report on
number of regulatory officials
trained)
List of courses
List of participants
1. (Number of) stakeholders
sensitised on public health
aspects of trade agreements
2. (Number of) policy briefs on
TRIPS /IPR submitted
3. (Number of) copies of report
on impact of trade agreements
on access to medicine
distributed
3.1 Organize briefing workshops Workshop reports
for stakeholders
3.2 Prepare and submit policy
Policy briefs
briefs
3.3 M onitor impact of trade
1. Draft report
agreements on access to essential 2. Comments on draft report
medicines
3. Final report
EC
6.1
$8,800
$8,000
$0
3
EC
EC
2
EC
2
$9,000
Availability of analysis results M ay-Dec
2004
submitted to national
authorities
7.1 Adopt protocol for sample
collection
7.2 Collect and submit drug
samples to EDM /AFRO for
analysis
7.3 Release analysis results
Sample collection protocol
8. Laboratory staff trained on
Good Laboratory Practices
(GLP)
Jun-Nov
1. (Number of) Lab. Staff
2004
trained in GLP
2. (Number of) copies of GLP
SOPs distributed
3. (Number of) laboratories
receiving copies of SOPs
(Note: will need to report on
number of regulatory officials
trained)
2
2
EC
7. Quality of anti-TB
medicines monitored
1
3
EC
Jun-Oct
2004
QUALITY & SAFETY
6.3
$15,000
EC
$0
Regional
Activity 4.2.5
1
3
(Number of) samples submitted
for analysis
3
Report of results of analysis
EC
$9,000
$0
1
1
TCM/NPO Monthly Monitoring and Evaluation Checklist
NPO:
Country:
Month:
Meetings/ Conferences
(Title and location)
WHO
staff
meeting
Internal
WHO
meeting
Meeting
with
stakeholders
If meeting with
stakeholders, list
stakeholders
represented.
Title of Mission/Travel
Within
country
Within
AFRO
Outside
AFRO
If part of team,
list WHO
departments/other
stakeholders
represented.
Title of Reports/
Documents
Meeting
Mission
Study
If part of
collaborative
project, list
stakeholders
represented. State
if the document
will be published
or how
disseminated.
Organization of Event
(Title)
Meeting
Training Other
List target
participants
Questionnaires/Surveys
Completed or
Participated in
(Title/Subject)
TCM
Other
WHO
If not TCM, list
sponsoring WHO
departments or
organisations
Other
NonWHO
What to Monitor & Evaluate



Monthly progress reporting against Plan of Action (POA)

Includes all POA activities and their indicators, timelines,
source of funds, and budget allocated

Additional activities undertaken are also added to the form
Each month NPO:

Updates budget obligated for each activity

Updates status of implementation of each activity using
indicated coding system

Provides narrative report for those activities where
progress has occurred during that month

Provides narrative report for those activities where no
progress has occurred during that month with justification
Upon completion of each activity, NPO reports on its indicator
and submits to EDM/AFRO and TCM/DAP any associated
documents, i.e. meeting reports, published studies, etc.
Update
implementation
status using codes.
Provide explanation
if delayed, cancelled
or postponed.
Update
obligated
budget
Completing the POA report
POA Monitoring and Evaluation Monthly Report
Country:
Responsible Officer:
ACP
Code
Country Expected
Result/Activity
Enter date
Country Indicator
POLICY
6.2
Period: Jan-Dec 2005
Date: 31 January 2005
Timeline Source of Budget Budget Imple
January 2005
funds (RB, allocated obligated mentat
Progress this month/next
EB) If EB, (USD)
to date
ion
steps/comments
specify
(USD) status (Please report on indicator status at
EC, DFID,
code
the completion of each activity)
Other
(see
$6,000
$0
below)
Jan-Jun
EC
$6,000
$0
When activity is
1
1. Trained national capacity
for drug policy and
management
1. Three drug managers trained
2. Availability of end of training 2005
reports
(Note: will need to report on
number of regulatory officials
trained)
1.1 Identify course for drug
policy and/or management
Name of course
complete report
on indicator
If availability Jan-Feb
of report
is an
EC
2005
indicator, submit
copies of
report to AFRO and TCM.
1.2 Organise attendance at course Names of 3 participants
Feb-M ar
2005
EC
3
1
Implementation Status Codes: Not yet begun = 0, Ongoing and on time = 1, Delayed but ongoing
(please explain) = 2, Completed = 3, Cancelled (please explain) = 4, Postponed (please explain and
indicate new date) = 5
Managing ARVs in a Resource Poor
Setting, 6-10 April 2005, Dar es Salaam,
Tanzania
Meeting next month with MoH to discuss
potential participants.
Record progress for each activity. If no
progress that month leave blank.
Implementation status codes






0 = not yet begun
1 = ongoing and on-time
2 = delayed but ongoing (explain)
3 = completed
4 = postponed (explain and give new
timeline)
5 = cancelled (explain)
Completing the Monthly
Report form



One file should be used for the entire
period of the POA
No changes to previous months
No deletion or changes of activities in
the original POA, rather explain any
changes agreed with MOH.
Kenya August 2005 Monthly Evaluation
Monthly Checklist


Monthly report of work done outside POA

Includes meetings, missions, report writing, organization of events,
participation in studies, etc. - generally those activities limited to one
month or less - activities with a longer duration should be added to
and reported on via the POA monthly report

NPO provides a brief description of all work done outside the POA
during that month
Enables tracking of:

Capacity building for NPO and NPO input into capacity building
opportunities for country representatives that are not part of the
POA

Collaboration with stakeholders

Various Demands on NPO time
Completing Monthly Checklist

Monthly checklist Kenya August 2005
Some Expected Results from
country work Implementation






ART Guidelines
Baseline Pharmaceutical Survey
Report
Essential Medicines List
National Drug Policy
National Formulary
Standard Treatment Guidelines
CD-Rom Collection features







Will be accessed/searched in 3 ways:
 By country: all documents in a specific country grouped
together and can be searched by subject
 By subject or document type
 Cross comparison over a range of criteria: e.g. compare
data sets between countries
Browse by alphabetical classification
Browse by keyword
Complete index/search function
Extract PDF files separately
More relevant documents could be added, links to websites
etc
Hyperlink to AFRO documents
The end…

Thank you.