Transcript Presentation - Governance Assessment Portal

Governance indicators for pro-poor
and gender-sensitive policies
The NHDRs as frameworks for analysis
with a focus on vulnerable groups
Andrey Ivanov
Human Development Adviser, Bratislava RSC
Main issues in this
presentation





Measuring what?
Measuring how?
The role of quantitative data
The case of NHDRs and RHDRs
Links to vulnerability assessment
Some terminological
clarity




Three distinct (but often confused)
concepts:
Monitoring
Evaluation
Impact assessment
All are building on data and indicators but of
different sort and from different source
What do we mean by:



Monitoring – primarily related to progress.
Relatively easy if major components are
clear and traceable with indicators
imbedded in the design of the project
Evaluation – primarily related to process but
also outputs and outcomes. Feasible if these
elements are replicable and provide grounds
for comparability
Impact assessment – long-term changes in
development situation. Difficult because of
correlations and mutual influences
Measuring what?




The quality of the process of policy making
(inclusive and participatory)?
The quality of policies developed (reflecting
the needs of vulnerable groups)?
The outcomes (the direct result of policies
implemented – how the status of the
beneficiaries has changed)?
Policies impact (in a broader and long-term
perspective)
Example: Employment
generation projects





Outputs: number of people with requalification course passed
Outcome: number of former unemployed
who found jobs
Sustainability: duration of the job found
after the project
Impact: HH incomes increased, poverty
indicators improved
Positive externalities: reduced drop-our
tares, reduced societal fragmentation
Employment generation –
possible data sources





Targeted small-sample surveys
Community level data collection (not samplebased)
Interviews the beneficiaries on the specific
involvement and how did it influenced them
Interviewing the other actors involved
Comparing the trends within the group with the
overall trends
At the end the data should allow building
alternative scenarios to compare with and
measure the efficiency of the specific project
NHDRs and governance



Analytical documents
Advocacy tool
Policy recommendations
– All these aspects are related to data on
status, process and implementation
– In the case of NHDRs focusing on
governance – focus on “democratic
governance”
HDI and governance
indicators

HD and HDI
– HDI is a proxy
– Reflects outcomes and not the quality of
the process
– Different role of national level and
disaggregated HDIs


The problem with correlated factors
Problem of international comparability
Regional HDRs and
governance
HIV/AIDS in Eastern Europe and CIS:
Reversing the Epidemic. Facts and
policy options
Roma in CEE: Avoiding the
dependency trap




Explicit focus on
policies
Based on
quantitative
indicators
Representative for
a major vulnerable
group in CEE
Reflecting gender
differences
Examples





Who is the head of the household?
Who is managing the money of the
household?
Do you know the name of your mayor?
Do you have an NGO you trust?
Have you voted in the last elections?
All these may reflect individual participation
(quality of the process) and to a limited
extent – quality of policies
Next step: VGS survey






First step: clearly define the issue
Integrated household survey containing
household and individual modules
“Status” data and not “attitudes”
information
Two separate questionnaires (status of the
household and of each individual member)
Universe studied – households in areas with
compact Roma population, adjacent
majorities and IDPs/refugees where relevant
Provides basis for comparisons to national
averages
Levels of comparability



Between different groups (Roma and
majority living in close proximity to
Roma; Roma and IDPs/refugees etc.)
Between Roma and status of the
average population (reflected in HBS,
LFS)
Between Roma populations in different
countries with similar socioeconomic
conditions
Clearly distinguish between
Data and Indicators


The survey provides data on the status
(both of individuals and of the households).
Example of data: levels of HH incomes or
educational status or age of respondents
Based on the data indicators are computed
using individual records (poverty rates
based on income or expenditure data or
enrollment rates based on educational
status and age of respondents)