Transcript Evaluation Plan 2007-2013

Evaluation arrangements in
Lithuania 2007-2013
Neringa Jarmalavičiūtė,
Evaluation Division, Ministry of Finance of the
Republic of Lithuania
Content of the presentation
1.
2.
3.
4.
Organizational structures.
Evaluation plans in 2007-2013.
Use of evaluation results.
Lessons from the past and new
challenges.
MONITORING
Monitoring Committee:
•Analyses evaluation results;
•Supervises implementation
of the OP’s.
OP managing
committee:
•Analyses OP’s planning
and implementation
problems.
Ministries (intermediate
bodies):
•Initiate strategic and
operational evaluations in
the field of their
responsibility;
• Participate in ECG.
1. Organizational Structures
Coordinating Authority:
•Establishes and approves Evaluation Plan
for 2007-2013;
•Establishes and organizes work of ECG;
•Organizes establishment of AEP’s and
monitors their implementation;
•Organizes “horizontal” evaluations;
•Is responsible for evaluation capacity
building.
Managing Authority:
•Participates in ECG;
•Ensures evaluations
under Art. 48, 3 (reg.
No.1083/2006).
Implementing Agencies:
•Collect monitoring data at project level.
Evaluation
Coordination
Group (ECG)
•discusses AEP’s;
•analyses
implementation
of AEP’s;
•discusses technical
specifications and
evaluation results,
etc.
Evaluation Plan for
2007-2013 –
evaluation strategy:
evaluation goals,
measures, financial
resources etc.
Annual evaluation
plans (AEP’s) –
projects: budget,
responsible
institutions,
implementation
period, etc.
EVALUATION
participates in …;
prepares project / ensures
implementation of ..;
discusses;
collaborates, exchanges information
2. Evaluation plans in 2007-2013
• Evaluation Plan 2007-2013:
– Evaluation “strategy”: evaluation requirements, national
needs, goals and objectives, measures, financial resources;
– Approved by the Minister of Finance in January, 2008
• Annual Evaluation Plans (AEP’s):
– Evaluation and evaluation capacity building projects for
the implementation of the “strategy”, proposed by
institutions, responsible for evaluation;
– Will be approved by the Minister of Finance every year in
December.
• Coordinating Authority monitors implementation of
all evaluation plans and reports to the Monitoring
Committee on their implementation and evaluation
results.
Evaluation Plan 2007-2013
Objectives
Measures
Results
1. Organising and
carrying out the
evaluation meeting the
requirements of EU
regulations and
national evaluation
needs and making use
of the results thereof
To carry out
evaluations of
strategic and
operational
nature.
3 strategic evaluations a year;
20 operational evaluations a
year;
evaluation reports including
recommendations.
2. Strengthening
evaluation capacities
in Lithuania
7 different
measures to
strengthen
evaluation
capacity at
personal,
institutional,
inter-institutional
and society level.
To set up ECG; appoint
responsible employees in all
relevant institutions;
To form legal basis for
evaluation;
Methodological guidance;
Training events, conferences,
presentations of the evaluation
results, etc.
Financial
resources
~10 million
EUR
~1 million
EUR
Annual Evaluation Plan 2008
• 13 projects:
– 12 evaluations (6 responsible institutions);
– 1 evaluation capacity building project (MoF).
• Budget:
– ~ 0,7 million EUR;
– ~ 6,5% of all allocations for evaluation in 2007-2013.
• Main areas of evaluations:
– strategic evaluations (e.g. priorities for 2014-2020);
– EU SF impact assessment (on GDP, transport sector and
information society);
– evaluations to define baseline indicators and to set up
methodologies for measurement of different indicators.
Ministry of Finance: projects in 2008
• 3 evaluation projects:
– Development priorities in 2014-2020;
– EU SF impact on GDP;
– Compatibility of the EU SF assistance under the
SPD 2004-2006 with the EU and national
strategies and other EU financial instruments;
• 1 evaluation capacity building project:
– Strategy for evaluation capacity building;
– Training for the members of the ECG;
– Study visits, conference on evaluation;
– Methodological documents on evaluation.
3. Use of evaluation results
(new requirements in 2007-2013)
• Institution, responsible for an evaluation, within 30
working days after the acceptance of an evaluation
report:
– organizes presentation of evaluation results (e.g. seminar,
meeting, discussion with different stakeholders);
– publishes evaluation report on the website of the EU
structural assistance (www.esparama.lt);
– provides a copy of an evaluation report and information on
the implementation of the recommendations to the
Coordinating Authority (form to provide information).
Form to provide information on the
implementation of the recommendations
Institution responsible for evaluation:
Contact person:
Evaluation (title):
No.
Recommendation
Will it be Why?
imple- (if partly
mented?
or no)
 yes
 partly
 no
Measures for the implementation
Measure Responsible
Time
institution
4. Lessons from the past…
• Planning is crucial for timely evaluations and
effective use of financial resources.
• Use of evaluation in decision making process
and benefit from evaluation depends on the
level of institutionalization.
• “Pure” evaluations are more useful than
different studies, research.
• Inter-institutional cooperation (formal and
informal) is widely recognized as an effective
way for the evaluation capacity building.
4. … and new challenges
• Use of evaluation results: more thorough
monitoring (result indicator in the OP’s – 70%
of recommendations taken to implement).
• Growing evaluation demand v. limited supply.
• New behavior of companies on the supply
side: cooperation instead of competition.
Thank you for your attention!
Neringa Jarmalaviciute
Senior specialist, Evaluation Division
Ministry of Finance of the Republic of Lithuania
Tel. +370 5 2199 363
Fax +370 5 2127 424
E-mail: [email protected]