TERMS OF REFERENCE
for the interim evaluation of the project
“PROMOTION OF INCLUSIVE AND EQUITABLE QUALITY EDUCATION FOR ALL IN ARMENIA”
Background and a short description of the project:
The project is financed by German Federal Ministry for Economic Cooperation and Development through Caritas Germany. Project’s aim is to contribute to the establishment of inclusive and equitable quality education for all in Armenia.
Project’s important components are trainings of staffs of 7 partner schools and kindergartens involved in the project to deliver with tools for application of inclusive practices at school as well as the equipment of one model classroom in each school and kindergarten for implementation of inclusive education, encouragement of the participation of pupils and parents in creation of inclusive environment in schools, contribution of inclusion of CWD in target schools and kindergartens, empowerment of day care centers for the inclusion of children with disabilities, development of positive attitude toward inclusion in the society and education, sensibilization of public on the barriers of inclusion of persons with disabilities, public events, flash mobs aimed at overcoming stereotypes and prejudices about disabilities, encouragement of persons with disabilities to benefit from their rights, opportunities and available services.
At the time of the interim evaluation the third (final) year of the three-year project is underway.
|
What: |
Project Overall Goal: to contribute to the establishment of inclusive and equitable quality education for All in Armenia (SDG 4). Specific Objective 1: Enhanced participation of pupils’ and parents’ representatives in targeted 7 schools of Armenia to promote inclusion at schools and at social level.”. Specific Objective 2: The participation of children with disabilities in 7 targeted kindergartens and 7 targeted schools in Armenia is increased. Specific Objective 3: Structures that promote access to social participation for children with disabilities are strengthened. Specific Objective 4: Society has developed a positive attitude towards inclusion of people with disabilities. |
|
Whom: |
The main target group of the project are: - Children with disabilities of target 7 schools and 7 kindergarten, - Parents of children with disabilities - Target school employees: teachers, headmasters, administration - Target kindergarten personal: director, educators - Parents’ representatives - Pupils and Pupils’ Councils representatives - Staffs and children of day care centers in Gyumri and Vanadzor - Multipliers - Special needs assistants (SNAs) - Journalists trained; - Students of art academy trained (20 per year) |
|
How: |
Outcome 1.1 Pupils’ Councils have been activated in the targeted schools and support inclusion Outcome 1.2 Self-support groups for parents of CWD are operating in target schools and kindergartens and are active members of Parents’ Councils. Outcome1.3 Network of Parents’ Councils at Provincial level (Shirak Province) is formed.
Outcome 2.1 Administrative and teaching staff of targeted schools and kindergartens have relevant knowledge, skills and attitude to plan and manage inclusive education Outcome 2.2 The model of SNA is piloted by AC and adopted by Government. Outcome 2.3 The targeted schools and kindergartens are physically accessible and equipped to provide equitable education and socialization for CWD.
Outcome 3.1 Two day-care centers of Armenian Caritas are inclusive by the end of 2022 (Gyumri and Vanadzor) and serve as successful showcases. Outcome 3.2 Other structures (day-care centers in project targeted locations) have relevant skills, knowledge and attitude to accept CWDs Outcome 3.3 The importance of structures providing services for social participation of CWD is increased.
Outcome 4.1 Increased media coverage on importance of social inclusion. Outcome 4.2 Enhanced visibility on the successes and achievements of PWDs in different spheres of life (politics, business/economy, education and other).
|
|
Who: |
Organisations implementing the project: Armenian Caritas In partnership with: ● RA Minister of Education, Science, Culture and Sports, ● RA Ministry of Labour and Social Affairs ● National Association of School Parent Council Members (NASPCM), ● Target schools and kindergartens, ● Day care centers in Shirak region, ● Universities and colleges of Shirak Region, ● Young people. |
|
Where: |
Shirak region |
|
When: |
November, 2019 - December, 2021 |
1. Aims and objectives of the interim evaluation of the project
Objectives of the interim evaluation:
(1) Evaluate and analyse to what extent the project objectives and results have been achieved and what impact the project has had on the main target groups of the project by the end of 2021;
(2) Evaluate and analyse project successes and problem areas, analyse the reasons for achieving or not achieving the planned results and draw key lessons learnt
(3) Receive recommendations for the future project planning.
Detailed Objectives of the interim evaluation:
- Evaluation the project achievement based on the standard OECD-DAC Criteria for Development Assistance: Relevance, Effectiveness, Efficiency and Impact and Sustainability:
1. Relevance: Is the relevant object concept and design the appropriate solution to these needs and problems: Is the project strategy, well balanced to achieve the project overall and specific objectives set?
2. Effectiveness: To what extant have the project’s objectives been reached? And if not, has some progress been made towards their achievement? What steps need to be taken to increase the effectiveness of the project? What were the problems and constraints encountered during the implementation?
Does the partner organization have direct access to the target group and communities? Are systematic approaches applied when identifying beneficiaries of project activities (e.g. participants, training)?
3. Efficiency: Were activities cost-efficient?
4. Impact: What is the assessment of the project’s contribution to human and institutional capacity building in terms of knowledge and competences? What are the most important changes in target groups’ lives, attitudes or behaviour that have been achieved by the project?
5. Sustainability: To what extent has the project established processes and systems that are likely to support the sustainability of the project impact? What steps need to be taken to ensure project sustainability?
- Identification of key lessons learnt
1. What were the main successes and problem areas throughout the realisation of the project? What were the reasons for achieving or not achieving the planned results, and were steps appropriately and systematically taken to readjust the project considering the change of context?
2. Identify and document key lessons learned and best practices from the project that could be used by the project management, on the continuation of this project or others.
- Recommendation for future projects
1. Identify gaps and make recommendations to improve project design (project strategy, SMART indicators, achievable objectives and targets), project coordination, and project management;
2. Provide concrete recommendations on how to increase impact of the project.
2. Scope of work and timetable
The estimated period of the interim evaluation is six weeks, February/mid-March 2022. The following is a table of the anticipated works and a timetable for the evaluation team:
a) Scope of work
Thematic coverage: Activities with target schools; Activities with target kindergartens; Activities with parents’ self-support groups.
Time period: first two years of the project (2020-2021)
Target group: Administrative staff of the target schools, teachers, pupils, Pupils’ Councils representatives, parents of self-support groups and Parent’s council representatives, Administrative staff of the target kindergartens and educators.
b) Timetable
|
Lead time |
Type of activity |
|
First two weeks (February 2022) |
Desk study: review of the project documentation: project proposal, project logical framework, project budget; Code of Ethics and Safeguarding; latest narrative and financial report of the project for the period 2019-2021; partners' social media activities, prepared modules, training reports; |
|
Two weeks (End of February 2022) |
Fieldwork / Collecting data from project participants |
|
Beginning of March |
· Preparation and presentation of the preliminary evaluation findings and preliminary version of the report in English, to managers of Caritas Armenia and Caritas Germany · Comments from to managers of Caritas Armenia and Caritas Germany |
|
By the 15th of March 2022 |
The final version of the report is sent to managers of Caritas Armenia and Caritas Germany. |
3. Methodology
The evaluation team should use various interactive methods during the collection of information and all necessary data to answer all the questions of the Terms of Reference. The list of those to be interviewed during the evaluation should include project staff, key stakeholders of the project and representatives of the target groups. The methods to be used during the evaluation should be described in detail in the application form for the evaluation of the project. Project staff involved in interviews should include both project manager and other key project staff working directly with representatives of the target.
The evaluation team may suggest other methods to collect information from project stakeholders and beneficiaries to implement Terms of Reference.
4. Expected results (outputs) and timetable for delivery:
● Detailed methodology for the Terms of Reference with indicative questionnaires for interviews/surveys and evaluation work plan – by 23 January 2022;
● Preliminary version of the report in English – beginning of March 2022
● The final version of the report in English is due by 15 March 2022.
5. Qualification requirements for consultants (experts) carrying out the inteim evaluation:
May only apply to this call registered independent consultant or consulting firm that comply with the following cumulative criteria:
- With a university degree, master's degree (at least) in the social sciences: sociology, law, political science or other related sciences);
- Proven experience (at least 5 years) in conducting project/programme evaluations and skills in conducting impact evaluations on the target group, using an interactive methodology, conducting interviews, developing questionnaires, etc;
- Experience in inclusive education context is highly preferable;
- Fluent Armenian language is a must to carry out interviews
- Proven analytical and reporting skills in English;
6. Guiding Principles & Donor concepts
The consultant is to conduct the evaluation in accordance with the principles outlined in the “Caritas Internationalis management standards” document, the “Caritas Code of conduct”.
The evaluator must take all required steps to ensure that the evaluation is designed and conducted to respect and protect the rights and welfare of the people and the communities of which they are members, as well as to ensure that the evaluation is technically accurate, reliable, and legitimate, and conducted in a transparent and impartial manner. Moreover, the evaluation should ideally contribute to organizational learning and accountability.
7. Budget and financial plan for the evaluation:
The applicants may use a free format for the elaboration of the budget, with the only requirement that the honorariums of the evaluators and the budget for the evaluation are indicated separately in the budget. All expenditure necessary and justified for the evaluation and indicated in the budget will be reimbursed at a later stage, once the relevant financial documents supporting the expenditure have been submitted. When working on the budget, applicants should take into account the fact that fieldwork is require.
The payment will be made as follows:
● 1st instalment – 40% (after signing the agreement); and
● Final instalment – 60% (after approval of final deliverables)
12. The application requirements for the evaluation of the project:
Candidates planning to apply for the evaluation of the project may submit an application form in free format, but with a mandatory indication that these candidates meet the eligibility requirements, attaching a CV and reports on similar missions, a detailed description of the methodology, an updated work plan, and a budget for the evaluation. If the evaluation will be carried out by a team of experts, their role in the Terms of Reference and their knowledge and experience in carrying out project and/or programme evaluations, and added value should be described.
Applications for the evaluation must be submitted by 23rd January, 2021 at the latest to s.minasyan@caritas.am and info@caritas.am.
13. Annexes
Annex 1: Table of content for the Inception Report
Annex 2: Table of content for Evaluation Report
Annex 3: Evaluation Matrix