Terms of Reference for the final evaluation of European Instrument for Democracy and Human Rights (EIDHR) in Ethiopia, Uganda, and South Sudan
HelpAge International is a global network of organizations promoting the right of all older people to lead dignified, healthy, and secure lives. HelpAge International envisions a world in which all older people fulfil their potential to lead dignified, active, healthy, and secure lives. HelpAge International’s mission is to work with its partners to ensure that people everywhere understand how much older people contribute to society and that they must enjoy their rights to healthcare, social services, and economic and physical security.
The programme that was implemented in Ethiopia, South Sudan and Uganda was informed by the fact that the security conditions in South Sudan remained volatile and clashes were reported in various parts of the country. According to a report released by the United Nations Mission in South Sudan (UNMISS) and the Office of the High Commissioner for Human Rights (OHCHR) on January 21, 2016, widespread human rights violations and abuses were committed in South Sudan by all parties to the conflict since December 2013, including hundreds of extra-judicial killings, enforced disappearances, sexual violence, forced recruitment and indiscriminate attacks against civilians. This situation led to internal displacement and accelerated the movement of South Sudanese to Uganda and Ethiopia.
By then and as of now, Ethiopia practiced an open border policy vis-à-vis refugees and being a signatory to the key international and regional frameworks regulating refugee protection (UN 1951 Convention, 1967 Protocol on the Status of Refugees and OAU Convention on Specific Problems Relating to Refugees in Africa), allowed South Sudanese refugees. Domestic policy guiding the rights and opportunities granted to refugees were anchored in the national Refugee Proclamation of 2004, which honoured protection principles but accommodated significant administrative discretion in their implementation, which led to inadequate rights fulfilment of refugees. By then Ethiopia had not ratified the AU Protocol on the Rights of Older Persons in Africa (adopted in January 2016)
Uganda on the other hand, is considered among the most progressive in the region as is the country has open border policy for refugees. However, the implementation of the Refugee Act (2006), remains inadequate and gaps in refugees’ rights fulfilment remain significant. The country was yet to ensure the article addressing the Protection of Older Persons in Conflict and Disaster Situations of the AU Protocol on the Rights of Older Persons in Africa (adopted in January 2016) is considered in national laws and policies on ageing. **
Due to inadequate laws and structure in the three countries, older women and men refugees faced violence, abuse and discrimination in refugee and settlement camps. A significant majority of older women in particular experienced abuse and isolation. Many of these older refugees were separated from their families and experienced emotional problems due to the trauma. Being on their own, older refugees were often unaware of available legal services and their own rights. They also lacked the physical mobility, the ability to travel with ease or the confidence to seek advice. Most of the had not received recognised legal status and relevant identification card. Without an identification card they were not able to access relevant services or legally prescribed schemes and entitlements, such as food rations. They therefore struggle to meet their personal needs including food security, access to health care and protection from violence and abuse.
It is out of this background that HelpAge International, with funding from the European Union, managed a 3-years, multi-country, a human rights programme, known as advancing the rights and protection of conflict-affected older South Sudanese migrants in Ethiopia, Uganda, and South Sudan. The programme that has come to an end, intended to build the capacity of older people to engage in community action meant to cause change in the lives of older persons; and to monitor and advocate for improved service delivery. The action was also intended to build capacity of government and non-state service providers to effectively engage in age friendly policy formulation/review, design, and delivery of more effective and inclusive social services.
2. Study background
With Funding from European Union, HelpAge International together with its network members managed a 3-year project in Adjumani, Gambela and Juba. This project ended in Dec 2020. The project aimed at advancing rights and protection needs of older South Sudanese migrants in Uganda, Ethiopia, and South Sudan. Among other things, the aimed at building movements of older person to voice their concerns and demand for effective service delivery from Humanitarian agencies, promotes access to legal aid services through linkages with and promoting referrals to legal Aid service providers, train Paralegal advisors who on day-to-day basis provide support to older persons in their respective settlements. The projects also promoted economic self-sufficiency of older persons through provision of business skills and start-up capital.
3. Programme Objectives
Overall Objective Impact
To contribute to rights fulfilment and protection of older migrants in Ethiopia, Uganda, and South Sudan.
Specific Project Outcome
Strengthen the operational and institutional capacities of duty bearers, Civil Society Organisations (CSOs) and OPAs to implement effectively the international and regional instruments regulating the protection and rights of South Sudanese migrant older populations in Ethiopia, Uganda, and South Sudan.
Specific Project Outputs
1) At least 1,500 older South Sudanese migrant women and men are supported to exercise their rights and be protected against violations through the provision of legal aid services and economic self-sufficiency opportunities.
2) 15,000 older South Sudanese migrant women and men are reached through campaigning and their associations are empowered to advocate for their own rights, thus positively influencing the legal and policy framework affecting their lives.
3) Increased awareness amongst targeted actors (CSOs, migration-focused administrations, international NGOs [iNGOs], UN agencies), enhance the effective implementation of international and regional instruments (including newly developed) guiding the rights of South Sudanese migrant women and men in Ethiopia, Uganda, and South Sudan
4. Purpose of the study and scope
The purpose of the exercise is to evaluate the programme in order to determine the impact on the lives of older men and women in the refugee camps in 3 countries of Ethiopia, South Sudan and Uganda. Particularly, study will also evaluate the contribution of the project to the systemic changes that might have occurred in the three countries and in favour of rights of the older women and men. The study will cover areas where HelpAge and Network members are implementing activities in the refugee camps in Adjumani, Gambela and Juba. The consultant will propose and design a suitable methodology in line with the evaluation objectives.
5. Evaluation Objectives
a) To assess if the programme achieved its intended goal/objectives and identify factors that may have contributed to successes or challenges. **
b) To assess whether the theory of change of the programme guided the achievement towards outputs and outcomes.
c) To review the extent to which the programme was relevant to the context and development plans of the various countries including the aspirations of beneficiaries and partners.
d) To assess the extent to which the programme and its associated implementation strategies contributed to policy changes for the benefit of communities, older persons, and the country.
e) To assess the contribution of the programme to long term change of the knowledge and attitude of the refugees and host communities towards the protection of older women and men as well as those with disability in the three countries. **
f) To document lessons learnt from the programme implementation, successful approaches, key challenges, and recommendations for future work on protection and accountability for the older people in the three countries**.**
g) To determine that aspects of project and/or its benefits are likely to continue without external support.
6. Evaluation Criteria
The consultants are expected to be guided by the following evaluation criteria across all activities.
Relevance and strategic fit
- To what extent are the objectives and the interventions of the programme consistent to the needs of older women and men migrants and relevant to partners’ needs.?
- How did the programme respond or contribute to the design and implementation of legal aid services?
- To what extent does the programme complement and fit with other partners and government development plans.
- Is the advocacy relevant to the needs and gaps in protection of older migrants and decision makings?
To what extent is the project theory of change representative of how change happened within the programme?
Are the programme design (objectives, outcomes, outputs, indicators, and activities) and its underlining theory of change logical and coherent? How realistic were the indicators for data collection?
o How realistic were the risks and assumptions upon which the programme logic was based?
- How did the programme strategies, within their overall scope, remain flexible and responsive to emerging concerns with regards to (i) gender equality and non-discrimination and (ii) inclusion of people with disabilities and (iii) project learning?
- To what extent have the expected outputs and outcomes been achieved or are likely to be achieved in relation to programme objectives and its results framework?
- In what areas (geographic, components, issues) does the programme have the greatest achievements? Why and what have been the supporting factors?
- To what extent can the emerging results be attributed to the EIDHR programme Grant funding??
- To what extent has the programme adapted its approach to specific country contexts?
- To what extent has the participation of older women and older people with disabilities within refugee and IDPs camps been enhanced by the programme?
- To what extent were the intervention results defined, monitored, and achieved (or not), and what was their contribution (or not) towards (i) Gender equality and non-discrimination? (ii)Inclusion of people with disabilities?
- How well have resources and inputs (funds, expertise, time, etc.) been allocated or used strategically to achieve the expected results?
- Have programme outputs been delivered in a timely manner? If not, what are the factors that have hindered timely delivery of outputs?
- To what extent did the programme budget factor-in the cost of specific activities, outputs and outcomes to address: (i) Gender equality and non-discrimination? (ii) Inclusion of people with disabilities?
- To what extent have programme resources been leveraged with other related interventions to maximize impact, if any?
- Has the programme reached sufficient scale and depth for replication and scale up in other countries within the region?
- To what extent are the planned results of the programme likely to be durable, maintained or even scaled up and replicated by other partners after major assistance has been completed?
- To what extent does the results of the intervention likely to have a long term, sustainable positive contribution to the relevant targets/beneficiaries?
- To what extent has the programme developed scalable and replicable models that can be used for future programming?
· Did the programme enhance local ownership and capacity to influence policy?
7. Evaluation Methodology
We are interested in reading proposals from consultants which include using participatory action research techniques, which aim as much as possible to minimize the extractive nature of external evaluations and build in opportunities for communities to also reflect on and inform emerging findings. The evaluation will be based on developing quantitative and qualitative research techniques which put the viewpoint of the refugees at the centre, such as the Most Significant Change technique.
Primary data collection is expected to be conducted in the 3 refugee camps. The mixed methodologies chosen will inform the number of older persons to be interviewed and a variety of stakeholders. The consultant(s) should propose their methodology, anticipated scope, and analytical framework, considering the primary data collection, in addition to analysing the data collected by HelpAge and its Network members during the 3-year period.
Primary Information will be gathered from older women and men and especially those with disabilities. Consultations will also be held with paralegals, refugee welfare committees, Older persons associations, local police stations, legal aid service providers and UNHCR at the district level and national levels in each country. References will also be made to existing research and policy documents. **
Overall, the methods for data generation should be age, disability, and gender sensitive and robust enough to provide adequate responses to the stated study questions. The methodology section should cover details of study design and approaches, sample size determination, data collection methods/instruments, data analysis techniques, plan for validation of study findings and a statement on quality assurance and ethical considerations during the study. The expected methodology should be described in enough detail to ensure that the study can easily be replicated.
HelpAge will provide contacts for key stakeholder consultations and in mobilisation of older persons.
a) In light of the above, the consultant(s) will submit; Inception Report (IR) detailing inter alia proposed work plan, methodology that will be agreed upon between the consultant and HelpAge.
b) Data collection tools: Develop the data collection tools and have them approved by HelpAge International and partners before data collection, analysis, interpretation.
c) Draft Evaluation report: The firm/consultant will prepare a draft evaluation report with details of findings, recommendations and lessons learnt for review by HelpAge International.
d) Validation workshop: Hold a validation workshop/meeting with relevant HelpAge programme staff and stakeholders as part of the validation and feedback.
e) Revise the draft report based on the feedback.
f) Four (3) qualitative in-depth case studies, one per target country
g) Final Evaluation report: A consolidate final evaluation report, which compares and expounds the project performance in each country.
h) Provide HelpAge with all data. This will be both in electronic and hard copy (MS Word document, PowerPoint slides).
NB: The report content should include the standard cover sheet; executive summary; Introduction, description of study purpose, objectives and scope, study methodology and limitations; study findings, conclusions and recommendations, appendices, and references.
9. Timeframe and Cost
The consultant is expected to indicate the number of days for the evaluation in line with his/her proposed methodology. The evaluation will begin in the month of March 2021, however preliminary works may begin earlier such as development of the tools and review of the final evaluation study design.
HelpAge will cover for the firm/consultant’s air tickets on economy class to the three countries (Ethiopia, Uganda and South Sudan), accommodation on bed and breakfast plus airport transfers and in-country logistics including field activities. All other costs shall be borne directly by the firm/consultant.
Payment will be based on submission of deliverables that are satisfactory and have been assessed by the HelpAge team to be of good quality. Taxation laws will apply on the overall consultancy fee.
The following payments will be paid to the firm/consultant using an agreed mode of payment.
- 30% of the contract value after the submission and approval of the inception report
- 30% of the contract value after the submission and approval of the Interim Final Evaluation report
- 40% of the contract value after the submission and approval of Final Evaluation Report
10. Ethics, Safeguarding and Code of Conduct
The firm/consultant will be working on behalf of HelpAge and will be required to sign and adhere to the Safeguarding Policy and ethical guidelines.
The firm/consultant will make clear to all participating stakeholders of all ages that they are under no obligation to participate in the exercise and that it is purely voluntary. All participants will be assured that there will be no negative consequences if they choose not to participate.
The firm/consultant must obtain informed consent from all participants. The firm/consultant must receive prior permission for taking and use of visual still/ moving images for specific purposes.
The firm/consultant will assure the participants the anonymity, confidentiality and will assure the visual data is protected and used for agreed purpose only. As regards the documentation, the title rights, copyrights and all other rights of whatever nature in any materials used or generated under the provisions of this consultancy will exclusively be vested with HelpAge International.
11. Qualifications and Experience Required
To accomplish the objectives of the study, the consulting firm/Consultant should have a multidisciplinary team with key qualifications and competencies as follows.**
A Postgraduate degree in a relevant humanitarian and development work related to Social Science, gender studies, human rights, sociology, project management, and monitoring and evaluation.
Minimum of 10 years’ relevant professional experience in social sciences, protection, and human rights research.**
Should have knowledge and experience in at least any of the following key crosscutting issues; gender, age, and disability issues.**
Thorough understanding of the humanitarian assistance standards as they relate to the local and national context.
Significant humanitarian work experiences and research in refugees’ settlements in Ethiopia, Uganda and South Sudan.
Strong background and experience in data collection and analysis.**
Proven experience in undertaking evaluation/research or leading evaluation/research teams, with outstanding skills in qualitative and quantitative research and data analysis using relevant software such as STATA, CSPro or SPSS. **
Knowledge of participatory action research-method
Excellent communication and report writing skills.**
Firm/Consultant with Associates in the programme locations will be an added advantage.**
12. Submission of Technical and Financial Proposal
All expressions of interest should include:
· Letter of interest (maximum one page) letter addressing the survey criteria.
· Technical Proposal (maximum 10 pages-excluding study instruments) highlighting: brief explanation about the consultant/s with emphasis on previous experience in this kind of work; profile of the Consultant/s to be involved in undertaking the study; understanding of the TOR, the study methodology, key contacts of previous similar work done.
· Financial Proposal: The financial proposal should provide cost estimates for services rendered among them daily consultancy fees including accommodation, stationeries, and supplies needed for data collection etc.
Data collection and data processing costs should also be included in the consultant’s fee.
How to apply:
All interested consultants/firms are requested to send this expression of interest and detailed profile of the consultants/firm by email to: email@example.com by 28th March, 2021.
For a detailed Terms of Reference and information on how to apply, please follow this link https://www.helpage.org/who-we-are/jobs/terms-of-reference-eidhr-final-evaluation/