Myanmar: Consultant Team for External Evaluation

Malteser International has been operational in Myanmar since 2001 and is currently implementing health, WASH (water, sanitation, hygiene) and DRR (disaster risk reduction) programs in Rakhine, Shan and Kayin States. The programs are implemented through Program Offices in the respective regions and supported by a Country Office in Yangon.

To conduct a final independent and field-based evaluation within the German government-funded project ”Creation of an enabling environment for the social reintegration of refugees and IDPs in Kayin State through sustainable reconstruction and improved access to social infrastructure” in Myanmar, Malteser International is looking for an

External Evaluation Consultant Team

I. Background Information and Rationale
Malteser International is the relief agency of the Sovereign Order of Malta for humanitarian aid. With over 100 projects annually in some 25 countries throughout Africa, Asia and the Americas, we provide emergency relief after disasters and support recovery efforts with a focus on sustainable development. Malteser International has been operational in Myanmar since 2001 and is currently implementing health, WASH (water, sanitation, hygiene) and DRR (disaster risk reduction) programs in Rakhine, Shan and Kayin States. The programs are implemented through Program Offices in the respective regions and supported by a Country Office in Yangon.

Project: ”Creation of an enabling environment for the social reintegration of refugees and IDPs in Kayin State through sustainable reconstruction and improved access to social infrastructure”
Project Period: 01 September 2014 – 30 June 2018 (46 months)
Project Budget: 1,960,635 Euro
Donor: German Government (BMZ)
Project Objective: The objective of the project is to support the resident population in areas of origin of Karen refugees in Kayin State in Myanmar for the improvement of social infrastructure and basic social services to facilitate the return and reintegration of IDPs in Myanmar and refugees from Thailand.
Expected Project Results:

1. Access to and utilization of public and community primary health care services is improved in 30 villages for residents and for a future reintegration of refugees or IDPs.
2. The access to mother-child-health services is improved through a network of trained public and community health staff in 30 villages for the resident population and in regard to a future reintegration of refugees and IDPs.
3. Access to safe drinking water, basic sanitation and hygiene awareness in 35 villages are improved for the residents as well as for a future reintegration of refugees or IDPs.

II. Objective of the Evaluation
This evaluation has been planned with the main purpose to assess the implementation process and impact orientation of the above-cited project, with feedback on the achievements as well as to facilitate learning for improvement of design and management of future projects, and in order to demonstrate accountability to donors and beneficiaries.
Key observations on the strengths and weaknesses of the project design, implementation processes, monitoring tools, cooperation with local stakeholders, best practices and lessons learnt as well as cross-cutting issues shall additionally be taken into account.

Expected Outcome
The evaluation will focus on:
Relevance
a) Has the project design and implementation been appropriate to meet the needs and priorities, especially concerning health, WASH and nutrition/livelihood, of the target groups?
b) Did the project successfully reach out to addressing the needs of women, children, elderly, persons with disabilities and other vulnerable groups?
c) Has the project design and implementation been coherent with policies of the Myanmar Government?
Efficiency
a) Have project funds been used in a cost efficient way? Have inputs been converted into outputs in a cost efficient way?
b) Were the resources allocated in the different sectors justified and adequate to reducing health, WASH and nutrition/livelihood related vulnerabilities of the target communities?
Effectiveness
a) Have the planned results been achieved and lead to the intended outcomes? How did women, children, elderly, persons with disabilities and other vulnerable groups benefit from the results?
b) Have the activities been effective in order to meet the needs of the targeted population?
c) Which project activities have had the greatest positive effect and which had the least effects? Are there any activities that should have been included in the action but were not?
d) Were education and awareness raising methods appropriate to achieve behaviour change?
e) What level of participation and satisfaction did the project services manage to generate among the beneficiaries? Were the target populations’ capacities strengthened through the intervention?
f) Was the established monitoring system adequate to provide oversight and steer the implementation?
g) Were activities supporting the capacity of the Ministry of Health and Sports (MoHS) and other relevant government departments at state and township levels and communities leading to a strengthening and improved quality of their services to the local populations?

Outcome/Impact
a) What is the cumulative effect of the operation in relation to the situation of the beneficiaries in general (including positive, negative, primary and secondary long-term effects produced by the action, directly or indirectly, intended or unintended impacts)?
b) What are the wider effects of the operation on individuals, different population groups, communities and institutions?
c) What visible/evident impacts are emerging from the project implementation?
d) Are beneficiaries satisfied with the assistance provided? What real difference does the project make to the beneficiaries?
e) Were cross-cutting issues (e.g. gender, social inclusion, disability, trust-building) adequately taken into consideration in the set-up and implementation of the project?
Sustainability
a) How did the project adapt to the changing context in Kayin State? Did Malteser International sufficiently incorporate a longer-term view into this project?
b) Did the project develop an exit strategy and to what extend are the project’s achievements likely to last after the project’s end?
c) What adjustments could possibly have been made to improve sustainability of individual project components?
d) What efforts have been made to ensure that the approach used in the project are participatory and creating ownership in the communities? How have these efforts been monitored?
Conclusions and Recommendations
a) Main conclusions drawn from analysis with evidence provided during field visits and observations;
b) A set of recommendations linked to the conclusions that would provide guidance to Malteser International for future interventions in Kayin State and in project-related sectors

III. Evaluation Methodology
An independent international consultant and at least one national evaluation facilitator will be contracted (international consultants do currently not have access to the target villages but only to the Program Office in Hpa An). Consultants can apply individually, it is however preferred that established teams submit a joint application. The selected consultants will receive all relevant documents from Malteser International for desk study at least 15 days prior to the start of the evaluation in the field. The evaluation team will conduct a 10-day field assessment in Kayin State which will include visits to selected target communities as well as interviews and/or conduct focus group discussions with staff members, beneficiaries of the project activities, target groups, and other stakeholders such as:
a) Malteser International project staff working in Kayin State
b) Community-based health and WASH volunteers and committees
c) Individual beneficiaries such as villagers, teachers, village leaders, religious leaders etc.
d) Government health care providers (Township Medical Officer, Basic Health Staff)
e) Local authorities (state, township and village administrators, health officials and officials from other relevant government departments)
In coordination with Malteser International, the consultants will elaborate a list of the specific meetings they wish to conduct and villages to be visited during the field assessment to allow for the related administrative and logistics arrangements (e.g. accommodation, transport, travel authorisations) and schedule of appointments. Malteser International will provide transportation of the consultant team from Yangon to Hpa An and further to the target villages as well as render translation services (Sgaw Kayin language to Burmese/English, Burmese to English) whenever necessary. A briefing meeting with representatives of Malteser International is foreseen in Yangon in order to finalise the organisation of the evaluation. A joint debriefing session/review workshop will be held in Hpa An, Kayin State before departure.

IV. Timeframe
The evaluation is expected to take place in June 2018 with the following preliminary timeframe:
Preparation and desk study, preparation of interview guidelines, team coordination 2 days
(If applicable) International travel to and from Yangon 2 days
Briefing with Malteser International in Yangon and travel to Hpa An, Kayin State 1 day
Joint review workshop with Malteser International and partners in Hpa An 1 day
Field visits to target villages 10 days
Debriefing/review workshop in Hpa An and return travel to Yangon 1 days
Reporting 5 days
Total Max. 22 days

V. Reporting
Key deliverable will be a consolidated evaluation report. The final report will consist of the following three parts:
1) Executive summary (standalone character, max. 5 pages)
2) Main report focusing on the questions raised in this ToR under the five headings (relevance, efficiency, effectiveness, impact and sustainability, conclusions and recommendations, max. 30 pages)
3) Annex of main supporting documents, agenda, maps, interview guidelines, questionnaires etc.
As part of the process, the evaluation team will submit the following documents:
Before leaving the field: A debriefing note (2-3 pages) which will contain a summary of main findings and recommendations to Malteser International. The debriefing note/summary will be discussed during the debriefing session/review workshop in Malteser International’s Program Office in Kayin State

3 weeks after departure from the field:
Draft report (electronic version, max. 30 pages) in English to Malteser International’s Program Office in Kayin State, Country Office in Yangon and HQ in Cologne
2 weeks after feedback from Malteser: Final report (electronic version, max. 30 pages) in English to Malteser International’s Program Office in Kayin State, Country Office in Yangon and HQ in Cologne

The report and all background documentation will remain the property of Malteser International and will be promulgated as appropriate by Malteser International.

VI. Required Expertise
Essential:
• Demonstrated capacity and experience (at least 5 years) in evaluating development and/or humanitarian projects, preferably in the South East Asian context
• Technical knowledge and experience in one or more of the following fields: Health, WASH, nutrition, and livelihood
• Fluency in English (spoken/written)
• Experience in working with (local and international) non-governmental organizations
• Understanding of Myanmar language (one person in consultant team)
• Demonstrated oral and written communication skills
• Demonstrated cross-cultural skills

Desirable:
• Previous work experience in Kayin State or Myanmar and knowledge of the Thai-Myanmar border context
• Familiarity with community-based health care, WASH and nutrition/livelihood projects in under-developed and complex environments
• Valid Myanmar MoHS visa / Business visa (facilitation of business visa possible).

VII. Tenders
Bids must include:
1) 1-2 pages outline covering: a) overall framework proposed for evaluation and b) methodologies that will be applied.
2) CV(s) and evidence/references of past evaluations.
3) Work plan and proposed budget for the evaluation covering consultancy fees, travel to Yangon and per diem. The budget should present consultancy fee costs according to number of expected working days over the entire period.

Bids should be submitted electronically to Malteser International by the closing date of 27.04.2018 to:

• Kai Pohlmann, Program Manager (Headquarters Germany) at kai.pohlmann@malteser-international.org
• Dr. Soe Naing, Program Coordinator (Program Office Kayin State) at soe.naing@malteser-international.org