TERMS OF REFERENCE
End-Line and Final Evaluation:
“Promoting Sustainable Consumption and Production in the Fish Processing Sector (MATA KAIL)”
|Location:||Lembata, Nagekeo, Sikka district of NTT Province|
|Application Deadline:||24 November 2020|
|Contract Type:||Professional Service Contract|
|Working Language:||The Report will be submitted in 2 versions, one in Bahasa Indonesia and one in English|
|Expected Starting Date:||1 December 2020|
|Contract Period:||1 December to 19 February 2021|
- About Plan International in Indonesia
About Plan International
We strive to advance children’s rights and equality for girls all over the world. As an independent development and humanitarian organisation, we work alongside children, young people, our supporters and partners to tackle the root causes of the challenges facing girls and all vulnerable children. We support children’s rights from birth until they reach adulthood and enable children to prepare for and respond to crises and adversity. We drive changes in practice and policy at local, national and global levels using our reach, experience and knowledge. For over 80 years we have been building powerful partnerships for children, and we are active in over 75 countries.
About Yayasan Plan International Indonesia (YPII)
Plan International has been operating in Indonesia since 1969, according to the Memorandum of Understanding with the Government of Indonesia. In 2017, Plan International Indonesia transformed into Yayasan Plan International Indonesia; registered by the Ministry of Law and Human Rights. This transformation aims to reach more children, especially girls in Indonesia. In YPII Country Strategy 4 (CS4) 2017 – 2022, the objective of the Youth Employment and Entrepreneurship (YEE) program is youth, in particular young women, have access to employment and business opportunities, according to their choice. The program has three outcomes, as follow
- Outcome 1: Youth (15-29 years old), particularly young women, have relevant skills to enter workforce in safe environments with improved incomes and set up businesses in safe environment.
- Outcome 2: Private sector, TVET Institutions and Business Incubators are actively involved in supporting youth, particularly young women, to provide market-driven capacity development, and access to financial assistance or employment.
- Outcome 3: Secured national and local government commitment to support youth, particularly young women to enter productive work and set up businesses or enterprise.
2. Project Background
The MATA KAIL-Project is implemented by consortium consisting of the following entities:
1. Plan International Germany (Lead Applicant and Coordinator)
2. Yayasan Plan International Indonesia (Co-Applicant)
3. Bengkel Appek (Co-Applicant)
4. Kopernik (Co-Applicant)
The project duration is three years (01.03.2018-28.02.2021).
The total budget of the project is 1.613.898,74 EUR. It is mainly funded by the European Union under their Switch Asia II grant programme. Co-Funding (25%) comes from Plan International Germany.
Geographic areas and target groups:
The target areas of the project are the 3 districts Nagekeo, Sikka and Lembata District in East Nusa Tenggara Province (NTT).
- 2,000 youth (1,400 female, 600 male) aged 15 to 29 years in Lembata, Nagekeo and Sikka Districts, East Nusa Tenggara/NTT province in Indonesia.
- 160 SMEs and MSMEs in Lembata, Nagekeo and Sikka Districts, East Nusa Tenggara/NTT province in Indonesia.
- 30 Government Facilitators for Community Training in Sustainable Consumption.
- Working groups in National and District Levels, consist of stakeholder in relation to SCP Practices in fisheries, namely; the Ministry of Women’s Empowerment and Child Protection; members of gender working groups from the Ministries of Education, Industry, Manpower and Cooperative, Small and Medium Sized Enterprises, and Social Affairs; the Department of Marine and Fisheries, Health, and Social affairs.
- 1,350 parents and caregivers (men and women) who are members of parenting groups in Lembata, Nagekeo and Sikka Districts, East Nusa Tenggara/NTT province, Indonesia.
- 120,361 youth (58,667 female and 61,694 male) in Lembata, Sikka and Negekeo Districts of NTT province aged 15 to 29 and potentially all youth in Indonesia.
- 132,171 (70,191 female; 61,980 male) of population in Lembata; 139,577 (71,660 female; 67,917 male) of population in Nagekeo; and 313,509 (165,384 female and 148,125 male) of population in Sikka, NTT Province.
To promote sustainable economic growth and employment opportunities of marginalized youth, particularly young women, in the fisheries sector in Indonesia.
Outcome 1. Empowerment of Small and Medium-sized Enterprises (SMEs) and Micro, Small and Medium-sized Enterprises (MSMEs) to provide environmentally friendly and sustainable processes, products and services in the fisheries sector which will promote employment opportunities to marginalized youth, particularly young women.
Output 1.1: 160 SMEs and MSMEs apply sustainable fish processing technologies and practices.
Activity 1.1.1: Capacitate 160 SMEs and MSMEs to apply environmentally friendly fish processing technologies and practices.
Output 1.2: 2,000 youth (1,400 female, 600 male) age 15-29 years are trained on sustainable fish processing, soft skills and green entrepreneurship skills (with 80% obtain decent work or establish a successful sustainable MSME).
Activity 1.2.1: Provide sustainable fish processing skills, soft skills and green entrepreneurship skills for the fish-processing sector to 2,000 youth (1,400 young women, 600 young men) aged 15-29 years.
Activity 1.2.2: Facilitate apprenticeship for youth to obtain employment opportunities in SMEs and MSMEs. Establish a Fishermen/women network.
Activity 1.2.3: Establishes a Fishermen/women’s network.
Output 1.3: 160 MSMEs have access to micro-finance services.
Activity 1.3.1: Engage in dialogue with the local government and MFIs to promote financing SMEs and MSMEs in fish processing sector.
Activity 1.3.2: Provide technical assistance for increasing access to microfinance for 160 SMEs/MSMEs.
Output 1.4: Joint action plan (Government, MSMEs and SMEs, MFIs, research academic and business association) on supporting sustainable production in fish processing sector in Lembata, Nagekeo and Sikka Districts of NTT.
Activity 1.4.1: Develop a joint action plan on SCP in the fish-processing sector (local government, SMEs/MSMEs, MFIs, research academic, business association).
Outcome 2: Increased knowledge, skills and attitudes of parents and caregivers, particularly young women, in promoting sustainable consumption patterns of fisheries products in order to achieve healthy and well-nourished children, particularly girls.
Output 2.1: Increased knowledge of 1,350 parents and caregivers (women and men) on Sustainable Consumption and Production (SCP) particularly on food safety & quality.
Activity 2.1.1: Provide capacity building for 30 government facilitators and 1,350 parents and caregivers to promote changes towards sustainable consumption patterns and behaviour particularly on food safety and quality of fish processing products.
Output 2.2: 600 youth, parents and caregivers are trained as retailers of cleaner fish-based processed food/products.
Activity 2.2.1: Train 600 youth, parents and caregivers as retailers for cleaner fish-based processing food/products.
Output 2.3: Improved government fish consumption campaign in Lembata, Nagekeo and Sikka Districts that integrates sustainable consumption principles is initiated.
Activity 2.3.1: Conduct youth-led advocacy to local government to integrate sustainable consumption principles in current government’s fish consumption campaign in Lembata, Nagekeo and Sikka Districts.
Activity 2.3.2: Conduct youth-led (in community) and girls-led (at school) campaign on SCP particularly on food safety and quality of fish processing products.
Activity 2.3.3: Promote the adaption and incorporation of SCP training modules from the action into national training programs (Y3).
3. Evaluation Focus
3.1 Purpose of the Evaluation
The purpose of the final evaluation is to critically reflect on the overall implementation quality of the project by assessing the relevance of the project design in the given context and as perceived by the beneficiary groups. This includes identifying the strengths and weaknesses of the project management and implementation. In addition, intended and unintended effects of the project on the beneficiaries and their communities shall be critically analyzed. Based on this analysis, the evaluation shall produce lessons learnt and recommendations for a) future programming in the geographic area, and b) in the thematic area; c) for partner selection, and d) for improving project management.
An additional purpose of this final evaluation is to verify indicator targets to inform the final reporting to the donor.
3.2 Evaluation Criteria & Questions
The criteria for this evaluation shall be the following with prioritization of the first four:
1. Relevance: the extent to which the interventions and their approaches were suited to the priorities and policies of the people and communities they were intended to benefit.
2. Effectiveness: the extent to which, and the reasons behind, the achievement (or not) of the project or programme’s objectives, and whether these are leading to unintended (positive or negative) consequences for anybody involved or affected by the interventions.
3. Impact: to establish causal attribution to any observed positive and negative, primary and secondary long-term effects observed.
4. Sustainability: the probability of continued long-term benefits to the target populations after the project or programme has been completed. This might include the resource and capacity of partners or beneficiaries to continue the intervention after phase out.
5. Child rights, gender and inclusion: the extent to which the project or programme applied gender and inclusion sensitive approaches and explicitly aimed for results that improve the rights of children and young people and gender equality.
6. Efficiency: the extent to which financial resources were used economically and efficiently, potentially including cost-benefit ratios and alternative programming approaches
3.3 Evaluation Questions:
1. Under Relevance:
- Did the intervention adapt the right design based on the needs of the beneficiaries and the context of the target region?
2. Under Effectiveness:
- Has the intervention achieved its objectives? (This includes measuring the project indicators and critically reflecting on the performance from baseline to endline in comparison to the target values).
- What intended or unintended effects did the project have on the lives of the beneficiaries and the communities?
- Were the right indicators chosen to effectively measure impact?
- Was the capacity of the project consortium sufficient to successfully implement the project? Which deficits can be observed if any?
- What lessons learnt can be drawn and recommendations given for:
- the implementation of future projects in the same geographic region
- the implementation of future projects in the same thematic area
- for partner selection of future projects
- for project management in general? What were strengths? What were weaknesses?
3. Under Impact:
- What difference to the lives of the beneficiaries did the intervention make?
4. Under Sustainability:
- Which outlook on lasting of positive or negative effects of the intervention do beneficiary groups obtain?
5. Under Child rights, gender and inclusion:
- Did the intervention successfully and coherently adapt Plan’s organisational approaches on participative processes, gender equality, and child safeguarding?
3.4 Child rights, gender, and inclusion
All Plan International staff and consultants hired by Plan International must adhere to Plan Internationals Child and Youth Safeguarding Policy (see Annex 2). The consultant must obtain written/ verbal consent from the respondents of primary data collection. Permission from parents must be sought if the children under 18 years are involved. Signed informed consent of each child and his/her parents need to take after explaining purpose of the study and its usage. Details on child safeguarding will be provided during the inception briefing.
All projects managed by Plan International and its partners should be aligned with Plan Internationals global ambition to reach 100 million girls, using gender transformative approach in delivering its tasks. In this assignment, the consultant is expected to understand and evaluate addressing gender norms, strengthening girls’ and young women’s agency, advancing girls’ and women’s condition and position, working with boys and men to embrace gender equality, responding to the needs and interest of girls and boys in all their diversity, and fostering an environment that enables gender equality and girls’ rights.
4. Users of the Evaluation
The target audience of this final evaluation are
1) the project consortium as listed above,
2) the donor European Union and its Switch Asia facility,
3) Other Plan International offices
4) local government stakeholders.
A dissemination plan will be developed by Yayasan Plan International Indonesia at the start of the evaluation.
5. Methods for Data Collection and Analysis
This evaluation shall use a combination of quantitative and qualitative methodology and analysis including the use of document review and secondary data. A result-based evaluation is desired to measure and/or verify target indicators as expected in the logframe of the approved project proposal. Based on the findings of the quantitative and qualitative data collection the evaluation team is asked to derive concrete recommendations of what could be improved in future programming, thus allowing the users of the evaluation to revise their work approaches.
Sustainability at the business entity level might entail business analytics tools for youth or MSMEs business such as IRR to project business profitability and sustainability. Any method proposed needs to be in line with Plan International’s MERL Standards – namely that it is ethical and consider the needs and wellbeing of any respondents involved including age appropriate approaches.
This evaluation will use a mostly qualitative method with a possibility limited quantitative in NTT Province, specifically in three districts of Lembata, Nagekeo, and Sikka.
If time allowed, the evaluation could utilize sampling method of 10% - 20% mainly youth beneficiary respondents in targeted location. Below is table summarizing project location and beneficiaries
|Type of Program Beneficiaries||Lembata||Nagekeo||Sikka|
|1. Youth age 15 – 29||356||348||320||417||270||465|
|2. Parents/ caregivers||497||99||71||425||60||319|
|Type of Program Beneficiaries||Lembata||Nagekeo||Sikka|
Qualitative method could use purposive sampling of key respondents such as youth beneficiaries, SME, parents and caregivers, key village/community leaders, key local government partners, key management staffs of local organization partners, and the implementing program staff.
The detail of sampling and respondent number will be proposed and elaborated by the evaluation consultant team in the inception report/evaluation design document upon the suitability of the program context, time, and resources.
5.2 Participant Selection
Representatives from key stakeholders and target groups should be given the opportunity to provide feedback on the project to the evaluator(s). This includes:
- Project managers from YPII, Bengkel Appek and Kopernik (incl. if possible former staff who have resigned during the project)
- Program Specialist from Plan Germany
- Consultants hired for field activities and module design
- Community leaders
- Local line ministries
- Youth beneficiaries
The evaluator(s) is also welcome to identify and suggest additional or excluded stakeholders that they feel are important to involve to ensure they get the information they need to answer the Evaluation Questions.
6. Ethics and Child Safeguarding
Plan International is committed to ensuring that the rights of those participating in data collection or analysis are respected and protected, in accordance with Ethical MERL Framework and our Child and Youth Safeguarding Policy. All applicants should include details in their proposal on how they will ensure ethics and child protection in the data collection process. Specifically, the consultant(s) shall explain how appropriate, safe, non-discriminatory participation of all stakeholders will be ensured and how special attention will be paid to the needs of children and other vulnerable groups. The consultant(s) shall also explain how confidentiality and anonymity of participants will be guaranteed.
7. Key Deliverables
Within the timeframe of the consultancy, the evaluator(s) should complete the following deliverables:
|Inception Report||Word-File submitted via email||20 pages + annexes||5 days after start of assignment||In English including:an updated timeline; an evaluation matrixdetailed methodology, including draft sampling methodology and size; draft data collection tools;ethical considerations; consent forms for any primary data collection;(draft) methods for data analysis;brief justification of the methods and techniques used (including relevant underlying values and assumptions/ theories) with a justification of the selections made (e.g. of persons interviewed).|
|Draft Evaluation Report||Word-File submitted via email||50 pages + annexes||10 days after completion of data analysis||see Annex 1 in EnglishSample of Success stories and/or testimony|
|Final Evaluation Report||PDF File submitted via email||50 pages + annexes||4 days after presentation of results and revision by Plan||see Annex 1In English and Bahasa Indonesia|
|Final Sampling methodology||Excel File submitted via email||n/a||As annex of final evaluation report||including unit of sampling and sampling frame and size|
|Final Data Collection Tools||Word/Excel File submitted via email||n/a||As annex of final evaluation report|
|Cleaned Data||Excel File submitted via email||n/a||As annex of final evaluation report||including data files (e.g. Excel, SPSS), transcripts of qualitative data syntax/ code books etc.)|
|Presentation of evaluation findings and recommendations||PPT-file presented in learning workshop after completion of draft evaluation report||Ca. 30 mins presentation||Tba||In English|
|Completed Consent Forms (data privacy and image and/or testimony)||Scans of signed forms/PDF submitted via email||n/a||Beginning of assignment||including for children and their caregivers and adults|
|Activity||Time||Days of Work||Responsible||Individuals Involved|
|Tendering||Week 2 – 3 November||7 days||MER Specialist||MER KM Manager, Project Manager, Program Manager, Logistic and Procurement|
|Background Checks and Contracting; Inception Call/Inception Workshop||Week 4 November||2 days panel interview, background check; 1 day inception and contract||Logistic and Procurement Officer||Admin Manager, Program Manager, YEE Advisor, MER Specialist, MER KM Manager|
|Submission of Inception Report and review||Week 1 December||3 day||MER Specialist||MER Specialist, Project Manager, Program Manager, YEE Advisor, MER KM Manager, GNO|
|Preparations for Data Collection||Week 2 – 3 December||7 day||MER Specialist||MER Specialist, Program and Project Manager, YEE Advisor, MER KM Manager|
|Data Collection||Week 1 – 2 January||10 days||MER Specialist||Project Manager, Bengkel APPeK|
|Data Entry ,Cleaning and Analysis||Week 2 – 3 January||5 days||MER Specialist||MER Specialist, Program and Project Manager, YEE Advisor, MER KM Manager|
|Report writing||Week 4 January – Week 1 February||5 days||MER Specialist||MER Specialist, Program and Project Manager, YEE Advisor, MER KM Manager|
|Submission Report and Feedback||Week 1 Feb||3 days||MER KM Manager||MER Specialist, Program and Project Manager, YEE Advisor, MER KM Manager, GNO|
|Submission of Final Report||Week 2 Feb||MER KM Manager, Project Manager, YEE Advisor||MER Specialist, Program and Project Manager, YEE Advisor, MER KM Manager|
|Learning Workshop||Week 3 Feb||1 day||MER KM Manager, Project Manager, YEE Advisor||MER Specialist, Program and Project Manager, YEE Advisor, MER KM Manager|
|Submission of Other Deliverables||Week 3 Feb||MER Specialist|
The total amount paid to the consultant(s) in addition to the daily rate of the consultancy includes the total budget necessary to conduct the evaluation. Specifically it includes:
- IT equipment
- Translation costs
- Internet credit
- Travel costs
- Expenses/per diems
YPII will provide support for logistic arrangements as relevant. This might include key documents, facilitating contact and support letters to access key respondents.
The consultant is expected to present a budget table outlining how the requested total budget splits into the items mentioned above.
Table of Payment Schedule
|Milestone||Detail||Amount to be Paid (%)||Expected Timeframe|
|Inception Report approved||YPII and Plan Germany will provide inputs. Once the inception report is finally approved the payment will be released.||30%||Approx. 10 days after start of assignment|
|Final Evaluation Report approved||After final approval and submission in English and Bahasa Indonesia, the final tranche will be released.||70%||Last week of February|
10. Expected Qualifications
The required skills and competences for the consultant are:
- At least 5 years’ experience in conducting baseline, mid-term and end-term evaluations with (I)NGOs
- Specific knowledge and expertise in economic growth or SMEs development in fishery sector are preferable
- Regional working experience in NTT, preferable in the districts outlined above.
- Proven experience in quantitative and qualitative data methodology and analysis
- Proven experience with a portfolio and recommendations
- Good communication skills, with the ability to explain complex problems or concepts in simple and easy-to-understand language
- Experience in researches involving marginalized or vulnerable children, young people and communities (desirable)
- Demonstrated understanding of and commitment to children’s rights, gender equality and development issues
- Experience in working across multiple sectors including with INGOs. Knowledge of Plan International/Plan Indonesia and its work (desirable)
- Fluent in Indonesia language and proficient in the use of English both oral and written
11. Application Procedure
Yayasan Plan International Indonesia (Plan Indonesia) will coordinate the application and hiring process locally. Firms/teams of consultants with relevant expertise and portfolio are invited to apply for the assignment by sending:
- A letter of intent expressing the consultant’s or firm’s capabilities and qualifications including a response to the ToR
- Proposal of the assignment with the following content:
(a) background; (b) approach and methodology of the assignment outlining key activities and key deliverables produced and proposed content of the evaluation; (c) workplan; (d) Ethics and child safeguarding approaches, including any identified risks and associated mitigation strategies; (e) personnel involved including their CVs and detail task and responsibilities related to the evaluation;
- Proposed detailled budget, including daily fee rates, expenses, taxes, etc. for all personnel involved as outlined above
- Proposed timelines
- Organization Profile with the information on: (a) current and previous relevant works and clients/users; (b) CV of the personnel involved in the assignment and their key responsibilities/roles in the assignment.
- Police Certificates of Good Conduct
The above documents should be sent electronically through the email: firstname.lastname@example.org; mentioning the code [SWITCH_Evaluation] in the email subject, before 17.00 PM, latest on 24 November 2020.
Or send in hard copy in a sealed envelope with the code [SWITCH_Evaluation] in the left corner of the envelope to:
Yayasan Plan International Indonesia
Menara Duta Building, 2nd Floor
Jl HR Rasuna Said, Kav B9, Kuningan
Tel: Office +62-21-5229566