Call for Consultant “Endline/Final Evaluation” BLOOM Indonesia Project

TERMS OF REFERENCE

Endline/Final Evaluation: BLOOM Indonesia Project
“Child Marriage, Adolescent Sexual and Reproductive Health and Right (ASRHR), Risky Behaviours, Life Skills, and Workforce Preparedness of Youth in Nagekeo, Sikka, and Lembata Districts”

Location:Nagekeo, Sikka dan Lembata
Application Deadline:23 November 2020
Contract Type:Professional Service Contract
Working Language:                                      The Report will be submitted bilingually in Bahasa Indonesia and English
Expected Starting Date:

27 November 2020
Contract Period:    27 November to 26 December 2020  
  1. About Plan International in Indonesia
    About Plan International

    We strive to advance children’s rights and equality for girls all over the world. As an independent development and humanitarian organisation, we work alongside children, young people, our supporters and partners to tackle the root causes of the challenges facing girls and all vulnerable children. We support children’s rights from birth until they reach adulthood and enable children to prepare for and respond to crises and adversity. We drive changes in practice and policy at local, national and global levels using our reach, experience and knowledge. For over 80 years we have been building powerful partnerships for children, and we are active in over 75 countries.

About Yayasan Plan International Indonesia (YPII)
Plan International has been operating in Indonesia since 1969, according to the Memorandum of Understanding with the Government of Indonesia. In 2017, Plan International Indonesia transformed into Yayasan Plan International Indonesia; registered by the Ministry of Law and Human Rights. This transformation aims to reach more children, especially girls in Indonesia. In YPII Country Strategy 4 (CS4) 2017 – 2022, the objective of Adolescent Health and Agency (AHA) is Girls and young women
make safe and informed decisions about their sexual and reproductive health, are able to decide when and whom to marry and protect themselves from risky behavior. The program has three outcomes, as following:
Outcome 1: Adolescents, particularly girls and young women, understand and uphold their SRHR (sexual and reproductive health and rights)
Outcome 2: Adolescents, particularly girls and young women, are supported by their communities to get their sexual and reproductive health and rights
Outcome 3: Adolescents, particularly girls and young women, are protected by local and national government through gender-responsive policies that ensure healthy and productive life choices

2. Project Background

Better Life Options and Opportunities Model (BLOOM) Indonesia Project, under Plan International, has been rigorously evaluated and proven effective for the gender-transformative delivery of life skills and empowerment of adolescents, particularly girls. BLOOM project is focusing on the province of Nusa Tenggara Timur (NTT), which is one of Indonesia’s most impoverished and underdeveloped regions. The majority of people living in NTT are subsistence farmers. Major issues impacting the population include unemployment, lack of access to education, early pregnancies, and high infant and maternal mortality rates. The goal of this project is to support 1,800 adolescent girls (70 percent) and boys (30 percent), aged 13-19, the majority of whom are out-of-school, in Sikka, Nagekeo, and Lembata, to envision and attain productive futures through integrated gender and life skills education and practical skill building in workforce preparedness.

The Project has conducted a baseline study in October 2017 in implementing area in Nagekeo, Sikka and Lembata. There are some key findings of the baseline which related to the project framework, such as:

  1. The national census data showed that the rate of child marriage was relatively high in Sikka – 4.63% of male and 16.37% of females aged 13 to 19 years reported that they have ever been married. Meanwhile for the two other areas, the total prevalence in the two areas were 1% among boys and 2% among girls in Nagekeo; and 1% among boys and 5% among girls in Lembata
  2. While only 0.7% of girl participants mentioned that they are currently married or have ever been married.
  3. 93% adolescents have future dreams and goals and only 25% of them have plans and sufficient capacity to achieve the goals
  4. High rate of teenage pregnancies in the districts of intervention indicates an alerting condition for the adolescent reproductive health program, due to both health and non-health consequences. In 2016, there were 558 teenage pregnancies in Sikka, 50% of 156 girls aged 18 years old or younger who pregnant in Lembata during the same period, was 12 – 13 years of age
  5. Child marriage leads to several consequences, for the family and the couple itself. This includes financial and economic burden, unbalanced gender power relation that potentially leads to domestic violence, risk of conflict and separation, lack of education, and child neglect.
  6. Unsafe sexual behavior leading to pre-marital pregnancy has to become a great concern of stakeholders and parents. As the result, reproductive health education for the adolescent is supported by the community, including village leaders, and parents.
  7. Job aspirations among the youth are disproportionally skewed to high-skilled academic trainings (For example, the proportion of girls who were willing to become a teacher in Sikka, Nagekeo, and Lembata was 33.1%, 25.4%, and 38.3%, respectively) that are inherently high risk for financially poor and low skills youth background
  8. The level of adolescents’ readiness to enter the world of work is still low in the intervention areas. Majority of them feel do not need training or do not know what training is right for them. Perhaps it is due to lack of references for young people in the village
  9. Among many other reasons, for instance, the social expectation of taking care of children, and insufficient soft and hard-skills, parental financial incapability is the major triggers of youth decision to discontinue their education. All of these factors contribute to the lack of work preparedness. Government agencies such as District Education Office and District Labor Office provide short-term vocational training, but these training lack connection to market demand and possible access to working capital.

Duration:
The project duration was initially three years (01.01.2017-31.12.2019). However, it has been extended 2 times with No Cost Extension (NCE), firstly NCE until June 2020 and secondly until November 2020, due to Pandemic COVID 19.

Funding:
The total budget of the project is 699,227.06 EUR. It is mainly funded by Plan USA (USNO) under their BIAAG Fund Appeal (BP#104).

Geographic areas and target groups:
The target areas of the project are the 3 districts Nagekeo, Sikka and Lembata in East Nusa Tenggara Province (NTT).
Direct Beneficiaries:
• 1800 youth (70% girls, 30% boys) aged 13 to 19 years in Lembata, Nagekeo and Sikka Districts, East Nusa Tenggara/NTT province in Indonesia.
• 60 facilitators in Lembata, Nagekeo and Sikka Districts, East Nusa Tenggara/NTT province in Indonesia.
• 2500 Parents/Family Forum to support youth personal and career development opportunities for Adolescent Girls and Boys in Lembata, Nagekeo and Sikka Districts, East Nusa Tenggara/NTT province, Indonesia.

Project Logic:
Project Impact
To contribute decreased number of Child Marriage (CM) and increased pre-employment in Sikka, Nagekeo and Lembata
Overall Objective
To support 1,800 adolescent girls (70% = 1260) and boys (30% = 540), aged 13-19, in Sikka, Nagekeo, and Lembata districts, to envision and attain productive futures through integrated gender and life skills education and practical skill building in workforce preparedness.
Outcome 1: Improved Agency and Capacity to Make Healthy Life Choices
Output 1.1. 60 facilitators trained and certified to implement BLOOM
Activity 1.1.1. TOT on BLOOM Curricula (Choose a Future and Ready for Work)
Activity 1.1.2. Training on BLOOM Curricula (Choose a Future and Ready for Work)
Activity 1.1.3. Refresh Training on BLOOM Curricula (Choose a Future and Ready for Work)
Activity 1.1.4. Facilitators Regular Meeting
Output 1.2. Facilitators apply their facilitation skills using effective and fun method
Activity 1.2.1. Youth training cycle on BLOOM (Choose A Future & Ready for Work)
Activity 1.2.2. Facilitators’ Positive Feedback from youth
Output 1.3. Youth enrolled in BLOOM program
Activity 1.3.1. Selection of Youth
Activity 1.3.2. Pre-Test
Output 1.4. Adolescent girls and boys increased knowledge on ASRH
Activity 1.4.1. Youth Training Cycle on Choose A Future and Ready for Work
Activity 1.4.2. Project Support Committees (PSC) action plan to support for youth personal development (girls football, youth-parents’ competition, movie watching – related to risky behaviors and child marriage prevention, youth creativity competition – speech, posters, writings)

Output 1.5. Adolescent girls and boys have graduated BLOOM program
Activity 1.5.1. Youth Training Cycle on Choose A Future and Ready for Work
Activity 1.5.1. Youth Graduation

Outcome 2: Improved capacity to demonstrate transferrable employment-relevant skills using Ready for Work Curriculum
Output 2.1. Youth trained in transferable employment-relevant skills using Ready for Work Curriculum
Activity 2.1.1. Youth training on ready for work
Output 2.2. Youth has successfully developed a CV and application letter
Activity 2.2.1. Youth Employment Boot-camp
Outcome 3: Increase Community and Government support for personal and career development opportunities for Adolescent Girls and Boys
Output 3.1. Increase Capacity of government stakeholders to support personal and career development opportunities for Adolescent Girls and Boys
Activity 3.1.1. Government coordination and network meetings
Activity 3.1.2. Advocacy workshops at district level
Output 3.2. PSCs are established and linked to CBCPM (Community Based Child Protection Mechanism)
Activity 3.2.1. Selection of PSC members (PSC establishment) in Sub-District/Village Level
Output 3.3. Increase Capacity of PSC Members to support for personal and career development opportunities for Adolescent Girls and Boys
Activity 3.3.1. PSC (monthly) meeting
Activity 3.3.2. PSC semi-annual capacity building
Output 3.4. Inclusive Learning Center (ILC) is established & functioned to support for personal and career development opportunities for Adolescent Girls and Boys
Activity 3.4.1. Establishment of Learning Center at village level
Activity 3.4.2. Activities in Learning Center (Youth Training Cycles, Youth additional activities, PSC meetings)
Output 3.5. Parents/Family Forum to support youth personal and career development opportunities for Adolescent Girls and Boys
Activity 3.5.1. Parents’ meeting

3. Evaluation Focus
3.1 Purpose of the Evaluation

The objectives of the evaluation are to (1) compare the results of the baseline study with the current situation of the project (2) assess the program outcomes indicated in the project framework (3) assess the effectivity, efficiency and quality of project implementation and management (4) assess good practices of the beneficiaries and the project as well as success stories and the lesson learned/testimonies (5) assess the project contribution (impact) to community, government and policy/regulation (6) produce recommendation for the purpose of the next project development
Result from this evaluation is expected to have a comprehensive report on the project end-line and final evaluation based on the objectives of this study.

3.2 Evaluation Criteria & Questions
The criteria for this evaluation shall be the following with prioritization of the first four:
1. Relevance: the extent to which the interventions and their approaches were suited to the priorities and policies of the people and communities they were intended to benefit.

2. Effectiveness: the extent to which, and the reasons behind, the achievement (or not) of the project or programme’s objectives, and whether these are leading to unintended (positive or negative) consequences for anybody involved or affected by the interventions.

3. Impact: to establish causal attribution to any observed positive and negative, primary and secondary long-term effects observed.

4. Sustainability: the probability of continued long-term benefits to the target populations after the project or programme has been completed. This might include the resource and capacity of partners or beneficiaries to continue the intervention after phase out.

5. Child rights, gender and inclusion: the extent to which the project or programme applied gender and inclusion sensitive approaches and explicitly aimed for results that improve the rights of children and young people and gender equality.

6. Efficiency: the extent to which financial resources were used economically and efficiently, potentially including cost-benefit ratios and alternative programming approaches

3.3 Evaluation Questions:

  1. Under Relevance:
  • Did the intervention adapt the right design based on the needs of the beneficiaries and the context of the target region?
  • 2. Under Effectiveness:
  • Has the intervention achieved its objectives? (This includes measuring the project indicators and critically reflecting on the performance from baseline to end-line in comparison to the target values).
  • What intended or unintended effects did the project have on the lives of the beneficiaries and the communities?
  • Were the right indicators chosen to effectively measure impact?
  • Was the capacity of the project team sufficient to successfully implement the project? Which deficits can be observed if any?
  • What lessons learnt can be drawn and recommendations given for:
    a) the implementation of future projects in the same geographic region
    b) the implementation of future projects in the same thematic area
    c) for project management in general? What were strengths? What were weaknesses?
  1. Under Impact:
  • What difference to the lives of the beneficiaries did the intervention make?

  • 4. Under Sustainability:
  • Which outlook on lasting of positive or negative effects of the intervention do beneficiary groups opine?5. Under Child rights, gender and inclusion:
  • Did the intervention successfully and coherently adapt Plan’s organisational approaches on participative processes, gender equality, and child safeguarding?

3.4 Child rights, gender, and inclusion
All Plan International staff and consultants hired by Plan International must adhere to Plan Internationals Child and Youth Safeguarding Policy. The consultant must obtain written/ verbal consent from the respondents of primary data collection. Permission from parents must be sought if the children under 18 years are involved. Signed informed consent of each child and his/her parents need to take after explaining purpose of the study and its usage. Details on child safeguarding will be provided during the inception briefing.
All projects managed by Plan International and its partners should be aligned with Plan Internationals global ambition to reach 100 million girls, using gender transformative approach in delivering its tasks. In this assignment, the consultant is expected to understand and evaluate addressing gender norms, strengthening girls’ and young women’s agency, advancing girls’ and women’s condition and position, working with boys and men to embrace gender equality, responding to the needs and interest of girls and boys in all their diversity, and fostering an environment that enables gender equality and girls’ rights.

4. Users of the Evaluation
The target audience of this final evaluation are
1) The project team,
2) Project Beneficiaries: Adolescents, Project Support Committees/KPAD, Parents/Family/Caregivers, Facilitators (Master Trainers/Villager Facilitators), Community Leaders
3) Local government stakeholders.
A dissemination plan will be developed by Yayasan Plan International Indonesia at the start of the evaluation.

5. Methods for Data Collection and Analysis
This evaluation shalll use combination of quantitative and qualitative methodology including document review and secondary data as relevant. This evaluation is expected to be conducted in 30 villages of BLOOM area in Lembata, Sikka and Nagekeo. The sampling of the quantitative method should be covered all BLOOM beneficiaries group (Adolescent, village facilitators, Project Support Committees, parents, and government in all levels) according to project indicators. The consultant should provide sampling matrix based on the project outcomes indicators. Based on the findings of the quantitative and qualitative data collection the evaluation team is asked to derive concrete recommendations of what could be improved in future programming, thus allowing the users of the evaluation to revise their work approaches.
Any method proposed needs to be in line with Plan International’s MERL Standards – namely that it is ethical and consider the needs and wellbeing of any respondents involved including age appropriate approaches.

5.1 Sample (3 – 4 sentences)
This evaluation will use both qualitative and quantitative methods in three districts of Lembata, Nagekeo, and Sikka, in NTT.
Sample number estimation is expected in accordance with Baseline sample numbers (433 sample)
Below is table summarizing project location and beneficiaries:

5.2 Participant Selection
Representatives from key stakeholders and target groups should be given the opportunity to provide feedback on the project to the evaluator(s). This includes:

  • Project manager and project coordinator from PII
  • Consultants hired as Project Field Facilitator who were the implementer of the project
  • Youth/Adolescents who joined the youth training cycles
  • Parents of the youth/Adolescents who joined the who joined the youth training cycles
  • Community leaders
  • Project Support Committees (PSCs)/KPAD
  • Village Facilitators
  • Local line ministries
    The evaluator(s) is also welcome to identify and suggest additional or excluded stakeholders that they feel are important to involve to ensure they get the information they need to answer the Evaluation Questions.

6. Ethics and Child Safeguarding
Plan International is committed to ensuring that the rights of those participating in data collection or analysis are respected and protected, in accordance with Ethical MERL Framework and our Child and Youth Safeguarding Policy. All applicants should include details in their proposal on how they will ensure ethics and child protection in the data collection process. Specifically, the consultant(s) shall explain how appropriate, safe, non-discriminatory participation of all stakeholders will be ensured and how special attention will be paid to the needs of children and other vulnerable groups. The consultant(s) shall also explain how confidentiality and anonymity of participants will be guaranteed.

7. Key Deliverables
Within the timeframe of the consultancy, the evaluator(s) should complete the following deliverables:

9. Budget
The total amount paid to the consultant(s) in addition to the daily rate of the consultancy includes the total budget necessary to conduct the evaluation. Specifically, it includes:

  • IT equipment
  • Translation costs
  • Internet credit
  • Travel costs
  • Insurance
  • Expenses/per diems
  • VAT/taxes
    YPII will provide support for logistic arrangements as relevant. This might include key documents, facilitating contact and support letters to access key respondents.
    The consultant is expected to present a budget table outlining how the requested total budget splits into the items mentioned above.

10. Annex

Can be downloaded at:

https://planinternational-my.sharepoint.com/:w:/g/personal/indra_sibarani_plan-international_org/EQS0iEkJQW1LtNSL5HNEcuQBnJAZoQX5jfoDACVVmZQ1Dw?e=AOp1Tr

11. Expected Qualifications
The required skills and competences for the consultant are:

  • At least 5 years’ experience in conducting baseline, mid-term and end-term evaluations with (I)NGOs
  • Specific knowledge and expertise in SRHR are preferable
  • Research experience in the SRHR or health sector and preferably proven experience in quantitative and qualitative data analysis
  • Experience working with participatory approach
  • Proven experience with a portfolio and recommendations
  • Good communication skills, with the ability to explain complex problems or concepts in simple and easy-to-understand language
  • Experience working with participatory approach
  • Experience in researches involving marginalized or vulnerable children, young people and communities (desirable)
  • Demonstrated understanding of and commitment to children’s rights, gender equality and development issues
  • Experience in working across multiple sectors including with INGOs. Knowledge of Plan International/Plan Indonesia and its work (desirable)
  • Fluent in Indonesia language and proficient in the use of English, both oral and written.

12. Application Procedure
Yayasan Plan International Indonesia (Plan Indonesia) will coordinate the application and hiring process locally. Firms/teams of consultants with relevant expertise and portfolio are invited to apply for the assignment by sending:

  1. A letter of intent expressing the consultant’s or firm’s capabilities and qualifications including a response to the ToR
  2. Proposal of the assignment with the following content:
    (a) background; (b) approach and methodology of the assignment outlining key activities and key deliverables produced and proposed content of the evaluation; (c) workplan; (d) Ethics and child safeguarding approaches, including any identified risks and associated mitigation strategies; (e) personnel involved including their CVs and detail task and responsibilities related to the evaluation;
  3. Proposed detailed budget, including daily fee rates, expenses, taxes, etc. for all personnel involved as outlined above
  4. Proposed timelines
  5. Organization Profile with the information on: (a) current and previous relevant works and clients/users; (b) CV of the personnel involved in the assignment and their key responsibilities/roles in the assignment.
  6. Police Certificates of Good Conduct
    The above documents can be sent electronically through the email: yayasan.procurement@plan-international.org; mentioning the code [BLOOM_Evaluation] in the email subject, before 17.00 PM, latest on 23 November 2020.
    Or send in hardcopy in a sealed envelope with the code [BLOOM_Evaluation] in the left corner of the envelope to:
    Yayasan Plan International Indonesia
    Menara Duta Building, 2nd Floor
    Jl HR Rasuna Said, Kav B9, Kuningan
    Jakarta, Indonesia
    Tel: Office +62-21-5229566
    Fax: +62-21-5229571