Since 2014, Water.org has been working in Indonesia to fulfil the gap in fulfilling the universal access to water and sanitation. By taking market-driven approaches, Water.org encourages financial sectors’ involvement to mobilize commercial funds towards the water and sanitation sector. In practice, Water.org provides technical assistance to financial institutions to develop new loan products aiming for household water and sanitation improvements, such as household connection, borewell, toilet, and septic tank. Support ranges from conduct market assessment, develop SOP, staffing for the product processes, training about the WSS sector to the relevant team members, piloting, and eventually scale up the product towards all of their coverage areas. Until now, the program has provided technical assistance to over 20 financial institutions, ranging from banks, cooperatives, and venture capitals.
In addition to working in the demand sector by enabling the access to financing, Water.org has also worked with urban water utilities (PDAMs) to strengthen the supply-side of the market. Acknowledging the importance of using household connections for more sustainable-use of water, Water.org assists PDAMs to be able to operate more suitably by developing business plans, delivering effective marketing, and develop installment plans as an alternative source of finance. The support enables PDAMs to further serve the lower-income households as the marginalized segment with more financially sustainable approaches.
As a part of the facilitation, Water.org has developed new Behavioral Change and Communication (BCC) tools aimed to strengthen staffs across financial institution and PDAM partners in demand-generation process. The field staffs across both types of institutions are at the forefront in convincing households in the needs of safe water and sanitation facilities not only to the households themselves, but also the wider communities. Poor use of water and sanitation access would implicate to the deterioration of water quality, the sustainability of water sources, and determining the quality of lives for current and future generations. Thereby, Water.org prepared tools such as WASH manual, videos, and posters to empower the field staffs in conveying appropriate and effective messages into the communities. Prior to expanding the use of the tools, Water.org seeks to work with a consultant to evaluate the effectiveness to the use of the respective IEC materials.
Scope of Work
To evaluate the developed IEC materials, Water.org will work with a consultant to conduct a semi-experimental research in the associated coverage of the financial institutions and PDAMs partners. PDAM partners will be located in Boyolali and Batang, Central Java; while Financial institution’s partner location will be located in Bogor or Bandung West Java. In the past, Water.org has conducted program evaluation to assess the impact of water and sanitation loan but has yet to specifically measure how partners’ field team executes the program in field. Hence, this assignment will require the following activities, but not limited to:
- Design. Consultant and Water.org will work together to design the research framework, which includes review initial documents and other references to benchmark from other countries, and establish the theory of change. Furthermore, Water.org also expects the consultant to conduct pre-assessment to collect data from field by interviewing team members from financial institutions and PDAMs, covering information on partners’ existing marketing strategies and proposing different alternatives aligning the theory of change, including the assumptions, potential risks, strategies for mitigation, and criteria for monitoring.
- Baseline. After theory of change structured in place and consulting with the partner and Water.org, the Consultant should conduct a baseline survey to collect information on households’ knowledge, attitude, and practices in water and sanitation. In consultation with partner and Water.org, the Consultant will determine selected treatment and non-treatment areas. For the purpose of the survey and in anticipation to the following endline survey, the sample should represent potential customers to the financial institutions and PDAMs as the targeted segment with minimum number of samples 300 respondents in total. The list of potential clients or respondents will be prepared by Water.org’s partner prior to the start of the data collection process.
- Tools. In parallel to the baseline research, Water.org and partners will tailor the BCC materials according to results from theory of change and baseline survey. In addition, Water.org and partners will develop the pilot plans that incorporates designated staffs as trainers and field staffs that will be implementing the intervention in the field. Furthermore, the developed communication tools should be ready for circulation and Water.org and Consultant have agreed upon the criteria for monitoring purposes.
- Intervention. Following the finalized BCC materials, Water.org and partner will perform the pilot plan by conducting trainings to the identified areas and ensuring that the designated staffs have adequate knowledge to deliver the BCC materials directly to the communities.
- Monitoring. In line with the intervention process, Water.org and partner will monitor the delivery of these procedures to assess whether the tools are conveyed to the households by the field staffs, by regularly coordinating with the partners and field monitoring as a sample of the program process. Aspects to be monitored shall align with what have been agreed upon in the design process, with the Consultant.
- Evaluation. After 3 months of implementation after tools being introduced by partners to branches staff and messages conveyed to the potential clients, consultant will conduct evaluation through household endline survey. The research design and instrument will be prepared by consultant in parallel with the implementation process.
Depending on the COVID-19 latest conditions, the randomized evaluation would be conducted using a mixed-methods approach using data collected from a variety of sources.
- Household survey: Water.org expects to have at least 300 households during baseline as provided by the partners as their potential customers. During the endline survey, the Consultant shall return to those same respondents respectively, or in the case of attrition replacements, Consultant could find similar households to overcome those limitations. The firm would need to evaluate the household impacts and estimate robust and unbiased treatment effects using an appropriate quasi-experimental design. An appropriate comparison group would be needed to be identified via matching or other techniques. The Consultant is expected to develop the survey questionnaire, covering a range of topics consistent with the evaluation objectives and will primarily be closed ended for quantitative analysis.
- Key informant interviews: Key informant interviews with selected personnel from financial institution and PDAM partner organizations, Water.org, existing or potential customers, and other stakeholders to capture more in-depth qualitative information.
With that, Water.org expects the consultant to provide the following deliverables
- Inception report explaining the research plans, including desk review and outline of evaluation approach, methodology and data collection instruments, and facilitator guides (for qualitative interviews).
- Both raw and clean data collected by the evaluators and codebook (for household surveys) and a summary of code data (from qualitative interviews) of both baseline and endline.
- A draft evaluation report submitted to Water.org for feedback
- A final evaluation report, including a strong executive summary highlighting insights and key recommendations.
- Presentation of the findings and recommendations to Water.org
- Dissemination to partners, stakeholders, and other related parties through partners meeting and/or online meeting.
Proposed Schedule and key dates
|1||Recruiting Consultant(s): put the consulting vacancy online and interview sessions||CVs of potential candidates, Interview result||30 Nov 2020|
|2||Consultant recruited: consultant officially onboard with the project||Agreement||11 Dec 2020|
|3||Program kick off meeting and workplan submission by consultant: requesting submission of workplan from consultant||Workplan||15-18 Dec 2020|
|4||Inception Report: consultant to work and submit inception report||Report||31 Dec 2020|
|5||Baseline Data Collection: consultant to start the data collection needed in both PDAM and FI Partners||Activity, Progress Report||1 Jan – 23 Jan 2021|
|6||Baseline Report: consultant(s) to submit baseline report||Report||30 Jan 2021|
|7||Intervention Implementation and Monitoring: consultant to support the implementation and monitoring the intervention activity by partners||Activity, Progress Report||30 Jan – 28 May 2021|
|8||Evaluation: consultant(s) to conduct evaluation and submit result report||Report||1 Jun – 25 Jun 2021|
|9||Result Dissemination: consultant assist Water.org in delivering the result to partners, stakeholders, and other related parties.||Meeting||7 Jul 2021|
Request for Proposals
Water.org wishes to hire a consultant to work with Water.org in supporting the implementation of randomized evaluation for Behavioral Change Communication (BCC) Evaluation to Water.org’s Partners. To be considered under this RFP, please submit the following:
A narrative proposal (no more than 10 pages excluding annexes) should include the following sections:
- Evaluation methodology: Describe the overall approach and evaluation methodology including, and not limited to, evaluation questions, evaluation design, data collection, data quality assurance measures and theory of change
- Relevant experience: provide details of projects of similar scope, complexity and nature you have worked on previously
- Specific expertise: Describe your level of knowledge and expertise specific to the water and sanitation, microfinance, and communication sectors. Also describe your expertise specific to conducting surveys using digital data collection and conducting impact evaluations using quasi-experimental designs.
- Key personnel and staffing: Describe the key personnel and a staffing plan for the project. Include CVs (no more than 2 pages each and attached as annex) of key personnel who would be part of the proposed plan.
- Timeline: Include a detailed timeline of key activities
The financial proposal should include a detailed budget and a narrative. The proposed budget should be incluside of any and all taxes.
Criteria for submission
Applicants may be individuals, group of individuals with a designated team lead, or firms. Applicants must have a minimum of the following qualifications:
- Proposed staffing plan includes at least one native or fluent English speaker as lead writer
- Proposed staffing plan includes enough qualified enumerators to conduct household survey sin the partner geographies
- Demonstrated experience in conducting a mixed methods evaluation and using quasi-experimental designs
- Demonstrated experience and familiarity with the WASH, microfinance, or communication sector
A proposed budget shall be included with the Applicants submission that resonates with the amount. The Applicants shall provide budget information in details of any format, including taxes associated with the project. The item that can be included in the budget proposal is as follow:
- Transportation (local and intercity, including fuel, toll, parking)
- Per diem
- Communication (phone balance, internet data)
- Other research-related spending with Water.org’s consent.
All proposals submitted by the deadline will be carefully reviewed by the Selection Committee based on the established selection criteria. The selection process may involve phone interviews with applicants. The final decision will be based on the overall quality of the technical proposal and value for money. The Selection Committee reserves the right to reject any or may cancel any submission at any time prior to agreement if it is in the best interests of Water.org.