Terms of reference
IDEA (International Development Education and Awareness) Mixed Methods Baseline Survey – Consultancy
Aga Khan Foundation Canada (AKFC) is seeking a consultant to lead the design and implementation of a mixed methods gender-sensitive baseline study for a new project, IDEA, that aims to enhance the engagement of youth in Canada’s international development efforts towards the achievement of the Sustainable Development Goals (SDGs) and Canada’s Feminist International Assistance Policy (FIAP), with a specific focus on global interconnectedness, gender equality, and the empowerment of women and girls.
About AKDN and AKFC
The Aga Khan Development Network (AKDN) is a group of private, international, non-denominational agencies working to improve living conditions and opportunities for people in the developing world. The Network’s organizations have individual mandates that range from the fields of health and education to architecture, livelihoods development, and the promotion of private enterprise. Together, they collaborate in working towards a common goal – to build institutions and projects that can respond to the challenges of social, economic, and cultural change on an ongoing basis.
Aga Khan Foundation Canada (AKFC) is an international development organization and registered charity. AKFC partners with Canadians and communities, businesses, and governments across Africa and Asia to promote inclusive development. Since 1980, AKFC has helped millions of people to unlock their own potential to build a better life. Working in Africa and Asia, the Foundation invests in local institutions and systems that anchor progress over the long term. In Canada, AKFC mobilizes funding and expertise, and promotes awareness of global issues. AKFC is an agency of the Aga Khan Development Network, one of the world’s most comprehensive development organizations.
IDEA – Project Background
Designed in close discussion with Global Affairs Canada (GAC), Canadian educators, Canadian youth, and Canadian NGOs, IDEA (International Development Education and Awareness), is a project executed and implemented by Aga Khan Foundation Canada (AKFC).
IDEA will increase the understanding of international development issues among youth (aged 12 to 18) in Canada and improve their access to, and use of, equitably distributed global citizenship learning products, resources, and opportunities. IDEA will engage youth through digital platforms and mass media accessed by young Canadians through school programs, extracurricular activities, and youth-focused organizations outside the formal education sector, as well as through both traditional and social media. Additionally, IDEA will create opportunities for youth to engage as emerging leaders in international development efforts, including through participation in relevant forums, events, and experiential learning opportunities. These could include opportunities to co-design, alongside educators, innovative classroom activities focused on international development. Special emphasis will be placed on FIAP, Canada’s role in the world in promoting gender equality and climate change adaptation, and Canadians’ role in achieving the SDGs.
A sector-wide community of practice (CoP) comprised of NGOs, government, private sector, and media will be formed to coordinate Canadian global citizenship education (GCE) activities, leverage networks, and support sector-wide complementary campaigns and initiatives.
IDEA will reach an estimated 1.360 million beneficiaries across Canada– youth aged 12-18 – through its direct interventions and via multipliers (682,633F; 668,979M; 13,654NB). IDEA will engage 5,266 intermediaries – teachers, NGO staff, the private sector, and the media. Special considerations have been made to ensure that 20% of beneficiaries and teachers are Francophone; 25% are rural or remote; 1% are Indigenous; 30% are non-Indigenous visible minorities.
Scope of the Mixed Methods Baseline Study
The baseline study data collection will be conducted across Canada, working through educators within schools. The survey processes will start on February 6, 2023, and will conclude by August 31, 2023.
The baseline study will be designed to ensure data is collected across five geographic zones (Atlantic, Central, Prairies, Western, Northern) capturing data from all communities including rural/remote, indigenous, non-indigenous visible monitories, and Francophones.
Objectives of the Baseline Study
The IDEA baseline study aims to establish a benchmark for measurement of the baseline status of indicators under the ultimate, intermediate, and immediate outcome level results of the project.
The specific objectives of the baseline study are:
- To establish starting points or baselines for all indicators in the PMF, suggesting revisions in their formulation if needed.
- To help validate the assumptions in the project’s Theory of Change (ToC) and define targets of the indicators in the project’s PMF.
- To support a better understanding of the implementation contexts for IDEA at the onset of the project, including the needs of youth in Canada related to engaging in international development.
- To provide recommendations for fine-tuning the project implementation strategy.
The baseline study will consider gender, geographic diversity, and social inclusion needs in the design of instruments, the protocols for administration (to the extent possible), and in the analysis framework.
Main Duties and Responsibilities
The consultant will be responsible for all components of the study, including:
- Developing the gender-sensitive study protocol, inclusive of the methodology, sampling plan, ethical protocols and procedures, data collection tools, study workplan, data analysis plan;
- Facilitating/enumerating recruitment and training;
- Data quality assurance;
- Data analysis; and
- Report writing.
The main deliverables for this project are as follows:
- Inception report: A detailed inception report per the requirements agreed with AKFC. This is expected to include the following elements:
- Study protocol covering methodology, design, and sampling strategy as well as proposed sample sizes for quantitative and qualitative components
- Detailed work plan that includes all tasks to be completed by the consultant (and team members, if applicable). The work plan should incorporate the study timelines, and include contingency planning and scenarios for COVID-19-related issues
- Level of effort (%) of each team member (if applicable)
- Description of enumerator and facilitator training and piloting exercises
- Data collection tools covering all the project indicators mentioned in the PMF
- Data collection, management, and analysis processes
- Detailed study budget
- Gender equality, safeguarding, ethics, and risk management
- A finalized data analysis plan which contains all definitions and computations for each project indicator, along with illustrative planned tables and figures (dummy tables)
- Data collection: Documentation of the following: 1) data collection tools translated (where translation is required), 2) ethical and other national government research approvals obtained, 3) data collectors recruited and trained, 4) data outputs tables; 5) data collection, entry (where applicable), and quality assurance completed.
- Baseline study report: Completed baseline study report including quantitative and qualitative baseline study findings, completed tables, data visualizations, and analysis of findings. The reporting structure should follow the requirements established with AKFC, and will include the following data as annexes:
- Baseline datasets: Raw data and complete, cleaned datasets in English. The Consultant will also provide a fully ‘cleaned-up’ dataset in an agreed file format (e.g., XLS, SPSS) accompanied by the code used to carry out analysis and a variable codebook. Transcribed and translated transcripts: Complete and edited transcriptions and translations of all survey responses, focus group discussions, and interviews conducted in English.
- Data interpretation workshop: A presentation of the preliminary study results in PowerPoint format, to be delivered for feedback and validation to staff from AKFC (and potentially other partners, including GAC).
- Presentation of results: A summary of the report results in English and French in PowerPoint format, highlighting key findings and recommendations for adaptive management.
- Final baseline study report: final draft of the study report in English and French on agreed template including all findings, in publishable quality. The final report should take into consideration any comments or suggestions made by AKFC reviewers before it can be considered final.
Project milestones: Project milestones should be included in the bidder’s work plans. Additional steps and details should be added. Modifications to deadlines may be proposed only with justification while respecting the overall deadline for submission of the final report.
Bidders are required to provide CVs for all those proposed in the Study Team, clearly stating their roles and responsibilities for this baseline study. Any changes to the team must be provided to and approved in writing by AKFC.
Please note that the lead consultant will be ultimately responsible for the enumerators and facilitators they are subcontracting to.
The consultant/proposed consultant team should include the technical expertise and practical experience required to deliver the scope of work and evaluation outputs, in particular, with regards to:
- Minimum of 10 years of experience in designing and administering studies, collecting data, and producing quality mixed-methods baseline study reports, with specific experience in conducting studies with youth and in schools, preferably for international non-profit organizations or multilateral agencies and multi-country studies.
- Demonstrated experience recruiting, training, and managing enumerators and facilitators for both quantitative and qualitative studies
- Demonstrated experience in quantitative data and statistical analysis, using software such as SPSS or Stata.
- Demonstrated experience in qualitative data analysis techniques, including the use of relevant software.
- Demonstrated experience in employing Open Data Kit (ODK) or other computer-assisted personal interviewing software.
- Demonstrated experience in data management, including designing and managing gender- and age-disaggregated data and information systems capable of handling large datasets for study purposes.
- Demonstrated experience in safeguarding and responding to the needs of intersecting youth identities, including indigenous, LGBTQI2S+, and BIPOC youth. Fluency in English and French is mandatory.
Qualified and interested parties are asked to submit the following:
- Letter of interest, including the names and contact information of two previous clients who can be contacted regarding relevant experience. Consultants are also expected to disclose any conflict of interest related to this mandate with AKFC.
- Detailed technical proposal of not more than 8 pages including the following:
- Description of mixed-methods study approach and methodology, including preliminary sampling strategy, data collection, data management and data analysis, gender equality and ethical standards
- Demonstrated experience in mixed methods and other qualifications outlined in this TOR
- A proposed timeframe detailing activities and schedule/work plan (including a Gantt chart)
- Team composition and level of effort of each proposed team member (if applicable)
- A financial proposal with a detailed breakdown of costs for the study
- Itemized consultancy fees/costs
- Itemized data collection expenses
- Itemized administrative expenses
- Validity period of quotations
- Expected payment plan and method
- CVs of all proposed team members outlining relevant experience (if applicable)
- A copy of a previous report of similar work undertaken on: a) baseline study; OR b) endline study
- Copy of legal registration (for registered firms)
- A Consulting Firm profile (if applicable).
Download the PDF for more information.
Thank you for your interest. Please note that this position is only open to those who are legally able to work in Canada.
AKFC is committed to advancing gender equality and inclusion through our programming and operations in Canada and overseas. AKFC requires all employees and consultants to review and abide by the AKFC Gender Equality Policy.
AKFC recognizes the importance of safeguarding and is committed to ensuring it manages a wide range of risks such that beneficiaries, staff, other associates, and the organization are kept safe from harm. All employees and consultants must respect the AKF Code of Conduct and Safeguarding Policy.
AKFC welcomes and encourages applications from people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process.