Background: 

The Strengthening Communities/Improving Lives and Livelihoods (SCILLS) program, launched by the Internet Society Foundation (ISOC) in 2020, aims to bridge the digital divide in underserved communities across six countries: Bangladesh, Brazil, Colombia, Ghana, Indonesia, and Senegal. With an investment of $8.68 million across 42 projects, SCILLS supports initiatives that empower individuals through digital literacy, fostering economic growth and educational opportunities. 

ISOC has commissioned an external evaluation of the SCILLS program to assess its impact, strategic alignment, and opportunities for enhancement. This evaluation aims to provide insights to guide future program strategies, ensuring SCILLS aligns with ISOC’s goals and continues to effectively serve its target communities. 

Triangle’s Assignment: 

Triangle is conducting an in-depth evaluation of the SCILLS program over six months. This assignment includes evaluating the program’s impact on participants, analyzing pathways to impact, and providing strategic insights to enhance program effectiveness. 

Objectives: 

The evaluation has four key objectives: 

• Assess Impact: Evaluate the tangible and intangible outcomes of the SCILLS program on individuals and communities, identifying both intended and unintended results. 
• Analyze Pathways: Examine the mechanisms through which SCILLS achieves its impact, identifying key activities, outputs, and intermediate outcomes. 
• Inform Strategy: Provide recommendations on the strategic direction of SCILLS, considering the benefits and challenges of expanding the program globally. 
• Enhance Effectiveness: Identify strengths and areas for improvement in the program’s design, delivery, and alignment with ISOC’s strategic priorities. 

Research Approach & Methodology: 

Triangle applies a comprehensive approach, including: 

• Outcome Harvesting and Process Mapping: Collecting best practices and tracking activities leading to specific outcomes, identifying both generalizable successes and context-specific insights. 
• Stakeholder Engagement: Conducting interviews and surveys with program staff, beneficiaries, and community leaders to gather feedback on program efficacy and relevance. 
• OECD-DAC Framework: Findings are analyzed against OECD-DAC criteria (Relevance, Effectiveness, Efficiency, Impact, and Sustainability) to align the evaluation with international standards.