Demonstrating Impact in Nonprofit Program Evaluation

A programme is six months old. The donor wants impact stories. The field team is still figuring out logistics, hiring, community trust, baseline data. This is where credibility is decided. Most organisations choose visibility over accuracy. They package two anecdotes. - Add photos. - Call it “early impact.” Here is the problem. When you overstate results at six months, you are training your donor to expect speed that systems cannot sustain. Next year, when outcomes take their natural time, you look like you have slowed down. But you have not. You were just premature. Serious institutions handle this differently. They say: Here is what we have stabilised. Here is what we have built. Here is what is still too early to measure. They report process indicators. Hiring completed. Partnerships signed. Baseline done. Training cycles finished. Not glamorous. But credible. Early-stage reporting is not a storytelling test. It is a governance test. If your communication is ahead of your operations, trust will eventually catch up and correct it. The real question is not “How do we show impact quickly?” It is “Are we disciplined enough to show progress honestly?” That is what compounds over time. . . . . #VisualStorytelling #Communications #Nonprofits #SocialSector #CreativeAgency #SimitBhagatStudios

Impact evaluation is a crucial tool for understanding the effectiveness of development programs, offering insights into how interventions influence their intended beneficiaries. The Handbook on Impact Evaluation: Quantitative Methods and Practices, authored by Shahidur R. Khandker, Gayatri B. Koolwal, and Hussain A. Samad, presents a comprehensive approach to designing and conducting rigorous evaluations in complex environments. With its emphasis on quantitative methods, this guide serves as a vital resource for policymakers, researchers, and practitioners striving to assess and enhance the impact of programs aimed at reducing poverty and fostering development. The handbook delves into a variety of techniques, including randomized controlled trials, propensity score matching, double-difference methods, and regression discontinuity designs, each tailored to address specific evaluation challenges. It bridges theory and practice, offering case studies and practical examples from global programs, such as conditional cash transfers in Mexico and rural electrification in Nepal. By integrating both ex-ante and ex-post evaluation methods, it equips evaluators to not only measure program outcomes but also anticipate potential impacts in diverse settings. This resource transcends technical guidance, emphasizing the strategic value of impact evaluation in informing evidence-based policy decisions and improving resource allocation. Whether for evaluating microcredit programs, infrastructure projects, or social initiatives, the methodologies outlined provide a robust framework for generating actionable insights that can drive sustainable and equitable development worldwide.

High-net-worth donors are acting more like venture capitalists. Not in the sense of writing checks for the next unicorn but in how they evaluate nonprofits: The shift: A 2023 Bank of America study found that 85% of high-net-worth donors now “expect measurable results” from their giving, compared to just 47% a decade ago. Another Bridgespan survey showed that nearly 70% of major philanthropists look for scalable models and evidence of impact before committing funds, almost identical to the screening criteria VCs use with startups. In other words: your nonprofit is being “pitched” just like a startup. What this means for you: Donors are no longer satisfied with: • “We served X families this year.” They’re asking: • “What’s the cost per outcome? How do you scale? Who’s on your leadership team? What’s your theory of change?” These are due diligence questions straight out of a VC’s playbook. The playbook shift for nonprofits: 1. Metrics over anecdotes → Replace “heartwarming story only” with “story + unit economics of impact.” 2. Growth narrative → Share not just what you did last year, but your roadmap for 3–5 years. Think in terms of market expansion (communities served), not just annual fundraising goals. 3. Board = Advisors → Highlight how your board members function like startup advisors, unlocking networks, capital, and credibility. 4. Risk transparency → Just like startups disclose risks in their decks, nonprofits that are candid about challenges gain trust with major donors. Why this works: Data shows that storytelling + data posts on LinkedIn outperform by 27% in engagement compared to generic updates . The same applies in fundraising. Pair the emotional “why” with hard “how” metrics, and you’ll unlock six- and seven-figure checks. With purpose and impact, Mario

The smartest investment we made as a nonprofit in 2025? It wasn’t fundraising. It was data. 📊 I say this as someone who often warns about measurability bias. But over the past few years, I’ve become one of the strongest advocates for 𝘥𝘢𝘵𝘢-𝘪𝘯𝘧𝘰𝘳𝘮𝘦𝘥 decision-making. 2025 was New Roots Institute's first full year with a dedicated R&D department, and it has transformed our fundraising, our strategy, and the quality of our programs. For a long time, “number of students reached” was our primary metric. That incentivized us to simply reach more people. We could 𝘵𝘩𝘦𝘰𝘳𝘦𝘵𝘪𝘤𝘢𝘭𝘭𝘺 scale volume, sacrifice program quality, have no strategy around who we were reaching, and still look successful on paper while making limited progress toward ending factory farming. We now evaluate every session, track the efficacy of our campaigns, and identify which tools, training, and support actually help students succeed as organizers and campaigners. That learning feeds directly back into program design and how we support fellows in real time. Our work is complex, relational, and long-term. Embracing monitoring, evaluation, and learning hasn’t flattened that complexity. It’s strengthened our ability to navigate it with nuance. As more nonprofits take on hard-to-measure challenges, I hope we stop treating R&D as a luxury. It’s a commitment to learning, humility, and building organizations that get smarter over time. Is R&D part of your work these days? I’m curious how your organization approaches data. Our fellows are reaching over 𝟯 𝗺𝗶𝗹𝗹𝗶𝗼𝗻 𝗽𝗲𝗼𝗽𝗹𝗲, shifting dining behaviors, and removing plant-milk upcharges. Explore their impact here: https://hubs.ly/Q03YSvbX0 Grateful for our incredible R&D team Sean Rice, Jiwon Joung, and Nichalus Vali who push us, and our movement, to learn faster and adapt smarter. 💜 #Leadership #Nonprofit #Data #MeasurabilityBias #R&D #Impact #Strategy #Evaluation #MovementBuilding

The theme for IDinsight's 2024 year-in-review is "Innovating for Inclusive Impact". The review showcases inclusivity in the process of creating impact: new tools and frameworks that IDinsight teams have developed to make data more accessible to decision-makers (Ask-A-Metric), to help organizations self-diagnose M&E needs and focus on the highest-priority M&E activities (M&E Health Check, Impact Measurement Guide), to include the voices & experiences of program recipients in design & implementation (Dignity Initiative), and other very cool innovations. Anyone interested in the frontier of data methods & AI tools for social impact is definitely encouraged to take a look. https://lnkd.in/dnTRvNTM   But another interpretation of "inclusive impact" could be "programs or interventions that benefit all participants." I'll admit that when doing impact evaluations it's easy to focus on the big headline average treatment effects. We'll usually do some subgroup analysis that shows we can't reject the null hypothesis of equal treatment effects for men vs women or older vs younger participants. But this is hardly suggestive of a program being impactful across the board. I've seen several evaluations where, when you dig into the data, the statistically significant treatment effects in the headline disappear when you omit the top 5 or 10% of performers.   For this reason, one of my favorite graphs from this year (below) comes from our RCT of the Luminos Fund program, where we measured the impact of their accelerated learning program for out-of-school children in Liberia. This graph was conceptualized by my colleague Mico Rudasingwa as a way of exploring impacts across the study sample. The graph shows the average change in reading fluency (words per minute) in each of the 98 communities in our study from baseline to endline, sorted by communities with the largest change (top) to smallest change (bottom), and color-coded by whether the community received the Luminos program (red) or not (blue).   Technically we're not pinpointing the program impact for each community; we don't know the counterfactual for each community, and at least for some communities the counterfactual would involve some improvement in reading ability (after all, learning gains do vary in control communities). But to me at least it's pretty convincing that children are benefitting from the program across the board. Not only are average learning gains positive in every community that got the Luminos program, but nearly every program community has larger average gains than nearly every control community. I've rarely seen such clear evidence of a program having inclusive impact.   If you're interested to dive into the data yourself, check out our interactive visualizations of the RCT results posted earlier this year! https://lnkd.in/dhf4wGbd

A Compelling Fundraising Rationale, A Promising Philanthropic Construct The United Way of Greater Atlanta gets it. They know that serious donors want to make an impact. So do they. Here's what they've done which is so worthy of emulation, no matter the nonprofit mission. Define the impact zone: Greater Atlanta (14 counties) Adopt a singular objective: Improve child well-being in that impact zone Determine the means of measuring impact: Work with community leaders to identify a constellation of characteristics by which child well-being can be assessed Create a service baseline: Using the community-sourced criteria, systematically gather information in your service area to determine the varying rates of child well-being Create a coalition of nonprofit service providers to ensure the allocation and application of resources are as synergistic as possible Show don't tell: Develop an interactive map that allows donors to see the varying rates of child well-being, highlighting degrees of need, allowing donors to click within the map to learn more about specific communities and neighborhoods Create opportunities for donors to interact with service providers in neighborhoods and/or addressing the issues they care most about Demonstrate how levels of giving can mitigate need Use the index of criteria to measure and communicate annual progress Donors don't expect perfection, particularly if a nonprofit is dealing with systemic issues, but they do want philanthropy-seeking organizations to conduct intelligent experiments, from which we can all learn. Those require thoughtful, rigorous design, establishment of baseline evaluative criteria, scrupulous collection of data, expert observation of various practices at work, and objective evaluation of what worked best and least, and how those lessons can be applied, year over year, in pursuit of continuous improvement. Concern for child well-being is universal, larger than any ideological, geographic or cultural divide. Donors look for organizations that will show them how to make a difference. They gravitate to those that are transparent and explicit about what they are attempting to achieve and how they are applying the lessons of last year to this one so they might better serve. United Way is sometime perceived as being "old school" and criticized for constraining donor's ability to pinpoint giving. United Way of Greater Atlanta has developed a construct that allows all to see how it is allocating resources and why. Whatever it constrains in terms of donor designations, it seeks to compensate for in the demonstration of its focused, transparent, collaborative pursuit of impact. As one member of their advancement team said, "We don't decide, the data does."

Stop being impressed with numbers. “I served 500 families.” “We reached 2,000 children.” “Our program impacted 15,000 people.” Okay. But whose life is actually different because you existed? This field loves to count people. Sign-in sheets. Workshop attendance. Pamphlets handed out. Parents who sat through a lecture. Technically… they were “served.” But a pamphlet has never stopped an eviction. A workshop has never turned the lights back on. A referral has never paid someone’s rent. And a parenting class does not keep kids out of foster care when the real problem is poverty. Yet we keep reporting these numbers as impact. Fifteen thousand children reached. Wow! But too often “reached” is a creative way to say they heard a presentation, or got a brochure. Sometimes it means their exhausted parent sat in a folding chair for an hour listening to a lecture while still wondering how they are going to pay rent. Technically… they were served. But families living in poverty do not need to be served. They need barriers removed. Rent paid so they are not evicted. Lights turned back on. Child care covered so they can work. Transportation so they can keep their job. Food in the fridge. Actual breathing room. Because the truth is this: It is easy to count people who walked through your program. It is much harder to build something that actually helps families change their own lives. But that is the work. Not serving people. Changing the conditions that are crushing them. So no, I am not impressed by how many families your program “served.” I am impressed when a child stays safely with their family. I am impressed when a mom keeps her housing. I am impressed when someone moves out of homelessness and gets hired in your program. I am impressed when a family finally has enough stability to breathe again and go to college. And if this field is serious about impact, then we need to educate ourselves. Attendance is not impact. A referral is not impact. Real impact is when a family’s actual life gets better. Until this field learns the difference, we will keep confusing activity with impact and calling it success. #preventfostercare #justhelp

𝗪𝗵𝗲𝗻 “𝗕𝗮𝗱” 𝗗𝗮𝘁𝗮 𝗶𝘀 𝗔𝗰𝘁𝘂𝗮𝗹𝗹𝘆 𝗚𝗼𝗼𝗱 Looks can be deceptive.  Ask the nonprofit that pursued a flashy corporate partner to make their Annual Report look good.  The corporate partner turned around and twisted the org to make major changes in their programs to better match their brand and required impossible reporting timelines. The same lesson applies to your data, but in reverse.  Real progress can actually be mistaken for decline. Consider the following: 𝗤𝘂𝗮𝗹𝗶𝘁𝘆 > 𝗤𝘂𝗮𝗻𝘁𝗶𝘁𝘆 • 𝘚𝘶𝘳𝘷𝘦𝘺 𝘳𝘦𝘴𝘱𝘰𝘯𝘴𝘦 𝘳𝘢𝘵𝘦𝘴 𝘧𝘦𝘭𝘭: Did the feedback quality improve because only recipients genuinely vested in the cause responded? • 𝘕𝘰 𝘰𝘧 𝘱𝘢𝘳𝘵𝘯𝘦𝘳𝘴𝘩𝘪𝘱𝘴 𝘥𝘦𝘤𝘳𝘦𝘢𝘴𝘦𝘥: Have you started focusing on value alignment instead of logos? • 𝘌𝘮𝘢𝘪𝘭 𝘭𝘪𝘴𝘵 𝘴𝘩𝘳𝘢𝘯𝘬: Have you invested hours cleaning it up? Gone are all the ghosts.  Is your open rate higher?   𝗖𝗹𝗮𝗿𝗶𝘁𝘆 > 𝗖𝗼𝗺𝗽𝗹𝗲𝘅𝗶𝘁𝘆 • 𝘋𝘢𝘴𝘩𝘣𝘰𝘢𝘳𝘥 𝘒𝘗𝘐𝘴 𝘥𝘦𝘤𝘭𝘪𝘯𝘦𝘥 𝘧𝘳𝘰𝘮 20 𝘵𝘰 10 𝘮𝘦𝘵𝘳𝘪𝘤𝘴: Is clarity your new mantra?  Have you gotten off the “just in case” data collection bandwagon? • 𝘙𝘦𝘷𝘦𝘯𝘶𝘦 𝘥𝘦𝘤𝘳𝘦𝘢𝘴𝘦𝘥: Is it because you said "No" to restricted-funds that came with strings attached?   𝗗𝗲𝗽𝘁𝗵 > 𝗕𝗿𝗲𝗮𝗱𝘁𝗵 • "𝘔𝘦𝘴𝘴𝘺" 𝘯𝘰𝘯-𝘯𝘶𝘮𝘦𝘳𝘪𝘤 𝘥𝘢𝘵𝘢 𝘪𝘯𝘤𝘳𝘦𝘢𝘴𝘦𝘥: Kudos!  Have you started listening and capturing the stories that factor intangible impact your programs are having? • 𝘌𝘷𝘦𝘯𝘵 𝘈𝘵𝘵𝘦𝘯𝘥𝘢𝘯𝘤𝘦 𝘳𝘦𝘥𝘶𝘤𝘦𝘥: Is headcount no longer your goal?  Have you shifted attention to designing experiences that attract authentic engagement and behavioral change? • 𝘝𝘰𝘭𝘶𝘯𝘵𝘦𝘦𝘳 𝘴𝘪𝘨𝘯-𝘶𝘱𝘴 𝘧𝘦𝘭𝘭: Has your volunteer retention rate increased?  Are volunteer satisfaction levels and engagement up? • 𝘕𝘦𝘸 𝘪𝘯𝘪𝘵𝘪𝘢𝘵𝘪𝘷𝘦 𝘥𝘦𝘭𝘢𝘺𝘦𝘥: Have you started running test pilots before scaling to ensure higher probability of impact? 𝗧𝗵𝗲 𝗕𝗼𝘁𝘁𝗼𝗺𝗹𝗶𝗻𝗲 I could go on but you get the drift. The drops above reflect an org’s growing maturity when it comes to its mission, staff, volunteers and data.  They are indicators that you are making hard choices over vanity metrics. 𝘏𝘰𝘸𝘦𝘷𝘦𝘳, 𝘯𝘰𝘵 𝘦𝘷𝘦𝘳𝘺 𝘥𝘦𝘤𝘭𝘪𝘯𝘦 𝘪𝘮𝘱𝘭𝘪𝘦𝘴 𝘱𝘳𝘰𝘨𝘳𝘦𝘴𝘴 - 𝘤𝘰𝘯𝘵𝘦𝘹𝘵 𝘮𝘢𝘵𝘵𝘦𝘳𝘴. 𝗪𝗵𝗮𝘁’𝘀 𝗮 𝗻𝗲𝘄 𝗺𝗮𝗻𝘁𝗿𝗮 𝗶𝗻 𝘆𝗼𝘂𝗿 𝗼𝗿𝗴 𝘁𝗵𝗮𝘁 𝗹𝗼𝗼𝗸𝘀 𝗹𝗶𝗸𝗲 𝗮 𝘀𝘁𝗲𝗽 𝗯𝗮𝗰𝗸 𝗯𝘂𝘁 𝗶𝘀 𝗮𝗰𝘁𝘂𝗮𝗹𝗹𝘆 𝗴𝗿𝗼𝘄𝘁𝗵?

Most non-profits struggle with impact measurement. The reason is simple: their work is multi-dimensional and inter-related, but measurement frameworks tend to reduce everything to a single axis: reach. Reach, as measured in the number of lives touched, has been the cornerstone of impact measurement because it is simple, measurable, objective and easy to comprehend. Sometimes, reach has been supplemented by the scale of impact on the life of each individual reached. But even then, it flattens the story. In practice, this creates three problems: 1. It reduces diverse types of work to the same metric. A think tank that shifts policy, a digital platform that reaches millions, and a grassroots NGO working deeply with 200 families are not comparable. 2. It creates pressure to show scale in numbers, rather than outcomes or systemic influence. 3. It makes it harder for funders and nonprofits to have a shared language of what impact looks like. During my six years at Omidyar Network, I worked on its impact measurement framework, one that I still find incredibly valuable. It captures both the direct impact that impact organisations have (as measured by reach, depth and inclusion), as well as the indirect impact that perpetuates their influence in other ways (for e.g., capital mobilised, replication of practices, institutional and policy shifts) I have found this framework incredibly useful because: 1. It moves beyond “just reach,” allowing nonprofits to tell their story in multiple ways. A for-profit impact start-up may focus on reach, but may also want to document its policy engagements with governments. 2. It works across organisational models, including grassroots NGOs, digital-first orgs, or policy think tanks. Each model may emphasize a different part of the framework but can still be placed on it. 3. It creates multiple valid pathways to being a high-impact organisation (e.g., low reach but high depth, or a pioneering idea that gets widely replicated). 4. It allows nonprofits to adapt the “indirect impact” dimension to their own context. For e.g., a think-tank may customise the policy impact pathway, based on its theory of change. Impact is rarely linear. A holistic framework like this creates space for nonprofits to be seen in their full richness, while still giving the ecosystem a common language to work with. #SocialImpact #ImpactMeasurement #Nonprofits #Philanthropy

𝐇𝐨𝐰 𝐝𝐨 𝐰𝐞 𝐤𝐧𝐨𝐰 𝐢𝐟 𝐚 𝐝𝐞𝐯𝐞𝐥𝐨𝐩𝐦𝐞𝐧𝐭 𝐢𝐧𝐭𝐞𝐫𝐯𝐞𝐧𝐭𝐢𝐨𝐧 𝐢𝐬 𝐭𝐫𝐮𝐥𝐲 𝐞𝐟𝐟𝐞𝐜𝐭𝐢𝐯𝐞, 𝐞𝐪𝐮𝐢𝐭𝐚𝐛𝐥𝐞, 𝐚𝐧𝐝 𝐰𝐨𝐫𝐭𝐡 𝐭𝐡𝐞 𝐢𝐧𝐯𝐞𝐬𝐭𝐦𝐞𝐧𝐭? As the shift toward evidence-based decision-making accelerates, we need more than good intentions. We need evidence, structure, and reliable data to design, monitor, and evaluate programs that create sustainable impact. This resource on Planning, Monitoring and Evaluation (PM&E): Methods and Tools offers practical approaches used globally to strengthen accountability and reduce poverty and inequality. It introduces proven methods such as cost-benefit analysis, causality frameworks, benchmarking, process and impact evaluations, all backed by real-world case studies. These tools help ensure that projects are not only well-designed but also deliver meaningful results. This document is especially valuable for: ✅ Civil society leaders designing impactful projects ✅ Policy makers & donors demanding accountability ✅ M&E professionals refining their evaluation toolbox ✅ Students & researchers deepening their knowledge of results-based management #MonitoringAndEvaluation #PME #ResultsBasedManagement #Accountability #EvidenceBasedPolicy #CivilSociety #ImpactEvaluation #DevelopmentTools