Are We Measuring Impact or Just Documenting Activity?

There’s a moment that happens in our sector, usually late in the grant cycle, when someone says: “We need to show impact.”

Not measure it. Not understand it. Show it.

The difference matters more than we admit.

What follows is a familiar choreography. Data gets gathered, polished, arranged into infographics that tell a clear story. Photos are selected. Text is written and rewritten until every rough edge is smoothed away.

The final report is beautiful. Funders are satisfied. Boards are reassured. The metrics glow green.

And somewhere, quietly, the people we claim to serve go on living lives far messier than our documentation suggests.

We’ve become extraordinarily good at producing evidence of our work. The question we’re less comfortable asking is whether we’re producing evidence of our impact. Or just evidence of our activity.

Consider what gets measured in most development projects: workshops held, people trained, consultations conducted, funds disbursed. Clean numbers. Quantifiable progress. Now consider what doesn’t get measured: whether the training changed how people actually work six months later, whether the partnerships shifted who holds power, whether the community will sustain any of this after we leave.

We track what’s easy to count. We struggle to capture what actually counts.

This isn’t malice. It’s something more insidious: a system optimized for the wrong outcomes. We’ve built reporting frameworks that reward demonstrating activity because activity is what we control. Transformative impact is harder to control, harder to predict, and far harder to measure within the tidy boundaries of a project timeline.

Photo by HONG SON

There’s a phrase that gets used constantly in our work: “stakeholder engagement.” It sounds participatory. Democratic. Inclusive. But it obscures more than it reveals.

Because “engagement” can mean we informed people about decisions we’d already made. It can mean we consulted them for input we may or may not use. It can mean we collaborated as equal partners. Or it can mean we stepped back and let communities lead.

These are vastly different types of relationships with vastly different implications for power, for sustainability, for dignity. Yet our reports treat them as interchangeable. We list attendance numbers and call it participation. We document the process and call it partnership.

Meanwhile, communities know the difference. They know when they’ve been genuinely heard and when they’ve been performed for. They know when their voices shaped outcomes and when they were invited to validate decisions already made.

Our reports rarely reflect what they know.

Here’s what honest reporting might look like instead: impact assessments that track what happens three years after project funding ends, not just at the final evaluation when we’re still there to fix what breaks. Reports where communities themselves validate our claims. Metrics that measure whether power shifted, not just how many people we reached.

Imagine a section called “What We Got Wrong”. Not as a confession of failure, but as evidence of learning. Where organizations could say: “Our theory of change predicted X would lead to Y, but what actually happened was Z, and here’s what that taught us.”

These questions are harder. The answers are messier. The metrics don’t fit neatly into dashboards. But they’re the questions that matter.

The technology exists to do this differently. We have tools for real-time feedback loops, participatory data collection, longitudinal tracking across years. What we lack isn’t capacity. It’s courage.

The courage to admit that impressive reach numbers don’t always translate to meaningful change. The courage to acknowledge when our interventions don’t stick. The courage to value truth over polish.

Because our current reporting systems don’t just shape how we communicate our work, they shape how we do our work. When we’re measured on activities, we optimize for activities. When we’re rewarded for quick wins, we design for quick wins. And transformation which can be slow, complex, and community-led gets left behind.

The sector is changing. A new generation of practitioners is asking harder questions. Communities are demanding genuine partnership, not just consultation theater.

The organizations that adapt first won’t just produce better reports. They’ll do better work. Because when you’re honest about what you’re measuring, you become more intentional about what you’re doing.

The reports might be less beautiful. The metrics might be less clean. The narratives might be less linear.

But the impact might finally be real.

And in the end, that’s the only thing that should matter.

Esther Gichuki is a communications consultant and documentary producer based in East Africa. She helps mission-driven organizations translate complex work into stories that move funders, partners, and communities to action.