Turning Data into Impact

Why sound data does not automatically change decisions, and what closes that gap: mapping who needs the evidence, tailoring the message to their needs, and communicating early rather than only at the end.

TipKey Takeaways
  • Evidence rarely speaks for itself. Access, relevance, timing, and capacity all sit between a finding and a decision.
  • Impact is built through relationships, not reports. Those who will act on the evidence should be engaged well before the results arrive.
  • The message must be tailored to the decision. Effective communication is not the same as simply sharing what was found.

The gap between evidence and action

A familiar assumption holds that an analyst produces a clear result, a decision-maker reads it, the policy adjusts, and the problem is solved. That sequence is rarely what happens. Sound evidence is regularly produced and then goes unused, not because it is wrong, but because something breaks down on the path from finding to decision. Understanding why that happens is the first step toward preventing it.

Four barriers to evidence use

A widely cited review (Oliver et al. 2014) groups the barriers into four categories.

  • Access. The evidence is unavailable, or buried in a format no one opens. A finding trapped in a 60-page report cannot inform anything, which makes dissemination part of the work rather than an afterthought.
  • Relevance. The research answers a question no one was asking. Relevance is established at the design stage, by grounding questions in the decisions people actually face.
  • Timing. Results arrive after the decision has been made, or during a lull when no one can act. Aligning delivery with the decision calendar matters as much as the finding itself.
  • Capacity. The audience lacks the skills, awareness, or time to interpret and apply the evidence. This calls for clearer communication and, where possible, for building the audience’s ability to use data over time.

Impact is built through relationships

Because these barriers are structural, a better final report does not resolve them. What does is engaging the people who will use the evidence throughout the work rather than only at its conclusion. Four practices sustain that engagement:

  1. engaging the ecosystem of people with a stake in the question;
  2. addressing a real need in the audience’s own language;
  3. maintaining contact across the project, sharing whatever interim data can responsibly be shared; and
  4. building capacity so that partners can use evidence beyond the current project.
NoteWhy communication should begin before results

An evaluation can take a long time to produce findings. Waiting until the end to engage the people whose decisions the work aims to inform wastes that interval. Early and ongoing communication keeps them engaged, can strengthen the study itself, and prepares them to act as soon as results become available.

Identifying the intended audience

Stakeholders do not all need the same information, or the same share of attention. It is useful to distinguish primary users, the specific people, in specific roles, who will use the findings and can effect a change, from secondary users, those affected by the decisions, such as program staff and participants. Stakeholders can then be placed according to their interest in the work and their influence over the decision.

TipThe interest-influence grid
High interest Low interest
High influence The most important audience. Engage often. Can block or enable the work. Keep informed at a high level.
Low influence Allies without decision power. Keep informed. Worth an occasional check-in as interest may grow.

The grid does not rank the worth of individuals. It allocates finite communication effort to where it changes outcomes.

Tailoring the message

The same finding should reach different audiences in different ways. The WHO / WHAT / HOW framework applies directly: who must act, what they need to know (the one or two messages relevant to their decision, not the full set of findings), and how the message should reach them. A researcher, a manager, and a funder examining the same result value different things: rigor, operational improvement, and cost-effective outcomes, respectively. Meeting each audience on its own terms is what separates evidence that is read from evidence that is used.

NoteCommunicating is not the same as sharing

Sending findings to someone is not the same as communicating them. Communication means the audience understands the message and can act on it, which requires knowing its objectives, keeping the message simple, and framing it around action.

TipAn IPA example

A phone-based tutoring program evaluated in the Philippines showed mastery of basic numeracy rising 15 percentage points after only 2.5 hours of instruction. The number mattered, but the impact came from how it was used. The team had engaged education authorities throughout, framed the result around their priority of recovering pandemic learning loss, and presented it as a decision: what scaling the program would require. The evidence fed directly into work with a regional ministry and UNICEF to adapt and expand the program. The statistic was the same on the day it was computed; its impact came from relationships, relevance, and timing established long before.

References

Langer, Laurenz, Janice Tripney, and David Gough. 2016. The Science of Using Science: Researching the Use of Research Evidence in Decision-Making. London: EPPI-Centre, University College London.

Oliver, Kathryn, Simon Innvar, Theo Lorenc, Jenny Woodman, and James Thomas. 2014. “A Systematic Review of Barriers to and Facilitators of the Use of Evidence by Policymakers.” BMC Health Services Research 14: 2. https://doi.org/10.1186/1472-6963-14-2.

Additional Resources

Abdul Latif Jameel Poverty Action Lab (J-PAL). “Evidence to Policy.” https://www.povertyactionlab.org/evidence-to-policy.

Back to top