four myths about nonprofit program evaluation explained

four myths about nonprofit program evaluation explained

What is your organization’s impact? 

This is a question that every nonprofit should be able to answer. After all, that’s why you started your organization: to change lives and make an impact in your community. And the surefire way to know if you’re making an impact is to create a system for collecting and analyzing data, making sense of the data, and then communicating your results. In other words, your team needs the capacity to engage in program evaluation.

However, many nonprofit leaders are resistant to the idea of program evaluation, and oftentimes the resistance is rooted in a few myths.

We don’t have time for program evaluation. 

Being the leader of a small or medium nonprofit is a LOT of work. You’re responsible for running the program(s), raising money, managing staff/volunteers… the list goes on and on. However, making time to ensure your program is improving is not extra work. It actually helps you do your work better. When you have a clear system for collecting and analyzing data, making strategic decisions rooted in data, and communicating your results… you wind up saving time. And I know you can use more time.

We can’t afford to hire a program evaluator.

It is true that hiring a program evaluator can cost at least $20,000. However, for small to mid-size nonprofits, you may not need that level of support and detail. If you’re just getting started with creating a measurement and evaluation system, it is entirely possible to do so own your own.  (If you need support, check out my book, The Nonprofit Manager’s Data Playbook.)

We don’t need to collect data. My instincts tell me that our organization is successful. 

This myth is one of the hardest to break because as a nonprofit leader, you are in the work and can see for yourself that you’re making an impact. You see people make a complete 180 degree turn and people tell you how much their program has impacted their lives. After all, seeing and hearing these things is what keeps you motivated each day. But, the truth is, that you can’t rely on your gut instincts. What separates good nonprofits from great ones is that they have concrete data that tells them what’s working, what’s not, so they know what to keep doing and where they need to pivot.

We don’t have the resources to invest in creating a system for data collection. 

Data collection systems can cost a ton of money and take a great deal of time to set up. And sometimes even after all the time and financial investment, you still don’t have useful data. But, it doesn’t have to be that way. You and your leadership can decide on which metrics are most meaningful for your organization and build a data collection system that works with what you’re already doing. Combine those with free and low cost tools and you’re good to go! If you need help with creating a system, check out my Data Strategy Workshop and book a consult to see if it’s a good for your organization.




I don’t believe you… you need measurable outcomes!

I don’t believe you… you need measurable outcomes!

One of the many reasons I choose to work with nonprofit organizations is because their intended outcomes are always incredibly inspiring. Each and every day leaders wake up with the intent to change their part of the world, one step at a time.

I mean, who wouldn’t be inspired by outcomes like these?

Decrease childhood obesity 

Increase the number of students who attend college

Decrease gun violence in our community 

But, I’ve also observed that too many organizations (particularly those that have been operating for more than a  few years) don’t go deeper and communicate just how much of an impact they’ve made.

For example, as many of you know, the majority of my professional career has been in the K-12 education field. And at this point, I’ve seen more than my share of organizations that seek to “increase the college going rate” in their community. So much so that my eyes start to glaze over when I read that outcome. Don’t get me wrong, helping to ensure more students have access to postsecondary education is incredibly important.

But, without measurable evidence that the outcome has been met… I’m skeptical.

You know what would help increase confidence? Data that shows whether the outcome was met.

So, instead of saying, “Our program has helped increase the number of students who attend college after graduating,” an organization could say:

“Over the past six years, on average, 80% of students who participated in our program went on to attend college compared to a 20% college going rate among students who did not participate in our program.”

Do you see the difference between the two sentences? Both state that they have met their intended outcome of getting more students to attend college acceptance. But, the second provides measurable evidence of their impact.

And guess what? That’s what separates the great nonprofits from the good ones.

Great organizations know exactly how much of an impact they’ve made.

And with that data, they’re better able to clearly and compellingly communicate their impact, which in turns means more people want to invest in their work because, well… it works.

It’s a simple as that.

Are you a nonprofit leader who needs help with having solid data that shows your organization is helping to change the world?

Book a complimentary consultation with me!

Data, Data Everywhere: What’s Most Important?

Data, Data Everywhere: What’s Most Important?

Q: “How does [our nonprofit] decide which data to use?”

A: So, this is a big question because nonprofits are swimming in data. There’s data about financials, website traffic, volunteers, participants, programming. The list goes on and on!

But, when you’re trying to decide which data to learn more about your program… pull out your logic model.

Remember that your logic model is a road map that explains how your program works to meet your outcomes and reviewing it will help you determine what data is needed to let you know what’s working, what’s not, and where you need to pivot.

Don’t have a logic model? Or do you have one but need to refine it?

Book a consultation with me. I’m happy to help!

It All Boils Down to Outcomes

It All Boils Down to Outcomes

This week, I wanted to share a quick nugget that came from conversations I’ve had over the past week with staff members at three foundations about a pilot nonprofit program that’s planning to launch soon. 

While the conversations differed, there was one question that each person asked: 

What’s the ultimate outcome of this program?

If you’ve worked with me before, you can probably guess that this question brought me a lot of joy. That’s because I ask a similar question when working with nonprofit leaders. 

When I ask about outcomes, I’m not referring to things like the number of workshops held or the number of people who attended said workshops. Those are activities and while it’s important to measure and report them, they are not sufficient. 

Ultimately, you should always ask yourself: 

  1. Does this program lead to changes in knowledge, behaviors, and skills? 
  2. Did those changes lead to improved quality of life? 

Those are outcomes and you must have a process for collecting, analyzing, and reporting the data about them. (And, yes, you can do this even if your nonprofit is only a few years old.) 

And, look, I know it can be hard to stay focused on outcomes because activities take up so much of your time. But, I strongly encourage you to take a moment and see the forest for the trees. 

Oh, and one more thing. Outcomes aren’t important just because a funder asked for them. 🙂  

Nonprofits are in the business of changing lives and outcomes tell you if you’re doing that. 

After Action Review

After Action Review

As summer comes to a close, many organizations (nonprofit and otherwise) are taking a step back to evaluate their summer work. They’re trying to understand what worked, what didn’t, and where they need to pivot for the future.

So, this week, I wanted to share a simple, yet effective method for helping your team do just that called an After Action Review.

If you’ve worked with me before, you know I LOVE After Action Reviews and think they’re especially useful for nonprofit leaders.

The beauty of nonprofits is that they are poised to quickly respond to community needs. However, one thing that I have observed with clients is that they get so focused on responding that they don’t take time to reflect on what they learned about their work.

It’s like ok, this project is done, let’s move on to the next one, and the next one, and the next one. And that cycle continues over and over again.

As your nonprofit responds to ever changing needs, it’s important to capture what you have learned along the way.

Taking the time to process what happened and document your learning ensures that you don’t waste time reinventing the wheel or continue doing things that are ineffective. 

It also provides you an opportunity to celebrate your successes and leverage them in the future.

Ok, so now you may be asking, ok, Christian, so what is an After Action Review?

An AAR is centered on four questions:

  1. What was expected to happen?
  2. What actually happened?
  3. What can we learn from this?
  4. What should we do next time?

So, how it works is, at the end of a project, every person who was involved comes together and answers those four questions. It’s important for everyone who was involved to participate because each person brings a unique perspective into what took place.

An informal After Action Review can be done in as little as fifteen minutes while a formal After Action Review may take one to two hours. No matter the length of time, the purpose is to extract the learnings and plan for the future.

A few things to keep in mind when conducting an After Action Review:

First, consider asking someone who wasn’t involved in the project to facilitate the meeting. This helps ensure that every participant is able to fully engage in the process.

Second, do not see the session as a time to assign blame for what did or did not happen. Instead, remain as objective as possible and simply state the facts.

I know that can be challenging, especially when projects don’t go as planned. But, try to keep in mind that the After Action Review will help you identify barriers to your progress and strategies to overcome them.

So again, here are the four questions that you should answer during an After Action Review:

  1. What happened?
  2. What was expected to happen?
  3. What can we learn from this?
  4. What should we do next time?

I hope this was helpful! And, if you’d like a copy of my After Action Review template, send me a message!