Outcomes Measurement
Logic Models
and Program Theory |
Data Collection Methods
Performance Indicators
Page: 1 | 2The next phase in putting together an effective outcome measurement system focuses on deciding how you are going to make your intended outcomes measurable, that is, defining a set of indicators, identifying the data collection methods to gather information about these indicators and organizing your data collection activities into a concrete plan. The sections that follow describe the steps involved in this phase:
- Step One: Developing good performance
indicators
- Step Two: Determining the appropriate
data collection methods
- Step Three: Creating a feasible outcome measurement plan
As written, outcomes are usually too broad to enable data collection tools to be developed directly from them. Remember, the purpose of outcomes is to describe the intended impact the client organization experiences. For this reason, indicators are used to serve as a bridge between intended outcomes and the actual data collection process. Indicators enable you to determine whether the FBCOs you work with have, in fact, changed in the specific ways that indicate your intended outcome has occurred.
Indicators must be specific and observable. They answer questions like: How will you know when changes have occurred? How will know when you have achieved the outcomes? Thinking ahead to possible data collection methods will tell you if your indicators are specific enough. Ask questions like these to determine whether your indicators will work:
- How can I see the change? (Through what
kind of observation?)
- How can I hear the change? (Through interviews?
Focus groups?)
- How can I read the change? (Through surveys? In records?)
For example, look at one of the outcomes we discussed in the Outcomes and Outcome Chains section:
| Outcome: | FBCOs have increased fund development capabilities and opportunities |
- How will you know whether an organization has increased its
fund development capabilities? What
will you look for? What questions will you ask? When you think
about becoming better at fund development, what comes to mind?
- Similarly, what will you include as a measure for increased
fund development opportunities? What is a fund development
opportunity? A phone call to a potential donor? A fundraising
event? Subscribing to a philanthropy magazine? How will you
decide whether the organization is pursuing more fundraising
than it used to pursue?
- Overall, what will you look at to see whether your technical assistance has helped the organization bring in additional funds through their fund development efforts?
In order to serve effectively as a bridge to data collection, indicators must be specific items of information that describe observable, measurable characteristics or changes in corresponding outcomes. Indicators must be measures that can be seen, heard, counted, reported or enumerated using some type of data collection method.
Page: 1 | 2
Logic
Models and Program Theory |
Data Collection Methods