Archive for the ‘Constituent Feedback’ Category

The Unique and Urgent ‘Business’ of Philanthropy

Thursday, December 22nd, 2011

The following blog post is adapted from a talk presented at a meeting of the Grantmakers of Oregon and Southwest Washington.

As Suk Rhee mentioned in her introduction, I am a native Oregonian, so I know that there is no better place than the Pacific Northwest. And I am so happy to be here with you – funders who are committed to making the region even better;

  • More economically prosperous;
  • with better opportunities for all children and stronger schools in which they can learn and grow;
  • with its natural beauty protected from pollution and destruction;
  • with habitats for wildlife preserved;
  • with fewer homeless and abused;
  • with fewer struggling with mental illness and disease;
  • with discrimination – whether based on gender, race, sexual orientation, or disability – stamped out.

These are among the very toughest challenges. Yet, if you pick up the paper or read some of the increasing number of books on philanthropy, you might think it’s not so hard.  Just apply “business thinking” or “market-based solutions,” and we’re all set.

Problems solved.

In their influential 2008 book, Philanthrocapitalism: How the Rich Can Save the World, Matthew Bishop of the Economist and his co-author Michael Green argue that a new breed of “philanthrocapitalists” are working to “apply the secrets behind their money-making success to their giving.” (As if this idea never occurred to Carnegie and Rockefeller.)

They write:

“While some are skeptical about the invasion of the M.B.A.-enabled executives in suits into the Birkenstock world of charity, many philanthrocapitalists believe that the world of giving could benefit at least as much as business from a bigger role for professional intermediaries and advisors, and from the sort of transparency and accountability that exists in financial markets.”

Did I mention that this book came out in the fall of 2008? Where is Lehman Brothers when you need them? Bishop and Green thought they were really on to something, and they’re thoughtful, smart guys who meant well.

But you know charity is working on the toughest problems. If business and government could solve the problems I listed at the start, they wouldn’t exist. You know, because you do this work every day, that no sector owns the concept of effectiveness, and that there is much work in the nonprofit sector that is strategic, data-driven, and rigorous, whether those doing it are wearing Birkenstocks or loafers.

You know, because you are living it, that though people look to you and your resources jealously, they pale in comparison to the challenges you confront.  Here is some context: Annual giving in this country is $300 billion. Total state and federal spending is an estimated $5 trillion.

You know all too well, because you are experiencing it right now that you cannot possibly fill the gaps created by slashed government spending and increased need. But you also know the nonprofit sector has a crucial role to play – one that is separate and distinct from corporations and government.

And, you know, because you live on this earth – and perhaps because, like me, you are a customer of a big national bank (and wondering why), or of the local cable company – that corporations have no greater claim on effectiveness than anyone else.

As Jim Collins, author of Built To Last and Good To Great,  has said, “We must reject the idea – well-intentioned, but dead wrong – that the primary path to greatness in the social sectors is to become ‘more like a business.’”

So let’s cut through the cloud of rhetoric that has descended on philanthropy like ash from Mount St. Helens. Let’s talk about how hard it is to be effective in philanthropy. And let’s talk about what it takes to be effective in philanthropy.

I don’t have the secret formula. No one does.

What I can offer you today may well even sound like what you already know.  (I promise to try not to pretend otherwise!) But I hope that I can at least help you understand more about why doing what we already know we need to be doing is so hard.

So let’s talk about what foundation effectiveness looks like. If you want to create the most positive impact with the resources you have – and I am going to go on the assumption that if you are here, you do – then how do you make that happen?

I think it requires four things:

  • Clear goals
  • Coherent strategies to achieve those goals
  • Disciplined implementation of those strategies
  • Relevant performance indicators to assess progress

Again, I want to repeat that these are not original thoughts nor fancy new ideas – and the challenge is not in understanding that they are necessary for effectiveness, it is that they are so hard to do right.

 

Clear goals

Defining clear, specific goals is tough.  If you’re Howard Schultz, and you’re running Starbucks, the task is clear: make a profit selling coffee.  Execution might be hard, but defining the goal is not.  Sell as much coffee as you can.  Package it up in different sizes and flavors and make people feel they have to have it. You might, I hope, increase the degree of difficulty by saying you want to do it in a responsible way, with good labor practices and sourcing, and so on. But, still, the goal is straight forward.

In foundationland, it’s much tougher. How do you choose goals?

It’s subjective, after all. Values-laden.

Plus, how do you choose just one or two goals or even several, when there are so many pressing social problems, and when those problems are so interrelated?

A wonderful former foundation staff member who I had lunch with a year or so before he died once recounted to me the story of being asked for advice by the new CEO of the foundation where he worked.

“What is the greatest mistake you fear I will make?” the new CEO asked.

The answer my lunch companion gave, at least as he recounted the story, was this:

“The greatest mistake you will make is that you will be drinking your coffee and reading the paper, and you will be deeply moved by something you read. And you’ll walk into the foundation offices and you’ll say, ‘Let’s investigate this issue. We have tremendous resources. There must be something we can do.’ And you will set in motion a process that leads to the creation of a new programmatic area at the foundation.

And, then, six months later, you will be shaving, thinking about another pressing social problem.  And you’ll do the same thing.

And then you’ll look out over the foundation five years from now, or maybe ten, and there will be so many different programs, in pursuit of so many different goals, you will realize that you have squandered the opportunity that your scale offered – to really make a difference on an issue.”

And that is precisely what occurred at this particular foundation. The CEO made exactly the mistake my former colleague predicted he would.

It’s hard not to.

When Jim Collins spoke at our conference in Los Angeles a couple of years ago, he said this:

“Disciplined action begins with piercing clarity about what you choose to not do.  In a world awash with opportunity for contribution, it’s what we choose not to do – because there is so much to do.”

So ask yourself:

  • Are your goals specific, focused, and clear?
  • How many are there?
  • Are they goals that are reasonable for you to believe you can make a difference toward, given your resources?
  • How aligned are your board and staff?
  • If each person associated with the foundation wrote down the goals, would they be the same?

It seems simple.  But all too often, the alignment just isn’t there. Our research shows that a CEO’s perception that there is goal alignment among staff and board is crucial.

So, whether your foundation has one staff member or 30, job one is to get clear on your goals.

Coherent strategies

If clear goals are the “what,” strategy is the “how.”

Everyone loves “strategy.”  Everyone has one.  But do they, really?

First, let me say that strategy plays out differently in philanthropy than in business, because there are no competitive dynamics for private foundations. In business, it’s all about “unique positioning.” But if I can make tremendous impact at my foundation by doing exactly what your foundation is doing, why wouldn’t I?  I wouldn’t demur, by saying, “No, I don’t want to fund those vaccinations because it’s not our ‘distinctive position’ to do that work.”

So how to define strategy in philanthropy?

We at CEP define strategy as:

A framework for decision-making that is

1) focused on the external context in which the foundation works, and

2) includes a hypothesized causal connection between use of foundation resources and goal achievement.

But in our research, we see a disconnect between the rhetorical embrace of strategy and the reality of its actual use. This disconnect exists at both private foundations and community foundations.

Strategy in philanthropy requires a relentless focus on the logic of how you will achieve your goals.  It is about data-driven decision making, rooted in analysis and a theory of how the foundation’s efforts can contribute to the desired change. Wherever possible, it’s informed by evidence of what works and what doesn’t, the more rigorous the better. It’s also influenced by feedback loops so you can constantly iterate and improve your strategy based on a changing context.

Strategy isn’t about deciding what works on high, about being arrogant or top-down. The best strategists are always questioning assumptions – theirs and others – and getting feedback.

Take the example of the Stuart Foundation, with roughly $300 million in assets, making grants in California and the Pacific Northwest.  In their child welfare work, the foundation focused on changing outcomes for former foster kids in California.

The conventional wisdom was that older foster kids couldn’t get adopted:  couldn’t find loving families or people who would assume some responsibility. The folks at Stuart consulted widely with those on the ground, including grantees, government officials, funders and foster kids themselves. They found reason to believe this assumption might be flawed, and tested a strategy that led to older foster kids getting adopted or connected to a caring adult. The data showed that the strategy worked, so they expanded the work.

The Foundation, joined by other foundations, also invested in the kind of supports at state universities that other kids would take for granted as coming from their families. Graduation rates in some cases for kids in these programs were better than the general student population.  The Foundation also recognized that better data systems were needed to track these kids and figure out what is working. So it did something too few foundations do: it invested in a data system.

The Stuart approach became a national model.

That’s good strategy. It’s incredibly difficult, but it can produce remarkable results.

 

Disciplined implementation

But Stuart didn’t just have a good strategy.  It had good implementation.

This is where so much falls apart.

We at CEP see this all the time. Over the past nine years we have surveyed 40,000 grantees of more than 250 foundations, developing a huge comparative dataset that we can mine for our research and for the Grantee Perception Reports we provide to individual foundations, such as Northwest Health Foundation and MJ Murdock Charitable Trust, which have both participated recently.

We see foundations that work very productively with their grantees to achieve shared goals, implementing their strategies well. But we also see foundations that undermine their effectiveness by operating in ways that are not supportive of grantees;

  • they compromise the relationship and then, inevitably, their ability to hear what is really going on;
  • they place requirements on grantees that don’t serve a purpose;
  • they fail to learn from those doing the work on the ground;
  • they fail to communicate clearly about their goals and strategies, and then somehow expect grantees to be able to implement against them.

We see foundations that say they provide capacity building assistance to nonprofits, that that is crucial to their strategy, but they don’t do it in the ways our research shows are required to make a difference.  Rather than doing the kind of comprehensive or field-focused assistance that actually helps grantees, they settle for “drive-by assistance” that may do as much harm as good.

More broadly, foundations frequently don’t commit the resources that would be necessary for implementation of their strategies.  In our research, this emerges as the biggest perceived barrier to strategy implementation.  The most effective foundations recognize that major change requires major resources. They also understand that it almost always requires resources beyond what any one foundation possesses.

Lately there has been a lot of chatter about the concept of collective impact: I got an email promoting a webinar (cost: $49) that read:

“Recently published in the Stanford Social Innovation Review …. Collective Impact is an approach to solving social problems that’s based on the idea that no organization acting alone can solve large-scale issues.”

Wait, didn’t we know this already?

Effective foundations have recognized for decades that achieving significant change requires working together to make changes with other funders and with the grantees on the ground. All the great examples of impact that foundations can lay some real claim to, from the Green Revolution to reducing tobacco use to the end of Don’t Ask, Don’t Tell, involve many institutions, funders, nonprofits, sometimes other actors including companies and government, working together, under the banner of a shared strategy, coordinating implementation.

There is nothing new here.

That’s why CEP and the Monitor Institute are working together to provide a tool that Monitor Institute created, called the Strategy Landscape Tool, to groups of funders who are working toward the same goal.  This tool allows these funders to see who is funding what, by strategy, rather than by the less helpful categories by which grantmaking is typically grouped. We’re providing these for foundations working toward shared goals in specific fields or, sometimes, as for funders in Detroit, for those pursuing improvement in a specific community.

Steve Schroeder, the former CEO of the Robert Wood Johnson Foundation, has argued that “Execution trumps strategy.” I think what he means is that strategy is meaningless if it isn’t well-implemented.

 

Relevant performance indicators to assess progress.

There has been real progress on this front in the past decade.

We see, in a survey we conducted this year of CEOs of foundations that make more than $5 million in grants annually, that assessment of foundation performance is a high priority to CEOs.  They believe much progress has been made in the last decade but that more needs to be done.  We also see that foundations are using a broader range of indicators than they were when we first studied this issue a decade ago.

This is good news.

Still, there is so much confusion about assessment. Lately, there has been a bit of a backlash against experimental design and randomized control trials. But rigorous experimental design is a powerful evaluation approach when applied well. If you are going to put major funding behind a particular strategy then you should know whether it works or not. If it’s new, then support finding out whether it works.

If something has already been shown to work, then don’t assess it all over again. Take the New York State Health Foundation, whose CEO, Jim Knickman, is on CEP’s Board of Directors. The Foundation focuses on improving clinical care and patient outcomes for diabetes – doing so by supporting the proliferation of treatment approaches that have already been proven effective. Rather than funding their own massive evaluation, they have relied on the work of others who have already shown what works – and their assessment now focuses on their ability to spread what works.

So you don’t all have to fund massive evaluative studies, but it’s irresponsible not to pay attention to what is known, and not known, about what works – and to act accordingly.

Another problem is that so much assessment today puts the foundation’s needs in front of the nonprofit grantee’s needs.  But assessment should also support the work of those on the ground, giving both you and them the information to assess and improve.

In his important new book, Leap of Reason, Mario Morino writes:

“I know many nonprofit leaders who are not managing to outcomes but are strongly predisposed to do so.  They inherently know what their outcomes are and very much want to assess and manage to them.  But they are severely hamstrung by the lack of available funding to do this hard work. … At minimum funders should be supporting efforts to help nonprofits to …. (a) track the outcomes of those served; (b) undertake at least basic analysis of this information; and (c) identify how they can use the information to learn and improve their programs over time.”

When it comes to assessment, I think the first step a foundation can take is to open itself up to feedback from the outside,  recognizing that it is surrounded by those who are predisposed to say what they think foundation staff want to hear.  To have any meaning whatsoever, this feedback must be collected by a third-party that is recognized and trusted for its independence so that the feedback is candid; and it must be put in a comparative context.  Without comparative data, it is impossible to make sense of what is a good result, what are relative strengths and weaknesses.

At the Center for Effective Philanthropy, we have worked hard to create these feedback loops.  Our Grantee Perception Report has been used by foundations as big as Gates as well as those with a couple of million dollars in annual giving. Our Applicant Perception Report captures the feedback of those who were declined funding. Our Donor Perception Report gives community foundations the opportunity to understand the views of their donors. Our Stakeholder Assessment Report taps into the perspectives of policy makers and field and community leaders. Our YouthTruth project taps into the voices of those who should matter most – the people whose lives a foundation seeks to improve. YouthTruth does this for education funders through surveys of students in high schools and, soon, middle schools – and its made a powerful difference to schools, districts, and funders.

In every case, the perceptual data is put in a comparative context to make it meaningful.

And we see that foundations are improving, to a statistically meaningful degree, when they repeat tools like the Grantee Perception Report.

As you assess, remember that what you learn often has broader relevance. If you know something about what works, or what doesn’t – share it, so others can learn from it. In my view, it’s morally indefensible not to.  Again, there is no competitive dynamic here – we’re all trying to make a positive difference.

Clear goals. Coherent strategies. Disciplined implementation. Relevant performance indicators.

Not radical concepts.

But incredibly difficult – it is much, much harder to be effective in philanthropy than it is to be successful in business.  Just ask some of the folks in Silicon Valley who have recently made the transition from business to philanthropy.

Not radical concepts – not new concepts either.  In their very good new book, GiveSmart, Tom Tierney and Joel Fleishman imagine Andrew Carnegie and Bill Gates having dinner, writing, “They would quickly discover how much they had in common.”

The authors speculate that as

“rigorous, disciplined, and deeply strategic” men, “the industrial baron and the software tycoon would be highly compatible.”

They write,

“If Gates were to mention ‘strategic philanthropy,’ ‘social entrepreneurs,’ or ‘scaling what works’ in the course of the conversation, Carnegie might not recognize the phrases but he would immediately understand the concepts.”

So the concepts are neither new nor radical, but they’re incredibly hard to act on, each day.

Each one of you here today has a role in making decisions about how resources are used to influence change for the better in this amazing region we call the Pacific Northwest.  How you do that work, each day, the discipline and clarity you bring to the task…it matters.

Foundations play a role other actors in our society cannot, or will not.

When they do it well, the results can be stunning.

So do it well.

 

Phil Buchanan is President of the Center for Effective Philanthropy.

YouthTruth Announces Strategic Partnership with The New Teacher Project

Monday, December 19th, 2011

I am pleased to announce a new partnership between YouthTruth and The New Teacher Project, which will bring student perspectives to teacher performance evaluations. See the video below for details or read the press release.

 

 

Valerie Threlfall is Vice President – YouthTruth Initiative at the Center for Effective Philanthropy.

Data Point: Getting Input When Developing Strategies

Friday, November 4th, 2011

Being “strategic” in philanthropy is sometimes equated with being isolated, arrogant, or top-down, with foundation leaders asserting detailed theories of change to rigidly guide grantmaking. But CEP’s research suggests that the opposite is the case. Those who are strategic are more likely to seek feedback from external constituents when developing strategies.

This data point comes from our December 2009 study titled Essentials of Foundation Strategy. The findings from this report are based on data collected from surveys of CEOs and program staff at private foundations with $100 million or more in assets. These leaders were then classified as either “more strategic” or “less strategic” based upon the extent to which they embody two defining elements: 1) an external orientation to their decision making, and 2) logical connections between the way they use their resources and the achievement of their goals.

Completed surveys were received from 102 CEOs and 89 program staff members, representing 155 different foundations. Respondents were asked to rate on a scale of 1 (Not at all) to 7 (To a very great extent) the extent to which they obtain input from four different external constituent groups when developing their foundation’s strategy.

The results show that more strategic leaders seek input from grantees, stakeholders, beneficiaries, and consultants when developing their strategies to a greater extent than their less strategic counterparts. Contrary to the perception that to be strategic in foundation work is to be inflexible, unresponsive, or top-down, the more strategic CEOs and program staff were in fact more likely to look outside their foundations’ walls and seek input from stakeholders.

Even for those leaders who are more strategic, though, the average rating for the extent to which they seek input on strategy development from the ultimate beneficiaries of their work falls on the lower end of the scale.

*   *   *   *   *   *   *   *

What separates more strategic foundation leaders from less strategic ones? To read CEP research that explores the state of strategy at private foundations and identifies behaviors and practices common to more strategic leaders, see the report Essentials of Foundation Strategy written by Ellie Buteau, Ph.D., Phil Buchanan, and Andrea Brock.

Ellie Buteau is Vice President – Research at the Center for Effective Philanthropy

 

A Foundation Asks its Constituents About How Best to Spend $100 Million

Monday, October 17th, 2011

I was struck by a September 29th blog post written by Chris Langston, program director at the John A. Hartford Foundation in New York City. In his post, Chris asks for suggestions from “grantees, stakeholders, peers, and older persons themselves” about how the Foundation can “make the biggest difference in the lives of older adults” with the $100 million it plans to spend between 2013 and 2017.

He specifies that, at this point, the Foundation wants to “discuss the nature of the problem of health and aging and the broad societal forces that seem likely to be relevant.” He goes on to explain why he believes it is so important to focus on the problems at hand before turning to strategies or grant ideas.

Much of CEP’s research, as well as our conversations with leaders in the field and clients, touch at one point or another on the complex yet crucial issues of communication, goals, and strategy. The challenging nature of each of these only increases as we consider the power dynamics that often exist between funders and the nonprofits they support, as well as the growing economic needs in our society.

The John A. Hartford Foundation’s experiment of seeking suggestions from such a wide variety of stakeholders about which problems it should be addressing through its funds – and of seeking them through social media – is one attempt to mitigate the power dynamic and hear directly from those closest to the problems at hand. So far, Chris’s post has received over a dozen comments containing suggestions, which have arrived steadily since the post appeared.

Chris’s post reminded me of several elements that have arisen in our research at CEP about what distinguishes more strategic leaders from less strategic leaders. Through our research, both qualitative and quantitative, CEP has developed and applied a definition of strategy. The first component of that definition focuses on foundation leaders who seek and consider information and data about the relevant populations, issues, communities, and fields when they are making decisions about how to use the foundation’s resources to achieve its goals. That means not relying solely on what the foundation already knows, what the board’s preferences are, or what the foundation has done in the past.

In our research, both with private and community foundations, we find that strategic leaders seek information from a variety of stakeholders when developing their strategies. In that context, Chris’s invitation to beneficiaries of the foundation’s work (i.e., older adults) to contribute suggestions also stands out. The inclusion of beneficiaries in input and feedback processes has been the focus of increasing conversation in philanthropy – in books, on blogs, in op-eds, and in CEP’s research. Today, though, the practice of seeking beneficiary voices is not a common occurrence.

As the John A. Hartford Foundation moves forward with its work, it would be helpful to learn how the input received from constituents shapes the thinking there, and what the ultimate decisions turn out to be. More broadly, I wonder if the Foundation’s openness to seek input in such a public forum will spur other foundations to take risks on similar efforts.

The John A. Hartford Foundation is by no means the first funder to open itself up in this way. In 2007, for example, the David and Lucile Packard Foundation solicited, through a wiki, suggestions for developing strategies to address nitrogen pollution.

Still, such efforts to invite input from a variety of relevant constituents remain far too rare. I can only wonder what the consequences of such lost opportunities have been for foundations making progress toward their goals.

Ellie Buteau is Vice President – Research at the Center for Effective Philanthropy.

Data Point: Importance of Social Networks to Donors

Friday, October 7th, 2011

The use and management of data stands at the core of the work undertaken by the Center for Effective Philanthropy. The set of survey tools CEP has developed as well as field-wide research builds comparative data drawn from key constituent groups—grantees, donors, staff members and others—providing insights that enable funders to better define, assess and improve their effectiveness.

 

This data point comes from the Donor Perception Report (DPR), which helps community foundations identify actionable strategies for more effectively engaging their donors. The DPR covers topics such as donor preferences, future giving plans, perceptions of impact on the community, and foundation communications.

The data point shown above results from responses to the following question:

“Please think about your use of online social networks (e.g., Facebook, Twitter). How important to you are these online networks?”

Donors taking this survey were asked to rate on a scale of 1 (Not at all important) to 7 (Extremely important) the importance of online networks. With over 1,500 respondents answering this question, the majority of donors (64%) gave the lowest possible rating to the importance of social networks, with an average rating of 1.9. Only a tiny sliver (2%) felt these networks were extremely important.

Perhaps even more striking, an overwhelming 91% of respondents indicate that they would NOT like to receive information about a foundation’s work over social networks.

Because this question is an optional addition to the standard DPR, results reflect respondents from only thirteen funders.

Readers of this blog post are invited to respond. Do donors really not want to be engaged through online networks or could their minds be changed with more effective social media outreach?

 

*   *   *   *   *   *   *   *

CEP’s work is rooted in the conviction that feedback can play a role promoting change in foundation practice. For a broader look at the role of feedback in philanthropy, see the report, Can Feedback Fuel Change at Foundations? written by Phil Buchanan, Ellie Buteau, Ph.D., and Shahryar Minhas and published by the Center for Effective Philanthropy.

 

Kevin Bolduc is Vice President – Assessment Tools at the Center for Effective Philanthropy