Posts Tagged ‘philanthropy’

Hard Facts: Data Tells an Unexpected Story in Boston

Monday, December 12th, 2011

The city of Boston stands as a gleaming example of the renewed and widespread appreciation for urban living. Its charms, after all, are abundant, from 18th century Beacon Hill streets to dynamic and diverse SOWA, the “new” South End. Plus it has been honored for its strong public schools (2006 winner of the Broad Prize for Urban Education, no less). All of which makes the new report, The Measure of Poverty: A Boston Indicators Project Special Report, something of a bombshell.

The Boston Indicators Project is the widely honored data-and-analysis special initiative run by the Boston Foundation with a host of partners in Greater Boston’s Civic Community. It is headed by Charlotte Kahn (honored in Istanbul in 2007 for her work) who is a leader in a global movement to create indicators initiatives, using open-source data collected from a wide array of credible sources to examine current trends and realities from the grass roots to broad regions.

Justification for the use of the b-word? Here are a few selected data points for consideration—drawn, I repeat, from the heart of one of the most economically successful places in the United States:

  • As many as 340,000 Bostonians now live in poverty (excluding college students) or stand at risk of being unable to afford such necessities as housing, food, transportation, child care and energy. That represents more than half of the total population of Boston.
  • Income inequality is bad and continues to grow worse. Despite Boston’s recent economic successes, Suffolk County remains one of the 50 most unequal in the United States. In 2009, the top 5 percent of Boston earners received 25 percent of total annual income in the city while the bottom 20 percent earned just 2.2 percent of the total.
  • Health care costs, already the highest in the nation, are expected to double by 2020. Meanwhile, social investment in programs that offer a significant return on the dollar are being slashed, promising downward economic pressure in years to come. Cuts in state funding for services from fiscal years 2009 and 2012 include the following: universal pre-kindergarten, cut 38 percent; teen pregnancy prevention, cut 41 percent; health promotion and disease prevention, cut by 77 percent; and employment services, cut 80 percent.

I find this report compelling for two reasons. First, I know Kahn to be a scrupulous and rigorous curator of data (she was a colleague when I worked for the Boston Foundation) with a prophetic voice that has—unfortunately—been validated consistently in recent years. This report deserves to be read and pondered far beyond the borders of Boston.

And the second reason is because at the Center for Effective Philanthropy (CEP), I spend much of my time looking for ways to highlight the power and utility of data as a critical tool for expanding the impact of philanthropic funders.

Real tension exists between the visceral power of anecdotal presentation and the sometimes challenging reality of actual fact. In a similar work of data-driven exposure, this tension is a major theme of the book Poor Economics, by Esther Duflo and Abhijit Banerjee, which speaks powerfully about the value of scientific investigation in the search for effective strategies that address the causes and effects of global poverty.

The point here is that our untested hunches often fail to provide a credible read of the world around us. The discipline of high quality research and data analysis brings us to a better understanding. In The Measure of Poverty, the better understanding is a sobering assessment of trends that are eroding common assumptions about the United States as a land of opportunity where the American Dream is a plausible aspiration. In Poor Economics, the better understanding is about the efficacy of common strategies to improve the lot of those with the least—and offers the better news of proven success in alternative methods that are tested and found effective.

This seems to be especially important right now, as we move toward a national election and the broad issues of where we are as a country and what we should be doing to address a long list or urgent needs. Policy decisions and the design and application of strategy—in the civic arena, for foundations, and the philanthropic sector more broadly—seem critical. Yet the air is full of unsupported assertions and sweeping summaries that don’t really bear scrutiny.

The Boston Foundation’s special report makes the point in a significant American context that Poor Economics makes in a global context: we can’t afford to make important decisions about philanthropic investment based on anecdotal evidence and our own hunches, however strongly held.

In the final analysis, data should be the decider.

 

David Trueblood is Vice President – Communications & Programming at the Center for Effective Philanthropy.

 

A CEP Advisory Board Member Weighs In

Monday, September 26th, 2011

Two weeks ago, CEP released a report about strategy at community foundations. Last Thursday, Ellie Buteau wrote a blog post about some responses we have received since the report’s release. Today, Alicia Philipp, who was a member of the advisory group for this study, weighs in with her thoughts on the report.  Philipp is president of the Community Foundation of Greater Atlanta.

 

Thoughts about CEP’s Recent Report on Community Foundation Strategy

I would like to weigh in with my thoughts on CEP’s new study of strategy at community foundations. I served as a member of the Community Foundation Strategy Study Advisory Committee and, hopefully, added input to the design but I take neither credit nor criticism for the study or the results. I do know that I, along with others, raised concerns about a singular focus on program strategy at community foundations and pushed successfully for the broader look at both strategy in donor and programmatic work.

My main worry about too great a reliance on this study arises from the sample size of 30. While it may not still be “if you have met one community foundation, you have met one community foundation”, it is not far from the truth. I can’t help wonder how the next 30 interviews would have changed the results.

That said, I believe community foundations are still in the early stages of figuring out how to have an overall strategy for their work that encompasses donor and program. The silos for many of us are hard to break down. Even in this study the two were looked at separately. Success will be when the articulation of our strategy is different from private foundations because of the unified way we impact communities with all of our assets (literally and figuratively).

 

 

David Trueblood is vice president – communications and programming at CEP.

Data Point: Talking About Staff Performance

Friday, September 23rd, 2011

The use and management of data stands at the core of the work undertaken by the Center for Effective Philanthropy. The set of survey tools CEP has developed as well as field-wide research builds comparative data drawn from key constituent groups—grantees, donors, staff members and others—providing insights that enable funders to better define, assess and improve their effectiveness.  We are posting this series to share our data more broadly and to highlight specific data points.

In this case the source is the Staff Perception Report (SPR), which explores foundation staff members’ perceptions of foundation effectiveness and job satisfaction on a comparative basis. The SPR is based on a survey specific to foundations that includes questions related to staff members’ impressions of their role in philanthropy, satisfaction with their jobs, their foundation’s impact, and opportunities for foundation improvement.

 

 

The data point shown above comes from responses to the following question:

Was your performance formally reviewed during the last 12 months? Those who answered ‘Yes,’ were then invited to agree or disagree with the following statement: Yes, I had a conversation about my recent performance with my supervisor.

Over 700 foundation staff members responded to this question. Of those, 551 individuals or 76 percent indicated that they had such a conversation, and 170 individuals or 24 percent said they had had no conversation with their supervisor about their performance.

 

Kevin Bolduc is vice president — assessment tools at CEP.

Working Strategically: A Common Challenge for Community and Private Foundations

Wednesday, September 14th, 2011

Over the course of CEP’s work, we often hear reasons why foundations cannot, or should not, be compared to one another. According to the conventional wisdom, “If you’ve seen one foundation, you’ve seen one foundation.”  And it is often assumed that community foundations are too different from private foundations to enable us to draw lessons from one that apply to the other.

While there is some truth in these statements, we also see that differences across foundations aren’t necessarily best explained by type, or asset size, or the other commonly hypothesized reasons.  Our past research indicates that important variation exists across foundations, as well as in the practice of foundation staff members, on more mutable characteristics such as how grantees experience working with the foundation, internal attitudes and practices related to data and assessment, or the presence of a strategy.

Our latest research report,Rhetoric versus Reality: A Strategic Disconnect at Community Foundations,” presents us with yet another instance in which we see more similarities than differences across foundations of different types.

In 2006, CEP released a report about the use of strategy, or lack thereof, among CEOs and program staff at large private foundations. It was a qualitative study, based on interviews with a total of 42 staff members from 21 private foundations. Based on our data from that research, CEP developed a definition of strategy:

A framework for decision-making that is 1) focused on the external context in which the foundation works, and 2) includes a hypothesized causal connection between use of foundation resources and goal achievement.

After receiving requests from community foundation leaders, we set out to conduct a similar, but separate study, about the meaning and use of strategy at community foundations. Given the particular challenges and competitive dynamics that community foundations face, we hypothesized that strategy may carry a somewhat different meaning or be viewed differently by community foundation CEOs.  Or that, perhaps community foundations, by virtue of the pressures they’re under, would be more strategic than their private foundation counterparts.

But findings from this new research do not support that hypothesis. Our findings for community foundations are strikingly similar to the findings from our research with private foundations.

After in-depth interviews with 30 randomly selected community foundation CEOs, we found that CEOs of community foundations believe that strategy is important, and say that they are using strategy in their work at their foundation. However, when we compare their descriptions of their strategies with CEP’s definition of strategy, we find that few community foundation CEOs are actually using strategy.

It is worth pointing out that while analyzing our data from this study, we noticed that CEOs’ descriptions of their decision making processes did not indicate that CEP’s strategy definition needed amending in order to be applied to the work of community foundations.

The missing ingredient for most who participated in our study is the second part of CEP’s strategy definition: the logic that explicitly links the use of foundation resources to intended results in the community it serves. When we drill down to examine the decision-making process, we tend to see the biggest gaps between a CEO’s choices and how those choices will help the foundation move closer to achieving the foundation’s goals.

But we know that gaps of this nature are also key opportunities for progress in the development of strategy – for community and private foundations alike. It is clear that community foundations, too, have a long way to go to marry their rhetoric and the stark reality when it comes to strategy.

 

Ellie Buteau, Ph.D., is Vice President – Research at the Center for Effective Philanthropy.

The State of Performance Assessment, 10 Years Later

Tuesday, September 6th, 2011

A decade ago, I started my job at CEP and we launched a study on performance assessment at large foundations. It’s not as if we were the first to think the question of whether a foundation was achieving its desired results was important. The earliest major American philanthropists cared deeply about results and some foundations, like Robert Wood Johnson Foundation, had been putting major resources into evaluation for decades.

But what was lacking, at that time, was a look across the large foundations to understand both practices and attitudes when it came to performance assessment.  So we undertook that study with limited resources — $345,000 in grants from the Atlantic Philanthropies, Packard, and Surdna –  and a small staff (three of us worked on the project, and that was CEP’s sole effort in its first year).  We conducted a broad-based survey of CEOs and a series of qualitative interviews.

What we found was clear – and sobering.  CEOs didn’t feel particularly satisfied with the information they could tap to understand how their foundations were doing. They weren’t utilizing a broad set of indicators, tending instead to rely on evaluations that told them more about a particular grant or set of grants than about the overall effectiveness of the foundation they led. And many of them told us they wanted more timely indicators to help guide and inform their work.

A lot has changed in the past decade. The Bill & Melinda Gates Foundation and other new foundations have burst onto the scene. A whole set of infrastructure organizations, from CEP to GEO to Bridgespan to Guidestar, have either been founded or grown substantially. And the media has paid more attention to philanthropy, raising questions about how it operates and what it has achieved.

So we thought it made sense to take stock, again, of the state of performance assessment at large foundations. This time, we surveyed CEOs of foundations with at least $5 million in annual grantmaking.  We’ll release results of that study tomorrow at noon, EST.  Check this blog and our Web site to find out how performance assessment has changed and what the attitudes and practices are of foundation CEOs today.