Author Archive

Hard Facts: Data Tells an Unexpected Story in Boston

Monday, December 12th, 2011

The city of Boston stands as a gleaming example of the renewed and widespread appreciation for urban living. Its charms, after all, are abundant, from 18th century Beacon Hill streets to dynamic and diverse SOWA, the “new” South End. Plus it has been honored for its strong public schools (2006 winner of the Broad Prize for Urban Education, no less). All of which makes the new report, The Measure of Poverty: A Boston Indicators Project Special Report, something of a bombshell.

The Boston Indicators Project is the widely honored data-and-analysis special initiative run by the Boston Foundation with a host of partners in Greater Boston’s Civic Community. It is headed by Charlotte Kahn (honored in Istanbul in 2007 for her work) who is a leader in a global movement to create indicators initiatives, using open-source data collected from a wide array of credible sources to examine current trends and realities from the grass roots to broad regions.

Justification for the use of the b-word? Here are a few selected data points for consideration—drawn, I repeat, from the heart of one of the most economically successful places in the United States:

  • As many as 340,000 Bostonians now live in poverty (excluding college students) or stand at risk of being unable to afford such necessities as housing, food, transportation, child care and energy. That represents more than half of the total population of Boston.
  • Income inequality is bad and continues to grow worse. Despite Boston’s recent economic successes, Suffolk County remains one of the 50 most unequal in the United States. In 2009, the top 5 percent of Boston earners received 25 percent of total annual income in the city while the bottom 20 percent earned just 2.2 percent of the total.
  • Health care costs, already the highest in the nation, are expected to double by 2020. Meanwhile, social investment in programs that offer a significant return on the dollar are being slashed, promising downward economic pressure in years to come. Cuts in state funding for services from fiscal years 2009 and 2012 include the following: universal pre-kindergarten, cut 38 percent; teen pregnancy prevention, cut 41 percent; health promotion and disease prevention, cut by 77 percent; and employment services, cut 80 percent.

I find this report compelling for two reasons. First, I know Kahn to be a scrupulous and rigorous curator of data (she was a colleague when I worked for the Boston Foundation) with a prophetic voice that has—unfortunately—been validated consistently in recent years. This report deserves to be read and pondered far beyond the borders of Boston.

And the second reason is because at the Center for Effective Philanthropy (CEP), I spend much of my time looking for ways to highlight the power and utility of data as a critical tool for expanding the impact of philanthropic funders.

Real tension exists between the visceral power of anecdotal presentation and the sometimes challenging reality of actual fact. In a similar work of data-driven exposure, this tension is a major theme of the book Poor Economics, by Esther Duflo and Abhijit Banerjee, which speaks powerfully about the value of scientific investigation in the search for effective strategies that address the causes and effects of global poverty.

The point here is that our untested hunches often fail to provide a credible read of the world around us. The discipline of high quality research and data analysis brings us to a better understanding. In The Measure of Poverty, the better understanding is a sobering assessment of trends that are eroding common assumptions about the United States as a land of opportunity where the American Dream is a plausible aspiration. In Poor Economics, the better understanding is about the efficacy of common strategies to improve the lot of those with the least—and offers the better news of proven success in alternative methods that are tested and found effective.

This seems to be especially important right now, as we move toward a national election and the broad issues of where we are as a country and what we should be doing to address a long list or urgent needs. Policy decisions and the design and application of strategy—in the civic arena, for foundations, and the philanthropic sector more broadly—seem critical. Yet the air is full of unsupported assertions and sweeping summaries that don’t really bear scrutiny.

The Boston Foundation’s special report makes the point in a significant American context that Poor Economics makes in a global context: we can’t afford to make important decisions about philanthropic investment based on anecdotal evidence and our own hunches, however strongly held.

In the final analysis, data should be the decider.

 

David Trueblood is Vice President – Communications & Programming at the Center for Effective Philanthropy.

 

Evaluation Roundtable Study Highlights the Role of the CEO in Evaluation

Wednesday, November 16th, 2011

report written by Elizabeth Heid Thompson and Patricia Patrizi (and currently available on the CEP website) explores the extent to which foundations evaluate the results of their work. An examination of 31 foundations that have demonstrated a commitment to evaluation over time highlights several key facts.

According to the report, published for the Evaluation Roundtable, funding to support evaluative activities has decreased despite an increase in the demand for the information those activities produce. The number of foundation staff devoted to these activities has also declined in recent years.

Much of the current investment in evaluation is focused on performance metrics, often administrative metrics, rather than on the measurement of the strategy behind the work or on the implementation process. In fact, many evaluation leaders raised the following concerns about the metrics used:

  • That the metrics they were tracking did not adequately align with their strategies;
  • That their investments did not make a difference in moving the needle; and
  • That metrics chosen often reflect goals too distant to inform the way a strategy is implemented.

The good news discovered in this research, which took place in 2009, was about the role of foundation CEOs in the evaluation process. They report that when the evaluation unit reports to the CEO, more financial resources will be provided, the evaluations will be more widely distributed and more attention will be paid to the findings.

 

Podcast Interview Explores Findings in CEP’s Recent State of Foundation Performance Assessment Report

Monday, November 7th, 2011

A podcast interview with CEP President Phil Buchanan provides a timely take on the state of foundation assessment. The interview is conducted by Larry Blumenthal and Bill Silberg for Talking Philanthropy, a Foundation Center service. The conversation, available directly here, is just over 15 minutes long and covers a wide range of questions.

It takes off from CEP research recently published in the report The State of Performance Assessment: A Survey of Foundation CEOs, which presented the following key findings:

  • CEOs place great importance on assessing their foundations’ effectiveness;
  • Foundations appear to be using a broader range of information to assess their financial, operations, and programmatic performance than a decade ago; and
  • Board involvement in assessment remains a challenge.

The conversation examines the findings and charts the changes since CEP’s earlier research on the subject almost a decade ago, putting the efforts to find effective ways to assess performance both in the long-range history of modern philanthropy and in the more immediate context of a decade of significant change in culture and practice.

 

Unexpected Examples of the Very Real Power of Data and Analysis

Wednesday, October 26th, 2011

To my surprise, baseball and Shakespeare have both recently underscored for me the importance of the mission and values of the Center for Effective Philanthropy, putting in to focus why I made the decision to join this organization. Not two elements I would expect to find sharing a Venn diagram, but the common theme has to do with the importance of data and the power of analysis.

By baseball, I mean the hit movie Moneyball (based on the book by Michael Lewis), which examines the innovative strategy put into play by general manager Billy Beane. He depended on close analysis of the proven performance by a more or less motley crew of players to build a team within tight budget constraints. What these players held in common was an ability to play at a level that exceeded their value as judged by conventional metrics. Beane stands for the power of data over hunch, and for a rejection of the accumulated experience of anecdotal evidence, a significant departure in the culture of baseball.

And by Shakespeare I mean a recent essay by Stephen Marche, a columnist most frequently read in Esquire, the Wall Street Journal and the New York Times. In a Sunday Times Magazine piece, Marche presents a compelling and timely critique of the durable legend that Shakespeare’s plays were written by someone else—in this case by Edward de Vere, earl of Oxford, most recently aired in the current film Anonymous. Marche dismisses the substance of this implausible narrative with a handful of compelling examples. (For instance: De Vere died before the events that inspired the plays MacBeth and The Tempest—let alone before the plays were written.)

Marche’s more important point is about the erosion of a culture of rigor and the threat that presents for all of us, outside of the somewhat restricted fields of theater and sport. The growing sense that it is somehow unnecessary, or even an affront, to speak from a position of informed expertise has profound implications on a wide swath of issues that matter a great deal to many of us and that will most likely matter more in the future, from climate change to the economic consequences of U.S. government default.

Moneyball offers compelling testimony to the real-world impact of data, making it possible to come to a deeper understanding of the processes that make things happen. It is easy to see the parallels to many thorny problems we confront—think education, or health care—that are themselves often understood through the power of anecdote. And Marche’s essay, titled ‘Wouldn’t it be Cool if Shakespeare Wasn’t Shakespeare?, speaks to the importance of beginning with the data and building understanding from there, rather than starting with a hypothesis and retro-fitting the evidence to accommodate it.

I am willing to concede that if someone were to make a movie out of CEP’s recent report, The State of Foundation Performance Assessment: A Survey of Foundation CEOs, it probably wouldn’t serve as a good vehicle for Brad Pitt. But the arguments pressed by these two examples drawn from the culture of our times take me back to the mission of CEP: To provide data and insight so philanthropic funders can better define, assess and improve their effectiveness. And to the vision: We seek a world in which pressing social needs are more effectively addressed.

In an age when the challenges we face are so large and complex, I just don’t see how we get to that world without a culture of rigor and analysis. We must maintain the ability to step away from conventional understanding and from the pleasures of conspiratorial thinking when the data rules them out.

Since leaving the Boston Foundation this summer to join CEP, colleagues have asked me why I made the jump from a well-established community foundation with a long record of visible accomplishment to join a young nonprofit with a mission that can seem abstract at times.

This is why. Because I want to spread the message that data matters, that rigor matters, if we are to make the changes we wish to see in our society.

 

David Trueblood is vice president — Communications & Programming at CEP.

The Power of Donor Feedback

Wednesday, September 28th, 2011

The conversation at the Center for Effective Philanthropy (CEP) tends to move rapidly toward the subject of feedback. The assessment tools we provide to foundations make it possible to collect responses in areas relevant to foundation organization and practice from a wide range of constituent groups — grantees, local stakeholders and donors among them. The goal in every case is credible, comparative feedback that gives those constituents a voice and places them in context.

Donors and the Donor Perception Report (DPR) were the particular focus of a recent seminar conducted at the Council on Foundations’ fall conference by Kevin Bolduc, CEP’s vice president – assessment tools. Video from that session makes a strong statement about the utility of feedback in general but also about the power of comparative data.

What we see here is a look at what foundations get from the DPR. Above all, that is the contrast between what foundation staff members surmise donors think of them, and what the data compiled through CEP’s cumulative surveys actually reveal. During the seminar, Kevin asked attendees to suggest one word that donors might be expected to use to describe their community foundation. Participants offered up a list: trustworthy, responsible, connector, leader, engaged, pretty much in that order.

From research, he then listed what donors actually said to describe the community foundation they work with. These were, in order: effective, professional, helpful and efficient.

The point is that data replaces assumptions with facts. And even a seasoned hunch can benefit from that sort of informational update.

Taking part in the rest of the session with Kevin Bolduc were Amy Cheney, vice president for Giving Strategies at the Greater Cincinnati Foundation; Terence Mulligan, president of Napa Valley Community Foundation; and Sarah Nelson, chief philanthropy officer at the Communities Foundation of Texas. These foundations differ in terms of geography, mission and history but all share an appreciation of how measurable feedback can improve their work processes as well as the specific findings they drew from constituent feedback. A full video of this seminar will be available soon at www.effectivephilanthropy.org.

To find out more about the DPR and the power of feedback, friends and colleagues are invited to join CEP for a webinar from 2 to 3 p.m., EST, on Friday, October 7. Amy Cheney will share her experience with the DPR, and participants will have the chance to pose questions to her, as well as to CEP President Phil Buchanan and Kevin Bolduc. We have had a good show of interest in the webinar already, and expect a lively conversation.

Click here to register.

David Trueblood is vice president – communications and programming at CEP.