Posts Tagged ‘foundation strategy’

Data Point: Developing Shared Measurement Systems

Friday, October 14th, 2011

The use and management of data stands at the core of the work undertaken by the Center for Effective Philanthropy. The set of survey tools CEP has developed as well as field-wide research builds comparative data drawn from key constituent groups—grantees, donors, staff members and others—providing insights that enable funders to better define, assess and improve their effectiveness.

 

This data point is drawn from a survey of the CEOs of 173 U.S. foundations with annual grantmaking of at least $5 million and focuses on the current status of performance assessment among larger foundations. The survey was conducted in January and February 2011.

Our survey focused on assessing individual foundation performance. However, because foundations are typically working as one of many actors seeking to achieve shared goals, there has been significant interest in the development of shared measures.

The majority of CEOs report their foundations are already using, or have considered using, shared measurement systems:

» 26 percent said they are using coordinated measurement systems with other funders.

» 23 percent said they are considering using such measurement systems.

» 10 percent said they considered such systems but decided not to use them.

In addition, 36 percent of CEOs cited the tracking of data collected by other organizations as a source of information for assessing programmatic performance.

Readers of this blog post are invited to respond. What has your experience been with shared measurement systems?

 

* * * * * * * *

To read about current foundation CEOs’ attitudes toward assessment and what foundations are doing to understand their performance, see the report, The State of Foundation Performance Assessment: A Survey of Foundation CEOs written by Ellie Buteau, Ph.D. and Phil Buchanan and published by the Center for Effective Philanthropy.

Ellie Buteau is Vice President – Research at the Center for Effective Philanthropy.

 

 

Guest Post: How the Robert Wood Johnson Foundation Seeks To Improve

Monday, October 3rd, 2011
At the Center for Effective Philanthropy, we believe that improved performance of philanthropic funders can have a positive impact on nonprofit organizations and the people and communities they serve. As part of our work, we aim to highlight stories from funders who share that vision and who value the role of data and assessment in efforts to increase their impact.

 

PROCESS PROGRESS: HOW RWJF STRIVES TO IMPROVE
by Robin Mockenhaupt, Ph.D., M.P.H., Chief of Staff,
Dee Colello, Senior Manager, Program Operations, and
David Adler, M.P.A., Communications Officer
of the Robert Wood Johnson Foundation

 

They must often change, who would be constant in happiness or wisdom. ~Confucius

Change and continual improvement is a valued part of the Robert Wood Johnson Foundation’s culture. It’s in our guiding principles, which state, “We must commit ourselves to lifelong learning and continual improvement.” In addition to change and improvement, RWJF is also committed to transparency and peer learning, and it is in that vein that we are sharing our progress on quality improvement since 2004.

As part of our 2004 annual organizational assessment, we commissioned the Center for Effective Philanthropy’s Grantee Perception Report (GPR). We learned that while our grantees rated us comparatively well in several areas, we were using up a lot of grantee time meeting our administrative demands and we weren’t moving as fast as we needed to in processing grants. We also learned we needed better clarity in our communications of goals and strategies.

A 2011 CEP case study, Frequent Checkups Make for Healthier Funding Relationships, illustrated that we changed. We wanted to share one of the ways we took that advice to heart.

With the findings from the GPR, input from an all-staff retreat, and a focus group of grantees, we developed our first Foundation-wide Quality Improvement (QI) initiative. Our process for implementing this QI project can be broken down to five steps.

  • We set the right tone. The all-staff retreat and the announcement of the QI process by our president and CEO, Risa Lavizzo-Mourey, M.D., M.B.A., helped create widespread buy-in among staff. Any organization considering quality improvement projects should recognize that having the buy-in and public support of the CEO is a crucial first step for setting the appropriate environment for change.
  • We started with something manageable. The initial focus of our quality improvement work was on a category of grants that accounts for about 20 percent of our grantmaking. We wanted to start with something manageable to see how it worked before rolling out broader efforts.
  • We gathered the troops. After the announcement, staff interested in quality improvement convened to map out current grantmaking processes; shortly after that, a smaller core staff team was chartered, supported by a group of project sponsors from senior management.
  • We jumped in. The team designed a pilot. After testing and implementation, the project moved into control (maintenance) phase. Our first QI project resulted in sequencing and prioritizing steps in our grantmaking process, as well as launching the Foundation’s Program Information Management System (PIMS).  After our first QI project, two other projects were designed and implemented, using a similar structure and process. In addition, three smaller projects were led by staff trained in the QI process.
  • We are monitoring ongoing progress. We needed a way to monitor how we were doing and for identifying new ideas for improvement. We organized a standing staff group called the Process Improvement Group to help track metrics for our grantmaking and to initiate new quality improvement initiatives. Additionally, other units within RWJF have taken up their own quality improvement initiatives.

What did we learn?

  • Communications is a key component to implementing quality initiatives and staff behavior change.
  • Staff like being involved in cross-functional improvement projects
    when they see the need for change and can be a part of the solution.
    It’s also an opportunity to involve staff at every level of the
    organization.
  • Staff need dedicated time for QI work, as opposed to trying to “fit it in” around other responsibilities.
  • Over time, managers learned better how to scope and implement QI projects.
  • The automation of our grantmaking process (which initially was
    paper) allowed for project milestones and timelines to be standardized
    and to become transparent to all staff.

 

We’re pleased that more recent CEP reports have concluded our grantee perceptions have gotten better over time, and we believe our quality improvement efforts were a factor in this change. Our responsiveness measures are now higher as well as our quality of interactions. With that said, all our quality improvement efforts were not successful and we are receptive to revising any processes that may have missed the mark. For example, we are still working toward reducing the amount of time in both selection process and improving our ongoing monitoring and reporting.

We’re happy to share additional information about our QI process and are eager to hear how our colleagues are approaching this as well.

A CEP Advisory Board Member Weighs In

Monday, September 26th, 2011

Two weeks ago, CEP released a report about strategy at community foundations. Last Thursday, Ellie Buteau wrote a blog post about some responses we have received since the report’s release. Today, Alicia Philipp, who was a member of the advisory group for this study, weighs in with her thoughts on the report.  Philipp is president of the Community Foundation of Greater Atlanta.

 

Thoughts about CEP’s Recent Report on Community Foundation Strategy

I would like to weigh in with my thoughts on CEP’s new study of strategy at community foundations. I served as a member of the Community Foundation Strategy Study Advisory Committee and, hopefully, added input to the design but I take neither credit nor criticism for the study or the results. I do know that I, along with others, raised concerns about a singular focus on program strategy at community foundations and pushed successfully for the broader look at both strategy in donor and programmatic work.

My main worry about too great a reliance on this study arises from the sample size of 30. While it may not still be “if you have met one community foundation, you have met one community foundation”, it is not far from the truth. I can’t help wonder how the next 30 interviews would have changed the results.

That said, I believe community foundations are still in the early stages of figuring out how to have an overall strategy for their work that encompasses donor and program. The silos for many of us are hard to break down. Even in this study the two were looked at separately. Success will be when the articulation of our strategy is different from private foundations because of the unified way we impact communities with all of our assets (literally and figuratively).

David Trueblood is vice president – communications and programming at CEP.

Avoiding a False Choice (Why We Need Both ‘Morality’ and Assessment)

Thursday, July 21st, 2011

I am speaking today on a panel at the Hudson Institute in Washington, D.C. on “Reclaiming the Moral Life of Philanthropy.”  The panel includes Gara LaMarche, president of Atlantic Philanthropies, and is centered on a talk he gave at MIT in which he suggested he has:

“A disquiet about the way we in the foundation world, along with the organisations we support and the infrastructure many of us have helped to build, have mirrored trends in the political world to talk about what we do and why we are doing it in ways that have strayed too far from first principles. We have become more about the fix, the intervention – to use a horribly dominant word in the field that calls to mind invading armies – than about the reasons for doing or caring about it. In marching under the flag of what works, and in particular what can be proven or demonstrated through the rigours of evidence, we risk straying too far from what is right. I think it is time to strike a better balance.”

I am one of three responding to Gara’s comments – along with Indiana University’s Leslie Lenkowsky, Maya Wiley of the Center for Social Inclusion.  William Schambra will moderate.

Here is what I intend to say (my actual comments may vary a bit of course): 

There is much about Gara LaMarche’s speech at MIT to be admired – and that I agree with.

For example, I agree with him that our political discourse, today, is often focused on poll-driven pragmatism at the expense of moral clarity and moral courage. Whether the issue is climate change or health care or immigration – all examples he cites – we hear too much about what is feasible, or politically possible, and not enough about what, simply, is right. (Although one could easily argue that, given what is going on in Washington right now, a little more focus on what is feasible with respect to the debt ceiling would be helpful! Still, I tend to agree with Gara’s general point here.)

Where I part company with him is when he asserts that this problem infects philanthropy. Or when he suggests that there is some disconnect in philanthropy between the moral case for what we do and the quest to understand what works. Or when he seems to imply that the fact that too many foundations are entrenched in “fixed and safe positions,” which I would agree with, is attributable to a focus on effectiveness – when, in fact, I believe the opposite is the case.

Gara says:

“In marching under the flag of what works, and in particular what can be proven or demonstrated through the rigors of evidence, we risk straying too far from what is right.”

I say: we stray from what is right when we do not assess.  This is, after all, about the people we seek to help – and if we don’t do the necessary work to confirm that we are, in fact, helping, we are falling short of our moral obligation. 

  • As Mario Morino of Venture Philanthropy Partners argues in his important new book, Leap of Reason, “Every ounce of our effort on assessing social outcomes should be with one end in mind: helping nonprofits deliver greater benefits to those they serve.” 
  • It is nothing less than a moral outrage when programs like DARE and Scared Straight receive massive funding only to realize, after years and millions of dollars, that they are having no effect, or, worse, the opposite of the intended effect. Mario’s book has a powerful example of such an instance here in Washington, D.C., at the Latin American Youth Center. That organization sought to change attitudes about domestic violence – but it found its efforts were having the opposite of the intended effect.  Fortunately, the Latin American Youth Center’s metrics allowed it to learn that early, and retool the program.
  • Or consider the durable programmatic infestation of abstinence-only education, propelled by only fervent belief in the face of clear evidence that it fails to protect young people from unintended pregnancy and exposure to disease.

We are all painfully aware that resources are limited. That means ineffective or counterproductive strategies deflect attention and waste time and money urgently needed to support and expand strategies that are effective.

Gara says,

“The effectiveness movement is now finding, I believe, that there is no real constituency for effectiveness as such. … because it is values that move people.”

I say, whatever happened to doing what is right because it is right, rather than worrying about whether an idea has a “constituency?” In fact, isn’t this the very point you led off, with, Gara, in your talk at MIT? 

I would say it is morally right to learn as much as possible about whether what you are doing is having the desired effect, whether it is politically popular or not. 

And let’s take on the task of building the constituency for effectiveness. My experience at the Center for Effective Philanthropy convinces me that there is one.  And I think it is growing.  A survey we conducted this year of foundation CEOs showed that the overwhelming majority say assessment is among their highest priorities. And the constituency for effectiveness has deep roots: it is as old as philanthropy itself. Bill Schambra so often reminds us of this in discussing the “mania to measure” – although to him it is a lament – that goes back to the days of Rockefeller and Carnegie.

The constituency for effectiveness is made up of all those who are not content to assume that they are doing as well as they could be doing – those who are not content to take for granted that they are not unintentionally doing harm.  Those who want to learn and improve. Those who reject ignorance and seek knowledge.  Those, among foundations, who want to break out of the bubble of isolation and positive feedback that affiliation with large endowments inevitably creates, so they can learn how they’re really doing – and how they are really perceived. It is a growing constituency of those who believe effectiveness is a moral imperative.

So here is my central point: Assessment and morality are not in tension, never have been.  On the contrary. We are morally obliged to seek to know how we are doing, and how we can improve.  

And I would argue that the impulse to understand the efficacy of what we are doing stems exactly from our reasons for caring about it.

  • If we really care about improving the lives of former foster kids, than we must track, as the Stuart Foundation in California and its grantees do, the numbers of those with lifelong connections to caring adults and the numbers graduating from college.
  • If we really care about civil rights for gays and lesbians, as the Gill Foundation and its grantees do, than we must track in which states gays and lesbians enjoy the same legal protections – whether in marriage or the workplace – that heterosexuals do.
  • If we really care, as the Robert Wood Johnson Foundation and its grantees do, about tackling the obesity epidemic, than we must track the relevant data – including data on the aspects of the strategies employed that we believe to be crucial, just as that Foundation did in its successful work on tobacco use.
  • If we really care, as the Wilburforce Foundation and its grantees do, about preservation of habitats for wildlife, than we must be data-driven in our tracking of endangered species and seek to strengthen the organizations on the ground doing that hard work; in seeking to strengthen those organizations, the Wilburforce Foundation also seeks to find out whether its help is really deemed to be helpful by its grantees – in part by working with CEP to get candid and comparative data on that question.

These organizations assess because they bring passion to important issues.  Caring and knowledge of efficacy are not in tension, these are not qualities needing to be held in “balance,” as Gara argues.  They form, instead, a virtuous cycle.

Just as we should reject the caricatures and labels – and polarization – that cheapen our political discourse, so should we reject them in philanthropy. 

Invocation of “morality” without regard to effectiveness is often mere ideology. 

We work in the nonprofit sector because of our desire to make communities stronger, lives better, air cleaner, whatever the goal is that you or your organization fight for.  That’s why we do the work.  For that reason, we want to know – most of us deeply, desperately want to know – whether our work is making a difference. 

Of course, it’s hard to know, and some of the attempts to answer those questions are misguided or ill-designed. I would be the first to acknowledge that some assessment is done badly.  And I’d also concede that some make the foolish choice to let ease of measurement drive their selection of goals.

But let’s not let those errors in thinking and approach taint our view of the importance of assessment. 

The fact is, the alternative to measurement and assessment is flying blind.  Doing nothing, or worse than nothing, when we mean to be doing good. 

Failing to know what really helps people. 

Failing to direct resources in ways that result in real improvement in peoples’ lives. 

Failing to be our very best.

Assessment and morality are not in tension, never have been.  On the contrary. We are morally obliged to seek to know how we are doing, and how we can improve.  

Michael J. Fox: Getting Results By Going the Unconventional Way

Thursday, June 30th, 2011

Almost from the start, Michael J. Fox and Debi Brooks began upending the way foundations typically do business.

The co-founders of the Michael J. Fox Foundation for Parkinson’s Research did so because they felt an urgency about finding a cure for Parkinson’s—and because in the beginning, they didn’t know any better.

When Fox decided to start a new foundation dedicated to finding a cure for Parkinson’s disease, he said he knew he wanted to keep its efforts tightly focused on research. 

“One of the reasons we focused on research was because it was a huge task, it was an essential task,” said Fox, who spoke at the Center for Effective Philanthropy’s (CEP) 2011 conference. “If we started going in all sorts of other directions, no one would be served.” 

The decision to center the foundation’s mission around Parkinson’s research, rather than patient services, was just one of the first ways that Fox and his colleagues forged their own way.

Fox, an acclaimed television and film actor as well as bestselling author, established the foundation in 2000, following the public disclosure of his diagnosis in 1991 at age 30 of young-onset Parkinson’s disease. Since its inception, the foundation has funded more than $240 million in research to speed development of breakthrough treatments and a cure for Parkinson’s disease. Today it is the world’s largest private funder of Parkinson’s research and has been held up as an exemplar of a new breed of nimble, strategic, and fast-moving disease research funders.

At the CEP conference, which marked its 10th anniversary, Fox said that the hallmark of the foundation is “informed urgency.”

“It’s been like a joke in our board meetings—POM—purity of motive,” he said. “Whenever we get bogged down in anything, we [remind ourselves] we are here for one thing. We are in business to get out of business.”

Co-founder Debi Brooks, a former Goldman, Sachs & Co. executive, said that the foundation began taking unconventional approaches like asking its researchers to meet and share what they learned simply because it made sense. Brooks and her colleagues did not realize that wasn’t the way that competitive scientists typically approach their work.

Brooks pointed out that many academics are accustomed to receiving grants of up to five years’ duration from funders who do not routinely require detailed updates on their progress. Brooks and her colleagues, by contrast, began making smaller  grants over shorter timeframes. And, they wanted researchers to provide in-person updates on their work. It was a request that the foundation’s own scientific advisory board challenged. Board members said it would result in scientists simply sending their postdoctoral students because they were too busy to attend, Brooks recounted.

“I said, ‘We’re kind of busy too,’” she said. “We did some pushback.”

The requirement to meet was meant to help focus the work, Brooks said. Initially, the scientists simply tolerated the obligation of making an in-person presentation of their work in front of their competitors. But their reluctance soon changed to a different attitude, she said.

“What we found was that there was so much cross fertilization and problem solving in the moment that the assessment meetings ended up as some of the best work that we could spawn. [There were] partnerships, collaborations, [people saying] ‘I’m sending you my antibodies, you help me with this.’ Then it became that you wouldn’t miss the assessment meetings. We would say ‘Given what we heard, what are the challenges we should be thinking about?’ If you weren’t at the assessment meeting, you’d miss the chance to influence us.”

Meanwhile, as scientists compared notes at the assessment meetings, Fox’s presence provided an unexpected motivation, he said.

“I would go by the foundation [with these] large groups of scientists in the conference room who were busy swapping stories,” Fox said. “I would come in to say thank you. Their response [to me] was not as Michael Fox or as the founder of the foundation, but as a Parkinson’s patient. I would be very symptomatic in front of them. I could see them make the connection between what they were doing and this shaky person at the front of the table. It was about ‘fix the shaky person.’”

The full video interview of Michael J. Fox and Debi Brook’s talk at the CEP conference is available here. The conversation was moderated by Rockefeller Brothers Fund President and CEP Board Chair Stephen B. Heintz.

Susan Parker is owner of Clear Thinking Communications.