Posts Tagged ‘funder effectiveness’

Assessing Foundation Performance

Thursday, April 15th, 2010

At last year’s CEP conference in Los Angeles, I presented on the Irvine Foundation’s approach to assessing foundation performance, joined by David Colby from the Robert Wood Johnson Foundation. I think it’s fair to say that David and I were presenting approaches used by our respective foundations that remain works in progress – Irvine’s even more so than RWJF’s given its focus on this area for many more years.

In view of the interest in this topic at the conference, and my own desire to share what we are doing at Irvine in an effort to improve upon it, I appreciate the opportunity offered by CEP to write a series of blog posts on the subject of assessing foundation performance.

 I plan to do this in four parts, addressing the following topics:

  1. Why we developed an approach to foundation performance at Irvine
  2. What we have found particularly challenging about assessing foundation performance
  3. How our board has engaged with us on this subject
  4. Why assessing foundation performance is both important and necessary

In reflecting upon Irvine’s experiences, I hope to stimulate readers’ contributions to deepening our collective understanding of this important subject and to improving our efforts to measure and understand our performance as foundations.

The focus of these blog posts is Irvine’s Annual Performance Report, which informs Irvine’s board about impact in our three program areas and our overall institutional effectiveness. I include links throughout this post and hope readers might take time to scan those related documents. 

We developed our current performance assessment framework after a strategic planning process in 2002-2003 that led to our current focus on three grantmaking programs (Arts, California Democracy, and Youth). As we embarked on this new focus, we wanted a plan to assess the foundation’s performance, both within the grantmaking programs, and across the foundation as a whole. 

A group of board and staff members worked together for several months and, as part of that, explored best practices in foundation-wide assessment. Two examples that stood out at that time were assessments done by the RWJF and the Rockefeller Brothers Fund

From those models and our discussions about what the board wanted to learn about the foundation’s performance, we created a framework that balances an assessment of grantmaking impact with ways to track overall institutional effectiveness, which are the two broad areas that organize Irvine’s approach. 

We also felt it was critical to look at our performance through different prisms, so within these two broad areas, we examine specific grantmaking statistics and progress, evaluation results, broader institutional effectiveness beyond the grantmaking programs, and a range of other categories. This framework is the basis for our Annual Performance Report. 

The primary audience to date for these Annual Performance Reports has been our board of directors. This focus has enabled us to be clear about the report’s purpose, ensuring that we are providing the information that is most relevant for that audience. 

Once we created the first report for the board in 2007, we then published it on our website, as a manifestation of our commitment to transparency and as another model for others to draw upon as they explore their own approaches. Throughout, I have also been interested in the critiques and questions that our approach has generated so that we might improve upon it going forward. 

This description of our process for creating Irvine’s Annual Performance Report sounds very straightforward. The reality, of course, is a bit messier, and my next blog post will focus on some of the challenges we’ve experienced and how we have refined our approach based on what we’ve learned. 

I’ll conclude with a final, personal observation: We have invested a great deal of time on this subject because I am persuaded that my obligations as CEO include developing an approach to rigorous foundation performance assessment. Given the autonomy that private foundations enjoy, and the occupational risks of complacency and insularity, creating a framework for foundation assessment and then reporting to our board in some regular interval has kept us focused on how we apply our finite resources for greatest impact. That goal has motivated us to date and it remains why we are keenly interested in improving upon and refining our approach to foundation performance assessment. 

There are undoubtedly other perspectives, however, including those that might disagree with this premise and/or our approach. I hope you’ll take a few minutes to share your thoughts, and I would especially value any comments or questions that will push us as we continue to grapple with this important work. 

Jim Canales is President of the James Irvine Foundation 

*****

Disclaimers and Disclosures: The views expressed in the CEP blog by guest bloggers are entirely their own and do not necessarily reflect the opinions of the Center for Effective Philanthropy.

Jim Canales to Address Overall Foundation Performance Assessment as CEP Guest Blogger

Thursday, April 15th, 2010

CEP is very lucky to have had the support and encouragement of Jim Canales of the James Irvine Foundation from the very early days of our establishment.  He has allowed the Foundation, on multiple occasions, to be a test site for new CEP assessment tools, such as our Staff Perception Report (SPR) and Stakeholder Assessment Report (STAR).  And the Foundation has supported CEP through grant funding to establish our West Coast office, to produce conferences and events in California, and to develop a new donor survey tool for community foundations.

As the Irvine Foundation CEO, Jim has been a leader on issues of governance, transparency, and effectiveness.  Jim is such a diplomat and has such great relationships across the foundation field and nonprofit sector that it’s easy to underappreciate the boldness of his leadership.  The Irvine Foundation’s website sets a bar for openness that many other foundations simply don’t clear. 

And, in recent years, Jim and his colleagues have done what all too few foundations do – make public a performance report that captures what they consider to be the key data about their foundation’s effectiveness.  While he’d be the first to admit that it’s a work in process, it’s an impressive effort to put down in one place – for all to see – the key indicators of foundation effectiveness.

As CEP’s next guest blogger, Jim will openly address the challenges and benefits of developing an overall foundation performance report.  I think his posts will challenge others to consider what they do to assess overall foundation performance, with whom they share that data, and to what end.

***

Phil Buchanan is President of CEP

Has Anything Really Changed in Philanthropy?

Monday, April 12th, 2010

Sean Stannard-Stockton, CEO of Tactical Philanthropy Advisors, and founder of the terrific blog Tactical Philanthropy, invited me to join a team of bloggers sharing thoughts on the GEO conference this week in Pittsburgh.  What follows are some musings on what’s changed since the first GEO conference I attended in 2002.  To link to this and the other guest blogs on the Tactical Philanthropy site, go to http://tacticalphilanthropy.com/2010/04/has-anything-really-changed-in-philanthropy.

The first Grantmakers for Effective Organizations (GEO) conference I attended was in Washington, D.C., in 2002.  It was tough to get in: GEO wouldn’t let me register because I was the executive director of a tiny (four staff) organization that no one had ever heard of  – the Center for Effective Philanthropy (CEP). I said, “Come on, we share a middle name.  We’re practically related!”  But they weren’t having it.

So, with a little help from Vince Stehle, then program officer at the Surdna Foundation (one of CEP’s initial funders), I registered as if I worked for Surdna and showed up.  Vince hosted a breakfast roundtable to discuss CEP’s first report, on overall foundation performance assessment, and I was thrilled when we had to pull two tables together because 17 people showed up.

Fast-forward to the eve of the GEO conference in 2010 and allow me to switch – as my 9-year old daughter often does when she writes – to the second person and say this: you are expecting me now to discuss “how much has changed” when it comes to funder effectiveness and assessment since that conference almost a decade ago.  And, I will, but it’s not quite so simple.

Fact is, I think we tend, in philanthropy (and maybe in life), to overlook historical examples and proclaim that something is “new” when it is really only new to us.

The media, and even those within philanthropy, often speak as if the focus on impact, outcomes, measurable results – whatever we call it – is brand new when, of course, it is not.  As Ed Skloot, now of Duke University, has noted, “Our earliest American philanthropic ancestors—John D. Rockefeller, Margaret Olivia Sage . . . , Andrew Carnegie — bequeathed a kind of courage and determination to us, a confidence we can take on large-scale problems with deeply rooted causes.”  Bill Schambra, of the Hudson Institute, also argues – although for him, unlike Skloot, it is a lament –  that the “mania to measure” goes back to the “first days” of the Rockefeller Foundation.

So, let’s not pretend that, just because our friends at McKinsey have launched a Web site focused on impact assessment, the concept was invented yesterday.  But, at the same time, it’s clear there has been dramatic change over the last decade in philanthropy.  New donors have brought new ideas, new and creative approaches, and new energy to the table. Numerous organizations that were either fledgling or non-existent a decade ago are now providing crucial data on nonprofits to funders:  Guidestar, Charity Navigator, Philanthropedia, Great Nonprofits.  And the list goes on.  And then there are the organizations focused on funder effectiveness:  GEO, GrantCraft, CEP.

But are funders operating more effectively?  Are they achieving more impact?  We at CEP see real signs of hope  – funders making clear their goals, strategies, and performance indicators; funders getting – and acting on – feedback from crucial stakeholders, from grantees to intended beneficiaries; boards really holding CEOs accountable for performance.

I can point to some inspiring examples of present-day foundation effectiveness and impact, from the Stuart Foundation’s Child Welfare Program to the Wilburforce Foundation’s work protecting wildlife habitat to the Gill Foundation’s work on gay rights to the groundbreaking and much-discussed work of the Edna McConnell Clark Foundation.  And we at CEP have some new data we’ve been analyzing that will suggest some movement in the right direction. But, quite frankly, the movement is less dramatic than many of us would hope.

The reality is that there are still far too many staffed foundations doing significant (in dollars) grantmaking that aren’t even clear on what, exactly, they’re trying to do, much less how they’ll do it or how they’ll know if they’ve been successful.  So, my question is, how much really has changed since that conference in 2002?

In my less optimistic moments, I wonder: is it possible that there has always been a subset of foundations that really care about effectiveness and impact and that their proportion of the overall number of foundations hasn’t changed much since the early days of Carnegie, Rockefeller, and Sage – even as the resources available to help them have grown and improved?  (A related question: how common is it that the very same foundation goes through periods of being highly effective – with clear goals, coherent strategies, and good performance indicators – and then other periods of being unfocused and adrift? I have seen many examples of this, suggesting that it’s not about “new” philanthropy or “old” philanthropy but rather “effective” philanthropy.)

My fundamental question is, how much change, really, has there been? Today, we can’t really answer that question as definitively as I would hope.  I’d be curious to know what others think.

(Disclosure: The foundations I mention above are among the more than 200 we have either provided assessment tools to or received funding from – and the former CEO of Edna McConnell Clark sits on our Board of Directors.)