Archive for the ‘Managing Operations’ Category

Data Point: How Foundation CEOs Use Information About the Effectiveness of their Programmatic Work

Friday, October 28th, 2011

The use and management of data stands at the core of the work undertaken by the Center for Effective Philanthropy. The set of survey tools CEP has developed as well as field-wide research builds comparative data drawn from key constituent groups—grantees, donors, staff members and others—providing insights that enable funders to better define, assess and improve their effectiveness.

Here is another finding from our recent survey exploring the current status of performance assessment among larger foundations. The survey was conducted in January and February of this year, and we received responses from CEOs of 173 U.S. foundations with annual grantmaking of at least $5 million.

In the survey, CEOs were asked to indicate how important the information they collect to assess the effectiveness of their foundation’s programmatic work was for a variety of purposes.

 

The majority of CEOs responded that this information was extremely important for various internally focused purposes. For example, almost 60 percent thought information about the effectiveness of their program work was extremely important to use when deciding whether or not to change or adjust their own programmatic strategies. A total of 70 percent thought this information was extremely important to help them understand the impact of their programmatic work. Very few CEOs – 6 percent and 2 percent, respectively – thought the findings were not important for these purposes. When rating the importance of using information about their programmatic effectiveness for a more external purpose, such as communicating publicly about what the foundation was able to learn through its programmatic work, only 37 percent thought it was extremely important and 18 percent said it was not important at all.

Does the lack of importance CEOs place on publicly sharing such information lead to missed opportunities for foundations to learn from one another’s work – about what works and what does not? Beyond that, are there also missed opportunities for nonprofits to learn more about what has been tried and assessed?

*   *   *   *   *   *   *   *

To read about current foundation CEOs’ attitudes toward assessment and what foundations are doing to understand their performance, see the report, The State of Foundation Performance Assessment: A Survey of Foundation CEOs written by Ellie Buteau, Ph.D. and Phil Buchanan and published by the Center for Effective Philanthropy.

 

Ellie Buteau is Vice President – Research at the Center for Effective Philanthropy.

Guest Post: How the Robert Wood Johnson Foundation Seeks To Improve

Monday, October 3rd, 2011
At the Center for Effective Philanthropy, we believe that improved performance of philanthropic funders can have a positive impact on nonprofit organizations and the people and communities they serve. As part of our work, we aim to highlight stories from funders who share that vision and who value the role of data and assessment in efforts to increase their impact.

 

PROCESS PROGRESS: HOW RWJF STRIVES TO IMPROVE
by Robin Mockenhaupt, Ph.D., M.P.H., Chief of Staff,
Dee Colello, Senior Manager, Program Operations, and
David Adler, M.P.A., Communications Officer
of the Robert Wood Johnson Foundation

 

They must often change, who would be constant in happiness or wisdom. ~Confucius

Change and continual improvement is a valued part of the Robert Wood Johnson Foundation’s culture. It’s in our guiding principles, which state, “We must commit ourselves to lifelong learning and continual improvement.” In addition to change and improvement, RWJF is also committed to transparency and peer learning, and it is in that vein that we are sharing our progress on quality improvement since 2004.

As part of our 2004 annual organizational assessment, we commissioned the Center for Effective Philanthropy’s Grantee Perception Report (GPR). We learned that while our grantees rated us comparatively well in several areas, we were using up a lot of grantee time meeting our administrative demands and we weren’t moving as fast as we needed to in processing grants. We also learned we needed better clarity in our communications of goals and strategies.

A 2011 CEP case study, Frequent Checkups Make for Healthier Funding Relationships, illustrated that we changed. We wanted to share one of the ways we took that advice to heart.

With the findings from the GPR, input from an all-staff retreat, and a focus group of grantees, we developed our first Foundation-wide Quality Improvement (QI) initiative. Our process for implementing this QI project can be broken down to five steps.

  • We set the right tone. The all-staff retreat and the announcement of the QI process by our president and CEO, Risa Lavizzo-Mourey, M.D., M.B.A., helped create widespread buy-in among staff. Any organization considering quality improvement projects should recognize that having the buy-in and public support of the CEO is a crucial first step for setting the appropriate environment for change.
  • We started with something manageable. The initial focus of our quality improvement work was on a category of grants that accounts for about 20 percent of our grantmaking. We wanted to start with something manageable to see how it worked before rolling out broader efforts.
  • We gathered the troops. After the announcement, staff interested in quality improvement convened to map out current grantmaking processes; shortly after that, a smaller core staff team was chartered, supported by a group of project sponsors from senior management.
  • We jumped in. The team designed a pilot. After testing and implementation, the project moved into control (maintenance) phase. Our first QI project resulted in sequencing and prioritizing steps in our grantmaking process, as well as launching the Foundation’s Program Information Management System (PIMS).  After our first QI project, two other projects were designed and implemented, using a similar structure and process. In addition, three smaller projects were led by staff trained in the QI process.
  • We are monitoring ongoing progress. We needed a way to monitor how we were doing and for identifying new ideas for improvement. We organized a standing staff group called the Process Improvement Group to help track metrics for our grantmaking and to initiate new quality improvement initiatives. Additionally, other units within RWJF have taken up their own quality improvement initiatives.

What did we learn?

  • Communications is a key component to implementing quality initiatives and staff behavior change.
  • Staff like being involved in cross-functional improvement projects
    when they see the need for change and can be a part of the solution.
    It’s also an opportunity to involve staff at every level of the
    organization.
  • Staff need dedicated time for QI work, as opposed to trying to “fit it in” around other responsibilities.
  • Over time, managers learned better how to scope and implement QI projects.
  • The automation of our grantmaking process (which initially was
    paper) allowed for project milestones and timelines to be standardized
    and to become transparent to all staff.

 

We’re pleased that more recent CEP reports have concluded our grantee perceptions have gotten better over time, and we believe our quality improvement efforts were a factor in this change. Our responsiveness measures are now higher as well as our quality of interactions. With that said, all our quality improvement efforts were not successful and we are receptive to revising any processes that may have missed the mark. For example, we are still working toward reducing the amount of time in both selection process and improving our ongoing monitoring and reporting.

We’re happy to share additional information about our QI process and are eager to hear how our colleagues are approaching this as well.

Challenging Without Silencing

Tuesday, June 14th, 2011

Often, I write in this space about CEP’s research, our work with foundations, or my thoughts on the nonprofit sector more broadly. But, today, I want to reflect instead on one of my own challenges as a leader of a nonprofit with 33 incredibly smart, committed staff.

I’ll be clear at the outset – I don’t have the answers on this one, far from it. And, quite frankly, I’d love advice from readers of the CEP Blog.

My challenge is this: how to get the best out of people by encouraging them to feel comfortable to speak up while simultaneously fostering a culture in which people constantly challenge each other in order to get to the best solutions.

To me, it often feels hard to figure out how to do both at once.

I think most of us have been in situations where we know the best ideas and insights are not being heard. The discussion is shut down. Opportunities for improvement or innovation are lost. Staff members sitting around a meeting table are holding their tongues, feeling “silenced.” Only later, out of earshot of the “leaders,” do their voices, and perspectives, come out.

But I think most of us have probably found ourselves at the other extreme, too. I am talking about situations in which a group endlessly exchanges ideas and thoughts as if they are all equally valuable – with such an emphasis on being non-judgmental that no decision ever gets made.

As a leader, I sure don’t want to contribute to either dynamic.

I thought a lot about this during CEP’s conference a few weeks ago as I reflected on the wisdom of the speakers who addressed us and how they apply to my own leadership responsibilities. These are important issues for foundation leaders – our audience – but, frankly, I was thinking about my own role here. As a leader, my job is to get the best out of everyone at CEP, such that we implement our organizational strategy as effectively as possible.

But it’s also my job to know when to cut off debate and discussion – when we need to move on. Or when to prevent certain topics from being brought forward at all, because I feel I can see that they will distract from more important work.  Or when to challenge something that doesn’t seem to quite hold together – and that isn’t being challenged by others.

It’s a difficult dance, and one that has to change as the leader reads the natural tendencies of those around him or her. Some people are more comfortable with vigorous debate, relishing it, even; others need to be drawn out, or are made uncomfortable with vigorous disagreement.

Sometimes, with some people, vigorous debate crosses a line and starts to feel personal. At that point, it’s rarely productive.

I’ve read dozens of books on leadership and organizational change, even taken courses on it. But if there is a magic formula, I haven’t found it. I feel like I make a mistake, in one direction or another, almost every day.

I will think, later, “I should have pushed harder on that point.” Or, “I pushed too hard, and it shut down the discussion too soon.”

I also wonder how much is really up to the leader, and how much is beyond his or her control – subject to the mysterious mix of personalities, dynamics, and work habits that shape an organization’s culture?

Still, as someone in a leadership position, I am not willing to give up the notion of my own relevance so easily! And so I struggle with whether I am getting the balance right: between being the nurturer and the challenger; between being the mediator and the prosecutor; between being the hard-charging coach and the impartial referee – or even assuming the role of the opposing team.

Maybe others have figured out how to strike the right balance better than I have?  If so, I’d love to learn from you.

Phil Buchanan is president of CEP.

Does Transparency Make Foundations More Effective?

Wednesday, May 11th, 2011

The subject of foundation transparency – especially to whom and for what purpose – can sometimes be murky. While there’s no doubt that foundations should be transparent – and I can’t imagine anyone disagreeing with that – to me it’s not simply a question of whether transparency is a good thing. But rather, what additional benefits accrue to foundations that are transparent? Are they more effective? Are they better known? Are they better liked or is their work more appreciated?

Put another way, is the right starting point for a conversation about transparency a question like, “Does being transparent make foundations more effective?,” or should we be asking, “Is it possible to be an effective foundation without also being transparent?”

At a May 10th panel at the Center for Effective Philanthropy (CEP) conference, a group of wise and experienced foundation and nonprofit hands tackled the question on the role of transparency in foundation operations. The presenter, Brad Smith, president of Foundation Center, was ably backed up by commentators Paul Brest, president, the William and Flora Hewlett Foundation, and Diana Aviv, president and CEO of Independent Sector, and moderator Stephen Heintz, president of the Rockefeller Brothers Fund.

There’s what might be called a moral imperative for foundations to be transparent. As Smith said, “Foundations are created to serve the public good, and they need to explain what they do in terms the public can understand.” That includes being clear about their purpose and demonstrating their performance. Notably, Paul Brest pointed out the risk to foundations that aren’t transparent. Only by being transparent can foundations get meaningful feedback about their work. Not surprisingly, Diana Aviv reminded the audience that one of the benefits of foundations behaving transparently is that it helps grantees understand their standing with the organizations that fund them, and can even be helpful in understanding the reasons why they get turned down for funding.

As a group, they did a valuable service by not limiting themselves to trying to answer that question exclusively about a link between transparency and effectiveness. Instead, in their comments – and in queries from the audience – the session raised many other companion questions that could themselves be individually debated in subsequent sessions. Those questions ranged from:

-          How do you define transparency?

-          What is the relationship between transparency and accountability?

-          Is transparency always the most effective strategy?

-          What are the costs as well as administrative burdens to transparent organizations?

-          Is there a role for foundation boards in setting parameters of transparency?

-          Whose job is it to ensure a foundation is transparent?

But at the heart of the conversation was an almost a priori belief that the more that foundations openly share information about their work with the public, policymakers, grantees, and other funders, etc., the better they are able to advance their missions.

The ultimate question – Does being more transparent make you a more effective organization? – is one that has to be viewed through the lens of what makes for an overall effective foundation strategy. In other words, transparency can’t be an end unto itself. But, instead, if there is an organizational commitment to behaving transparently and if foundations are willing to share what goes on inside, that can serve as the basis or starting point for all sorts of other activities that would be otherwise impossible without it.

For instance, it’s unlikely that motivation (not to mention the costs) in creating websites, publishing grant data, sharing CEP grantee perception reports, or tweeting, blogging or having a presence on Facebook – plus all the other means and methods that Foundation Center tracks on its Glasspockets website – is because a foundation decides it wants to be transparent. Rather, foundations that behave that way believe that the information they share (and how they share it) can contribute to advancing their work.

Stated another way, the path to effectiveness comes from a clear and thoughtful foundation strategy that includes the need to share information, communicate strategically, and be open to public scrutiny as an essential way of doing business.

At the outset, I said this topic can sometimes still be a murky one. That point was reinforced by Paul Brest who said his foundation, at times, sees the need to be less open about its strategies. For example, he maintains that there’s no benefit when working in areas such as climate change or family planning to let your opposition know your strategy so they can use it against you.  

Similarly, Diana Aviv noted that too much information – especially if it’s not categorized or presented in a useful way – can create confusion.

Once again, it all comes down to identifying your goal and the most effective strategy to get you there.

No harm being transparent about that.

Bruce Trachtenberg is the executive director of the Communications Network

The Most Important Topic We Never Talk About: Exit Strategies

Friday, May 6th, 2011

Philanthropy is about beginnings – new ideas, new projects, new awards, and new initiatives.  Foundation program staff are attracted to philanthropic jobs because of the opportunity to start projects that will make a difference in people’s lives.  To the extent the public thinks about foundations, it is as grantmakers

But for every new grant, program, or initiative, sooner or later there is an exit. Too often, these exits are neglected. 

A session at the upcoming Center for Effective Philanthropy (CEP) conference Better Philanthropy: From Data to Impact (May 10-11, 2011) will tackle the vital topic of exit strategies. I’m excited that CEP is taking on this often overlooked topic in philanthropy.

The neglect occurs despite the fact that foundations know that sound exit strategies are necessary to achieve sustained impact. We know that the absence of thoughtful exit strategies harms grantees, foundations, and the legacy of good work done together. 

In my experience as a grantmaker and a consultant, I’ve seen foundations exit a grantmaking program for a variety of reasons.  Among them: 

  • A foundation board changes priorities
  • New foundation leadership adds new goals and drops others
  • An economic downturn leads to fewer dollars to award
  • An initiative achieves its goals or financial sustainability
  • Grantee performance is unsatisfactory
  • New funders enter an area and existing funders pull back
  • A foundation “spends down” or closes

In other words, there are many explanations for foundation exits, most of which have little to do with the performance of the grantee.  But the diversity of reasons for exits does not explain why exits are often problematic or awkward. 

One source of awkwardness is that too often the funding size and duration (and thus the timing of the exit) is more often determined by funder constraints that do not fit the problem or need the project intends to address. This can result in grantees accepting support that is insufficient to meet the aims of the project. Another potential source is that expectations between funders and grantees are rarely discussed. When the relationship approaches the end, divergent expectations that haven’t been voiced can lead to problems.

The Wednesday, May 11th CEP panel on exit strategies will examine this rarely discussed topic. It will be moderated by Debra Jacobs of the Patterson Foundation and kicked off by remarks from Kevin Walker from the Northwest Area Foundation, Mayur Patel from the John S. and James L. Knight Foundation, and Ann Monroe from the Community Health Foundation of Western & Central New York. The panel will include ample time for discussion among panelists and attendees to share their ideas. 

As I anticipate participating in this session, some of the questions that I hope panelists and attendees will discuss are: 

  • Does it matter why foundations exit a grantmaking area? That is, do the reasons for the exit influence the approach to an exit strategy?
  • When does it make sense to begin a discussion of exit strategies in a foundation?
  • When does it make sense to begin talking about exit strategies with grantees?
  • Have foundations found effective exit strategies in working with their board, their program staff, and their grantees?
  • What hasn’t worked in exit strategies?
  • How can foundations best anticipate various exits and prepare for them in a responsible manner?

I’m looking forward to a lively and interactive discussion at the CEP panel.

Robert Hughes is a consultant and Learning Lens Manager for The Patterson Foundation.