Posts Tagged ‘Grantee Perception Report’

Keepin’ It Real with GPR Results

Wednesday, September 8th, 2010

Before I get started, I’d like to thank the folks at CEP for asking me to contribute to their blog. I’m looking forward to the conversation that will unfold here.

I’m a person who appreciates candor in my relationships. I think it runs in my family. I don’t know too many Ragins who will hesitate to tell you what they think about anything — always with tact and respect, of course. As such, I was excited (and admittedly a bit nervous) when the Hewlett Foundation commissioned CEP to conduct its third Grantee Perception Report (GPR) in 2009. Having previously worked at CEP, it was odd to be on the receiving end of grantee feedback for the first time, but I was anxious to learn what Hewlett’s grantees thought of the performance of the Performing Arts Program, where I serve as associate program officer.

So what did we learn? First, the good news. Compared to other foundations, grantees rated our program quite positively for its impact on and understanding of the field, local community, and organizations that we support. Given that the Performing Arts Program is field-specific as well as regionally focused, we were pleased with this result and felt affirmed in the grantmaking approaches we’d chosen to take. Though we don’t have direct measures of impact (we’re still working on it), grantee perceptions therefore are important performance indicators, as these organizations have on-the-ground knowledge upon which to draw.

However, we received less positive ratings on other important measures, including the clarity of communications of our goals and strategy and the helpfulness of our selection process in strengthening grantee organizations. In response to open-ended questions, grantees expressed a desire to better understand the Program’s strategy and to have it communicated more consistently. They also wanted to know how their work fits into our strategies. With regard to the selection process, grantees told us something we certainly know — relative to other arts funders, our application is long and difficult. We intend the rigorous thinking that is required to complete our application to be of benefit to the organizations, and while many responded that they found the “extra” application elements to be useful, we recognize that improvements could be made.

As a program officer, it’s easy to get trapped in a bubble, deprived of the critical feedback necessary to improve practice over time. This is why GPR results are so helpful. They give us a necessary reality check that we may not otherwise receive.

So what did we do? After a number of internal conversations, as well as some Program-specific follow-up sessions with CEP staff, we made a few changes that we think will help the Performing Arts Program move in the right direction. We now reinforce and communicate to grantees the Program’s goals and strategies as frequently as possible, particularly when having in-person meetings. We placed our Program’s logic model on the Hewlett Foundation website and refer grantees to it, as well as other funders and interested parties. Three times a year, we host a series of grant seeker workshops, during which the Program staff review goals and strategies with grantees, walk through the more challenging application elements, and field questions. We also revised our application, identifying and removing some redundant elements.

I’d be curious to know what other folks have done to improve communications about goals and strategy and to make their selection processes more helpful in strengthening grantees. Any good stories or suggestions? CEP has published a number of reports about ways in which foundations have made improvements in response to grantee feedback. Check them out, if you haven’t already.

Ron Ragin is an associate program officer in the Performing Arts Program at Hewlett Foundation.  The views expressed are his own. 

Report Watch: Leveraging Communications

Wednesday, September 1st, 2010

CEP often has a front row view of communications challenges faced by foundations. One issue foundations grapple with on an ongoing basis is getting all staff members to communicate the same messages about a foundation’s work, and specifically its goals, strategies, and grantmaking guidelines.

In light of this, I was not surprised by the following finding from the report The Communications Supercharge: How Foundations Use Communications to Advance Their Public Policy Work, recently released by USC’s Center on Philanthropy and Public Policy (bolded emphases are my own):

The interviews suggest widespread agreement that the thorniest challenge faced by these leaders is how to best integrate communications into program planning and execution. In the respondents’ views, communications is a horizontal function in a vertical world. Its place and points of intersection with other foundation activity are still somewhat ambiguous, in spite of growing levels of activity and support from top leadership levels. The challenge stems from the basic facts of foundation culture. ‘Program is king’ in foundations: grantmaking programs are vertically organized silos, presided over by program directors, initiative directors, and program officers. Communications is not seen as programs, at least not yet, in all but a very few foundations.

This is a great summary of a challenge we see frequently at CEP. The USC report is part of a heartening trend of foundations paying more attention to their communications challenges.  Also worth reading is a new report from California Healthcare Foundation (CHCF) on communicating with grantees. Spitfire Strategies will be releasing a report on the same topic at the Communications Network conference this month.

This focus on communications by foundations will be welcome news to grantees. In CEP’s surveys of tens of thousands of grantees of more than 200 foundations over recent years, clarity of communication of goals and strategy is among the areas where grantees give foundations lower marks. Hopefully, thoughtful engagement with the new resources that exist for foundations, like this study, will start to change that.

In USC’s report, foundation leaders talk about their struggle to make communications more “integral to the program planning process”—something the authors suggest is highly connected to getting all program staff communicating on message. In a recent Communications Network blog post discussing The Communications Supercharge, Marcia Sharp  writes “that when we look at the sum total of a foundation’s communications efforts, we should be looking at both the efforts of the communications department itself and the communications efforts supported through grantmaking programs.”

While it may be tempting for foundation leaders to lay all the responsibility for communications at the feet of communication professionals, both the USC report and CHCF piece make clear that this won’t lead to the desired results. Getting clear and consistent about communication is tough, painstaking work that involves everyone from program assistants to the CEO, as CEP’s case study on the Wallace Foundation makes clear. But, by looking across the foundation, and involving all the right players — as Wallace did — improvement is possible.

Improvement matters, because better communication leads to better understanding  about important philanthropic goals and the strategies to achieve them. With this understanding comes alignment, as foundations and their stakeholders work together to accomplish their shared goals.

Report Watch: Engaging Stakeholders

Wednesday, July 7th, 2010

Do Nothing About Me Without Me: This is the title of a just-released, toughly worded, “action guide” that calls on funders to embrace “stakeholder engagement.”  The report, released by Grantmakers for Effective Organizations (GEO) in partnership with the Interaction Institute for Social Change, calls on funders to substantively engage stakeholders in their decision making, defining stakeholders in five categories: 

  • Internal stakeholders
  • Grantees
  • Grantmaking peers
  • Local community members
  • Thought leaders / experts 

I was pleased to see the emphasis on hearing from and listening to stakeholders.  I was, of course, also happy to see CEP’s work referenced in the guide: the report notes that our research on foundation strategy has shown that more strategic foundation leaders tend to do more to solicit feedback from stakeholders.  And “commission a Grantee Perception Report from the Center for Effective Philanthropy” is one of the report’s recommendations for “getting started” in the effort to engage stakeholders.   

But I found myself worrying that the guide over-emphasizes “shared decision making”: it’s just not clear to me that this model typically works so well.  As a grantee, my experience is that the more individuals with authority in a funder’s decision making about a grant proposal we have submitted, the more miserable (and not in a way that ultimately proves helpful) and duplicative the process for us.  I should emphasize that we haven’t explored this issue directly in our grantee survey, though perhaps we should.  Yes, I get the whole “crowd-sourcing” thing, but that strikes me as relevant for a different kind of decision making. 

So I would put the emphasis on gathering the data you need to make good decisions – and stakeholder perspectives are essential data. I think a funder can retain for itself decision-making rights about its funding and still hear from – and engage – stakeholders in a meaningful way.   

Still, this new report from GEO is a clarion call for funders to reach out to their stakeholders and on that broad point I can only say, Amen. 

In my next post, I will discuss the stakeholders for whom the stakes are highest: those whose lives a funder seeks to improve.

Phil Buchanan is President of CEP.

Taking the Next Step(s)

Monday, May 17th, 2010

My posts last week were about how best to engage those on the front lines in philanthropy’s work. Of course, your strategy for engagement must be informed by what you’re trying to accomplish and how your organization perceives its role. However, there are some universal actions that philanthropy can undertake that would benefit grantees regardless of individual foundation goals and strategies.

I’ll leave you with this short list of actions that may help you more clearly see the world—and your own decisions—through the eyes of those you intend to serve.

  1. Solicit anonymous grantee feedback. For any funder that hasn’t yet solicited feedback from grantees, this is the place to start and you won’t be disappointed. The feedback will be illuminating and will spur important clarifying conversations. The Center for Effective Philanthropy’s Grantee Perception Report has enabled hundreds of foundations to get a better view of themselves through comparative feedback. Armed with this view, grantmakers are in a better position to make smarter decisions.
  2. Start with what your community needs rather than what you are equipped to provide. Try to work backwards by developing a stronger sense of what people want and need.  For instance, the next time your foundation is considering something new, start from an initial framing of the problem you hope to address, but leave your actions and the format of your response open to shaping by input from those closest to the issue. This can be applied to a new online grants application process as well as to the structuring of a new grants portfolio.
  3. Hire your grantees. GEO’s 2008 national study of foundation effectiveness, Is Grantmaking Getting Smarter?, found that grantmakers with staff members who have nonprofit experience are far more likely to engage in a host of “grantee – friendly” practices. Intentionally hiring folks with nonprofit experience will help you create an organization where employees at all levels have a deep connection to people outside your walls – especially those who receive your funding and ultimately benefit from your efforts. That connection will help you make hundreds of better decisions every day.
  4. Go into the community. Bill Somerville in his book Grassroots Philanthropy: Notes of a Maverick Grantmaker extols the importance of understanding what’s happening on the ground and in the community in order to be an effective grantmaker. He talks about hanging out at a community center or soup kitchen and talking to some of those receiving the service as an irreplaceable part of intelligence gathering when considering who and what to fund.
  5. Update your nonprofit experience set. Many in philanthropy got their start in the nonprofit sector, but it may have been years, even decades, since they’ve worked on the front lines. Grantmakers might consider creating periodic opportunities for staff members to work a three- to six-month stint inside a nonprofit of the size and scope typical of their grantees. Experiences like these provide grantmakers with a front row seat to understand the realities of grantees’ work and give them a variety of insights and firsthand experiences they need to do a better job as grantmakers.
  6. Go all the way. The highest level of stakeholder engagement involves creating a sense of shared ownership with grantees and communities. By including stakeholders in shaping foundation strategy and grant decisions, you’re giving up some of the power while at the same time exhibiting incredible trust in those most closely connected to the work. In the end, none of the problems we hope to address in philanthropy will be solved by independent actors. Attentiveness to philanthropy’s role as one actor in a collaborative problem-solving process will likely lead to shifts in some practices that serve as barriers to doing work in partnership with others.

My question for you is, what’s holding philanthropy back from more regularly putting what we hope to accomplish at the center of our decision making rather than the particulars of our individual organizations?

GEO and CEP are both shining the spotlight on ways to meaningfully engage important stakeholders in philanthropy’s decision making.  Please stay tuned for a soon-to-be-published GEO report on strategies for engaging stakeholders in order to get results that really matter for the people and communities we serve.

I’d like to extend my thanks to Phil Buchanan and the top-notch team at CEP for inviting me to participate in this dialogue.  Feel free to respond to this post or to contact me directly at enright@geofunders.org.

Kathleen P. Enright is President and CEO of Grantmakers for Effective Organizations

*****

Disclaimers and Disclosures: The views expressed in the CEP blog by guest bloggers are entirely their own and do not necessarily reflect the opinions of the Center for Effective Philanthropy.

A Dose of Honesty: The Tyranny of the Anecdote

Wednesday, February 10th, 2010

“We always felt we had a ‘Hannibal-the-cannibal’ relationship: Stay where you are and mind yourself and you’re okay. Take one step forward and your arm will be bitten off.”

“The Foundation has had a negative impact on our organization in spite of funding. Runaround by foundation staff and [the Foundation’s] nontransparent priorities and processes have wasted staff time and effort…. It is disheartening to think that the viability of an important program is subject to an unqualified person’s review, analysis, and presentation of our project to the full decision group.”

In my last “Dose of Honesty,” I highlighted the positive end of the spectrum of commentary we receive from grantees. Here, I figured I’d talk a bit about the other end, using these comments from surveys of two different funders.  Just like positive remarks, the terrible need equally careful consideration.

It’s a rare foundation that solicits candid, grantee feedback through CEP’s Grantee Perception Report, that doesn’t end up with a zinger in there. Invariably, comments like these cause serious freak-outs when staff members read them in the full list of redacted comments we provide.

Yet, as these one-off comments absorb attention and focus, they can distract from the important insights hidden in less snappy language in the rest of the qualitative feedback. So, staff should be upset – but mostly if those comments are part of a broader theme and not, as the zingers often are, just an indication of one very broken funding relationship.

One comment is scant evidence of failure – or, for that matter – of success. The glowing comment that gets tacked up on a bulletin board can wipe away dozens of comments that reveal utter mediocrity, or worse, a serious problem. As intoxicating as they may seem, like the zingers, one or two compliments – in a survey or at a dinner party – are just anecdotes.

Don’t get me wrong – qualitative anecdotes have their place. Terrible comments like those at the beginning of this post make for important warnings to foundations about what to try to avoid. They provide a visceral punch in the gut. But our focus at CEP is to raise up themes worthy of significant attention – and so we try to focus on trends in negative comments that highlight areas in which grantees say funders most need to improve.

****

Kevin Bolduc is Vice President - Assessment Tools at CEP