We were excited to learn recently that Public Agenda and the Participatory Budgeting Project – two of our prominent NCDD member organizations – have released a new participatory budgeting evaluation toolkit in collaboration with the North American PB Research Board. The toolkit will help municipalities across the continent document the impacts and effectiveness of their local PB efforts. We encourage you read more about it in the Public Agenda article below or find the original here.
Evaluation Matters: A New Toolkit for Assessing Participatory Budgeting
For those of us exploring ways to deepen and expand public participation in democracy, we know how essential evaluation is to our cause. Both government officials and the public have limited time, energy and resources. And furthermore, many may already be disillusioned by current and past efforts to include the public in decision making.
We need to be able to demonstrate to officials, the public, interested funders, community partners, and others that their investment in new public engagement methods will be worth it. Will more people participate, particularly those who have been historically less civically engaged? Will the new form of engagement lead to better decisions and policies that residents support? Will the public feel like their voices have been heard, and will they come to understand the complexities and trade-offs inherent in many policy decisions? Will the method build trust among officials and the public and open pathways for collaboration among community-based organizations and the government?
At the same time, we as public engagement practitioners are very busy. Evaluation can be time consuming and complicated, especially when we’re attempting to measure something amorphous like deeper public participation. As such, evaluation too often gets lost among everything else we’re doing.
For these and other reasons, we are particularly excited about one of our current projects: an initiative to help make it easier for practitioners to evaluate participatory budgeting efforts.
Communities across the country are experimenting with participatory budgeting (PB for short), which is one potential avenue for deeper public participation and engagement. Through PB, local residents get to decide how their community will spend a set amount of public money. Many of these communities, including some in New York, Chicago, Long Beach, CA and Dieppe, in New Brunswick, Canada, are also trying to track and measure how PB is affecting residents, officials, and neighborhoods.
Community members evaluating PB often have questions that are locally unique and relevant. At the same time, because many PB processes across the U.S. and Canada follow a similar structure, these evaluators are also often looking to answer common questions shared by communities.
To help foster collaboration among evaluators and facilitate shared learning on these questions, we have been working since the start of 2015 to support and coordinate local evaluation work. Ultimately, we hope that this will also lead to a better understanding of the successes and challenges of the PB movement as a whole.
One of our first steps has been to develop a toolkit for those tasked with evaluating PB in their communities. We developed the toolkit in concert with the Participatory Budgeting Project (PBP), the North American PB Research Board and local evaluators from numerous PB sites across the U.S. and Canada.
The toolkit includes key metrics – 15 in all – for capturing important elements of each local PB process specifically and the movement in North America generally. These metrics describe the way PB could impact things like civic life, equity, and governance.
To help ease the evaluation process and data collection, these metrics are paired with survey instruments that address the 15 key metrics. Evaluators can customize these survey instruments and use as needed. We also developed a questionnaire for evaluators that will help us and local evaluators to collect and share comparable data about PB processes across North America and over time.
The toolkit also includes a timeline to help evaluators best determine where and how to undertake PB evaluation at different stages of the PB process.
While we developed the metrics and survey instruments for participatory budgeting, the underlying concepts are applicable to evaluating other forms of public engagement, like deliberative meetings, community conversations, and citizen juries.
We hope these tools will help those working on participatory budgeting in their communities by taking some of the guesswork out of measurement and making time for other things like constituent outreach and engagement. If you’re interested in hearing more about evaluation and our work with PB researchers, you can join our listserv for the participatory budgeting community by sending an email here.
Have you voted in a PB process and want to get more involved? Or are you curious about PB and looking to introduce it to your community? The website and people of Participatory Budgeting Project are a great resource for those who are new to PB and want to know more. Introduce yourself to the Participatory Budgeting Project.
You can find the original version of this Public Agenda blog post at
www.publicagenda.org/blogs/evaluation-matters-a-new-toolkit-for-participatory-budgeting#sthash.SQWKGkAR.dpuf.


We know you appreciate the work NCDD does, and many of you are already supporting, sustaining, and organizational members. But for those who aren’t, please consider upgrading or renewing this week. Your support means the world to us, and helps us continue serving this amazing community.
As many of you know, NCDD was co-founded in 2002 (13 years ago now!) by me and Andy Fluke. The vision for NCDD was primarily mine, but Andy’s skills in website and graphic design were critical to the organization’s success. Back in 2002, everything we did to initially build this largely virtual network, from online survey creation to listserv maintenance to website design, required a very specialized skill set we wouldn’t have had the budget to acquire. Andy and my partnership and perseverance were what made NCDD possible.
This wasn’t an easy transition for any of us, or for the organization, but we managed — and pretty darn well, all things considered! Andy and I are amicable (indeed, I can now honestly say we are friends), and we are still working with him to finish up a project or two. Check out the
My transition out of a long-term business partnership and marriage, and into a new life in Boston on my own has been complicated, emotional, amazing and challenging. It has been filled to the brim with new people, new experiences, an unprecedented reliance on my network of friends and colleagues for support, and yet a new sense of being completely on my own.
Courtney directs NCDD’s ongoing programming for our network (
NCDD has grown from a Coalition of 50 in late 2002 to a Coalition of more than 2,200 members and 35,000 subscribers. Processing new members and renewals, coordinating and managing our database,
Roshan Bliss is an inclusiveness trainer and group process facilitator who began working with NCDD when he stepped up to serve as volunteer coordinator for our 2012 national conference in Seattle. We enjoyed working with Roshan so much that we asked him to serve as our
Keiva Hummel serves as NCDD’s Resource Curator, managing content in our well-loved 



