Techniques and Technologies for Mobilizing Citizens: Do They Work?

17146073016_5657607917_z1

Techniques for mobilizing citizens to vote in elections have become highly sophisticated in large part thanks to get-out-the-vote (GOTV) research, with fascinating experimental evidence from interventions to increase turnout. Until recently, the use of these techniques has been mostly limited to electoral processes, often resorting to resource intensive tactics such as door-to-door canvassing and telemarketing campaigns. But as digital technologies such as email and SMS lower the costs for targeting and contacting individuals, the adaptation of these practices to participatory processes is becoming increasingly common. This leads to the question: how effective are GOTV-type efforts when using technology outside of the electoral realm?

One of the first (if not the first) efforts to bring together technology and GOTV techniques to non-electoral processes took place in the participatory budgeting (PB) process of the municipality of Ipatinga in Brazil in 2005. An automated system of targeted phone calls to landlines was deployed, with a recorded voice message from the mayor informing residents of the time and the location of the next PB meeting closest to them. Fast forward over a decade later, and New Yorkers can receive personalized text messages on their phones indicating the nearest PB polling location. Rather than a mere coincidence, the New York case illustrates a growing trend in participatory initiatives that – consciously or not – combine technology with traditional GOTV techniques to mobilize participation.

However, and unlike GOTV in elections, little is known about the effects of these efforts in participatory processes, the reasons for which I briefly speculated about in a previous post. We have just published a study in the British Journal of Political Science that, we hope, starts to reduce this gap between practice and knowledge. Entitled “A Get-Out-the-Vote Experiment on the World’s Largest Participatory Budgeting Vote in Brazil”, the study is co-authored by Jonathan Mellon, Fredrik M. Sjoberg and myself. The experiment was conducted in close collaboration with Rio Grande do Sul’s State Government (Brazil), which holds the world’s largest participatory budgeting process.

In the experiment, over 43,000 citizens were randomly assigned to receive email and text messages encouraging them to take part in the PB voting process. We used voting records to assess the impact of these messages on turnout and support for public investments. The turnout effect we document in the study is substantially larger than what has been found in most previous GOTV studies, and particularly those focusing on the effect of technologies like email and SMS. The increase in participation, however, did not alter which projects were selected through the PB vote: voters in the control and treatment groups shared the same preferences. In the study, we also assessed whether different message framing (e.g. intrinsic versus extrinsic) mattered. Not that much, we found, and a lottery incentive treatment had the opposite effect to what many might expect. Overall, our experiment suggests that tech-enabled GOTV approaches in participatory processes are rather promising if increasing levels of participation is one of the goals. But the “more research is needed” disclaimer, as usual, applies.

You can find the final study (gated version) here, and the pre-published (open) version here.

 

Catching up (again!) on DemocracySpot

cover-bookIt’s been a while since the last post here. In compensation, it’s not been a bad year in terms of getting some research out there. First, we finally managed to publish “Civic Tech in the Global South: Assessing Technology for the Public Good.” With a foreword by Beth Noveck, the book is edited by Micah Sifry and myself, with contributions by Evangelia Berdou, Martin Belcher, Jonathan Fox, Matt Haikin, Claudia Lopes, Jonathan Mellon and Fredrik Sjoberg.

The book is comprised of one study and three field evaluations of civic tech initiatives in developing countries. The study reviews evidence on the use of twenty-three information and communication technology (ICT) platforms designed to amplify citizen voices to improve service delivery. Focusing on empirical studies of initiatives in the global south, the authors highlight both citizen uptake (yelp) and the degree to which public service providers respond to expressions of citizen voice (teeth). The first evaluation looks at U-Report in Uganda, a mobile platform that runs weekly large-scale polls with young Ugandans on a number of issues, ranging from access to education to early childhood development. The following evaluation takes a closer look at MajiVoice, an initiative that allows Kenyan citizens to report, through multiple channels, complaints with regard to water services. The third evaluation examines the case of Rio Grande do Sul’s participatory budgeting – the world’s largest participatory budgeting system – which allows citizens to participate either online or offline in defining the state’s yearly spending priorities. While the comparative study has a clear focus on the dimension of government responsiveness, the evaluations examine civic technology initiatives using five distinct dimensions, or lenses. The choice of these lenses is the result of an effort bringing together researchers and practitioners to develop an evaluation framework suitable to civic technology initiatives.

The book was a joint publication by The World Bank and Personal Democracy Press. You can download the book for free here.

Women create fewer online petitions than men — but they’re more successful

clinton

Another recent publication was a collaboration between Hollie R. Gilman, Jonathan Mellon, Fredrik Sjoberg and myself. By examining a dataset covering Change.org online petitions from 132 countries, we assess whether online petitions may help close the gap in participation and representation between women and men. Tony Saich, director of Harvard’s Ash Center for Democratic Innovation (publisher of the study), puts our research into context nicely:

The growing access to digital technologies has been considered by democratic scholars and practitioners as a unique opportunity to promote participatory governance. Yet, if the last two decades is the period in which connectivity has increased exponentially, it is also the moment in recent history that democratic growth has stalled and civic spaces have shrunk. While the full potential of “civic technologies” remains largely unfulfilled, understanding the extent to which they may further democratic goals is more pressing than ever. This is precisely the task undertaken in this original and methodologically innovative research. The authors examine online petitions which, albeit understudied, are one of the fastest growing types of political participation across the globe. Drawing from an impressive dataset of 3.9 million signers of online petitions from 132 countries, the authors assess the extent to which online participation replicates or changes the gaps commonly found in offline participation, not only with regards to who participates (and how), but also with regards to which petitions are more likely to be successful. The findings, at times counter-intuitive, provide several insights for democracy scholars and practitioners alike. The authors hope this research will contribute to the larger conversation on the need of citizen participation beyond electoral cycles, and the role that technology can play in addressing both new and persisting challenges to democratic inclusiveness.

But what do we find? Among other interesting things, we find that while women create fewer online petitions than men, they’re more successful at it! This article in the Washington Post summarizes some of our findings, and you can download the full study here.

Other studies that were recently published include:

The Effect of Bureaucratic Responsiveness on Citizen Participation (Public Administration Review)

Abstract:

What effect does bureaucratic responsiveness have on citizen participation? Since the 1940s, attitudinal measures of perceived efficacy have been used to explain participation. The authors develop a “calculus of participation” that incorporates objective efficacy—the extent to which an individual’s participation actually has an impact—and test the model against behavioral data from the online application Fix My Street (n = 399,364). A successful first experience using Fix My Street is associated with a 57 percent increase in the probability of an individual submitting a second report, and the experience of bureaucratic responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of responsiveness for fostering an active citizenry while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

Does online voting change the outcome? Evidence from a multi-mode public policy referendum (Electoral Studies)

Abstract:

Do online and offline voters differ in terms of policy preferences? The growth of Internet voting in recent years has opened up new channels of participation. Whether or not political outcomes change as a consequence of new modes of voting is an open question. Here we analyze all the votes cast both offline (n = 5.7 million) and online (n = 1.3 million) and compare the actual vote choices in a public policy referendum, the world’s largest participatory budgeting process, in Rio Grande do Sul in June 2014. In addition to examining aggregate outcomes, we also conducted two surveys to better understand the demographic profiles of who chooses to vote online and offline. We find that policy preferences of online and offline voters are no different, even though our data suggest important demographic differences between offline and online voters.

We still plan to publish a few more studies this year, one looking at digitally-enabled get-out-the-vote (GOTV) efforts, and two others examining the effects of participatory governance on citizens’ willingness to pay taxes (including a fun experiment in 50 countries across all continents).

In the meantime, if you are interested in a quick summary of some of our recent research findings, this 30 minutes video of my keynote at the last TicTEC Conference in Florence should be helpful.

 

 

Taking the Goals of Deliberation Seriously: A Differentiated View on Equality and Equity in Deliberative Designs and Processes

The 20-page article, Taking the Goals of Deliberation Seriously: A Differentiated View on Equality and Equity in Deliberative Designs and Processes (2016), was written by Edana Beauvais and Andre Baechtiger, and published in the Journal of Public Deliberation: Vol. 12: Iss. 2. The article reviews the goals of healthy deliberative systems and the different designs of civic forums, including participant recruitment, nature of interaction, and decision-making. The authors reviews research which shows evidence that the design of a deliberative system affects its outcomes and goals.

Read an excerpt of the article below and find the PDF available for download on the Journal of Public Deliberation site here.

From the article…

Deliberative theorists have long stressed that deliberation must be immunized against coercive power by a baseline of equality (Habermas, 1990). But what does the democratic pre-condition of equality mean, in practice, for organizers designing deliberative events and forums? After all, as Bernard Williams (1972) notes, equality is fundamentally about two – at times contradictory – values. On the one hand, the value of universal moral equality, which refers to the fundamental sameness of common humanity, requires abstracting from social circumstances. On the other hand, the value of equity, which refers to just distributions of power and resources, requires attending to social circumstances. Deliberative institutions vary in their capacity to promote one value over the other, or in their capacity to compromise between the two. We argue that negotiating between these twin values should be done with reference to the different goals of the deliberative process, with an eye to the trade-offs that achieving particular goals might require, and to the context within which the deliberation takes place.

In the first section of this paper, we discuss some of the central normative goals that discourse achieves in a healthy deliberative system. In the second section, we review existing empirical research on how institutional designs impact deliberation’s different goals, including the trade-offs different institutional design choices might require. While there are many examples of deliberative sites in political systems, we restrict our discussion to instances of organized, structured deliberation, or “civic forums” (Karpowitz & Raphael, 2014), because these are instances where practitioners can more easily exert direct influence over design.1 Civic forums include a wide variety of deliberating bodies, such as community policing initiatives (Fung, 2009; Karpowitz & Raphael, 2014), participatory budgeting (Avritzer, 2009), civic intergroup dialogue meetings (Walsh, 2004), and deliberative “mini-publics,” such as Deliberative Polls and citizens’ assemblies (Fung, 2003; Goodin & Dryzek, 2006; Grönlund, Bächtiger, & Setälä, 2014; Smith, 2009). We consider three important aspects of design – participant recruitment, the nature of the interaction, and decision-making – and review existing research regarding how different designs impact deliberation’s different normative goals.

We conclude by drawing out the implications of our discussion for practitioners and theorists, arguing against a totalizing view of deliberation where unitary deliberative institutions and processes achieve all of deliberation’s desired outcomes at once (see Fishkin, 2009). Instead, we show that deliberative theorists and practitioners should ultimately accept that various ideals may sometimes form trade-offs that require thinking about which designs and processes are most appropriate for realizing particular normative outcomes.

Achieving Different Normative Outcomes: Understanding the Trade-Offs
Deliberation can achieve a number of distinct goals or functions. One of deliberation’s central functions is to produce decisions that are perceived as legitimate by those who are bound by them. Since democratic legitimacy is predicated upon the inclusion of those affected by decisions in processes of decision-making, those affected by decisions must have equal opportunities to participate, and equal (or fair) influence over the outcomes of discourse. Clearly, these values can conflict. In practice, equal opportunity to participate is often interpreted to mean making civic forums open to anyone who wants to join. But inclusion that abstracts from social differences in this way may not produce diverse or even representative deliberating groups. By contrast, inclusion that is attentive to social differences – such as reserving seats for, or affirmatively recruiting disempowered social group members – can achieve more diverse or representative deliberating bodies, but at the cost of limiting the openness of recruitment.

In addition to legitimacy, deliberation achieves epistemic and ethical goals. Deliberation’s epistemic function refers to discourse’s capacity to encourage learning and produce opinions, preferences, and attitudes that are informed by facts, information, and the full range of relevant arguments and concerns. Conventionally, the ethical function refers to whether deliberation generates mutual respect (Mansbridge et al., 2012). We suggest that other ethical functions include promoting mutual recognition, accommodating ethno-cultural or linguistic diversity, and community-building through developing social bonds, feelings of mutual interdependence, and trust both within and across groups. As we have suggested, achieving one function may conflict with other functions in ways that are relevant for deciding how to organize a deliberative event.

Deliberative venues and forums often cannot achieve every deliberative goal simultaneously, since different functions (or different aspects of the same function) can come into conflict. This is not a problem for the overall health of the deliberative system, since different deliberative tasks are “distributed” sequentially across various component parts, which can refer to different moments in a deliberative event, or to different deliberative forums and actors across a deliberative system (Goodin, 2005). The health of the deliberative system is judged according to how well the variegated, interlocking deliberative forums and actors – informal communication networks, associations, the media, legislatures, and the courts, to name a few – achieve discourse’s various normative goals, in the aggregate (Mansbridge, 2015; Mansbridge et al., 2012). Now we will discuss how, in practice, deliberative design can impact which normative ideals are achieved and which are sacrificed in civic forums.

Download the full article from the Journal of Public Deliberation here.

About the Journal of Public Deliberation
Journal of Public DeliberationSpearheaded by the Deliberative Democracy Consortium in collaboration with the International Association of Public Participation, the principal objective of Journal of Public Deliberation (JPD) is to synthesize the research, opinion, projects, experiments and experiences of academics and practitioners in the emerging multi-disciplinary field and political movement called by some “deliberative democracy.” By doing this, we hope to help improve future research endeavors in this field and aid in the transformation of modern representative democracy into a more citizen friendly form.

Follow the Deliberative Democracy Consortium on Twitter: @delibdem

Follow the International Association of Public Participation [US] on Twitter: @IAP2USA

Resource Link: www.publicdeliberation.net/jpd/vol12/iss2/art2/

New Papers Published: FixMyStreet and the World’s Largest Participatory Budgeting

2016_7_5_anderson-lopes_consulta-popular_virtual

Voting in Rio Grande do Sul’s Participatory Budgeting  (picture by Anderson Lopes)

Here are two new published papers that my colleagues Jon Mellon, Fredrik Sjoberg and myself have been working on.

The first, The Effect of Bureaucratic Responsiveness on Citizen Participation, published in Public Administration Review, is – to our knowledge – the first study to quantitatively assess at the individual level the often-assumed effect of government responsiveness on citizen engagement. It also describes an example of how the data provided through digital platforms may be leveraged to better understand participatory behavior. This is the fruit of a research collaboration with MySociety, to whom we are extremely thankful.

Below is the abstract:

What effect does bureaucratic responsiveness have on citizen participation? Since the 1940s, attitudinal measures of perceived efficacy have been used to explain participation. The authors develop a “calculus of participation” that incorporates objective efficacy—the extent to which an individual’s participation actually has an impact—and test the model against behavioral data from the online application Fix My Street (n = 399,364). A successful first experience using Fix My Street is associated with a 57 percent increase in the probability of an individual submitting a second report, and the experience of bureaucratic responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of responsiveness for fostering an active citizenry while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

An earlier, ungated version of the paper can be found here.

The second paper, Does Online Voting Change the Outcome? Evidence from a Multi-mode Public Policy Referendum, has just been published in Electoral Studies. In an earlier JITP paper (ungated here) looking at Rio Grande do Sul State’s Participatory Budgeting – the world’s largest – we show that, when compared to offline voting, online voting tends to attract participants who are younger, male, of higher income and educational attainment, and more frequent social media users. Yet, one question remained: does the inclusion of new participants in the process with a different profile change the outcomes of the process (i.e. which projects are selected)? Below is the abstract of the paper.

Do online and offline voters differ in terms of policy preferences? The growth of Internet voting in recent years has opened up new channels of participation. Whether or not political outcomes change as a consequence of new modes of voting is an open question. Here we analyze all the votes cast both offline (n = 5.7 million) and online (n = 1.3 million) and compare the actual vote choices in a public policy referendum, the world’s largest participatory budgeting process, in Rio Grande do Sul in June 2014. In addition to examining aggregate outcomes, we also conducted two surveys to better understand the demographic profiles of who chooses to vote online and offline. We find that policy preferences of online and offline voters are no different, even though our data suggest important demographic differences between offline and online voters.

The extent to which these findings are transferable to other PB processes that combine online and offline voting remains an empirical question. In the meantime, nonetheless, these findings suggest a more nuanced view of the potential effects of digital channels as a supplementary means of engagement in participatory processes. I hope to share an ungated version of the paper in the coming days.

Catching Up on DemocracySpot

CaptureOGRX

It’s been a while, so here’s a miscellaneous post with things I would normally share on DemocracySpot.

Yesterday the beta version of the Open Government Research Exchange (OGRX) was launched. Intended as a hub for research on innovations in governance, the OGRX is a joint initiative by NYU’s GovLab, MySociety and the World Bank’s Digital Engagement Evaluation Team (DEET) (which, full disclosure, I lead). As the “beta” suggests, this is an evolving project, and we look forward to receiving feedback from those who either work with or benefit from research in open government and related fields. You can read more about it here.

Today we also launched the Open Government Research mapping. Same story, just “alpha” version. There is a report and a mapping tool that situates different types of research across the opengov landscape. Feedback on how we can improve the mapping tool – or tips on research that we should include – is extremely welcome. More background about this effort, which brings together Global Integrity, Results for Development, GovLAB, Results for Development and the World Bank, can be found here.

mapping2

Also, for those who have not seen it yet, the DEET team also published the EvCaptureDEETguidealuation Guide for Digital Citizen Engagement a couple of months ago. Commissioned and overseen by DEET, the guide was developed and written by Matt Haikin (lead author), Savita Bailur, Evangelia Berdou, Jonathan Dudding, Cláudia Abreu Lopes, and Martin Belcher.

And here is a quick roundup of things I would have liked to have written about since my last post had I been a more disciplined blogger:

  • A field experiment in Rural Kenya finds that “elite control over planning institutions can adapt to increased mobilization and participation.” I tend to disagree a little with the author’s conclusion that emphasizes the role of “power dynamics that allow elites to capture such institutions” to explain his findings (some of the issues seem to be a matter of institutional design). In any case, it is a great study and I strongly recommend the reading.
  • A study examining a community-driven development program in Afghanistan finds a positive effect on access to drinking water and electricity, acceptance of democratic processes, perceptions of economic wellbeing, and attitudes toward women. However, effects on perceptions of government performance were limited or short-lived.
  • A great paper by Paolo de Renzio and Joachim Wehner reviews the literature on “The Impacts of Fiscal Openness”. It is a must-read for transparency researchers, practitioners and advocates. I just wish the authors had included some research on the effects of citizen participation on tax morale.
  • Also related to tax, “Consumers as Tax Auditors” is a fascinating paper on how citizens can take part in efforts to reduce tax evasion while participating in a lottery.
  • Here is a great book about e-Voting and other technology developments in Estonia. Everybody working in the field of technology and governance knows Estonia does an amazing job, but information about it is often scattered and, sometimes, of low quality. This book, co-authored by my former colleague Kristjan Vassil, addresses this gap and is a must-read for anybody working with technology in the public sector.
  • Finally, I got my hands on the pictures of the budget infograffitis (or data murals) in Cameroon, an idea that emerged a few years ago when I was involved in a project supporting participatory budgeting in Yaoundé (which also did the Open Spending Cameroon). I do hope that this idea of bringing data visualizations to the offline world catches up. After all, that is valuable data in a citizen-readable format.
cameroon1

picture by ASSOAL

cameroon2

picture by ASSOAL

I guess that’s it for now.