Techniques and Technologies for Mobilizing Citizens: Do They Work?

17146073016_5657607917_z1

Techniques for mobilizing citizens to vote in elections have become highly sophisticated in large part thanks to get-out-the-vote (GOTV) research, with fascinating experimental evidence from interventions to increase turnout. Until recently, the use of these techniques has been mostly limited to electoral processes, often resorting to resource intensive tactics such as door-to-door canvassing and telemarketing campaigns. But as digital technologies such as email and SMS lower the costs for targeting and contacting individuals, the adaptation of these practices to participatory processes is becoming increasingly common. This leads to the question: how effective are GOTV-type efforts when using technology outside of the electoral realm?

One of the first (if not the first) efforts to bring together technology and GOTV techniques to non-electoral processes took place in the participatory budgeting (PB) process of the municipality of Ipatinga in Brazil in 2005. An automated system of targeted phone calls to landlines was deployed, with a recorded voice message from the mayor informing residents of the time and the location of the next PB meeting closest to them. Fast forward over a decade later, and New Yorkers can receive personalized text messages on their phones indicating the nearest PB polling location. Rather than a mere coincidence, the New York case illustrates a growing trend in participatory initiatives that – consciously or not – combine technology with traditional GOTV techniques to mobilize participation.

However, and unlike GOTV in elections, little is known about the effects of these efforts in participatory processes, the reasons for which I briefly speculated about in a previous post. We have just published a study in the British Journal of Political Science that, we hope, starts to reduce this gap between practice and knowledge. Entitled “A Get-Out-the-Vote Experiment on the World’s Largest Participatory Budgeting Vote in Brazil”, the study is co-authored by Jonathan Mellon, Fredrik M. Sjoberg and myself. The experiment was conducted in close collaboration with Rio Grande do Sul’s State Government (Brazil), which holds the world’s largest participatory budgeting process.

In the experiment, over 43,000 citizens were randomly assigned to receive email and text messages encouraging them to take part in the PB voting process. We used voting records to assess the impact of these messages on turnout and support for public investments. The turnout effect we document in the study is substantially larger than what has been found in most previous GOTV studies, and particularly those focusing on the effect of technologies like email and SMS. The increase in participation, however, did not alter which projects were selected through the PB vote: voters in the control and treatment groups shared the same preferences. In the study, we also assessed whether different message framing (e.g. intrinsic versus extrinsic) mattered. Not that much, we found, and a lottery incentive treatment had the opposite effect to what many might expect. Overall, our experiment suggests that tech-enabled GOTV approaches in participatory processes are rather promising if increasing levels of participation is one of the goals. But the “more research is needed” disclaimer, as usual, applies.

You can find the final study (gated version) here, and the pre-published (open) version here.

 

Catching up (again!) on DemocracySpot

cover-bookIt’s been a while since the last post here. In compensation, it’s not been a bad year in terms of getting some research out there. First, we finally managed to publish “Civic Tech in the Global South: Assessing Technology for the Public Good.” With a foreword by Beth Noveck, the book is edited by Micah Sifry and myself, with contributions by Evangelia Berdou, Martin Belcher, Jonathan Fox, Matt Haikin, Claudia Lopes, Jonathan Mellon and Fredrik Sjoberg.

The book is comprised of one study and three field evaluations of civic tech initiatives in developing countries. The study reviews evidence on the use of twenty-three information and communication technology (ICT) platforms designed to amplify citizen voices to improve service delivery. Focusing on empirical studies of initiatives in the global south, the authors highlight both citizen uptake (yelp) and the degree to which public service providers respond to expressions of citizen voice (teeth). The first evaluation looks at U-Report in Uganda, a mobile platform that runs weekly large-scale polls with young Ugandans on a number of issues, ranging from access to education to early childhood development. The following evaluation takes a closer look at MajiVoice, an initiative that allows Kenyan citizens to report, through multiple channels, complaints with regard to water services. The third evaluation examines the case of Rio Grande do Sul’s participatory budgeting – the world’s largest participatory budgeting system – which allows citizens to participate either online or offline in defining the state’s yearly spending priorities. While the comparative study has a clear focus on the dimension of government responsiveness, the evaluations examine civic technology initiatives using five distinct dimensions, or lenses. The choice of these lenses is the result of an effort bringing together researchers and practitioners to develop an evaluation framework suitable to civic technology initiatives.

The book was a joint publication by The World Bank and Personal Democracy Press. You can download the book for free here.

Women create fewer online petitions than men — but they’re more successful

clinton

Another recent publication was a collaboration between Hollie R. Gilman, Jonathan Mellon, Fredrik Sjoberg and myself. By examining a dataset covering Change.org online petitions from 132 countries, we assess whether online petitions may help close the gap in participation and representation between women and men. Tony Saich, director of Harvard’s Ash Center for Democratic Innovation (publisher of the study), puts our research into context nicely:

The growing access to digital technologies has been considered by democratic scholars and practitioners as a unique opportunity to promote participatory governance. Yet, if the last two decades is the period in which connectivity has increased exponentially, it is also the moment in recent history that democratic growth has stalled and civic spaces have shrunk. While the full potential of “civic technologies” remains largely unfulfilled, understanding the extent to which they may further democratic goals is more pressing than ever. This is precisely the task undertaken in this original and methodologically innovative research. The authors examine online petitions which, albeit understudied, are one of the fastest growing types of political participation across the globe. Drawing from an impressive dataset of 3.9 million signers of online petitions from 132 countries, the authors assess the extent to which online participation replicates or changes the gaps commonly found in offline participation, not only with regards to who participates (and how), but also with regards to which petitions are more likely to be successful. The findings, at times counter-intuitive, provide several insights for democracy scholars and practitioners alike. The authors hope this research will contribute to the larger conversation on the need of citizen participation beyond electoral cycles, and the role that technology can play in addressing both new and persisting challenges to democratic inclusiveness.

But what do we find? Among other interesting things, we find that while women create fewer online petitions than men, they’re more successful at it! This article in the Washington Post summarizes some of our findings, and you can download the full study here.

Other studies that were recently published include:

The Effect of Bureaucratic Responsiveness on Citizen Participation (Public Administration Review)

Abstract:

What effect does bureaucratic responsiveness have on citizen participation? Since the 1940s, attitudinal measures of perceived efficacy have been used to explain participation. The authors develop a “calculus of participation” that incorporates objective efficacy—the extent to which an individual’s participation actually has an impact—and test the model against behavioral data from the online application Fix My Street (n = 399,364). A successful first experience using Fix My Street is associated with a 57 percent increase in the probability of an individual submitting a second report, and the experience of bureaucratic responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of responsiveness for fostering an active citizenry while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

Does online voting change the outcome? Evidence from a multi-mode public policy referendum (Electoral Studies)

Abstract:

Do online and offline voters differ in terms of policy preferences? The growth of Internet voting in recent years has opened up new channels of participation. Whether or not political outcomes change as a consequence of new modes of voting is an open question. Here we analyze all the votes cast both offline (n = 5.7 million) and online (n = 1.3 million) and compare the actual vote choices in a public policy referendum, the world’s largest participatory budgeting process, in Rio Grande do Sul in June 2014. In addition to examining aggregate outcomes, we also conducted two surveys to better understand the demographic profiles of who chooses to vote online and offline. We find that policy preferences of online and offline voters are no different, even though our data suggest important demographic differences between offline and online voters.

We still plan to publish a few more studies this year, one looking at digitally-enabled get-out-the-vote (GOTV) efforts, and two others examining the effects of participatory governance on citizens’ willingness to pay taxes (including a fun experiment in 50 countries across all continents).

In the meantime, if you are interested in a quick summary of some of our recent research findings, this 30 minutes video of my keynote at the last TicTEC Conference in Florence should be helpful.

 

 

New IDS Journal – 9 Papers in Open Government

2016-01-14 16.51.09_resized

The new IDS Bulletin is out. Edited by Rosemary McGee and Duncan Edwards, this is the first open access version of the well-known journal by the Institute of Development Studies. It brings eight new studies looking at a variety of open government issues, ranging from uptake in digital platforms to government responsiveness in civic tech initiatives. Below is a brief presentation of this issue:

Open government and open data are new areas of research, advocacy and activism that have entered the governance field alongside the more established areas of transparency and accountability. In this IDS Bulletin, articles review recent scholarship to pinpoint contributions to more open, transparent, accountable and responsive governance via improved practice, projects and programmes in the context of the ideas, relationships, processes, behaviours, policy frameworks and aid funding practices of the last five years. They also discuss questions and weaknesses that limit the effectiveness and impact of this work, offer a series of definitions to help overcome conceptual ambiguities, and identify hype and euphemism. The contributions – by researchers and practitioners – approach contemporary challenges of achieving transparency, accountability and openness from a wide range of subject positions and professional and disciplinary angles. Together these articles give a sense of what has changed in this fast-moving field, and what has not – this IDS Bulletin is an invitation to all stakeholders to take stock and reflect.

The ambiguity around the ‘open’ in governance today might be helpful in that its very breadth brings in actors who would otherwise be unlikely adherents. But if the fuzzier idea of ‘open government’ or the allure of ‘open data’ displace the task of clear transparency, hard accountability and fairer distribution of power as what this is all about, then what started as an inspired movement of governance visionaries may end up merely putting a more open face on an unjust and unaccountable status quo.

Among others, the journal presents an abridged version of a paper by Jonathan Fox and myself on digital technologies and government responsiveness (for full version download here).

Below is a list of all the papers:

Rosie McGee, Duncan Edwards
Tiago Peixoto, Jonathan Fox
Katharina Welle, Jennifer Williams, Joseph Pearce
Miguel Loureiro, Aalia Cassim, Terence Darko, Lucas Katera, Nyambura Salome
Elizabeth Mills
Laura Neuman
David Calleb Otieno, Nathaniel Kabala, Patta Scott-Villiers, Gacheke Gachihi, Diana Muthoni Ndung’u
Christopher Wilson, Indra de Lanerolle
Emiliano Treré

 

Three New Papers (and a presentation) on Civic Tech

CaptureFMS

This blog has been slow lately, but as I mentioned before, it is for a good cause. With some great colleagues I’ve been working on a series of papers (and a book) on civic technology. The first three of these papers are out. There is much more to come, but in the meantime, you can find below the abstracts and link to each of the papers. I also add the link to a presentation which highlights some other issues that we are looking at.

  • Effects of the Internet on Participation: Study of a Public Policy Referendum in Brazil.

Does online voting mobilize citizens who otherwise would not participate? During the annual participatory budgeting vote in the southern state of Rio Grande do Sul in Brazil – the world’s largest – Internet voters were asked whether they would have participated had there not been an online voting option (i-voting). The study documents an 8.2 percent increase in total turnout with the introduction of i-voting. In support of the mobilization hypothesis, unique survey data show that i-voting is mainly used by new participants rather than just for convenience by those who were already mobilized. The study also finds that age, gender, income, education, and social media usage are significant predictors of being online-only voters. Technology appears more likely to engage people who are younger, male, of higher income and educational attainment, and more frequent social media users.

Read more here.

  • The Effect of Government Responsiveness on Future Political Participation.

What effect does government responsiveness have on political participation? Since the 1940s political scientists have used attitudinal measures of perceived efficacy to explain participation. More recent work has focused on underlying genetic factors that condition citizen engagement. We develop a ‘Calculus of Participation’ that incorporates objective efficacy – the extent to which an individual’s participation actually has an impact – and test the model against behavioral data from FixMyStreet.com (n=399,364). We find that a successful first experience using FixMyStreet.com (e.g. reporting a pothole and having it fixed) is associated with a 54 percent increase in the probability of an individual submitting a second report. We also show that the experience of government responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of government responsiveness for fostering an active citizenry, while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

Read more here.

  • Do Mobile Phone Surveys Work in Poor Countries? 

In this project, we analyzed whether mobile phone-based surveys are a feasible and cost-effective approach for gathering statistically representative information in four low-income countries (Afghanistan, Ethiopia, Mozambique, and Zimbabwe). Specifically, we focused on three primary research questions. First, can the mobile phone survey platform reach a nationally representative sample? Second, to what extent does linguistic fractionalization affect the ability to produce a representative sample? Third, how effectively does monetary compensation impact survey completion patterns? We find that samples from countries with higher mobile penetration rates more closely resembled the actual population. After weighting on demographic variables, sample imprecision was a challenge in the two lower feasibility countries (Ethiopia and Mozambique) with a sampling error of /- 5 to 7 percent, while Zimbabwe’s estimates were more precise (sampling error of /- 2.8 percent). Surveys performed reasonably well in reaching poor demographics, especially in Afghanistan and Zimbabwe. Rural women were consistently under-represented in the country samples, especially in Afghanistan and Ethiopia. Countries’ linguistic fractionalization may influence the ability to obtain nationally representative samples, although a material effect was difficult to discern through penetration rates and market composition. Although the experimentation design of the incentive compensation plan was compromised in Ethiopia and Zimbabwe, it seems that offering compensation for survey completion mitigated attrition rates in several of the pilot countries while not reducing overall costs. These effects varied across countries and cultural settings.

Read more here.

  • The haves and the have nots: is civic tech impacting the people who need it most? (presentation) 

Read more here.


10 Most Read Posts in 2013

Below is a selection of the 10 most read posts at DemocracySpot in 2013. Thanks to all of those who stopped by throughout the year, and happy 2014.

1. Does transparency lead to trust? Some evidence on the subject.

2. The Foundations of Motivation for Citizen Engagement

3. Open Government, Feedback Loops, and Semantic Extravaganza

4. Open Government and Democracy

5. What’s Wrong with e-Petitions and How to Fix them

6. Lawrence Lessig on Sortition and Citizen Participation

7. Unequal Participation: Open Government’s Unresolved Dilemma

8. The Effect of SMS on Participation: Evidence from Uganda

9. The Uncertain Relationship Between Open Data and Accountability

10. Lisbon Revisited: Notes on Participation


The Effect of SMS on Participation: Evidence from Uganda

Screen Shot 2013-11-30 at 11.19.05 AM

I’ve been wanting to post about this paper for a while. At the intersection of technology and citizen participation this is probably one of the best studies produced in 2013 and I’m surprised I haven’t heard a lot about it outside the scholarly circle.

One of the fundamental questions concerning the use of technology to foster participation is whether it impacts inclusiveness and, if it does, in what way. That is, if technology has an effect on participation, does it reinforce or minimize participation biases? There is no straightforward answer, and the limited existing evidence suggests that the impact of technology on inclusiveness depends on a number of factors such as technology fit, institutional design and communication efforts.

If the answer to the question is “it depends”, then the more studies looking at the subject, the more we refine our understanding of how it works, when and why. The study, “Does Information Technology Flatten Interest Articulation? Evidence from Uganda” (Grossman, Humphreys, & Sacramone-Lutz, 2013), is a great contribution in that sense. The abstract is below (highlights are mine):

We use a field experiment to study how the availability and cost of political communication channels affect the efforts constituents take to influence their representatives. We presented sampled constituents in Uganda with an opportunity to send a text-message to their representatives at one of three randomly assigned prices. This allows us to ascertain whether ICTs can “flatten” interest articulation and how access costs determine who communicates and what gets communicated to politicians. Critically, contrary to concerns that technological innovations benefit the privileged, we find that ICT leads to significant flattening: a greater share of marginalized populations use this channel compared to existing political communication channels. Price matters too, as free messaging increase uptake by about 50%. Surprisingly, subsidy-induced increases in uptake do not yield further flattening since free channels are used at higher rates by both marginalized and well-connected constituents. More subtle strategic hypotheses find little support in the data.

But even if the question of “who participates” is answered in this paper, one is left wondering “as to what effect?”. Fortunately, the authors mention in a footnote that they are collecting data for a companion paper in which they focus on the behavior of MPs, which will hopefully address this issue. Looking forward to reading that one as well.

***

Also read

Mobile phones and SMS: some data on inclusiveness 

Unequal Participation: Open Government’s Unresolved Dilemma

Mobile Connectivity in Africa: Increasing the Likelihood of Violence?


Mobile Connectivity in Africa: Increasing the Likelihood of Violence?

Regarding the above picture of DRC government troops with their mobile phones, Alexis Madrigal from the Atlatinc wrote in his column last year:

I don’t know what to say about this photograph aside from suggesting that an enterprising PhD student write a dissertation on “Cell Phones in War.” How are fighting, killing, and controlling territory different when you can call your brother after battle, post a photo of your squadron on the march to Facebook, or play Angry Birds between skirmishes?

Part of the answer to Alexis’ question comes in a newly published article in the American Political Science Review by postdoctoral fellow Jan Pierskalla and PhD candidate Florian Hollenbach (ht the Monkey Cage).

In a nutshell, the authors’ findings suggest that cell phone coverage in Africa increases the likelihood of political violence. The abstract is below:

The spread of cell phone technology across Africa has transforming effects on the economic and political sphere of the continent. In this paper, we investigate the impact of cell phone technology on violent collective action. We contend that the availability of cell phones as a communication technology allows political groups to overcome collective action problems more easily and improve in-group cooperation, and coordination. Utilizing novel, spatially disaggregated data on cell phone coverage and the location of organized violent events in Africa, we are able to show that the availability of cell phone coverage significantly and substantially increases the probability of violent conflict. Our findings hold across numerous different model specifications and robustness checks, including cross-sectional models, instrumental variable techniques, and panel data methods.

It will be interesting to see how this paper resonates with different audiences, such as the ICT4D community and political scientists. Some have already started to question the methodology and underlying assumptions in the paper.

But despite the findings of this study, like it or not, at some point technology cheerleaders will have to come to terms with a simple fact: if technology helps us overcome problems of collective action, there’s no reason to believe that this can only happen when it comes to virtuous collective action. And it shouldn’t take a PhD to know that.

Read the full paper here [PDF].