A Charter for How to Build Effective Data (and Mapping) Commons

Among those trying to build a new economy, there is growing interest in developing online maps as tools for helping people understand and engage with the rich possibilities.  One of the earliest such maps was TransforMap, a project with origins in Austria and Germany that is using OpenStreetMap as a platform for helping people identify and connect with alternative economic projects. In the US, CommonSpark assembled a collection of “maps in the spirit of the commons” such as

the Great Lakes Commons Map (a bioregional map of healing and harm), World of Commons (innovative forms of citizen-led governance of public property and services in Italy), Falling Fruit (a global map identifying 786,000 locations of forgeable food), a map of Free Little Libraries (free books available in neighborhoods around the world), a global Hackerspace map, a global Seed Map, a map of all Transition communities, and several Community Land Trust directory maps.

As the varieties of maps proliferate, there is growing concern that the mapping projects truly function as commons and be capable of sharing data and growing together. But meeting this challenge entails some knotty technical, social and legal issues.  

A group of mappers met at the Commons Space sessions of the World Social Forum in Montreal last year to try to make progress on the challenge.  The dialogues continued at an "Intermapping” workshop in Florence, Italy, last month. After days of deep debate and collaboration, the mappers came up with a document that outlines twelve key principles for developing effective data and mapping commons. The Charter for Building a Data Commons for a Free, Fair and Sustainable Future is the fruit of those dialogues.

read more

New Papers Published: FixMyStreet and the World’s Largest Participatory Budgeting

2016_7_5_anderson-lopes_consulta-popular_virtual

Voting in Rio Grande do Sul’s Participatory Budgeting  (picture by Anderson Lopes)

Here are two new published papers that my colleagues Jon Mellon, Fredrik Sjoberg and myself have been working on.

The first, The Effect of Bureaucratic Responsiveness on Citizen Participation, published in Public Administration Review, is – to our knowledge – the first study to quantitatively assess at the individual level the often-assumed effect of government responsiveness on citizen engagement. It also describes an example of how the data provided through digital platforms may be leveraged to better understand participatory behavior. This is the fruit of a research collaboration with MySociety, to whom we are extremely thankful.

Below is the abstract:

What effect does bureaucratic responsiveness have on citizen participation? Since the 1940s, attitudinal measures of perceived efficacy have been used to explain participation. The authors develop a “calculus of participation” that incorporates objective efficacy—the extent to which an individual’s participation actually has an impact—and test the model against behavioral data from the online application Fix My Street (n = 399,364). A successful first experience using Fix My Street is associated with a 57 percent increase in the probability of an individual submitting a second report, and the experience of bureaucratic responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of responsiveness for fostering an active citizenry while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

An earlier, ungated version of the paper can be found here.

The second paper, Does Online Voting Change the Outcome? Evidence from a Multi-mode Public Policy Referendum, has just been published in Electoral Studies. In an earlier JITP paper (ungated here) looking at Rio Grande do Sul State’s Participatory Budgeting – the world’s largest – we show that, when compared to offline voting, online voting tends to attract participants who are younger, male, of higher income and educational attainment, and more frequent social media users. Yet, one question remained: does the inclusion of new participants in the process with a different profile change the outcomes of the process (i.e. which projects are selected)? Below is the abstract of the paper.

Do online and offline voters differ in terms of policy preferences? The growth of Internet voting in recent years has opened up new channels of participation. Whether or not political outcomes change as a consequence of new modes of voting is an open question. Here we analyze all the votes cast both offline (n = 5.7 million) and online (n = 1.3 million) and compare the actual vote choices in a public policy referendum, the world’s largest participatory budgeting process, in Rio Grande do Sul in June 2014. In addition to examining aggregate outcomes, we also conducted two surveys to better understand the demographic profiles of who chooses to vote online and offline. We find that policy preferences of online and offline voters are no different, even though our data suggest important demographic differences between offline and online voters.

The extent to which these findings are transferable to other PB processes that combine online and offline voting remains an empirical question. In the meantime, nonetheless, these findings suggest a more nuanced view of the potential effects of digital channels as a supplementary means of engagement in participatory processes. I hope to share an ungated version of the paper in the coming days.

Bit by Bit: Social Research in the Digital Age

bigdata

Pic by Jim Kaskade (flickr creative commons)

Matthew Salganik, Professor of Sociology at Princeton University, has recently put his forthcoming book on social research and big data online for an open review. Matthew is the author of many of my favorite academic works, including this experiment in which he and Duncan Watts test social influence by artificially inverting the popularity of songs in an online music market. He is also the brains behind All Our Ideas, an amazing tool that I have used in much of the work that I have been doing, including “The Governor Asks” in Brazil.

As in the words of Matthew, this is a book “for social scientists that want to do more data science, and it is for data scientists that want to do more social science.” Even though I have not read the entire book, one of the things that has already impressed me is the simplicity with which Matthew explains complex topics, such as human computation, distributed data collection and digital experiments. For each topic, he highlights opportunities and provides experienced advice for those working with big data and social sciences. His stance on social research in the digital age is brilliant and refreshing, and is a wake-up call for lots of people working in that domain. Below is an excerpt from his preface:

From data scientists, I’ve seen two common misunderstandings. The first is thinking that more data automatically solves problems. But, for social research that has not been my experience. In fact, for social research new types of data, as opposed to more of the same data, seems to be most helpful. The second misunderstanding that I’ve seen from data scientists is thinking that social science is just a bunch of fancy-talk wrapped around common sense. Of course, as a social scientist—more specifically as a sociologist—I don’t agree with that; I think that social science has a lot of to offer. Smart people have been working hard to understand human behavior for a long time, and it seems unwise to ignore the wisdom that has accumulated from this effort. My hope is that this book will offer you some of that wisdom in a way that is easy to understand.

From social scientists, I’ve also seen two common misunderstandings. First, I’ve seen some people write-off the entire idea of social research using the tools of the digital age based on a few bad papers. If you are reading this book, you have probably already read a bunch of papers that uses social media data in ways that are banal or wrong (or both). I have too. However, it would be a serious mistake to conclude from these examples that all digital age social research is bad. In fact, you’ve probably also read a bunch of papers that use survey data in ways that are banal or wrong, but you don’t write-off all research using surveys. That’s because you know that there is great research done with survey data, and in this book, I’m going to show you that there is also great research done with the tools of the digital age.

The second common misunderstanding that I’ve seen from social scientists is to confuse the present with the future. When assessing social research in the digital age—the research that I’m going to describe in this book—it is important to ask two distinction questions:

How well does this style of research work now?

How well will this style of research work in the future as the data landscape changes and as researchers devote more attention to these problems?

I have only gone through parts of the book (and yes, I did go beyond the preface). But from what I can see, it is a must read for those who are interested in digital technologies and the new frontiers of social research. And while reading it, why not respond to Matthew’s generous act by providing some comments? You can access the book here.

 

New IDS Journal – 9 Papers in Open Government

2016-01-14 16.51.09_resized

The new IDS Bulletin is out. Edited by Rosemary McGee and Duncan Edwards, this is the first open access version of the well-known journal by the Institute of Development Studies. It brings eight new studies looking at a variety of open government issues, ranging from uptake in digital platforms to government responsiveness in civic tech initiatives. Below is a brief presentation of this issue:

Open government and open data are new areas of research, advocacy and activism that have entered the governance field alongside the more established areas of transparency and accountability. In this IDS Bulletin, articles review recent scholarship to pinpoint contributions to more open, transparent, accountable and responsive governance via improved practice, projects and programmes in the context of the ideas, relationships, processes, behaviours, policy frameworks and aid funding practices of the last five years. They also discuss questions and weaknesses that limit the effectiveness and impact of this work, offer a series of definitions to help overcome conceptual ambiguities, and identify hype and euphemism. The contributions – by researchers and practitioners – approach contemporary challenges of achieving transparency, accountability and openness from a wide range of subject positions and professional and disciplinary angles. Together these articles give a sense of what has changed in this fast-moving field, and what has not – this IDS Bulletin is an invitation to all stakeholders to take stock and reflect.

The ambiguity around the ‘open’ in governance today might be helpful in that its very breadth brings in actors who would otherwise be unlikely adherents. But if the fuzzier idea of ‘open government’ or the allure of ‘open data’ displace the task of clear transparency, hard accountability and fairer distribution of power as what this is all about, then what started as an inspired movement of governance visionaries may end up merely putting a more open face on an unjust and unaccountable status quo.

Among others, the journal presents an abridged version of a paper by Jonathan Fox and myself on digital technologies and government responsiveness (for full version download here).

Below is a list of all the papers:

Rosie McGee, Duncan Edwards
Tiago Peixoto, Jonathan Fox
Katharina Welle, Jennifer Williams, Joseph Pearce
Miguel Loureiro, Aalia Cassim, Terence Darko, Lucas Katera, Nyambura Salome
Elizabeth Mills
Laura Neuman
David Calleb Otieno, Nathaniel Kabala, Patta Scott-Villiers, Gacheke Gachihi, Diana Muthoni Ndung’u
Christopher Wilson, Indra de Lanerolle
Emiliano Treré

 

World Development Report 2016: Digital Dividends

nationalgeographic_1746433-wblive (1)

The World Development Report 2016, the main annual publication of the World Bank, is out. This year’s theme is Digital Dividends, examining the role of digital technologies in the promotion of development outcomes. The findings of the WDR are simultaneously encouraging and sobering. Those skeptical of the role of digital technologies in development might be surprised by some of the results presented in the report. Technology advocates from across the spectrum (civic tech, open data, ICT4D) will inevitably come across some facts that should temper their enthusiasm.

While some may disagree with the findings, this Report is an impressive piece of work, spread across six chapters covering different aspects of digital technologies in development: 1) accelerating growth, 2) expanding opportunities, 3) delivering services, 4) sectoral policies, 5) national priorities, 6) global cooperation. My opinion may be biased, as somebody who made some modest contributions to the Report, but I believe that, to date, this is the most thorough effort to examine the effects of digital technologies on development outcomes. The full report can be downloaded here.

The report draws, among other things, from 14 background papers that were prepared by international experts and World Bank staff. These background papers serve as additional reading for those who would like to examine certain issues more closely, such as social media, net neutrality, and the cybersecurity agenda.

For those interested in citizen participation and civic tech, one of the papers written by Prof. Jonathan Fox and myself – When Does ICT-Enabled Citizen Voice Lead to Government Responsiveness? – might be of particular interest. Below is the abstract:

This paper reviews evidence on the use of 23 information and communication technology (ICT) platforms to project citizen voice to improve public service delivery. This meta-analysis focuses on empirical studies of initiatives in the global South, highlighting both citizen uptake (‘yelp’) and the degree to which public service providers respond to expressions of citizen voice (‘teeth’). The conceptual framework further distinguishes between two trajectories for ICT-enabled citizen voice: Upwards accountability occurs when users provide feedback directly to decision-makers in real time, allowing policy-makers and program managers to identify and address service delivery problems – but at their discretion. Downwards accountability, in contrast, occurs either through real time user feedback or less immediate forms of collective civic action that publicly call on service providers to become more accountable and depends less exclusively on decision-makers’ discretion about whether or not to act on the information provided. This distinction between the ways in which ICT platforms mediate the relationship between citizens and service providers allows for a precise analytical focus on how different dimensions of such platforms contribute to public sector responsiveness. These cases suggest that while ICT platforms have been relevant in increasing policymakers’ and senior managers’ capacity to respond, most of them have yet to influence their willingness to do so.

You can download the paper here.

Any feedback on our paper or models proposed (see below, for instance) would be extremely welcome.

unpacking

unpacking user feedback and civic action: difference and overlap

I also list below the links to all the background papers and their titles

Enjoy the reading.


What do we want in a social studies teacher?

Recently, the National Council for the Social Studies released its National Standards for the Preparation of Social Studies Teachers guidance document for public review. If you are a parent, pre-service social studies teacher or teacher educator, current or former teacher, or, honestly, simply an engaged citizen with a concern for the future, I encourage you to check it out and provide them with feedback. The document, which runs about 23 pages, provides an overview of five core competencies that are important in social studies teacher education.

5 core competenciesEach section of the report dives deeper into each of the core competencies. No doubt, there will be some comments raised about the inclusion of ‘social justice’, knowing that that particular term was once removed from standards of the National Council for Accreditation of Teacher Education (now the Council for the Accreditation of Educator Preparation), for good or ill. I do appreciate the emphasis on inquiry, skills, and knowledge as having an equal role in teacher preparation, though the references to C3 could be an issue in states where that program is (unfortunately) not adopted.

As a civic educator, I cannot help but notice that there is a HUGE amount of attention paid to varying elements of civic education and competency. Obviously, if we consider that social studies is at the heart of instruction in good citizenship, this is important, but it’s ultimately necessary that these standards make clear that civics must necessarily connect to other content areas in our field, and I think they do that adequately.

You can review the standards here, and I encourage you to do so and reflect on them before you complete the survey here.


Civic Tech and Government Responsiveness

For those interested in tech-based citizen reporting tools (such as FixMyStreet, SeeClickFix), here’s a recent interview of mine with Jeffrey Peel (Citizen 2015) in which I discuss some of our recent research in the area.

 


Praising and Shaming in Civic Tech (or Reversed Nudging for Government Responsiveness) 

The other day during a talk with researcher Tanya Lokot I heard an interesting story from Russia. Disgusted with the state of their streets, activists started painting caricatures of government officials over potholes.

 

In the case of a central street in Saratov, the immediate response to one of these graffiti was this:  

 

Later on, following increased media attention – and some unexpected turnarounds – the pothole got fixed.

That reminded me of a recurrent theme in some conversations I have, which refers to whether praising and shaming matters to civic tech and, if so, to which extent. To stay with two classic examples, think of solutions such as FixMyStreet and SeeClickFix, through which citizens publically report problems to the authorities.

Considering government takes action, what prompts them to do so? At a very basic level, three hypothesis are possible:

1) Governments take action based on their access to distributed information about problems (which they supposedly are not aware of)

2) Governments take action due to the “naming and shaming” effect, avoiding to be publically perceived as unresponsive (and seeking praise for its actions)

3) Governments take action for both of the reasons above

Some could argue that hypothesis 3 is the most likely to be true, with some governments leaning more towards one reason to respond than others. Yet, the problem is that we know very little about these hypotheses, if anything. In other words – to my knowledge – we do not know whether making reports through these platforms public makes any difference whatsoever when it comes to governments’ responsiveness. Some might consider this as a useless academic exercise: as long as these tools work, who cares? But I would argue that the answer that questions matters a lot when it comes to the design of similar civic tech initiatives that aim to prompt government to action.

AAAFMSscreenshot

Let’s suppose that we find that all else equal governments are significantly more responsive to citizen reports when these are publically displayed. This would have importance both in terms of process and technological design. In terms of process, for instance, civic tech initiatives would probably be more successful if devoting part of their resources to amplify the visibility of government action and inaction (e.g. through local media). Conversely, from a technological standpoint, designers should devote substantive more effort on interfaces that maximizes praising and shaming of governments based on their performance (e.g. rankings, highlighting pending reports). Conversely, we might find that publicizing reports have very little effect in terms of responsiveness. In that case, more work would be needed to figure out which other factors – beyond will and capacity – play a role in government responsiveness (e.g. quality of reports).   

Most likely, praising and shaming would depend on a number of factors such as political competition, bureaucratic autonomy, and internal performance routines. But a finer understanding of that would not only bear an impact on the civic tech field, but across the whole accountability landscape. To date, we know very little about it. Yet, one of the untapped potential of civic technology is precisely that of conducting experiments at lowered costs. For instance, conducting randomized controlled trials on the effects on the publicization of government responsiveness should not be so complicated (e.g effects of rankings, amplifying visibility of unfixed problems). Add to that analysis of existing systems’ data from civic tech platforms, and some good qualitative work, and we might get a lot closer at figuring out what makes politicians and civil servants’ “tick”.

Until now, behavioral economics in public policy has been mainly about nudging citizens toward preferred choices. Yet it may be time to start also working in the opposite direction, nudging governments to be more responsive to citizens. Understanding whether praising and shaming works (and if so, how and to what extent) would be an important step in that direction.

***

Also re-posted on Civicist.


Good News for Civic Education in Florida!

Putting aside the question of whether Florida’s middle school civics benchmarks and related assessment are actually an appropriate measures of civic learning, some good news here in the Sunshine State concerning the past administration of the Civics EOCA. As you probably know, Florida is currently one of the few states with a somewhat high stakes test connected to civics. This test, while selected response, is crafted using Webb’s Depths of Knowledge as a guide, and students are given multiple choice questions that range from level 1 to level 3 on the cognitive complexity scale. The most recent scoring of the assessment revealed some positive growth on the part of students in Florida, and I am hopeful that this is a sign that civic education could make an impact long term. Let’s take a look at the positives:

Civics EOC Assessment By Achievement Level

Civics EOC Assessment By Achievement Level

This is good news! While one would hope for a greater number of level fours, any growth in the number of students scoring at level 3 can only be a good thing.

Achievement Level by Demographic Background

Achievement Level by Demographic Background

These numbers, again, are a positive. I am most excited by the growth in African American scores. For the first time, half of all African American students taking the assessment scored at least a 3, a jump of 7 percentage points. On the downside, only half of all African-American students scored at least a 3. This needs to change, and we need to figure out how to do it.

Growth in Achievement Level 4, by Demographic Background

Growth in Achievement Level 4, by Demographic Background

Again, we see growth, but it is simply too low. Yes, great that more students scored higher on an equivalent test, but frustrating that so few are scoring at a high level. How do we change this?

Overall, much positive news. I encourage you to take a look at some of the other data in the report, including how your county might have done overall compared to other counties and to last year. One of the projects involving the Partnership for Civic Learning involves looking at what some of these schools and districts that exceed expectations are doing right. Can what they are doing be duplicated across the state? It is an important question to consider. For now, let’s enjoy the good news, review the data, and see how what we are doing might be impacting civic education in Florida.


Ubiquitous Commons: The Struggle to Control Our Data

Over the past twenty years, there has been such a proliferation of computers, smartphones, digital devices, surveillance cameras, maps, mobile applications, sensors and much else – all of it networked through the Internet, wireless and telephone connections – that an unimaginably vast new body of personal data is being generated about us, individually and collectively.    

The question is, Can we possibly control this data to serve our own desires and purposes?  Or will we be modern-day techno-peasants controlled by the neo-feudal masters on the hill, Facebook, Google and Twitter and their secret and not-so-secret partners in the US Government?

Finding an effective response to this worsening situation is not going to be easy, but one brave initiative is attempting to start a new conversation about how to build a new, more socially benign data order.  The Ubiquitous Commons, a project launched by Italians Salvatore Iaconesi and Oriana Persico, seeks to find new technological, legal and social protocols for managing the sheer ubiquity of networked information, and for assuring us some control over our digital identities.  Their basic idea is “to promote the adoption of a new type of public space in which knowledge is a common," which they describe as "ubiquitous commons."

Iaconesi and Persico believe that vital public and personal information should not be controlled by large proprietary enterprises whose profit-driven activities are largely hidden from public view and accountability.  Rather, we should be able to use our own data to make our own choices and develop “ubiquitous commons” to meet our needs. 

Why should Facebook and its social networking peers be able to control the authentication of our digital identities?  Why should they decide what visual and textual works shall be publicly available and archived for posterity?  Why should their business models control the types of insights that can be gleaned from “their” (proprietary) Big Data based on our information -- while government, academic researchers and the general public are left in the dark? 

I remember how Google crowed that its search results could make better, more timely predictions about the flu and other contagious diseases than the Centers for Disease Control.  I don't see this type of unaccountable, god-like power over social information as so wonderful and benign, especially when lucrative business self-interests may selectively govern what gets disclosed and what is used for private strategic advantage.  

read more