survey measures of civic learning and engagement that track change from grades 4-12

Our colleagues Amy Syvertsen, Laura Wray-Lake, and Aaron Metzger have posted on the CIRCLE website a set of survey-based measures of civic engagement that they have carefully developed to be appropriate for kids all the way from fourth grade up to twelfth grade. Such measures are invaluable for assessing growth and learning. They are hard to develop, for reasons the authors describe on the CIRCLE website. Even just finding phrases that are appropriate for both children and older teenagers is a challenge. The new toolkit is the result of an intensive and highly professional project funded by the John Templeton Foundation, and it sets the standard.

See Civic and Character Development: Good Data Starts with Good Measures. The recommended citation for the toolkit itself is: Syvertsen, A. K., Wray-Lake, L., & Metzger, A. (2015). Youth civic and character measures toolkit. Minneapolis, MN: Search Institute.

citizens at work: how small groups address large-scale problems

(Orlando) I am on my way home from a meeting of the Florida Partnership for Civic Learning. I’d like to argue that it exemplifies citizens’ work. To be sure, it has a specific mission: improving civic education in Florida’s k-12 schools. And it enlists a specific kind of person: professionals in k12 schools, ed schools, and state agencies, all of whom participate in the effort as part of their jobs. It thus differs in significant ways from a group of miners forming a union or volunteers fixing a neighborhood park. (I can spot k12 teachers and ed-school professors from 500 yards away, due to some ineffable mix of demographics, fashion/accessories, and ways of navigating the physical world). Still, the essential features of this group would apply to different issues and different people.

Using the terms I summarize in this 10-minute video, groups of effective citizens seriously ask the question, “What should we do?” That question implies a deep consideration of values, of facts and constraints, and of strategies. The group not only discusses (deliberates), but also takes collective action (collaborates) and learns from the results of its own actions. Finally, it is attentive to relationships both within the group and with outsiders. It specifically promotes civic relationships, which imply certain values–such as mutual respect and accountability–without relying on personal friendships or financial ties. Because the fundamental question is “What we should do (about some large question)?” the group is satisfied neither with just doing something by itself that has limited effects nor with wishing or hoping that someone else acts. It finds leverage over larger systems.

Without going into details about the Florida Partnership or its current work, I would argue that it embodies all the key words in the previous paragraph. The question for the Partnership is “What should we do to improve civic learning for all Florida students?” The main value-questions include: “What is important for a citizen to learn and know?”, “What rights/obligations do schools have to educate citizens?” and “What constitutes just outcomes for the population of students across the state?” Participants discuss extensive factual information: 7th grade civics test scores for every student in the state, detailed survey data on students’ values and behaviors, and information on the effectiveness of various programs. At this particular meeting, we looked at regression models that predicted test scores, elaborate maps of schools that surpassed expectations, toplines from surveys, and qualitative reports from some of those schools. Participants spent time building relationships among themselves and with other actors. Finally, the group considered a whole range of strategies, from working with elementary reading organizations to changing course requirements in state colleges.

Nothing is perfect, but I think we did a good job of avoiding these classic pitfalls:

  1. Turning everything into a communications problem, a problem of “getting the word out.” In an era of constant marketing and propaganda, it seems to come as second nature to focus on “messaging.” But rarely is the main problem that lots of people believe the wrong things. And even when they do, communicating is challenging in a very crowded media environment. Smart groups communicate as they need to but don’t overemphasize its importance.
  2. Imagining phantom agents. It’s a constant temptation to imagine–or hope–that someone else will solve a problem. Someone else’s actions may indeed be essential. For instance, it may take the state legislature to improve civics. But then the question becomes: How can we influence the legislature? The “we” has to be concrete and real: an actual list of individuals who know what to do next. We are the ones we have been waiting for.
  3. Oscillating between the trivial and the utopian. I have often observed groups jump back and forth between the ends of a spectrum of practicality. At one moment, they will convince themselves that a given problem cannot be solved without changing the whole political/economic system. At another moment, they will talk about making one presentation at someone else’s small-scale meeting. To make a substantial difference, you have to find space between those extremes.
  4. Operating at only one level of power. According to the train of thinking inaugurated by Steven Lukes and John Gaventa in the 1970s, power operates at several levels. There is explicit power: the power to do something (such as require a statewide civics test or grade an individual kid). There is the power to set agendas. There is power over other people’s preferences and values. And there is power to affect who uses the other forms of power. Truly effective citizen groups think at all these levels.
  5. Losing the moral questions in data. We have civics test scores for every 7th grader in Florida, and my colleagues have analyzed those data in several illuminating ways (geospatially, demographically, even qualitatively). But it is fundamentally a moral question what to measure on a 7th grade civics test. It is also a moral question whether the state should test students, and what consequences should follow from success or failure on a test. Finally, given a distribution of real test scores, it is a moral question what to do next. Should you devote all your resources to serving the lowest-scorers? Raise the median? Reward the high-scorers? In an age of positivism, we tend to be better at analyzing the data than at reasoning about what the data imply morally. But good groups hold philosophically diverse and productive explicit discussions of the moral issues.
  6. Losing sight of either the short-term or the long-term. Really effective citizen groups achieve short-term victories with an eye to building momentum and winning longer-term victories later. The two mistakes to avoid are looking only for easy “wins” that don’t create momentum or working directly on long-term problems without having enough people or money to sustain the effort.

Returning to our Roots: a new white paper on educating for democracy

GCwhitepaperReleased today is a strategy paper entitled Returning to Our Roots: Educating for Democracy. The authors are Generation Citizen plus a committee from other groups, including my CIRCLE colleagues and me. I’m pleased to have been part of the discussions that generated this paper. It is distinctive in that it puts political engagement at the center of civic education and addresses both schools and out-of-school opportunities.

Generation Citizens’ executive director, Scott Warren, also has a piece entitled “Student protests reveal thirst for a dialogue on democratic process” in the Hechinger Report. Scott uses this article to summarize the recommendations of the report.

special issue of Diversity & Democracy on political engagement

The latest issue of Diversity & Democracy (vol. 18, no. 4, fall 2015) was edited by members of my team at Tisch College in conjunction with AAC&U. The topic of the whole issue is “Student and Institutional Engagement in Political Life.” Three specific articles are also by members of our team:

The lineup of the whole issue is excellent, and the topic couldn’t be more timely.

why it’s especially important to deliberate in diverse schools

(Washington, DC) In a new article, Kei Kawashima-Ginsberg and I argue that discussing current, controversial issues is an effective way to teach civic skills and raise students’ interest in politics. Such discussions are relatively rare in schools that are “racially pluralistic” (having no racial majority), probably in part because diversity makes teachers and students wary of broaching controversy. Yet the benefits of discussion are strongest in just those schools. That may because the students’ diversity is an asset for good conversations, and also because planned discussions fill a gap in diverse schools that pervasively lack political conversation. Our article assembles the quantitative evidence for controversial issue discussions in racially pluralistic schools and offers tips for teachers and links to helpful organizations. See Kei Kawashima-Ginsberg & Peter Levine, “Challenges and Opportunities for Discussion of Controversial Issues in Racially Pluralistic Schools,” Social Education, vol. 79, no. 5 (Oct. 2105), p. 271-7 (or via Academia.edu.)

measures of Critical Consciousness

New on the CIRCLE website is a guest post on Critical Consciousness Impact Measures. As the authors (Matthew Diemer, Ellen Hawley McWhirter, Emily J. Ozer, and Luke Rapa) explain, Critical Consciousness “refers to marginalized or oppressed people’s critical reflection on oppressive social, economic, or political conditions, the motivation to address perceived injustice, and action taken to counter injustice.” In their work–together and separately–these scholars have found that students do better when they have more Critical Consciousness. Survey measures are embedded in the post and are available for anyone to use in program evaluations or research, or even just for discussion.

Q&A for Constitution Day

It’s Constitution Day. Thanks to an amendment included at the behest of the late Robert Byrd in 2004, every educational institution that receives federal money–from a kindergarten to a graduate school–must offer programs on this day that concern the Constitution. Eight years ago, I posed some gently subversive questions that could be the basis of a discussion on Constitution Day. Here are my questions again, with–for what they’re worth–my answers:

  • How, under our Constitution, can legislation be passed on the sole prerogative of one US Senator?

The Constitution leaves it up to each house of Congress to organize its own procedures. (Article 1, sec. 2: “Each House may determine the rules of its proceedings.”) The Senate can basically construct bills any way it wants.

There is no ideal way to legislate. Any parliamentary body faces a severe challenge in aggregating the opinions of its many members on the many topics that come before it. No legislature can discuss and separately vote on everything. Still, the Senate’s rules give an awful lot of power to individual members to insert provisions. I suspect the reason lies with the Senate’s filibuster rules, which make the passage of legislation extraordinarily difficult. To prevent even more filibusters than we actually have, Senators are allowed to slip in special provisions they especially care about.

Legislating this way is not “unconstitutional” in the sense of violating the text of the document. But we could say that in the broader meaning of the phrase “constitutional system,” our system includes the rules of the US Senate, which are very problematic.

  • How can Congress pass legislation without hearings or debate?

See above. But this second question underlines a particular disadvantage of the Senate’s rules: many decisions get no deliberation whatsoever. No teachers were asked to testify about the pros and cons of a Constitution Day mandate. Again, no process is prefect, but the Senate’s procedures seem to neglect the deliberative value that our constitutional order was meant to uphold: “the mild voice of reason, pleading the cause of an enlarged and permanent interest.”

  • Is it a constructive and appropriate use of federal power to determine the content and timing of educational instruction?

Strong conservative constitutionalists will say that Congress has no business in education at all, because education is not among the enumerated powers of Article 1, Section 8. Students should learn and consider that argument. For my part, I think we long ago rightly settled that the Congress may raise taxes and spend the money on education and may put certain conditions on the funding. I would especially argue for a federal role in supporting education for republican self-government, on the ground that this is “necessary and proper” for the survival of our system.

But that doesn’t mean that micromanagement from Washington is wise. To pick a day–right at the beginning of the conventional academic year–when every school (k-20) must teach the Constitution is a good example of meddling. It’s unlikely to yield positive results. Conservatives make a valid point that needn’t be rooted in an originalist reading of the Constitution: Congress should generally avoid micromanaging, especially in an ad hoc way, because it is too distant from local concerns, too likely to make one size fit all, and too remote from accountability. Characteristically, when the Senate passed a Constitution Day mandate, no one even dreamed of empirically evaluating the impact–whereas a school district that tried such an experiment might have to show that it was cost-effective and a “research-based best practice.” Congressional micromanagement violates the spirit of the Constitution, even when it passes legal muster.

Finally, I do think some good comes from the Constitution Day mandate. It gives an annual boost to the wonderful organizations that provide materials, lesson plans, and professional development for civics, and it yields an annual crop of articles and social media about civic education. Still, if I had to teach a lesson on Constitution Day, it might be about how the legislation that launched it is constitutional yet also problematic–so maybe we need some reform.

See also liberals, conservatives, and love of the Constitutionis our constitutional order doomed? and constitutional piety.

youth Participatory Budgeting in Boston

In April, 2014, I had the pleasure of watching Boston teenagers begin a youth Participatory Budgeting process. The city has asked them to decide how to allocate $1 million of capital funds, engaging their peers in research, deliberation, and voting. I described my observations in “You can add us to equations but they never make us equal: participatory budgeting in Boston.”

Now their decisions have been announced. The projects they selected include extending the city’s bicycle share system and free WiFi to additional neighborhoods, installing water bottle refill stations, and renovating a high school gym. The photo below shows some of the kids with Boston Mayor Marty Walsh. More here.

The post youth Participatory Budgeting in Boston appeared first on Peter Levine.

media literacy education article

This is just out today: Levine, P. (2014). Media Literacy for the 21st Century. A Response to “The Need for Media Education in Democratic Education.” Democracy and Education, 23 (1), Article 15. It’s an invited response to Jeremy Stoddard’s fine piece “The Need for Media Education in Democratic Education.” My response is not a critique but just a complementary perspective. The abstract:

We cannot pretend to educate young people for citizenship and political participation without teaching them to understand and use the new media, which are essential means of expressing ideas, forming public opinions, and building institutions and movements. But the challenge of media literacy education is serious. Students need advanced and constantly changing skills to be effective online. They must understand the relationship between the new media and social and political institutions, a topic that is little understood by even the most advanced social theorists. And they must develop motivations to use digital media for civic purposes, when no major institutions have incentives to motivate them. Until we address those challenges, students will struggle to make sense of the new media environment, let alone take constructive action.

 

The post media literacy education article appeared first on Peter Levine.

CIRCLE’s release on today’s Civics results

23% of 8th-Graders “Proficient” in Civics According to Nation’s Report Card Released Today
Today’s Release Shows Inequality in Civics Education, Serious Gaps by Racial and Economic Backgrounds Reflecting Unequal Education

Medford/Somerville, MA – Today, the Federal Government released the Nation’s Report Card: 2014 U.S. in Civics. Experts on civic education from the Center for Information and Research on Civic Learning & Engagement (CIRCLE) based at Tufts University’s Tisch College – the preeminent, non-partisan research center on youth engagement – have been involved in both designing and analyzing the National Assessment of Educational Progress (NAEP) Civics Assessment and can provide informed commentary.

“The quality and equality of civic education is a reflection of our investment in a healthy democracy,” said Dr. Kei Kawashima-Ginsberg, director of CIRCLE. “The National Assessment of Education Progress, or the Nation’s Report Card, as it’s also known, is a difficult and complex test that successfully measures some key areas of civic learning and how well civics is taught. However, as the new Nation’s Report Card: 2014 shows, we are far from achieving an acceptable quality or equality of civics education.”

The 2014 NAEP Civics, released today, finds that 23% of America’s 8th graders are “proficient.” Although higher scores would certainly be desirable, many adults might be surprised by how difficult the NAEP Civics questions are. For instance, in 2014, 8th graders were asked to identify a power of the modern President not described in the Constitution and to understand that growth in the elderly population would affect Social Security spending.

NAEP assessments in all other subjects yield roughly comparable proficiency levels to those found in civics. For instance, on the 2013 Mathematics NAEP, 27% of 8th graders scored proficient and 9% scored advanced.

More significant than the overall proficiency levels are gaps by student groups. For instance, only 9% of African American students reached at least the “proficient” level in the 2014 NAEP Civics, compared to 40% of Asian/Pacific Islander students. Students from urban areas, students whose parents didn’t attend college, students eligible for free and reduced-price lunch, and students with disabilities all scored lower than average.

“The NAEP Civics measures education for citizenship, which is an essential purpose of schools,” said Peter Levine, Associate Dean for Research at Tufts University’s Jonathan M. Tisch College of Citizenship and Public Service and a member of the NAEP Civics Committee. “In 2014, due to budget cuts, the NAEP Civics was fielded only at the 8th grade level. It is important for the NAEP Civics to be administered regularly and at the 4th grade, 8th grade, and 12th grade levels so that we can assess our progress in educating America’s kids for citizenship.”

Previous research by CIRCLE has shown that what students know about civics is related to how much and how well they are taught civics. The gaps in NAEP scores reflect inequality in civic education.

Dr. Kei Kawashima-Ginsberg closely studied previous NAEP Civics results for a fact sheet entitled, “Do Discussion, Debate, and Simulations Boost NAEP Civics Performance?” In that work, Kawashima-Ginsberg explored the relationship between three promising teaching practices and NAEP scores for various demographic groups.

Dr. Peter Levine, Associate Dean for Research at Tisch College, has written a fact sheet entitled, “What the NAEP Civics Assessment Measures and How Students Perform.” The fact sheet looks closely at what the NAEP Civics test measures, the skills and values that it doesn’t capture, and in general how to interpret the results. Levine was a member of the committee that helped design the 2014 civics test.

###

The post CIRCLE’s release on today’s Civics results appeared first on Peter Levine.