PSR Interviews #2: An Introduction to Multilevel Regression and Post-Stratification – an interview with Chris Hanretty

MRP is a model-based technique, so if you have a really poor model of the opinion you’re examining, that’s going to hurt you” – claims Prof. Hanretty.Hopefully, everyone using MRP will have at least some substantive knowledge of the demographic and geographic determinants of public opinion” – he adds. In this interview, the author explains complexities, the potential and flaws of multilevel regression and post-stratification. A fuller analysis of this emerging technique can be found in Prof. Hannerty’s PSR article.

Political Studies Review: How would you describe the basic idea behind multilevel regression and post-stratification (MRP) technique?

Chris Hanretty: There are two basic steps in MRP: (1) you learn about voter opinions from a large national sample, and in particular, the opinions of certain types of voters; (2) and you go look up other sources of information (often a census or something similar) to find out how many voters of each type there are in each area. If I know (on the basis of my national sample and some model) that 55-64-year-old men with a high school education are very likely to vote Conservative, and if I know how many such men there are in a particular seat, then that gets me part of the way to understanding how that seat as a whole will vote. I just need to repeat the exercise for all the different voter types implicit in my model.

That’s the idea in a nutshell. In practice, it’s more complicated, and often a lot of the added value comes not from knowing information about individual voter types, but information about the types of the area they live in. The single best predictor of Conservative vote share in a seat is the Conservative vote share in the last election. MRP really benefits from having these predictors alongside demographic predictors, but I lead with the demographic picture because that’s much more intuitive.

You wrote that MRP has been developing for the past 15–20 years. It has made it possible to pose and answer questions related to public opinion in small areas that have not been possible before. How was this method popularised, and what influenced its development? Is it becoming a prevalent statistical technique?

I think Andrew Gelman at Columbia has been an outstanding popularizer of MRP. I think technical and software developments have always played their part. There are now a lot more packages which allow researchers to estimate multilevel models of the kind used in MRP.

The major benefit of MRP seems that it allows avoiding the need for surveys at a sub-regional level. Are there any other benefits?

For me, it’s hard to see past that benefit. If you want to know about constituency opinion in the UK, it’d be impossible to field a standard 1,000 person survey in all those seats. No company has that polling capacity. Maybe for some contexts – say, US states – you could think about conducting state polls and aggregating those. But then you’d have to think about varying dates of fieldwork, different weighting targets in those states – urgh, it makes me shudder to think of it.

What are the possible limitations of this method?

MRP is a model-based technique, so if you have a really poor model of the opinion you’re examining, that’s going to hurt you. Hopefully, everyone using MRP will have at least some substantive knowledge of the demographic and geographic determinants of public opinion.

Maybe for some contexts – say, US states – you could think about conducting state polls and aggregating those. But then you’d have to think about varying dates of fieldwork, different weighting targets in those states – urgh, it makes me shudder to think of it.

Another limitation is that you might not always have the post-stratification data you need. You might want to create estimates just for adult citizens, but your national census office might only release breakdowns for the adult population. There’s often a tension between what you want to include in the model and what’s available from official statistics.

What are other contributions your article brings to the field you’d like to highlight?

I’m just happy to have some code out there which takes people through the whole process. Written descriptions of procedures in peer-reviewed journals are obviously important, but additional documented code is the cherry on the cake!

MORE

Article: Hannerty C. (2020), An Introduction to Multilevel Regression and Post-Stratification for Estimating Constituency Opinion, Political Studies Review 2020, Vol. 18(4) 630–645.

ABOUT

Professor Christopher Hannerty – Professor of Politics at Royal Halloway, University of London.

His research areas concern representation and the politics of the judiciary. More

Twitter Political Studies Review @PolStudiesRev

Questions and production

Dr Eliza Kania, PSR/Brunel University London

PSR Interviews #1: “Enemies of the American people” – Donald Trump, populism and politics of insecurity – interview with Daniel Béland

Why does Donald Trump want to “depict his opponents as enemies of the American people, who will cheat and do whatever it takes to kick him out of the White House”? What consequences will his actions have on the country’s future? Now, when America is facing a profound political change, we decided to discuss Donald Trump’s political legacy with Profes­sor Daniel Béland. He’ll debate collective threat framing, Trump’s populist tactics and the results it may have on the country’s society. A fuller analysis of these issues can be found in Prof. Beland’s PSR article. But here, we’re beginning a short PSR research-based interviews series

PSR: How would you define populism? What components do you find the most essential?

Daniel Béland: Populism is a slippery and contested concept that can be hard to define. In my article, I draw on the work of Jan-Werner Müller (2016) to stress two main components of populism: its critique of the elites and its claim to speak on the behalf of a people that is both unified and coherent. My article focuses exclusively on right-wing populism, even if left-wing populism shares these two basic characteristics. 

How is populism linked to the politics of insecurity?

The politics of insecurity is largely about the framing and reframing of collective threats. In my article, I suggest that right-wing populism defines migrants as a key threat, something obvious in President Trump’s rhetoric, which depicts them as “folk devils” who constitute a direct menace against the American people.      

What are the major collective threats that have been framed and acted upon during Donald Trump’s presidency?

Migrants are only one of the major perceived collective threats President Trump focused on during his presidency and it is the one I decided to focus on in my article. Other collective threats President Trump has referred to include the economic threat stemming from China and the “bad” trade deals with other countries, including Canada and Mexico, a situation that led to the renegotiation of NAFTA. However, these threats are less “personal” and seemingly immediate than the migrant caravan I discuss in my article.    

Trump might have lost the popular vote and at the electoral college but right-wing populism and white nationalism associated to him and his faithful base are unlikely to disappear any time soon

If populism is about framing and reframing national identities, what was the major change caused by Trump’s rhetoric?

Under Trump, the emphasis on border control has increased well beyond the issue of terrorism, which became such a central issue in the United States after the terrorist attacks of September 11, 2001. For instance, concerns about the US-Mexico border had long existed but President Trump depicted Mexican and Central American migrants who cross the border as an imminent and existential threat to the United States. More recently, in a similar way, the president has also attacked Black Lives Matter and ANTIFA, which he has distorted the image and blown out of proportion to scare voters.    

How has the framing of migrants and other collective threats reshaped how Americans regard politics? Will – regardless of his defeat, – the base of Trump supporters reshapes the US politics itself?

President Trump’s recent refusal to concede defeat and recognize the clear victory of Democratic candidate Job Biden is part of a broader attempt to depict his opponents as enemies of the American people, who will cheat and do whatever it takes to kick him out of the White House. Clearly the accusations of voter fraud are embedded in racial prejudice, especially when the president targets alleged yet fictional widespread “cheating” in cities with a large black population like Detroit and Philadelphia. Trump might have lost the popular vote and at the electoral college but right-wing populism and white nationalism associated to him and his faithful base are unlikely to disappear any time soon in what remains a highly divided country, in which different narratives about who the people is are now embedded in resilient and highly contentious partisan identities.   

What are the key contributions your article brings to the field?

The main contribution of my article is theoretical, as it bridges and integrates the literatures on populism and on the politics of insecurity to formulate an integrated framework that other scholars could apply or adapt to a variety of political and geographical settings. This is why the article is not only targeting students of the United States or the politics of immigration but all scholars interested in the insecurity/populism nexus.     

LEARN MORE

ABOUT

Prof. Daniel Béland

Prof. Daniel Béland – James McGill Professor; Director of the McGill Institute for the Study of Canada (MISC).

Questions and production

Dr Eliza Kania, PSR/Brunel University London

Photo used in the heading image: Gage Skidmore via Flickr (link), license: Creative Commons Attribution-ShareAlike 2.0 Generic (CC BY-SA 2.0), modified.

Political Studies Review: a research-based interview project

Some researchers claim that “a key to accessible, interesting academic work is [a] conversational yet authoritative tone coupled with attention-getting titles, compelling openings, anecdotes and illustrations”[1]. We agree.

Our editorial team is committed to presenting and visualizing research data to boost dissemination and to reaching wider (including non-academic) audiences. We use different forms of communication to present research findings such as infographics and data animations. Some of our authors have also contributed to our excellent podcast series. But this time we would like to invite PSR authors to take part in our research-based interview project.

We believe that interviews are also a prominent form of research communication. It gives a space to discuss a research topic, article or research ideas in a less formal format.

To illustrate this idea, we have prepared some excellent examples:

If you’d decide to take part in this, here’s how it works. We will provide you with around 5 questions based on your article, research aims or ideas. You can answer them in writing, or by recording your answers and add any visual/graphical material you want to use to explain your point. The idea is that answers should be relatively brief, and provide readers or listeners with a flavour of your research. As with all our activity, we will promote this through social media for maximum exposure.

The idea is that answers should be relatively brief, and provide readers or listeners with a flavour of your research.

The outcome will be informative and accessible (published at psr.brunel.ac.uk) and will encourage readers to engage further with your article and wider research.


[1] Feature Essay: The road to academic success is paved with stylish academic writing, LSE Impact Blog, 20.05.2020, https://blogs.lse.ac.uk/lsereviewofbooks/2012/05/20/the-road-to-academic-success-is-paved-with-stylish-academic-writing/