Religion_5CR – Comparing Religions – Political Behavior

Note to the Instructor: This is the fifth in a series of six exercises that focus on comparing religions.  In these exercises we're going to analyze data from the Pew 2014 Religious Landscape Survey conducted by the Pew Research Center.  We're going to use SPSS to analyze the data.  A weight variable is automatically applied to the data set so it better represents the population from which the sample was selected.  You have permission to use this exercise and to revise it to fit your needs.  Please send a copy of any revision to the author so I can see how people are using the exercises. Please contact the author for additional information.

Goal of Exercise

The goal of this exercise is to compare two religions of your choice in terms of political behavior.  Religion_1CR guided you through the process of choosing the two religions to compare and selecting out respondents in those two religions.  In the next exercise (Religion_6CR) we'll compare the two religions you chose in terms of how people feel about social issues. 

Part I—Concepts

We use concepts all the time.  We all know what a book is.  But when we use the word “book” we may not be talking about a particular book we’re reading. We could be talking about books in general.  In other words, we’re talking about the concept to which we have given the name “book.”  There are many different types of books – paperback, hardback, small, large, short, long, and so on.  But they all have one thing in common – they all belong to the category “book.”

Let’s look at some other examples.  Religious preference refers to the religion with which people identify.  Some people say they are Lutheran; others say they are Roman Catholic; still others say they are Muslim; and others say they have no religious preference.  Religiosity is another concept which refers to the degree of attachment that individuals have to their religious preference.  It’s different than religious preference.   Every religion has certain beliefs that are central to their religion.  Religions also differ in terms of religiously motivated behaviors.  Religiosity, religious preference, religious beliefs, and religious behavior are all concepts.

These concepts focus on religion.   Other concepts deal with political behavior.  Political party preference refers to the political party with which people identify.  Some identify with the Democratic Party; others with the Republican Party; others say they are independent; and still others identify with a third party.  Political views is another concept that refers to whether people see themselves as liberal or conservative or somewhere in between.

In other words, a concept is an abstract idea.  There are the abstract ideas of book, religiosity, religious preference, religious beliefs, religious behavior, political party preference, political views, and many others.  Since concepts are abstract ideas and not directly observable, we must select measures or indicants of these concepts.  We call this process measurement.

Part II – The Data Set We'll be Using

The Pew Research Center has conducted a number of surveys that deal with religion.  Two of these surveys are the Religious Landscape Surveys conducted in 2007 and then repeated in 2014.  They were very large telephone surveys of about 35,000 adults in the United States.   For more information about the surveys, go to their website

We'll be using a subset of the 2014 survey in this exercise which I have named Pew_2014_Religious_Landscape_ Survey_subset_for_classes.sav.  For the purposes of these exercises I selected a subset of variables from the complete data set.  I recoded some of the variables, created a few new variables, and renamed the variables to make them easier for students to use.  There is a weight variable which should always be used so that the sample will better represent the population from which the sample was selected.  To open the data set in SPSS, just double click on the file name.[1]  Your instructor will tell you where the file is located.[2]

Part III – Choosing the Two Religions to Compare

In this exercise you're going to choose two religions which you will compare.  There are several ways you can do this.

  • You could compare your own religious group with another religious group of your choice.  If you don't have a religious preference, you could select "nothing in particular" to compare with another group.  For example, you could compare Lutherans with those who have no religious preference (i.e., nothing in particular).
  • You could compare two religious groups that you are interested in.  For example, you could compare Catholics with Lutherans.
  •  Instead of comparing two religious groups, you could compare two religious traditions such as the Mainline Protestant tradition and the Evangelical Protestant tradition.
  • You could compare a Christian group with a non-Christian group.  For example, you could compare Catholics with Muslims.
  • You could compare two non-Christian groups.  For example, you could compare Muslims and Buddhists.

You want to compare two religions that have enough cases to make the comparisons meaningful.  Don't select religions that have fewer than 150 cases in them. 

Review Exercise_1CR to learn more about choosing the religions you will compare and how to select out respondents in those two religions.  In the rest of this exercise, I'm going to assume that you know how to do this.  If you're having trouble, talk with your instructor who will help you.

Part IV – Measuring Political Behavior

We want to compare our two religions to see if respondents differ in terms of political behavior.  The Pew survey asked several questions that can be used to measure political behavior.  These include political party preference and political views.

Let's start with political party preference.  The Pew survey asked, "In politics today, do you consider yourself a Republican, Democrat, or Independent?"  This variable is named P2.  This was followed by another question asked of anyone who didn't choose one of the two main parties in politics today – Republican or Democrat.  The question asked, "As of today do you lean more towards the Republican Party or more to the Democratic Party?"  The name of this variable is P3.  These two variables were then combined into another variable named P4.  We're going to use P4 as our measure of political party preference in this exercise.

We can also look at the political views of individuals.  The Pew Survey asked, "In general, would  you describe your political views as very conservative, conservative, moderate, liberal, or very liberal?"  The name of this variable is P5. 

Run frequency distributions for P4 and P5.  Some of you have used SPSS, the statistical package we're using, and know how to get a frequency distribution.  Others of you are new to SPSS.  There is a tutorial that you can use to learn how to get a frequency distribution.  The tutorial is freely available on the Social Science Research and Instructional Center's website.  Chapter 1 of the tutorial gives you a basic overview of SPSS and frequency distributions are covered in Chapter 4. 

Write a paragraph or two describing what these distributions tell you about political party preference and political views in the U.S. Be sure to use the valid percents in your answer.  If you need more information on getting the frequency distributions in SPSS and interpreting them, review Exercise_1CR. 

Part V – Comparing the Two Religions

Now we're going to compare the two religions that you chose in Exercise_1CR.  This represents a shift from what we typically call univariate (i.e., one-variable) analysis to bivariate (i.e., two-variable) analysis.  Frequency distributions look at variables one at a time.  Crosstabulation looks at variables two at a time.

The statistical tools that we're going to use are crosstabulation, Chi Square, and measures of association.  We're not going to go into a lot of detail about these tools.  Your instructor will provide that information.   We will talk briefly about how to get SPSS to compute them and how to interpret them. 

Before we use crosstabulation we need to talk about independent and dependent variables.  The dependent variable is whatever you are trying to explain.  In our case, that would be political party preference.  The independent variable is some variable that you think might help explain why some people are more likely to identify with a particular political party.  In our case, that would be whichever variable we used to select the two religions we want to compare. 

To run a crosstabulation in SPSS click on "Analyze" in the menu bar at the top of the screen.  Now click on "Descriptive Statistics" in the drop-down menu and then on "Crosstabs."  (See Chapter 5, Cross Tabulations, in the online SPSS book mentioned earlier.)   Your screen should look like Figure 1. 

Title: Figure 1 - Description: This is the SPSS dialog box for Crosstabs.

Figure 1

As an example, I'm going to compare Lutherans in the Evangelical Tradition with Lutherans in the Mainline Tradition and use RBH1 as my measure of religious behavior.  In order to do this I selected all respondents who were value 4 (i.e., Lutherans in the Evangelical Tradition) and value 37 (Lutherans in the Mainline Tradition) on variable R4.[3]  (See Exercise_1CR for an explanation of how to select out particular respondents.)

To make sure that I did this correctly, I ran a frequency distribution for R4.  It should only include respondents in those two religious groups which is what the SPSS output shows in Figure 2.

Title: Figure 2 - Description: This is the SPSS  output showing the frequency distribution for R4 after selecting out values 4 and 37 on R4.

Figure 2

To run a crosstabulation, you're going to put your variables in the "Row(s)" and "Column(s)" boxes by clicking on the variable in the left-hand pane to select it and then clicking on the arrow that points to the right.  When you do that, the arrow will change so it points left.  If you click on it again, it will move the variable back to the left-hand pane.  That way you can correct errors you would make when you select the wrong variable.

But which variable goes in which box?  We're going to put the independent variable in the column box and the dependent variable in the row box.  Since we're trying to explain why some people are more likely to identify with a particular political party, we'll put our measure of political behavior (i.e., P4) in the rows and whichever variable you used to select the two religions in the columns.  In my example, that would be R4.  Your screen should look like Figure 3.

Title: Figure 3 - Description: This is the Crosstabs dialog box with R4 in the columns and P4 in the rows.

Figure 3

Since your independent variable is in the columns, you want the column percents so click on the "Cells" button and check the box for the "Column" percents and then click on "Continue."  Now click on the "Statistics" button and check the boxes for Chi Square and Kendall's tau-b and then click on "Continue."  (We'll discuss these statistics in a little bit.)  Your screens should look like Figure 4 and 5.

Title: Figure 4 - Description: This is the Crosstabs: Cell Display dialog box with column percents selected.

Figure 4

Title: Figure 4 - Description: This is the Crosstabs: Statistics dialog box with Chi Square and Kendall's tau-b selected.

Figure 5

Now all you have to do is to click on "OK" and you should see your output.  Since the column percents sum down to 100, you should compare the percents straight across.  Always compare the percents in the direction opposite to the way they sum to 100. 

How would you describe your findings in a report?  Think of writing two sentences.  The first sentence should describe the pattern without using numbers.  The second sentence should use the percents to illustrate the pattern.  So you might write something like this.  "Evangelical Lutherans are more likely to identify with the Republican Party while Mainline Lutherans are more likely to identify with the Democratic Party.  For example, 59.7% of Evangelical Lutherans identified with Republican Party or leaned toward the Republicans, while only 44.6% of Mainline Lutherans identified or leaned toward the Republican Party.  However, 42.7% of Mainline Lutherans identified or leaned toward the Democratic Party compared to only 27.8% of Evangelical Lutherans.  Approximately equal percents of Mainline and Evangelical Lutherans were true independents that didn't lean either way."

What about Chi Square?  Chi Square is a test of significance that tests the null hypothesis that the two variables are unrelated to each other.  In statistical speak, we would say that the null hypothesis is that the variables are statistically independent.  Chi Square tests this null hypothesis and tells you whether you should reject or not reject it.  If you can reject it, then you have evidence that the two variables are related to each other.  If you can't reject it, then you don't have any evidence of such a relationship.

To interpret Chi Square in your output, look at the first row for "Pearson Chi Square" and the column for "Asymptotic Significance."  In your output, it should read ".000".  This is the probability that you would be wrong if you rejected the null hypothesis.  It's actually not 0, but rather it is less than (<) .0005 since it's a rounded value.  That tells you that it's very unlikely that this is a chance relationship.  There probably is some relationship between these two variables.  Our rule is to reject the null hypothesis when the significance value is < .05.  In other words, when the probability of being wrong is less than five out of one hundred.

A measure of association is a statistic that measures the strength of the relationship.   The Chi Square test doesn't tell you anything about the strength of the relationship.  You need a measure of association to do that.  There are many different measures of association.  For our measure of association, we used Kendall's tau-b.  Tau-b can be used when both of your variables are ordinal.  Ordinal means that the categories have an inherent order to them.  In other words, they are ordered from high to low or from low to high.  In our example, tau-b is .152 which means that there is a weak relationship between the two variables.  Measures of association are most useful for comparing the strength of the relationship in two or more tables.

Part VII – Now It's Your Turn

Decide which two religions you want to compare and select out the respondents in these two religions.  Check to make sure that you did this correctly by running a frequency distribution for the variable you used to select out the two religions.  Run the appropriate crosstabs to see if the two religions differ in terms of political behavior.  Use P4 and P5 as your measures of political behavior.  This will give you two separate tables.  Be sure to get the column percents, Chi Square, and Kendall's tau-b for both crosstabs.

Write one paragraph describing your findings for each of the two measures of political behavior.  Follow the approach I described above by writing two sentences.  The first sentence should describe the pattern without using numbers.  The second sentence should use the percents to illustrate the pattern.  Be sure to use the column percents, Chi Square, and Kendall's tau-b in your answer. 

 


 

[1] This assumes that the proper associations have been set up on your computer so the computer knows that .sav files are SPSS data files

[2] SPSS allows you to change the way your output is displayed.  You can change these preferences by clicking on "Edit" in the menu bar at the top of the screen and then clicking on "Options" and finally on the "Output" tab.  Under "Variables in item labels shown as" select "Names and Labels" and then under "Variable values in item labels shown as" select "Values and Labels."  Then click on "OK."  You can also try out other options.

[3] Exercise_1CR discusses what we mean by these different religious traditions and gives you links to articles providing more information.