Levi Martin Sociological Methodology
Levi Martin Sociological Methodology
Levi Martin Sociological Methodology
Sociological Inquiry
Sociology 30002
University of Chicago
Graduate Class: Winter 2012
John Levi Martin
Course Description
How do you make knowledge in sociology? That’s what this class is about. We are going to
look at issues of research design and process while also exploring the diversity of methods of
sociological analysis. Further, we will be doing this in a way that helps you work towards an
original research paper. But we will do so in a way that forces you to look at your question from
multiple angles.
As a result, we will be doing three sorts of things in this all-too-brief quarter. We will be reading
a bit about, and discussing, general issues of research design. We will be reading exemplary
works using different sorts of methods. We will be doing exercises related to our question,
trying out different methods and seeing what kinds of things we can learn using them. I hope
that at the conclusion you understand (1) how to choose a sociological research project that will
not be a dead end; (2) how to choose a method that will help you answer your questions and will
also be fun for you; (3) how to critically evaluate the presentation of evidence in support of
theoretical claims.
Structure
Now it has become typical in these sorts of courses to assign readings about different aspects of
the research process. So Prof. X. writes an article about “sampling” and gets it published, I make
you guys read it, and so everyone but you is happy. X got a publication, and I avoided preparing
anything and teaching you. But such pieces are generally dry as toast. So instead, I will be
going through different themes in a more lecture-y way. That is, on different days I will not only
be talking about certain methodological approaches, but how this helps us think about some of
the key issues in research that cut across methods.
If you need to eat, please make sure that you bring enough for everybody. All entering food will
be split 15 ways, with the exception of life-sustaining beverages or power bars for pregnant
people of any gender.
2
Regarding every method I will have something prepared regarding 1) what is distinctive about a
certain method, its advantages and disadvantages; 2) who uses these methods and why; 3) how
the common methodological themes play out here; 4) how the works we read illustrate the
methods. Then we will discuss the works in question, paying attention to 1) do the methods
work? 2) were the methods done well? 3) do the methods match the questions? 4) do we see
advantages or disadvantages to the method come out in the examples?
I will also be returning to the key analytic issues that I think are common to sociological
research; I will be trying to make use of the strengths of different readings, so that we will be
able to think things we couldn’t have guessed at the beginning of the class. I will tend to front
load these on the “1” parts of units.
Finally, every week I will give a “tip for the week”—a little handy piece of wisdom that could
save you a few years of wasted effort.
Requirements
1) Active attendance. That means (a) coming prepared (doing “all” the reading); (b)
discussing the works and the results of the exercises.
2) Writing up weekly musings on the reading (i.e. you are to keep a journal in which you
critically analyze the methods as they whizz past). We’re talking just a two-page reaction
to the readings: you need to do one for all the classes where you see the charming “”
icon. This means that your reaction paper is due 5:00 the day before this class, on the
major reading for this day. They can be placed in my box or electronically submitted.
3) Completion of exercises. You will have to carry out a number of projects that contribute
to the fleshing out of your question and the formation of a research proposal at the end.
You should thus be working on your final paper, in different ways, all through the class.
It may be that portions of (some of) your exercise(s) can be incorporated in your final
research proposal, although it might be that they only are food for thought. But do not
leave the entire proposal for the last week of class!
YES, there are a lot of books to read, and the price adds up too. But a small investment in terms
of the development of a methodological sense repays itself a thousand fold. As they say. The
following books are going to be at the Seminary Co-Op book store. If you can’t afford them,
you can probably squeeze by using the library and borrowing from other people, but talk to me.
Every one of these books is something any sociologist should have anyway. All the other things
will appear a bit before they are assigned on CHALK; if that doesn’t work for you let me know.
Also, the recommended readings given below are to get anyone started who wants to pursue one
method in greater detail. They are a combination of classics and personal favorites.
3
Speaking of reading each and every one, in case I forget to say it the first day, I am aware that
some weeks the amount of assigned reading exceeds reasonable expectations even for graduate
student rite-of-passage overload. When the reading is huge and multiple, it is quite acceptable to
focus on a subset of the works, but to try to familiarize yourself with the methods and arguments
of the others. Where we read a large book, I will usually suggest parts to concentrate on, but if I
don’t, read selectively if you must, so as to focus on the methods, argument, and connection of
the two.
Required Books:
Making It Count by Stanley Lieberson $15.95
Street Corner Society by William Foote Whyte $14.95
The Fabrication of Labor, by Richard Biernacki—approx $22.00; note this is out of print
but available through the interweb as an e-book from U of C Press.
The Abolition of Feudalism by John Markoff, $29.95.
Money, Morals, and Manners by Michele Lamont $12.95
Forgive and Remember, by Charles L. Bosk $18.00
Here is the overview of the analytic plan of the class: after this I’ll go through things in more
detail with readings and dates and all that.
I. RESEARCH DESIGN I
Basic do’s and don’t and wills….I will outline the main repeating themes. The class is
not organized to follow these, but I indicate in the bigger part of the syllabus where these
themes re-appear for reconsideration.
A. Concepts
1) What are Theories? (Revisited IV1).
2) What is real, what can act? (Revisited IV1).
3) Operationalization (revisited IIIA1).
4) Relations between concepts (Revisited V2).
5) Objectivity vs. bullshit (Revisited IIB2)
C. Other Regularities
1) Mechanisms (Revisited IIIA2).
2) Patterns (Revisited IIA2).
3) Subsumptions; this is a case of…? (Revisited VIA1).
4) Floors, ceilings and regressions-to-the-mean (Revisited IIIB1).
4
E. Measurement
1) Quantities and Qualities. (Revisited IIB1).
2) What is Measurement? (Revisited VIA2).
3) What is a Variable? (Revisited VIB2).
4) Validity and reliability (Revisited VIB2).
5) Indices (Revisited VIB2).
F. Designs
1) Testing Theories and other Fast Tracks to Unemployment (Revisited VIB1.)
2) Impossible Case (Revisited VIB1.)
3) Loaded Comparison (Revisited IIIB1).
4) Grudge Match (Revisited VIB1.)
5) Synthetic Cohort and Kin (Revisited IV2).
6) Causes of Effects and Effects of….? (Revisited IIIA2),
Schedule of things that will happen because you make them happen….
5
OK, now for the details, with readings and dates! And assignments! Note that a means that
your reaction paper is due 5:00 the day before this class, on the major reading for this day. A
means that a bigger paper is due this day or the next. Since this whole icon thing is going so
well, two more: a Ɗ
Ɗ means that this comes from the author’s dissertation project; a ₵
₵ means
means that the dissertation never made it past the defense,
that this was done at Chicago, a
means that the person’s career was effectively over at this point, and a means that s/he
became the unibomber. Don’t let this happen to you! Learn the proper methods of sociological
research! It’s included free with your tuition this quarter!
I. RESEARCH DESIGN I
1) A Conversation About Theory? Can we go over what we have learned about The
Logic of Sociological Methods: Selective abstraction; Conventional ways of thinking
about sociological explanation. Variables, Cause and Effect, Deduction, Testing,
Sampling. We will talk about some of the common issues and how we will be
looping back to them over time (Wednesday, January 4).
BEGIN Question Writing: For next time, you need to propose a sociological question that
will be your focus of investigation for this quarter. It is expected that this will be the core of a
paper that you are planning to write, though it is not unusual for the progress of this class to
lead you to fundamentally revise your question. This question should be posted on CHALK
in the blog area, which I am pretty sure I successfully created. This should be NO MORE
THAN ONE PAGE. It should have NO REFERENCES. A question is something that (1)
seems like it might have an answer; (2) but this answer is, so far, at least to you, unknown. It
is not the same thing as an interest, an illustration, or even a test.
Due Monday, January 10, by 9:00 AM! If you can, please get your questions in sooner
so we can start our discussion of them! Please read over each other’s questions, and be
ready to discuss them on Monday.
6
2) Do you want to stick with what you have, or try for what’s behind curtain number
three? (Monday, January 9)
Further recommended reading: You know, let’s hold off on the critical stuff for a
while. It’s easy to get discouraged. But I do recommend Lieberson’s later article,
“Modeling Social Processes: Some Lessons from Sports” (Sociological Forum
12[1997]:11-35. There are also some books on sociological methodology that are
collections of insight and wisdom and all that. The best I’ve read is Howard
Becker’s Tricks of the Trade, but there are too few tricks per column inch to justify
assigning it. Also, a great collection on sociological methodology—the hows, whys,
and is-it-okays, (I’m sure long out of print, otherwise I would have assigned it) is
Fist-Fights in the Kitchen edited by George H. Lewis. Regarding the issues
Lieberson raises, a recent volume: Causality in Crisis, edited by Vaugn McKim &
Stephen Turner (U of Notre Dame) might prove helpful. Certainly John Goldthorpe’s
On Sociology has a very compelling critique. For nice polemics about use and
misuse, see Joel Best’s Damned Lies and Statistics and More Damned Lies and
Statistics.
Ɗ
Ɗ₵₵
, Required Reading: Charles L. Bosk, Forgive and Remember ; Blau,
Ɗ
Ɗ
The Dynamics of Bureaucracy, 1-15, 183-206, 269-303*.
B. And Butt In
1) Watching, playing, asking, walking and so on (Monday, January 23). Here we
revisit IE1.
Ɗ
Ɗ₵₵
Required Reading: William. H. Whyte, Streetcorner Society , Intro, Ch 1,
Ch 5, Conclusion, Appendices A and B, Whyte, “Revisiting Street Corner
₵₵
Society”; Mitchell Duneier, Sidewalk, Intro, Appendix. (I’m going to assume
you either have this or will read it all anyway, so it’s ordered, but we’re only
going to talk about the Appendix today….)
Not required but available and I’ll briefly mention: You may look at Harriet
Whitehead, Renunciation and Reformulation, selection*--it’s one of my favorite
examples of ethnography, but it’s hard to get from this excerpt.
Another truly great work is Chicago PhD Mitchell Duneier’s Sidewalk, which has
a very important methodological discussion; also take a look at Sudhir Venkatesh,
ƊƊ₵₵
American Project ; his Gang Leader for a Day has an admirable discussion of
some of the ethical/methodological problems we will return to next class. A great
tradition of community studies, reaching from Lloyd Warner to Michael Bell
Ɗ
Ɗ
(Childerly ) should be looked at, but here the methods are generally less visible.
Ɗ
Ɗ
Benajmin Zablocki’s Joyful Community is an interesting twist on this take.
Another Chicago PhD, Loïc Wacquant (Body and Soul), proposes a new kind of
carnal ethnography—another recent example here is Matthew Desmond, On The
Fireline (an MA thesis that became a book). I think another of the all-time great
examples of participant observation is Martin Sanchez-Jankowski, Islands in the
Street.
9
2) What Can you do with Data? (Wednesday, February 1). Here we revisit IC1
and IF6.
Ɗ
Ɗ
Required Reading: The Fabrication of Labor , by Richard Biernacki.
12
Note: this reading is currently (and inexcusably) out of print, but if you can’t
find a used copy, UC Press has it in e-book form for free at…
http://ark.cdlib.org/ark:/13030/ft8g5008n9/
BEGIN Exercise: “Choosing a Site.” There are two variants for this—ethnographic and
historical, depending on whether your question refers to something going on now, or
something in the past. First, you need to translate your question as closely as possible to a
form that can allow for a historical or ethnographic exploration. Then conduct one of the
following exercises:
Ethnographic Variant: Choose a site and do observations. You may, if necessary, select a
site in which you are simply observing people, or one to which you have pre-existing ties, but
far, far, better will be participant-observation in a previously unfamiliar site, one chosen
because of theoretical interest. Write up the results as follows: 1) did you have a hypothesis
or hunch when you began? If so, what was it? If not, why did you pick the site (and here,
“convenience” is deadly!)? 2) What did you find that was interesting? 3) If you had a
hypothesis or question, was it addressed by what you found? If so, what is the result? 4) If
you didn’t have a hypothesis or question when you began, did you get one after the fact?
What is it? 5) Ethnographers in contrast to other sociologists are permitted to reflect upon
their research in each and every work. Tell about your personal experience as it relates to
your conclusions: did you feel phony? Did you establish rapport? Are you confident that
people were telling you the truth? Did you have main informants?
For either of the variants, if this is the method you are planning to propose to answer your
question, how might you now revise your question? If this is not the method that you would
propose, how has it altered your understanding of the relation between questions and
answers?
Required Reading: Emile Durkheim, Suicide, [41-46], 46-52, 104-122, 152-160, 171-
202 (especially), [208-216], [246-258], 259-276 (especially). Note that it is assumed
that students have read much of Suicide for their theory class. The assigned page
numbers are to brush up on the methodological aspects. Those who have not already
read Suicide should add the page numbers in brackets.
2) What can official statistics tell us? (Wednesday, February 15). Here we revisit IF5.
, Required Reading: Gerald Marwell and Ruth E. Ames, 1979, “Experiments
on the Provision of Public Goods I” American Journal of Sociology 84: 1335-1360*;
“Experiments on the Provision of Public Goods II”, AJS 85: 926-937*; Delia
Baldassarri and Guy Grossman, “Centralized Sanctioning and Legitimate Authority
Promote Cooperation in Humans,” Proceedings of the National Academy of Sciences,
108(27; 2011):11023-11027.*
15
Note: If a more recent piece by Baldassarri and Grossman comes out, I may
substitute this.
Required Reading: Helen Rose Fuchs Ebaugh, Becoming an Ex, 1-3, 25-40,
62-65, 87-89, 97-103, 124-129, 139-143 and Appendix B (213-224) **,
2) To whom does one talk? (Wednesday, February 29). Here we revisit IE2.
BEGIN Exercise: Making Data. There are again two variants of this exercise.
In-Depth Interviewing Version: Think of a question that you might be able to answer by
asking people. And not a whole bunch of people, just some. Who would you interview?
How would you get this information? Do two in-depth interviews. The first should be with
someone who is not a sociologist. I understand you’ll probably have to hit on someone you
know pretty well, but the more distant the better. For the second, interview someone in the
class (I will assign your interviewee from among the other students choosing the interview
variant). For both, try to get the information you want to answer your question. (I suggest
you tape record the interview, unless you are an expert note-taker. Give yourself an hour or
so for each interview.) When you’re done, write up your report as follows: 1) the question or
hunch; 2) whom you would interview if this was a real project; 3) whom you actually chose
to interview; 4) how you think the interview went; 5) what you learned. Do you think you
could answer your question with more of these interviews? Give snippets. NOW ATTACH
A SECOND PART—tell me about the interview in which you were the subject. Did you
think it went well? Did the questions make sense? Did the interviewer establish rapport?
Did they get information that was misleading? Did you ever withhold information or lie?
Did some questions ask too much from you in cognitive terms?
Experimental Version: Take your question and consider some aspects that might seem most
difficult to answer using the method(s) previously tried. Write a proposal that would suggest
how an experimental approach could be used to answer these questions. Describe it in
detail—say who are the subjects, what are the procedures, how are the data collected, how are
they analyzed, and defend your claim that what is measured in the experiment is the same as
whatever you were talking about in your theoretical question.
2) How do you make surveys? (Wednesday, March 7). Here we revisit IE3-5.
Required Reading: Edward O. Laumann et al, The Social Organization of
Sexuality, 35-71, 96-118, 124-133, 606-608, 622-649, 670-677*, Paul M.
Sniderman and Edward G. Carmines, Reaching Beyond Race, 11-14, 37-53*,
BEGIN Final exercise. Write a research proposal for your question. It should be as clear as
possible regarding: (1) what your question is; (2) why it is reasonably important; (3) how you
plan to study it (what general methodological approach); (4) your choice of site or data
source; (5) your choice of methods and proposed line of investigation; (6) possible problems
that you are likely to run into.
Remember:
1. Clarity and specificity above all else. You have a good proposal when you can die
right now, and your executors can still write this one up.
2. Even if you’ve already begun your project, take this seriously—re-think what your
question is. What would be the best way to answer it? Don’t try to sell what you have
in your hand if you realize there could be something better.
3. Feel free to use portions of your earlier exercises, word for word if appropriate.
That’s what they were all about.
ADDENDUM:
What else do you need to write a great sociological paper or book besides all the work? Maybe a
bit on how to phrase your argument. This brings us to the art of rhetoric, for which I do not have
time in this quarter. There are conventions of presentation and argumentation which are
necessary (though not sufficient) for scholarly communication in sociology. I suggest that you
take a look at the followings: Bruno Latour and Steve Woolgar, Laboratory Life; Latour,
Science in Action, Charles Kurzman, "The Rhetoric of Science: Strategies for Logical Leaping,"
Berkeley Journal of Sociology, Vol. 33, 1988, pp. 131-158; Donald McCloskey, The Rhetoric of
Economics, Michael Lynch, “Pictures of Nothing? Visual Constructs in Social Theory”
Sociological Theory 9 (1991):1-21 has a nice analysis of the rhetoric of visual presentation.
Bruno Latour, in “Visualization and Cognition” (Knowledge and Society 6:1-40) stresses the
importance of distilling complexity into visual form so as to triumph in agonistic encounters with
competing would-be truth-tellers. And in fact, in his Pasteurization of France, he has some great
examples of this, but not for sociology. You also might want to look at Alvin Gouldner’s
explanation for Talcott Parsons’s rhetorical style in The Coming Crisis in Western Sociology.
There is a growing body of explicit work on rhetoric and/in sociology. In the Hunter edited
volume, The Rhetoric of Social Research, you might want to look at James Bennett’s analysis of
the rhetoric of Merton’s paper on anomie; in the same volume Kai Erikson has a nice and
reasonable discussion of the pros and cons of scientific-y voice. (Which reminds me of Ira
Cohen’s analysis of “Voice as Method,” comparing the rhetorical strategies of Goffman and
Garfinkle.) Other things I haven’t read: Richard H. Brown, A Poetic for Sociology, Ricca
Edmondson, Rhetoric in Sociology, and Andrew Weigert, “The Immoral Rhetoric of Scientific
Sociology”, American Sociologist 5(1970):111-116.