TU-L0040 Advanced Statistical Research Methods 2021
TU-L0040 Advanced Statistical Research Methods 2021
TU-L0040 Advanced Statistical Research Methods 2021
1 John Antonakis, Nicolas Bastardoz, and Mikko Rönkkö, “On Ignoring the Random-Effects Assumption in Multilevel Models:
Review, Critique, and Recommendations,” Organizational Research Methods forthcoming (2019),
https://doi.org/10.1177/1094428119877457.
3 PARTICIPATION AND SIGNING UP
This course is targeted to students who have completed TU-L0022/JSBJ1310 Statistical
Research Methods and want to deepen their understanding of quantitative research methods.
Faculty or students from other universities are admitted if space permits.
Aalto students can sign up for the course using Oodi. Student without Aalto user account can
sign up through MyCourses using the following URL and the enrolment key ASRM2021 (in
capital letters):
https://mycourses.aalto.fi/enrol/index.php?id=33652
4 LEARNING OUTCOMES
The main goal of the course is to provide an overview of most commonly used data analysis
techniques and research designs that go beyond cross-sectional designs and simple linear models.
Instead of just explaining how the methods are used, we focus on why certain methods are used
and how and why these methods work. We will also learn to interpret methodological evidence
and go over basics of doing simulations to test or validate methods.
Completing the 6-credit base module will introduce you to the logic of structural equation
models, generalized linear models, longitudinal data analysis, missing data, advanced
measurement concepts, and endogeneity and causality.
The optional written assignments are more challenging and recommended only for those who
plan to use the methods and designs covered in these assignments in their own research.
5 WORKLOAD
TO BE ADDED2. If you want to complete all mandatory and optional assignments on the course,
you should book at least a day per week for the duration of the course.
2 Asko Karjalainen, Katariina Alha, and Suvi Jutila, Anna Aikaa Ajatella: Suomalaisten Yliopisto-Opintojen Mitoitusjärjestelmä
(Oulun yliopisto, opetuksen kehittämisyksikkö, 2007).
Principles Study the topic Watch videos and read a book. Can be done Test in TEL environment. Immediate feedback
(factual knowledge) alone. anytime, but preferably well before the next step. (correct answers and points).
Practice Group meets to Assignments in TEL environment: conceptual TEL environment offers immediate feedback
(conceptual knowledge) practice using questions, simulations, numerical exercises, (correct answers and points; group members
the principles short problems, and reflective assignments that present in the meeting share the same points).
and concepts. support collaborative inquiry-based learning.
6 COURSE CONTENT Group can meet anytime and anywhere.
The teacher is not present.
The course consistsApply
Problems of athepre-exam, readings
concepts Solve andalone
physics problems written assignments,
or collaboratively. data TEL
After deadline, analysis
environmentassignments,
reveals correct
(procedural knowledge) in full-scale Reinforce explicit problem-solving skills. solutions. Students grade and correct their
video lectures, online interactions,Teacher
problem-solving. seminar
support sessions,
available when computer
needed. classes, a Monte
solutions based on givenCarlo project,
criteria. Teacher
and final exam. All assignments are distributed and returned
Solutions (e.g., scanned papers) are submitted
to TEL environment by a deadline.
through Aalto MyCourses
verifies corrections and gives feedback.
where
online
Primetimeinteractions also
Students take place.
and the Group meets teacher privately to discuss Teacher gives oral feedback for the group and
(metacognitive knowledge) group receive remaining problems and to reflect upon each student personally.
https://mycourses.aalto.fi/course/view.php?id=33652
personal support learning difficulties.
from the teacher.
The course is structured as ten units that are completed sequentially. Unit 1 is a preparatory unit
Units 2-8 are the main units, and Unit 10 is the course conclusion with student presentations and
have better chances to address individual needs. Although Step 3. Problems: Full-scale problem-solving
final exam.
the teacher is absent, TEL environments can adopt some After the principles are known and rehearsed under the
of the teacher’s routine work (Bell et al. 2010; Maloney guidance of TEL environment, students proceed to solve
The main units follow primetime learning model3, modified to fit the course. In the primetime
2011; Wagh et al. 2017). Precious contact time with full-scale problems, as familiar from traditional course
learning model,
teachers, as each
discussed unit
later, willhas fourindifferent
increase later stepssteps: principles,
of designs. practice,
The emphasis problems
is on proceduraland primetime
understanding,
astheshown in Figure 1. The learning model is explained
study process. duringrealistic,
on analyzing the first seminar but
context-rich participants
problems, and on
Principles and practices can also repeat twice before
are encouraged to read the article by Koskinen and coauthors to familiarize themselves withmay
applying the concepts in realistic settings. Problems the
proceeding to the following steps. Such an arrangement be adopted from textbooks, but they should explicitly
model.
helps to balance study load and to lessen the amount of teach problem-solving skills and go beyond mere symbol
material
Figure per session. learning (Koskinen et al, 2018)
1 Primetime manipulation. The problems can also be based on the
Fig. 2 Primetime learning model with the four-step study process: principles, practice, problems, and primetime. Formative assessment underlies the
entire process and motivates students to perform activities that also directly affect the grade. This drawing is a succinct summary of the primetime
model (drawing courtesy of Linda Saukko-Rauta)
Principles is the first step of a unit. During this step, the students receive a set of readings and
video materials that they study independently. Written assignments are also completed and
returned individually during this step.
After the students have studied the principles individually, we discuss them as a whole class.
These discussions start on the course forum where possible questions and thoughts that the
material raises are discussed. Thereafter, we will meet for a seminar for further discussions.
For the practice and problems steps the students are assigned into groups. Each group can decide
on their own work practices and schedules, but share the same deadline for submitting the data
analysis assignment.
Practice is when work on the data analysis assignment starts. The students should work on the
assignment alone and complete those parts that they can. The assignments are challenging and it
3 Pekka Koskinen et al., “Primetime Learning: Collaborative and Technology-Enhanced Studying with Genuine Teacher
Presence,” International Journal of STEM Education 5, no. 1 (December 2018), https://doi.org/10.1186/s40594-018-0113-8.
is not expected that students can complete them alone within a reasonable time. The purpose of
this step is to gain experience on the use of statistical software and looking for information and
solutions to problems online – both essential skills for an advanced quantitative researcher. The
course forum can be used for general questions (e.g. which multilevel package for R is the best)
but troubleshooting of problems should be done in the next step.
Problems step follows the practice step. In this step, the students meet with their groups,
compare their answers to the data analysis assignment and try to solve problems that they had
together. There is no traditional computer class but the teacher is available through
WhatsApp/Signal hotline and guidance can be arranged over Zoom as needed. After working on
the assignment together, the students prepare one submission and everyone in the group receives
the same grade. The purpose of this part is to provide peer support and learn how to solve data
analysis problems as a research team. More advanced students should also gain experience in
instructing others, which is a useful skill to have when you move to a position where you need to
instruct and supervise junior researchers such as doctoral students.
Primetime takes place after the group has submitted all the work. After viewing the model
answers, each group schedules a Zoom meeting with the teacher to discuss their work and the
challenges that they faced during the unit.
Detailed descriptions of the elements of the course are listed below:
4 e.g., Herman Aguinis and Robert J. Vandenberg, “An Ounce of Prevention Is Worth a Pound of Cure: Improving Research
Quality Before Data Collection,” Annual Review of Organizational Psychology and Organizational Behavior 1, no. 1 (2014):
574, https://doi.org/10.1146/annurev-orgpsych-031413-091231.
6.7 Online interactions (mandatory)
Each unit contains mandatory online participation in the form of course forum discussion. At the
beginning of each unit, the students are assigned the materials for that unit including readings,
assignments, and video content. After a few days of familiarizing with the content, students are
expected to post a question or a comment about the materials on the course forum. These
questions and comments are then discussed online with the course instructor. To pass an online
interaction session, a student must either start at least one discussion thread by posting a question
or comment or reply to at least one thread started by someone else. Participation is graded.
Detailed instructions for how to participate online are delivered by email when the course forums
open.
5 Leah J Welty et al., StatTag (Chicago, IL: Galter Health Science Library, 2016), https://doi.org/10.18131/G36K76.
Mediation is introduced in more detail including estimation of models with endogenous
mediators.
We discuss further instrumental variable techniques including estimation of instrumental
variable models with ML SEM, generalized method of moments (GMM), and two-stage least
squares. Tests for endogeneity, weak instruments, and instrument exclusion are introduced as is
the concept of plausible exogeneity.
Computer tools:
This unit introduces two new tools: matrix algebra and numerical optimization. Understanding
the basics of matrix algebra is useful for two reasons. First, many texts on quantitative methods
that go beyond introductory level use matrix notation if not in full then at least in part. If you
understand how to read matrix equations and what these equations mean, this will make it easier
to study these sources. Second, if you are generating datasets yourself, doing that with matrix
equations instead of writing a separate (scalar) equation for each variable is much more
straightforward. The introduction covers the topics of matrix sums, matrix multiplication,
inverse, and determinant.
Every statistical model addressed on the course is estimated by minimizing and objective
function. While some techniques, such as least-squares regression, has a closed from solution
which can be simply calculated by applying algebra to the data, most other techniques do not. In
these cases, the estimates are obtained by numerically minimizing or maximizing the objective
function. This unit covers the basics of numerical optimization and how gradient vector and
Hessian matrix are used in this process and can be used for troubleshooting non-convergent
models.
Readings:
Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). New York,
NY: Guilford Press. (Chapters 1, 5-8, 153 pages)
Lu, G., Ding, X. (David), Peng, D. X., & Hao-Chun Chuang, H. (2018). Addressing endogeneity
in operations management research: Recent developments, common problems, and directions for
future research. Journal of Operations Management. https://doi.org/10.1016/j.jom.2018.10.001
Empirical examples:
Bergh, D. D., Aguinis, H., Heavey, C., Ketchen, D. J., Boyd, B. K., Su, P., … Joo, H. (2016).
Using meta-analytic structural equation modeling to advance strategic management research:
Guidelines and an empirical illustration via the strategic leadership-performance
relationship. Strategic Management Journal, 37(3), 477–497. https://doi.org/10.1002/smj.2338
Hekman, D. R., Aquino, K., Owens, B. P., Mitchell, T. R., Schilpzand, P., & Leavitt, K. (2010).
An Examination of Whether and How Racial and Gender Biases Influence Customer
Satisfaction. Academy of Management Journal, 53(2), 238–
264. https://doi.org/10.5465/AMJ.2010.49388763
Eshima, Y., & Anderson, B. S. (2017). Firm growth, adaptive capability, and entrepreneurial
orientation. Strategic Management Journal, 38(3), 770–779. https://doi.org/10.1002/smj.2532
Optional readings:
Cortina, J. M., Green, J. P., Keeler, K. R., & Vandenberg, R. J. (2017). Degrees of Freedom in
SEM: Are We Testing the Models That We Claim to Test? Organizational Research
Methods, 20(3), 350–378. https://doi.org/10.1177/1094428116676345
Kline, R. B. (2015). The mediation myth. Basic and Applied Social Psychology, 37(4), 202–
213. https://doi.org/10.1080/01973533.2015.1049349
Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R. (2010). On making causal claims: A
review and recommendations. The Leadership Quarterly, 21(6), 1086-1120.
doi:10.1016/j.leaqua.2010.10.010
Ketokivi, M., & McIntosh, C. N. (2017). Addressing the endogeneity dilemma in operations
management research: Theoretical, empirical, and pragmatic considerations. Journal of
Operations Management, 52, 1–14. https://doi.org/10.1016/j.jom.2017.05.001
8 GRADING
All submitted work will be graded between 1-5 and your grade will be a weighted average of the
parts of the course that you completed.
Course part Weight Notes
Pre-exam 5
Seminar and 1 each By default, you will receive 2 for posting something on the
forum (total 9) course forum or being present at a seminar and your grade
participation will increase based on your participation
Final exam 16
Assignments 1 each 8 data analysis assignments, 8 written assignments, 1
(total 17) methodological article presentation.
Project 3 1 Monte Carlo project presentation
Total 50
9 COURSE MATERIAL
The reading materials for the course are distributed through the Zotero reference management
system. To get access to the materials:
1. Create a user account at Zotero.org
2. Email your username to the course instructor
3. The course instructor will send you an invitation to a group library, which you need to
accept.
After you have accepted the invitation, you can access the material either online with a web
browser or by installing the Zotero software on your computer. See the MyCourses page for
information.
9.1 Books
To be added.
XX pages total.
9.2 Articles
To be added.
XX pages total.
9.3 Empirical articles used as examples
To be added.
XX pages total.