Schedule: words in a haystack
This schedule is subject to change.
Assignments are due at the end of their due date (midnight).
Readings can be done either before or after class; they are chosen to support the material covered in class.
Aug 27: Introduction
Counting politicians' words: SOTU addresses over the years, SOTU pronouns, more presidential pronouns, presidential pronouns again (There was also at some point a nice tally of the rate at which different candidates particular words and parts of speech, but it has disappeared. Tell me if you find it.)
Sep 1: Getting started with R
Sep 3: Inspecting and visualizing data
Continuing on the worksheet
ALD ch. 2
Sep 9: Descriptive statistics: central tendency and spread.
Readings: SE chapters 2
For computing the mode of a sample, see the R code snippets page
Do women talk more than men do? Here are some relevant Language Log posts:
Sep 11: Descriptive statistics continued
Sep 15: Invited talk: Statistics in practice
Sep 17: Invited talk: Statistics in practice
Homework 1 due
Sep 22: Obtaining your data: Getting text into R
Sep 24: Obtaining your data, continued
Sep 29: Probability distributions.
Readings: SE ch. 3, ALD ch. 3 pp. 44-63
We talk in class about your project ideas
Oct 1: Probability distributions continued. Samples and populations.
Oct 6: Statistical tests: the basic principle; significance thresholds. Also: starting on the t-test
Readings: SE ch. 4,5, 6
Homework 2 due
Oct 8: The t-test, continued. Also confidence intervals
Initial project descriptions due
Oct 13: Comparing more than two data sets: ANOVA
Pitfalls of statistical analysis: The problem of multiple testing https://xkcd.com/882/
Readings: SE ch. 11, 12
Oct 15: Correlation and linear regression
Readings: SE ch. 20, 261-70
And another note on correlation and causation: "Nobel prize winners eat more chocolate"??
Oct 20: more linear regression
Readings: ALD ch. 4 pp. 84 - 10; SE rest of ch. 20, ch. 21
Oct 22: Logistic regression
Nov 3: Practising linear and logistic regression
Nov 5: Statistical testing: chi-squared
Readings: SE ch. 19
Intermediate project reports due
Nov 24: Statistical pitfalls to avoid
Nov 26: Thanksgiving
Dec 1: Project presentations
Dec 3: Project presentations
Final report due: Monday December 14, 2015, end of day