Analyzing linguistic data: schedule

Courses‎ > ‎Analyzing linguistic data, and programming for linguists‎ > ‎

Home

Syllabus

This schedule is subject to change.

Assignments are due at class time (11am) on their due date. Please submit assignments online on Canvas unless the assignment tells you otherwise.

Readings can be done either before or after class (unless noted otherwise); they are chosen to support the material covered in class.

Week 1

Jan 19 Introduction

Analyzing text to gain insight about language, and about the people who use it:

Foundations of programming

Jan 21 Programming first steps

Week 2

Jan 26 Exploring and visualizing data

Code for download: exploring data.
We use the inaugural speeches dataset available on Canvas as inaugural.csv. Please put it in the same directory as your Jupyter notebooks.

Jan 28 We continue on exploring and visualizing data.

Code: same worksheet as Jan 26.

Week 3

Feb 2 Programming basics: conditions, lists, and loops.

Code for download: conditions, lists, and loops

Feb 4 Programming basics: conditions, lists, and loops, continued

Code for download: conditions, lists, and loops

Week 4

Text processing

Feb 9 Programming basics: Dictionaries/maps

Code for download: dictionaries
Homework 1 due

Feb 11 Counting words, and tools for text preprocessing

Code for download: preprocessing text

Week 5

Feb 16 Class canceled due to inclement weather.
Feb 18 Class canceled due to inclement weather

Week 6

Feb 23: Class canceled due to inclement weather

Material we did not cover synchronously in class

Project ideas: We discuss your course project ideas on the "course-project-planning" channel on slack. See you there!
Jupyter notebooks:

Summarizing and exploring data

Feb 25 descriptive statistics: central tendency and spread.

Readings: SE chapter 2

Do women talk more than men do? Here are some relevant Language Log posts:

Code for download: central tendency and spread
We use the Fisher telephone data available on Canvas as fisher1.tbl

Week 7

Mar 2 Separating the wheat from the chaff: Identifying important words

Code for download: Identifying important words

Mar 4 Clustering: Automatically grouping data for exploratory data analysis

Code for download: clustering

Week 8

Mar 9 More clustering techniques

Code for download: dimensionality reduction

Code for download: topic modeling
Initial project description due.

Mar 11 Discussion session What can we find out about people from what they say? And what should we try to find out?

Readings we'll use in class:

Homework 2 due.

Week 9

Spring break

Week 10

Risky conclusions: Hypothesis testing

Mar 23 Samples and populations, probability distributions, and the central limit theorem

Readings: SE ch. 3, 4, 5
Code for download: probability distributions
Cartoon Introduction to Statistics, available on Canvas:

Samples and populations: 1-cartoon-sampling
Confounder variables: 2-cartoon-two-variables
The Central Limit theorem: 3-cartoon-central-limits
Applying the Central Limit theorem: 4-cartoon-applying-central-limits

Mar 25 Hypothesis testing

Readings: SE ch. 6, 7, 8
Code for download: hypothesis testing
Code for download: the t-test
https://xkcd.com/539/
Pitfalls of statistical analysis: The problem of multiple testing https://xkcd.com/882/
Cartoon Introduction to Statistics, available on Canvas: Hypothesis testing: 5_cartoon_hypothesistesting