0% found this document useful (0 votes)
15 views3 pages

Data Mining Course Syllabus Fall 2020

The Data Mining for Social Science course (GR5058) taught by Ben Goodrich focuses on programming best practices, exploratory data analysis, and both unsupervised and supervised learning techniques using R. The course includes various assessments such as homeworks, a midterm, a final project, and class participation, with a grading breakdown of 20% each. Students are encouraged to use CampusWire for questions and discussions, and the syllabus outlines the topics and readings for each week.
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
15 views3 pages

Data Mining Course Syllabus Fall 2020

The Data Mining for Social Science course (GR5058) taught by Ben Goodrich focuses on programming best practices, exploratory data analysis, and both unsupervised and supervised learning techniques using R. The course includes various assessments such as homeworks, a midterm, a final project, and class participation, with a grading breakdown of 20% each. Students are encouraged to use CampusWire for questions and discussions, and the syllabus outlines the topics and readings for each week.
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Data Mining for Social Science (GR5058), Fall 2020

Instructor: Ben Goodrich ( [Link]@[Link] )


Verify that the date below is recent! Syllabus subject to change!
September 5, 2020

Course website: [Link]


Course Time: Tuesdays 8:10-10:00PM New York time over Zoom
Teaching Assistants: Jiaqing Zhang and Korina Baraceros

Office hours: Thursday mornings New York time. Sign up for a slot on
[Link]
UUM0UUpEc0pMRjlWfGRlZmF1bHR8ZmE4YzUzYmQ4NmQyYjk0ZWM3MmM2ZmYwODZhNjgzNzM

Course Description
The class is roughly divided into two parts:
1. programming best practices, exploratory data analysis (EDA), and unsupervised learning

2. supervised learning including regression and classification methods


In the first part of the course we will focus writing R programs in the context of simulations, data wrangling, and EDA.
Unsupervised learning is focused on problems where the outcome variable is not known and the goal of the analysis is
to find hidden structure in data such as different market segments from buying patterns or human population structure
from genetics data. Supervised learning deals with prediction problems where the outcome variable is known such as
predicting a price of a house in a certain neighborhood or an outcome of a congressional race.

Prerequisites
Any QMSS student is presumed to have sufficient background. Any non-QMSS students interested in taking this
course should have sufficient background in quantitative methods.

Grading
• 20% homeworks (done in pairs)

• 20% in class midterm


• 20% final project (done in pairs)
• 20% final during finals week

• 20% class participation

1
Books
• Gareth James, Daniela Witten, Trevor Hastie and Robert Tibshirani, 2013, Introduction to Statistical Learning
with Applications in R, Springer-Verlag. Available from [Link]
resolve?clio10415714.
• Garrett Grolemund and Hadley Wickham, 2016, R for Data Science, O’Reilly. Available from [Link]
[Link]/.
• Max Kuhn and Kjell Johnson, Applied Predictive Modeling, 2013, Springer. Available from [Link]
[Link]/cgi-bin/cul/resolve?clio10413027.

CampusWire
CampusWire is a beta version of a tool that is available [Link] using code 2982. Make
sure to sign up for the 2020 version of the course. Rather than emailing questions directly to the professor or TAs,
you should post on CampusWire. That way, other students can answer your question, benefit from an answer that the
professor or TA provides, ask follow-up questions, etc. There is also Reddit-style upvoting and the statistics collected
by CampusWire go into the participation portion of your grade. Students should not ask questions in office hours that
have not first be posted on CampusWire.
If your question pertains to an ongoing homework assignment, your grades, or similar, then you should click on
the option to make your post only visible to “Instructors and TAs”. Otherwise, you should post to “Everyone in the
class” and avoid direct messaging the instructor and TAs. There is an option to post in Stealth Mode, in which case no
one will know it was you that asked the question, but doing so obviously cannot count toward the class participation
component of your course grade.
There are Notification options under User Settings (click on your picture in the bottom left) where you can control
how often you receive emails about activity on CampusWire. You can turn some or all of those off but are still
responsible for reading posts by other students.

Outline
The following outline describes the topics that will be covered along with anticipated associated readings.

I. Programming Best Practices, Exploratory Data Analysis, and Unsupervised Learning


Week 1: Introduction to the Course
• ISLAR, Chapters 1 and 2. You do not need to read the section of Chapter 1 entitled “Notation and Simple Matrix
Algebra” yet.
• “7 Reasons Most Econometric Investments Fail” by Marcos Lopez de Prado in 2019. You can download the pa-
per from [Link] without reg-
istering for SSRN but after clicking “Download This Paper” you may have to scroll down and look to the right
for the option.

Week 2: Introduction to R
• Grolemund and Wickham, chapters 1, 2, 4, 26, 27, 29, 30

Week 3: Intermediate R
• Grolemund and Wickham, chapters 5, 6, 9, 10, 11, 12, 15

Week 4: Exploratory Data Analysis


• Grolemund and Wickham, chapters 3, 7, and 28

2
• APM chapter 3 (excluding section 3.3)

Week 5: Matrix Algebra


• ISLR: Read the section of Chapter 1 entitled “Notation and Simple Matrix Algebra”
• A Mathematics Course for Political and Social Research, by Will H. Moore and David A. Siegel, published by
Princeton University Press in 2013. Read chapter 12, 13, and section 14.1 from [Link]
[Link]/lib/columbia/[Link]?docID=10723957.

Week 6: Unsupervised Learning

• ISLAR, chapter 10

Week 7: Midterm, in class


Week 8: Text Analysis
• Grolemund and Wickham, chapter 13
• [Link] chapters 1 – 6

II. Supervised Learning


Week 9: Linear Regression
• APM, chapters 1, 2 (read these first)
• ISLAR, chapters 3 and 6

• APM, chapters 4, 5 and 6

Week 10: Classification and Logit Models


• ISLAR, chapter 4
• APM, chapters 11 and 12

Week 11: Nonlinear Models


• ISLAR, chapter 7
• APM, section 7.2

Week 12: Tree Methods


• ISLAR, chapters 5 and 8

• APM, chapters 8 and 14

Week 13: Neural Networks and Other Stuff


• APM, chapter 7 (you already read section 7.2) and 13
• Arvind Narayanan (2019) “How to Recognize AI Snake Oil” Link

• Shira Mitchell, Eric Potash, Solon Barocas (2018) “Prediction-Based Decisions and Fairness: A Catalogue of
Choices, Assumptions, and Definitions” arXiv:1811.07867 Available here

Common questions

Powered by AI

The course prepares students for real-world data analysis challenges by covering a range of essential topics, from programming best practices to advanced supervised and unsupervised learning techniques. The curriculum includes practical assignments, a midterm, and a comprehensive final project that require students to apply learned skills to simulate real-world data scenarios, analyze data patterns, and make predictive analyses, thereby equipping them with valuable analytical and programming skills .

The course 'Data Mining for Social Science' integrates programming best practices with exploratory data analysis (EDA) by having students write R programs to conduct simulations and perform data wrangling, which are essential components of EDA. This approach helps students develop skills in identifying patterns and structures within data, setting a foundation for more advanced unsupervised learning techniques later in the course .

The course's weekly structure supports a gradual understanding of complex concepts by systematically introducing foundational topics such as programming in R and exploratory data analysis before moving to more advanced elements like unsupervised learning and neural networks. This progression from basics to complex topics allows for stepwise skill development and maturation, which is critical for mastering the intricate processes involved in data mining and analysis .

Students may face challenges due to the complexity of distinguishing between unsupervised and supervised learning objectives, particularly when transitioning from identifying hidden data structures to predictive modeling. The dual focus demands strong familiarity with programming and statistical methods, which might be overwhelming for students lacking a robust quantitative background. Additionally, integrating these diverse methodologies within a final project might pose difficulties in selecting appropriate techniques for specific data problems .

The course emphasizes strategic approaches such as employing programming best practices, developing proficiency in R for data wrangling and analysis, and applying both unsupervised and supervised learning techniques to tackle predictive modeling challenges. Students learn to select and implement appropriate statistical models, validate their predictive accuracy, and synthesize insights from complex data sets, crucial for effective problem-solving in real-world data environments .

In the course, unsupervised learning is focused on analyzing data where the outcome variable is unknown, aiming to discover hidden structures, such as market segments or genetic population patterns. This contrasts with supervised learning, which deals with situations where the outcome variable is known, like predicting housing prices or election outcomes. The course emphasizes these differences by teaching unsupervised learning in the context of finding latent patterns and supervised learning in the context of prediction problems .

The recommended textbooks like 'Introduction to Statistical Learning with Applications in R' and 'R for Data Science' are crucial for understanding both the theoretical and practical aspects of the course. They provide comprehensive coverage of data analysis techniques and R programming, aligning well with the course’s focus on statistical learning and data wrangling. These resources are instrumental in bridging the gap between theory and application, thus supporting the course’s learning objectives .

The final project is intended to provide hands-on experience where students can apply both supervised and unsupervised learning techniques learnt throughout the course. This complements the course objectives by enabling students to demonstrate their ability to wrangle data, perform exploratory analysis, and execute appropriate predictive or clustering models on real-world datasets, effectively synthesizing and applying the knowledge gained in previous coursework .

The assessment structure comprises 20% homeworks (done in pairs), a 20% in-class midterm, a 20% final project (also done in pairs), a 20% final exam, and 20% class participation. This evaluation scheme is designed to balance theoretical understanding and practical application by involving both individual and collaborative tasks, as well as engagement through class participation and online platforms like CampusWire .

The use of CampusWire offers advantages such as allowing students to engage with peers and instructors, providing a platform for collaborative learning, and enabling sharing of valuable insights and resources. However, disadvantages might include potential over-reliance on peer-supplied answers, which might not always be accurate, and the risk of decreased face-to-face interaction, which is sometimes crucial for complex problem-solving .

You might also like