DAT8

DAT8 Course Repository

Course materials for General Assembly's Data Science course in Washington, DC (8/18/15 - 10/29/15).

Instructor: Kevin Markham (Data School blog, email newsletter, YouTube channel)

Tuesday | Thursday --- | --- 8/18: Introduction to Data Science | 8/20: Command Line, Version Control 8/25: Data Reading and Cleaning | 8/27: Exploratory Data Analysis 9/1: Visualization | 9/3: Machine Learning 9/8: Getting Data | 9/10: K-Nearest Neighbors 9/15: Basic Model Evaluation | 9/17: Linear Regression 9/22: First Project Presentation | 9/24: Logistic Regression 9/29: Advanced Model Evaluation | 10/1: Naive Bayes and Text Data 10/6: Natural Language Processing | 10/8: Kaggle Competition 10/13: Decision Trees | 10/15: Ensembling 10/20: Advanced scikit-learn, Clustering | 10/22: Regularization, Regex 10/27: Course Review | 10/29: Final Project Presentation

<!-- ### Before the Course Begins * Install [Git](http://git-scm.com/downloads). * Create an account on the [GitHub](https://github.com/) website. * It is not necessary to download "GitHub for Windows" or "GitHub for Mac" * Install the [Anaconda distribution](http://continuum.io/downloads) of Python 2.7x. * If you choose not to use Anaconda, here is a list of the [Python packages](other/python_packages.md) you will need to install during the course. * We would like to check the setup of your laptop before the course begins: * You can have your laptop checked before the intermediate Python workshop on Tuesday 8/11 (5:30pm-6:30pm), at the [15th & K Starbucks](http://www.yelp.com/biz/starbucks-washington-15) on Saturday 8/15 (1pm-3pm), or before class on Tuesday 8/18 (5:30pm-6:30pm). * Alternatively, you can walk through the [setup checklist](other/setup_checklist.md) yourself. * Once you receive an email invitation from Slack, join our "DAT8 team" and add your photo. * Practice Python using the resources below. -->

Python Resources

• Codecademy's Python course: Good beginner material, including tons of in-browser exercises.
• Dataquest: Uses interactive exercises to teach Python in the context of data science.
• Google's Python Class: Slightly more advanced, including hours of useful lecture videos and downloadable exercises (with solutions).
• Introduction to Python: A series of IPython notebooks that do a great job explaining core Python concepts and data structures.
• Python for Informatics: A very beginner-oriented book, with associated slides and videos.
• A Crash Course in Python for Scientists: Read through the Overview section for a very quick introduction to Python.
• Python 2.7 Quick Reference: My beginner-oriented guide that demonstrates Python concepts through short, well-commented examples.
• Beginner and intermediate workshop code: Useful for review and reference.
• Python Tutor: Allows you to visualize the execution of Python code.

<!-- ### Submission Forms * [Feedback form](http://bit.ly/dat8feedback) * [Homework and project submissions](http://bit.ly/dat8homework) -->

Course project

Comparison of machine learning models

Comparison of model evaluation procedures and metrics

Advice for getting better at data science

Additional resources

---

Class 1: Introduction to Data Science

• Course overview (slides)
• Introduction to data science (slides)
• Discuss the course project: requirements and example projects
• Types of data (slides) and public data sources
• Welcome from General Assembly staff

Homework:

• Work through GA's friendly command line tutorial using Terminal (Linux/Mac) or Git Bash (Windows).
• Read through this command line reference, and complete the pre-class exercise at the bottom. (There's nothing you need to submit once you're done.)
• Watch videos 1 through 8 (21 minutes) of Introduction to Git and GitHub, or read sections 1.1 through 2.2 of Pro Git.
• If your laptop has any setup issues, please work with us to resolve them by Thursday. If your laptop has not yet been checked, you should come early on Thursday, or just walk through the setup checklist yourself (and let us know you have done so).

Resources:

• For a useful look at the different types of data scientists, read Analyzing the Analyzers (32 pages).
• For some thoughts on what it's like to be a data scientist, read these short posts from Win-Vector and Datascope Analytics.
• Quora has a data science topic FAQ with lots of interesting Q&A.
• Keep up with local data-related events through the Data Community DC event calendar or weekly newsletter.

---

Class 2: Command Line and Version Control

• Slack tour
• Review the command line pre-class exercise (code)
• Git and GitHub (slides)
• Intermediate command line

Homework:

• Complete the command line homework assignment with the Chipotle data.
• Review the code from the beginner and intermediate Python workshops. If you don't feel comfortable with any of the content (excluding the "requests" and "APIs" sections), you should spend some time this weekend practicing Python:
  • Introduction to Python does a great job explaining Python essentials and includes tons of example code.
  • If you like learning from a book, Python for Informatics has useful chapters on strings, lists, and dictionaries.
  • If you prefer interactive exercises, try these lessons from Codecademy: "Python Lists and Dictionaries" and "A Day at the Supermarket".
  • If you have more time, try missions 2 and 3 from DataQuest's Learning Python course.
  • If you've already mastered these topics and want more of a challenge, try solving Python Challenge number 1 (decoding a message) and send me your code in Slack.
• To give you a framework for thinking about your project, watch What is machine learning, and how does it work? (10 minutes). (This is the IPython notebook shown in the video.) Alternatively, read A Visual Introduction to Machine Learning, which focuses on a specific machine learning model called decision trees.
• Optional: Browse through some more example student projects, which may help to inspire your own project!

Git and Markdown Resources:

• Pro Git is an excellent book for learning Git. Read the first two chapters to gain a deeper understanding of version control and basic commands.
• If you want to practice a lot of Git (and learn many more commands), Git Immersion looks promising.
• If you want to understand how to contribute on GitHub, you first have to understand forks and pull requests.
• GitRef is my favorite reference guide for Git commands, and [Git quick reference for beginners](http: