Fort Collins Data Science Meetup 2
Meetup link Transcripts provided by Adriana Flores
What is data science?
- Extract knowledge/insights from data
11 Steps of a Data Science Project:
- Define the questions
- What do you want to know?
- Define the ideal data set
- What data can you access
- Examples:
- UCI: http://archive.ics.uci.edu/ml/
- GoCodeColorado - http://gocode.colorado.gov/
- Quandl - https://www.quandl.com/
- Obtain the data
- Clean the data
- Data splitting - Caret package
- Skewed data - Training set to represent the population
- Exploratory analysis
- E.g. Summary status , missing data
- Statistical prediction/modeling
- Interpret results
- Challenge results
- Write up the story
- Write reproducible code
- Markdown
Blog Posts
Resources mentioned:
- Jenny Bryan (GitHub)
- Udacity Git Course
- BigQuery (data warehouse)
- Caret package
- JsonLite (parser)
- R-Fiddle
- Web Scraping
- Scrapy - https://scrapy.org/
- Rvest - https://github.com/hadley/rvest
Data Sets:
- UCI: http://archive.ics.uci.edu/ml/
- GoCodeColorado - http://gocode.colorado.gov/
- Quandl - https://www.quandl.com/