r/rprogramming • u/jerburt • Dec 10 '20
Data Science Learning Resources
It was requested in the past to but together some resources for new R users. Below is a collection of everything I could find to help others out.
Data Science Learning Resources
Sections
Programming
Machine Learning
Leadership & Strategy
Programming
General
The Pragmatic Programmer (Book)
Clean Code (Book)
Architecture Playbook (Online guide)
Python
A Whirlwind Tour of Python (Book)
Python Tricks (Book)
Learning Python (Book)
Effective Python (Book)
R
R for Data Science (Book)
Advanced R (Book)
bookdown: Authoring Books and Technical Documents with R Markdown (Book)
Data Science in R: A Case Studies Approach to Computational Reasoning and Problem Solving (Book)
Introduction to Data Science (Book)
Spark
Spark: The Definitive Guide: Big Data Processing Made Simple (Book)
Mastering Spark with R: The Complete Guide to Large-Scale Analysis and Modeling (Book)
Command Line
The Missing Semester of Your CS Education (Online course)
Learning the bash Shell (Book)
The Art of the Command Line (GitHub resources)
explainshell.com (Online help)
Containers
Docker tips & tricks or just useful commands (Online article)
Rocker: R configurations for Docker (GitHub resources)
Docker and Python: making them play nicely and securely for Data Science and ML (PyCon Talk)
Functional Programming
An Introduction to the Basic Principles of Functional Programming (Online article)
R for Data Science, Ch. 21 (Book)
Advanced R, Ch. 9 (Book)
Jenny Bryan's purrr tutorials (Online tutorial)
Version Control
Excuse me, do you have a moment to talk about version control? (Paper)
Learn Git (Online tutorial)
Git Commit Message Style Guide (Online guide)
Code Packaging
Style Guide, Readability, Best Practices
The Art of Readable Code (Book)
The Tidyverse Style Guide (Online book)
PEP 8 -- Style Guide for Python Code (Online guide)
Guidelines for code reviews (README)
Code Review Best Practices (Blog post)
Testing
Testing R Code (Book)
Python Testing with pytest (Book)
Multiply your Testing Effectiveness with Parameterized Testing (PyCon Talk)
Test-Driven Development (Book)
Machine Learning
General
Applied Predictive Modeling (Book)
Deep Learning (Book)
Hands-On Machine Learning with Scikit-Learn & TensorFlow (Book | GitHub)
Unsupervised Modeling
ISLR: Ch. 10.3 Clustering Methods (Book chapter)
A K-Means Clustering Algorithm (Paper)
Generalized Low Rank Models (Paper)
Deep Learning Ch. 15 Autoencoders (Book chapter)
Hands-On Mach. Learning with Scikit-Learn Ch. 15 Autoencoders (Book chapter | GitHub resource)
Sparse autoencoder (Andrew Ng CS294A lecture notes)
A/B Testing
Lessons from Running Thoursands of A/B Tests (Online presentation with many references)
Peaking at A/B Tests (Paper)
Multi-armed Bandit (Online tutorial)
A Modern Bayesian Look at the Multi-armed Bandit (Paper behind above online tutorial)
Predicting Search Satisfaction Metrics with Interleaved Comparisons (Paper)
Evaluating Retrieval Performance using Clickthrough Data (Paper)
Multivariate Adaptive Regression Splines
Multivariate Adaptive Regression Splines (Friedman's original paper)
APM: Ch. 7.2 Multivariate Adaptive Regression Splines (Book chapter)
ESL: Ch. 9.4 Multivariate Adaptive Regression Splines (Book chapter)
Notes on the earth package (Paper)
K-Nearest Neighbor
k-Nearest neighbour classifiers (Paper)
APM: Ch. 7.4 & 13.5 K-Nearest Neighbors (Book chapter)
ESL: Ch. 13.3 k-Nearest-Neighbor Classifiers (Book chapter)
Random Forests
An Introduction to Recursive Partitioning Using the RPART Routines (Paper)
Random Forests - Leo Breiman's original research paper (Paper)
Gradient Boosting Machines
How to explain gradient boosting (Online tutorial)
Trevor Hastie - Gradient Boosting & Random Forests at H2O World 2014 (YouTube)
Mark Landry - Gradient Boosting Method and Random Forest at H2O World 2015 (YouTube)
Peter Prettenhofer - Gradient Boosted Regression Trees in scikit-learn at PyData London 2014 (YouTube)
Alexey Natekin1 and Alois Knoll - Gradient boosting machines, a tutorial (Paper)
Deep Learning
Deep Learning with R (Book)
Deep Learning with Python (Book)
Deep Learning Specialization (MOOC)
keras.rstudio.com (Online articles & tutorials)
blogs.rstudio.com/tensorflow (Online articles & tutorials)
Understanding LSTMs (Blog)
The Unreasonable Effectiveness of Recurrent Neural Networks (Blog)
Revisiting Small Batch Training for Deep Neural Networks (Paper)
On Loss Functions for Deep Neural Networks in Classification (Paper)
Practical Recommendations for Gradient-Based Training of Deep Architectures (Paper)
Efficient BackProp (Paper)
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification (Paper)
Cyclical Learning Rates for Training Neural Networks (Paper)
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks (Paper)
Ensembles / Model Stacking / Super Learners
Stacked Regressions (Paper)
Super Learner (Paper)
Natural Language Processing / Text Mining
Text Mining with R (Book)
Probabilistic Topic Models (Paper)
The Illustrated Word2vec (Online tutorial)
Sebastian Ruder's series on Word Embeddings (Online articles & tutorials)
Tuning
Hyperparameters and Tuning Strategies for Random Forest (Paper)
Tunability: Importance of Hyperparameters of Machine Learning Algorithms (Paper)
Machine Learning Benchmarks and Random Forest Regression (Paper)
Feature Engineering
Feature Selection
APM: Ch. 19 An Introduction to Feature Selection (Book chapter)
Machine Learning Interpretability
H2O.ai Machine Learning Interpretability Resources (GitHub resources)
Patrick Hall's Awesome Machine Learning Interpretability Resources (GitHub resources)
Visualizing the Feature Importance for Black Box Models (Paper)
A Simple and Effective Model-Based Variable Importance Measure (Paper)
pdp: An R Package for Constructing Partial Dependence Plots (Paper)
"Why Should I Trust You?": Explaining the Predictions of Any Classifier (Paper)
A Unified Approach to Interpreting Model Predictions (Paper)
Consistent Individualized Feature Attribution for Tree Ensembles (Paper)
On the Art and Science of Machine Learning Explanations (Paper)
Explanation in artificial intelligence: Insights from the social sciences (Paper)
Please Stop Permuting Features: An Explanation and Alternatives (Paper)
A Stratification Approach to Partial Dependence for Codependent Variables (Paper)
Explaining Machine Learning Classifiers through Diverse Counterfactual Examples (Paper)
Auto ML
A Review of Automatic Selection Methods for Machine Learning Algorithms and Hyperparameter Values (Paper)
Learning Multiple Defaults for Machine Learning Algorithms (Paper)
Benchmarking
Szilard Pafka's ML Benchmarking Research (GitHub resources)
Data-driven advice for applying machine learning to bioinformatics problems (Paper)
Resampling Procedures
Futility Analysis in the Cross-Validation of Machine Learning Models (Paper)
Estimating Classification Error Rate: Repeated Cross-validation, Repeated Hold-out, and Bootstrap (Paper)
Productionalization
150 Successful Machine Learning Models: 6 Lessons Learned at Booking.com (Paper)
Deep Learning in Production (Github resources)
Leadership & Strategy
2
2
u/proverbialbunny Dec 11 '20
For anyone interested in getting into data science, the topics covered in this post are not key data science topics.
Sections
Programming
Machine Learning
Leadership & Strategy
Programming: Sure, knowing how to program is helpful, or how are you going to verify a hypothesis? And to be fair, there are a few good books in that list, but most of the "programming" topics like containers are for data engineer related work. One of the benefits of exploring it is maybe you'll find a passion for that kind of work. Data engineers / cloud engineers / infrastructure engineers are the most in demand data roles in the industry right now.
Machine Learning: A data scientist might use ML from time to time, but it's not a key focus. There are some good topics like A/B testing, and gradient boosted machines, so some of the papers linked are definitely worth checking out. Exploring ML you might find a passion for tensorflow and deep neural networks. If you end up liking ML a lot, it opens the door to machine learning engineer work, and it pays better than data science work too. So, like the previous topic, it opens doors to more job opportunities.
Leadership & Strategy: This is a great topic that is important for data science work, but the book selection does not cover what is ideal for a data scientist to know. Data science has more to do with learning communication skills (like setting up meetings with different people at the company and figuring out what best benefits the business), how to manage upward, how to make an IT request, and so on. In short, it's more about learning the business domain than it is outright management skills. One benefit of exploring the books linked above is you might find a new found love for project management related work, and that too pays quite a bit more than data science work.
What are the most important things for a data scientist to learn, if it is not these three topics? Outside of learning the business domain / communication skills, basic programming skills, and which ML to choose usually based on how much labeled data you have, the bread and butter or day-to-day typical data science work is cleaning data, pattern matching, and feature engineering. imo, the best data scientists are the best feature engineers. Feature engineering makes or breaks a model. If you want to get really good at data science, learn advanced feature engineering.
1
u/eipi-10 Dec 11 '20
I strongly disagree with your first point and disagree with your second. I use Docker every day to deploy models and tools to production, and would be a huge pain at my company if I needed to ask a data engineer how to use it every time (or, god forbid, to do it for me).
I also use plenty of ML tools, and understanding ML principles is a central piece of DS work and the DS interview process. If you don't know any ML, your odds of landing a DS job are virtually zero
1
1
u/Creator42121 Apr 03 '21
Just found some great tidy lessons learned. Iām sure this will be very helpful to all those who are starting out and even those who already know the tidy verse packages. tidyverse helpful tips
1
u/irhen_25 Nov 26 '21
Is this to be followed in order .
How much time would it take to learn / go through everything mentioned above for a complete beginner.
And what would I be able to achieve after I have successfully finished the above stuff.
2
3
u/FakespotAnalysisBot Dec 10 '20
This is a Fakespot Reviews Analysis bot. Fakespot detects fake reviews, fake products and unreliable sellers using AI.
Here is the analysis for the Amazon product reviews:
Link to Fakespot Analysis | Check out the Fakespot Chrome Extension!
Fakespot analyzes the reviews authenticity and not the product quality using AI. We look for real reviews that mention product issues such as counterfeits, defects, and bad return policies that fake reviews try to hide from consumers.
We give an A-F letter for trustworthiness of reviews. A = very trustworthy reviews, F = highly untrustworthy reviews. We also provide seller ratings to warn you if the seller can be trusted or not.