faridcher / ml-course

Introduction

This is one of the best ML massive online open courses (MOOC) that is taught by Prof. Andrew NG. However, Prof. NG teaches the course along with MATLAB/Octave and the assignments must be done and submitted in MATLAB/Octave. Do you like the course but not the proprietary MATLAB or the sluggish Octave? Or for any reason, would you rather to use the free GNU R to complete the assignments? This project is your answer.

To view/download the lecture videos, slides and assignments instructions visit the course website:

• Course website
• The course wiki page

This repository provides the starter code to solve the assignment in R statistical software; the completed assignments are also available beside each exercise file. Simply follow these steps to complete the assignments:

1. View the lectures videos and handouts.
2. Read the instructions which are basically for MATLAB/OCTAVE. R compatible version of instructions will become available here as Wiki pages in future.
3. Use the starter folder and fill the parts of the code that is written "YOUR CODE HERE"
4. If you couldn't solve it by yourself, get help from the accompanied file suffixed by _solution inside the same folder of the starter code. For example, starter/ex1/computeCost.R has an associated solution file named starter/ex1/computeCost_solution.R
5. Submit

You are welcome to star this project if you find it useful.

Dependencies

In order to produce similar results and plots to Octave/Matlab, you should install a few packages:

• rgl package is used to produce the 3D scatter plots and surface plots in the exercises.

• SnowballC: portStemmer function in this package has the same role of the portStemmer.m.

• raster package is used to produce the plot of the bird in exercise 7.

• jsonlite and httr packages are needed for submission.

• pinv.R: The ginv function, generalized inverse, in MASS package doesn't produce the same result of the Matlab pinv (pseudo-inverse). pinv.R is the modified version of MASS ginv to produce the same effect of the MATLAB pinv. For more info see this stackoverflow discussion

• lbfgsb3_.R: Certain optimization tasks could only be solved using lbfgsb3 package, yet there are a few bugs in this package. The purpose of lbfgsb3_.R is to address these bugs; it is used for exercises 4 and 8. Beware that fmincg or fminunc optimization function in Matlab takes one function as input and computes cost and gradient simultaneously. However, cost and gradient functions MUST be supplied into optim or lbfgsb3 functions individually.

Before starting to code, install the following packages: install.packages(c('rgl','lbfgsb3','SnowballC','raster','jsonlite', 'httr'))

Submission

After completing each assignment, source("submit.r") and then submit() in your R console.

I submitted the solutions to Coursera for testing and the scores were 100%. Please report any problem with submission here.

Topics covered in the course and assignments

1. Linear regression, cost function and normalization
2. Gradient descent and advanced optimization
3. Multiple linear regression and normal equation
4. Logistic regression, decision boundary and multi-class classification
5. Over-fitting and Regularization
6. Neural Network non-linear classification
7. Model validation, diagnosis and learning curves
8. System design, prioritizing and error analysis
9. Support vector machine (SVM), large margin classification and SVM kernels (linear and Gaussian)
10. K-Means clustering
11. Principal component analysis (PCA)
12. Anomaly detection, supervised learning
13. Recommender systems, Collaborative filtering
14. Large scale machine learning, stochastic and mini-batch gradient descent, on-line learning, map reduce

Screen-shots

A few screenshots of the plots produced in R:

Licence

This project is released under MIT to the extent it is originial.