gradient-descent-algorithm

[Python] [arXiv/cs] Paper "An Overview of Gradient Descent Optimization Algorithms" by Sebastian Ruder

A collection of various gradient descent algorithms implemented in Python from scratch

Implementation of Convex Optimization algorithms

An interesting application of gradient descent aims to stabilize any input graph such that the forces applied on each node are minimum and the overall model is stable. Visualization is perform using NetworkX.

Predicting wine quality using regression on the well-known UCI data set and more

Utilizing Tensorflow's animation capabilities to visualize a Linear Regression model built for predicting House Prices.

Linear line fitting to data and optimising parameters with Gradient Descent algorithm

Implementation of nonlinear Optimization Algorithms in Python

This is a workspace for meta-learning methods using Reinforcement learning

It demostrates the batch gradient descent algorithm of machine learning for linear regression problems.

Logistic Regression using Tensorflow

Implementation of the quasi Cauchy optimizer, an optimization method from the quasi Newton family. It uses a diagonal approximation of the Hessian and therefore has a small memory footprint.

Using language modelling to develop a text-completion application; studying interpolation of several n-gram models and opimisation of interpolation weights to minimise the perplexity of the model.

Linear Regression w. Gradient Descent

Perceptron Linear Classification Learning and Linear Regression Gradient Descent

An implementation of a logistic regression algo

Implemented machine learning algorithms.

This is a showcase of various models, using different methods to get the best result, XGBoost, SVM, Logistic Regression, Random Forest, Decision Trees, Gradient Boosting, Neural Networks