This repository contains an implementation of the Gradient Descent Algorithm in C++, utilizing the Armijo condition to optimize step sizes.

some option technics within python and R

Bespoke, from scratch, implementation of Armijo-Wolfe inexact line search technique to find step length for gradient descent optimisation. The library alternative is scipy.optimize.line_search

This project is about the implementation of unconstrained optimization algorithms

[Optimization Algorithms] Implementation of Nonlinear least square curve fitting using the Gauss-Newton method and Armijio’s line search.

Comparison of Gradient Descent and Block Coordinate Gradient Descent methods through a semi supervised learning problem.

Implementation of Trust Region and Gradient Descent methods for Multinomial Regression

Repository for machine learning problems implemented in python

A matlab function for steepest descent optimization using Quasi Newton's method : BGFS & DFP

PyTorch optimizer based on nonlinear conjugate gradient method