xiaoyuwang2821 Goto Github PK

academic-kickstart

ada-hessian

Easy-to-use AdaHessian optimizer (PyTorch)

adam-convergence

Reproducing the results of the influential paper "On The Convergence of ADAM And Beyond."

adamod

Adaptive and Momental Bounds for Adaptive Learning Rate Methods.

adamw-and-sgdw

Decoupled Weight Decay Regularization (ICLR 2019)

adamw-pytorch

Implementation and experiment for AdamW on pytorch

admm

examples/code for the alternating direction method of multipliers (ADMM)

admm-1

Implemented ADMM for solving convex optimization problems such as Lasso, Ridge regression

alex-net-on-mini-imagenet-and-cifar-10

In this Notebook, I have implemented an Alex Net on Mini Image Net and CIFAR 10. Anyone can help to improve Mini Image Net version.

ali-g

Implementation of the ALI-G algorithm (PyTorch, Tensorflow)

ali-g_iclr-2020

PyTorch & Tensorflow implementations of the AliG algorithm

amsgradpytorch

Experiments on AMSGrad -- pytorch version

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

apollo

Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization

awd-lstm-lm

LSTM and QRNN Language Model Toolkit for PyTorch

awesome-federated-learning

Federated Learning Library: https://fedml.ai

batch-normalization

Implementation of Batch Normalization Layer by Theano. Test Code with MNIST data.

benchmark_bilevel

benchmark for bi-level optimization solvers

bome

Bilevel Optimization

cifar-10-cnn

Play deep learning with CIFAR datasets

cifar10-image-classification

An implementation of CIFAR-10 dataset on CNN image classification using Theano and Lasagne

deep-learning-optimization-algorithms

Visualization of various deep learning optimization algorithms using PyTorch automatic differentiation and optimizers.

deep-neural-network-second-order-optimization

I try to use Hessian-free optimization to train the deep neural network. The training is based on the MNIST data set.

descent

First-order optimization tools

dlwin

GPU-accelerated Deep Learning on Windows 10 native

examining-approaches-to-saddle-point-escaping-using-non-convex-optimization

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

federated-learning

A PyTorch Implementation of Federated Learning http://doi.org/10.5281/zenodo.4321561

fedprox

Federated Optimization in Heterogeneous Networks (MLSys '20)

few-shot-ctm

Few shot learning