Introduction Stochastic Gradient Descent (SGD) sits at the centre of modern machine learning training. Instead…