Struct engram::optimizer::SGD

pub struct SGD {
    pub learning_rate: f64,
}

Stochastic Gradient Descent (SGD).

A basic optimizer that updates the weights based on the gradients of the loss function with respect to the weights multiplied by a learning rate.

Fields

learning_rate: f64

Implementations

impl SGD

pub fn new(learning_rate: f64) -> SGD

Trait Implementations

impl Clone for SGD

fn clone(&self) -> SGD

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SGD

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SGD

fn default() -> Self

Returns the “default value” for a type.

impl Optimizer for SGD

fn step(&mut self, weights: &mut Tensor, gradients: &Tensor)