SEARCH LAVACS

Find a topic across LavaCS

Search textbooks, study guides, six encyclopedias, experiments and comparisons.

6 results · page 1 of 1

Calculus and Optimization · Experiments and implementations

Testing gradient descent across step sizes

Trace a quadratic update to distinguish convergent oscillation, constant-amplitude alternation, and divergence as the learning rate changes.

Intermediate

Calculus and Optimization · Experiments and implementations

Checking gradients with finite differences

Compare an analytic derivative with central finite differences and inspect the competing effects of truncation and floating-point error.

Intermediate

Calculus and Optimization · Study guides

Convexity and optimization guarantees

Separate convexity, strong convexity, and smoothness when reasoning about stationary points, uniqueness, and constrained optimization.

Intermediate

Calculus and Optimization · Study guides

Numerical stability and condition numbers

Use cancellation, stable reformulation, residuals, and conditioning to distinguish numerical algorithms from the sensitivity of a problem.

Intermediate