Notes

Home

❯

01_foundations

❯

deep_learning_theory

index

Mar 02, 20261 min read

deep_learning_theory

Core

  • supervised_learning
  • logistic_regression
  • cross_entropy_loss
  • gradient_descent
  • adaptive_optimizers

Backprop + implementation

  • backpropagation
  • backpropagation_through_time
  • gradient_checking
  • weight_initialization
  • batch_normalization
  • vectorization
  • neural_network_notation

Metric learning + style transfer

  • triplet_loss
  • style_cost_function

14 items under this folder.

  • Mar 02, 2026

    adaptive_optimizers

    • optimization
    • adaptive_lr
    • momentum
    • adam
    • rmsprop
  • Mar 02, 2026

    backpropagation

    • backpropagation
    • autodiff
    • computation-graph
    • chain-rule
    • gradients
  • Mar 02, 2026

    backpropagation_through_time

    • BPTT
    • RNN
    • recurrent-networks
    • vanishing-gradient
    • exploding-gradient
  • Mar 02, 2026

    batch_normalization

    • normalization
    • optimization
    • preprocessing
  • Mar 02, 2026

    cross_entropy_loss

    • cross-entropy
    • loss-function
    • softmax
    • KL-divergence
    • maximum-likelihood
  • Mar 02, 2026

    gradient_checking

    • debugging
    • optimization
    • backpropagation
  • Mar 02, 2026

    gradient_descent

    • optimization
    • gradient_descent
    • training
    • schedules
  • Mar 02, 2026

    logistic_regression

    • logistic-regression
    • classification
    • sigmoid
    • cross-entropy
    • gradient-descent
  • Mar 02, 2026

    neural_network_notation

    • notation
    • deep_learning
    • linear_algebra
    • implementation
  • Mar 02, 2026

    style_cost_function

    • cnn
    • loss
    • style_transfer
  • Mar 02, 2026

    supervised_learning

    • supervised-learning
    • empirical-risk-minimization
    • bias-variance
    • classification
    • regression
  • Mar 02, 2026

    triplet_loss

    • metric_learning
    • loss
    • embeddings
  • Mar 02, 2026

    vectorization

    • numpy
    • linear_algebra
    • vectorization
    • implementation
  • Mar 02, 2026

    weight_initialization

    • initialization
    • optimization
    • deep_networks

Created with Quartz v4.5.2 © 2026

  • GitHub
  • Discord Community