Nafiz
All work
Open source

FizTorch

Deep learning framework from scratch

I wanted to know what happens inside loss.backward(), so I wrote it. FizTorch is a tensor library in Python and NumPy with automatic differentiation (backpropagation), a handful of neural network layers and an optimizer, small enough to read in an afternoon.

01Highlights

  • Autograd engine on top of NumPy
  • Linear, ReLU and Sigmoid layers with a Sequential container
  • Adam optimizer
  • Checked on MNIST and California Housing

02Stack

  • Python
  • NumPy
  • Autograd