Building Neural Nets from First Principles
I often keep trying to implement architectures, and papers from first principles or ‘from-scratch’ as it’s more commonly known today. Instead of creating multiple ’nn_test’ colab notebooks, I decided to begin adding them to a repo, not just to have them on my git, but also as a quick refresher I can keep looking back to. A screen grab of my self-masked attention implementation ...