Aryan Pareek

P.S. I started writing these for my little sister based on whatever I teach her.

(⚠️ site under construction)
Blogs:

• Activations and Hooks in PyTorch
  


• Drawbacks in Distributed Parallel and Data Distributed Parallel
  


• More intuition on activations
  


• Fully Sharded Data Parallelism