# Tensor Autograd from Scratch in NumPy: Building Broadcasting-Aware Mini-Tinygrad

> Source: https://sukruyusufkaya.com/en/learn/llm-muhendisligi/numpy-tensor-autograd-mini-tinygrad
> Updated: 2026-05-13T13:00:23.821Z
> Category: LLM Mühendisliği
> Module: Module 2: Before PyTorch — NumPy and Autodiff from Scratch
**TLDR:** Lift scalar micrograd from Lesson 1.4 to tensor level: NumPy-based Tensor class, broadcasting-aware backward (sum-along-broadcast-dims trick), matmul/conv/softmax operators, gradient flow through transpose and views, ~500-line PyTorch-like training engine.