# Liger Kernel Tour: RMSNorm + SwiGLU + GeGLU + Fused Linear+CE — Source Reading

> Source: https://sukruyusufkaya.com/en/learn/fine-tuning-cookbook/ftc-liger-kernel-source-tour
> Updated: 2026-05-14T14:42:59.568Z
> Category: Fine-Tuning Cookbook (Model-by-Model)
> Module: Part XIII — Custom Kernels & Performance Surgery
**TLDR:** Liger Kernel (LinkedIn, 2024) — production-grade Triton kernel suite. Fused RMSNorm + dropout, SwiGLU + GeGLU + GeLU, RoPE rotary, fused linear+CE (memory savings), CrossEntropy chunked. Llama 3.1 8B FT throughput +20%, memory -30% on RTX 4090. Source reading: production Triton patterns.