# Sequence Parallel + Context Parallel: Ulysses + Ring Attention + 1M Context

> Source: https://sukruyusufkaya.com/learn/fine-tuning-cookbook/ftc-sequence-context-parallel-ulysses-ring
> Updated: 2026-08-22T14:35:39.550Z
> Category: Fine-Tuning Cookbook (Model-by-Model)
> Module: Part IV — Mid-Large Models (13B-70B+) + Distributed Internals
**TLDR:** Long-context FT'in fizik sınırını aşmak: sequence/context'i GPU'lar arasında böl. DeepSpeed-Ulysses (sequence parallel — head-wise), Ring Attention (Berkeley, sequence-wise), Megatron Sequence Parallel. 1M token context'i mümkün kıl. Kimi-1.5 (Moonshot) 2M context reçetesinin teknik altyapısı.