# Streaming & Sharded Datasets: 500GB+ Veriye Disk Olmadan Eğitim

> Source: https://sukruyusufkaya.com/learn/fine-tuning-cookbook/ftc-streaming-sharded-datasets-large-scale
> Updated: 2026-08-21T12:28:58.908Z
> Category: Fine-Tuning Cookbook (Model-by-Model)
> Module: Part II — Tokenizer & Data Engineering
**TLDR:** 1 TB dataset 4090'ın 2TB NVMe'sine sığar ama tokenize edip cache'lemek 5 TB ister. Çözüm: streaming. HuggingFace datasets.IterableDataset, WebDataset .tar shard'lar, MosaicML Streaming (MDS), S3 streaming, resumable streaming (epoch'tan yarıdayken duruyor, resume). Multi-worker collator pattern.