https://www.youngju.dev/blog 천천히 올바르게. AI Researcher & DevOps Engineer Youngju's tech blog. GPU/CUDA, LLM, MLOps, Kubernetes AI workloads, distributed training, and data engineering. ko fjvbn2003@gmail.com (Youngju Kim) fjvbn2003@gmail.com (Youngju Kim) Sat, 16 May 2026 00:00:00 GMT https://www.youngju.dev/blog/culture/2026-05-16-open-source-ai-training-datasets-2026-common-crawl-fineweb-redpajama-dolma-slimpajama-the-stack-laion-coyo-deep-dive.en https://www.youngju.dev/blog/culture/2026-05-16-open-source-ai-training-datasets-2026-common-crawl-fineweb-redpajama-dolma-slimpajama-the-stack-laion-coyo-deep-dive.en A full atlas of open source AI training datasets in 2026. The foundation Common Crawl and its refined descendants RefinedWeb / RedPajama-V2 / FineWeb / FineWeb-Edu / Dolma / SlimPajama, the academic stacks The Pile / S2ORC / arXiv, code-only datasets The Stack v2 / StarCoder, multimodal LAION-5B / DataComp / COYO-700M, the Korean ecosystem (AI Hub, NIA, KAIST, HyperCLOVA), the Japanese ecosystem (NII, NTT, ABEJA), and the robotics frontier Open X-Embodiment — with licensing, ethics, and right-to-be-forgotten implications throughout. Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) ai-datasetstraining-datacommon-crawlrefinedwebredpajamafinewebfineweb-eduthe-piledolmaslimpajamaoscarc4mc4commonpilerootsopenwebtextarxivs2orcthe-stack-v2starcodercoyo-700mkakao-brainlaion-5blaion-aestheticsdatacompimagenetcc12mopen-imagescocoopen-x-embodiment2026deep-diveenglish https://www.youngju.dev/blog/culture/2026-05-16-open-source-ai-training-datasets-2026-common-crawl-fineweb-redpajama-dolma-slimpajama-the-stack-laion-coyo-deep-dive.ja https://www.youngju.dev/blog/culture/2026-05-16-open-source-ai-training-datasets-2026-common-crawl-fineweb-redpajama-dolma-slimpajama-the-stack-laion-coyo-deep-dive.ja 2026年のオープンソースAI学習データセットの全体地図を描く。すべてのLLMの基盤となるCommon Crawl、それを精製したRefinedWeb / RedPajama-V2 / FineWeb / FineWeb-Edu / Dolma / SlimPajama、学術系のThe Pile / S2ORC / arXiv、コード系のThe Stack v2 / StarCoder、マルチモーダルのLAION-5B / DataComp / COYO-700M、韓国(AI Hub, NIA, KAIST, HyperCLOVA)・日本(NII, NTT, ABEJA)のデータセット、ロボティクスのOpen X-Embodimentまで — ライセンス、倫理、忘れられる権利を含む実務者向け深掘りガイド。 Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) ai-datasetstraining-datacommon-crawlrefinedwebredpajamafinewebfineweb-eduthe-piledolmaslimpajamaoscarc4mc4commonpilerootsopenwebtextarxivs2orcthe-stack-v2starcodercoyo-700mkakao-brainlaion-5blaion-aestheticsdatacompimagenetcc12mopen-imagescocoopen-x-embodiment2026deep-dive日本語 https://www.youngju.dev/blog/culture/2026-05-16-open-source-ai-training-datasets-2026-common-crawl-fineweb-redpajama-dolma-slimpajama-the-stack-laion-coyo-deep-dive https://www.youngju.dev/blog/culture/2026-05-16-open-source-ai-training-datasets-2026-common-crawl-fineweb-redpajama-dolma-slimpajama-the-stack-laion-coyo-deep-dive 2026년 오픈소스 AI 학습 데이터셋의 전체 지도를 그린다. 모든 LLM의 토대인 Common Crawl, 그것을 정제한 RefinedWeb / RedPajama-V2 / FineWeb / FineWeb-Edu / Dolma / SlimPajama, 학술용 The Pile / S2ORC / arXiv, 코드용 The Stack v2 / StarCoder, 멀티모달 LAION-5B / DataComp / COYO-700M, 그리고 한국·일본 데이터셋(AI Hub, NIA, KAIST, HyperCLOVA, NII, NTT, ABEJA)과 로보틱스 Open X-Embodiment까지 — 라이선스, 윤리, 옵트아웃 권리를 포함한 실무자용 심층 가이드. Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) ai-datasetstraining-datacommon-crawlrefinedwebredpajamafinewebfineweb-eduthe-piledolmaslimpajamaoscarc4mc4commonpilerootsopenwebtextarxivs2orcthe-stack-v2starcodercoyo-700mkakao-brainlaion-5blaion-aestheticsdatacompimagenetcc12mopen-imagescocoopen-x-embodiment2026deep-dive