https://www.youngju.dev/blog 천천히 올바르게. AI Researcher & DevOps Engineer Youngju's tech blog. GPU/CUDA, LLM, MLOps, Kubernetes AI workloads, distributed training, and data engineering. ko fjvbn2003@gmail.com (Youngju Kim) fjvbn2003@gmail.com (Youngju Kim) Tue, 16 Jun 2026 00:00:00 GMT https://www.youngju.dev/blog/gpu-cuda/2026-06-16-groq-sambanova-inference-chips.en https://www.youngju.dev/blog/gpu-cuda/2026-06-16-groq-sambanova-inference-chips.en A deep look at the working principles of two chips that bet everything on inference rather than training: the Groq LPU and the SambaNova RDU. We cover how deterministic execution and compiler scheduling, plus reconfigurable dataflow, produce low latency, and where they win and lose against GPUs. Tue, 16 Jun 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) groqsambanovainferenceai-hardwarelpudataflow https://www.youngju.dev/blog/gpu-cuda/2026-06-16-groq-sambanova-inference-chips.ja https://www.youngju.dev/blog/gpu-cuda/2026-06-16-groq-sambanova-inference-chips.ja 学習ではなく推論にすべてを賭けた2つのチップ、Groq LPU と SambaNova RDU の動作原理を深く覗き込みます。決定的実行とコンパイラスケジューリング、reconfigurable dataflow がどう低遅延を生むか、そしてGPUに対しどこで勝ちどこで負けるかを整理します。 Tue, 16 Jun 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) groqsambanovainferenceai-hardwarelpudataflow https://www.youngju.dev/blog/gpu-cuda/2026-06-16-groq-sambanova-inference-chips https://www.youngju.dev/blog/gpu-cuda/2026-06-16-groq-sambanova-inference-chips 학습이 아니라 추론에 모든 것을 건 두 칩, Groq LPU와 SambaNova RDU의 동작 원리를 깊게 들여다봅니다. 결정적 실행과 컴파일러 스케줄링, reconfigurable dataflow가 어떻게 낮은 지연을 만들어내는지, 그리고 GPU 대비 어디서 이기고 어디서 지는지 정리합니다. Tue, 16 Jun 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) groqsambanovainferenceai-hardwarelpudataflow