Chaos and Order https://www.youngju.dev/blog 천천히 올바르게. AI Researcher & DevOps Engineer Youngju's blog. GPU/CUDA, LLM, MLOps, Kubernetes AI workloads, and data engineering — plus mindset essays on confidence, routines, health, and sport psychology. ko fjvbn2003@gmail.com (Youngju Kim) fjvbn2003@gmail.com (Youngju Kim) Wed, 12 Aug 2026 00:00:00 GMT https://www.youngju.dev/blog/ai-papers/2026-08-12-model-internals-how-to-read-a-config-json.en Anatomy of config.json — Reading a Model From One Settings File https://www.youngju.dev/blog/ai-papers/2026-08-12-model-internals-how-to-read-a-config-json.en How every field in config.json — hidden_size, num_hidden_layers, num_attention_heads versus num_key_value_heads, head_dim, intermediate_size, rope_theta, vocab_size, tie_word_embeddings — shows up in memory and speed, and a hand count of Qwen3-8B and Mixtral-8x7B parameters that matches the published tensor totals exactly. Wed, 12 Aug 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) ai-papersmodel-internalsconfig-jsontransformerllm-architectureparameter-count https://www.youngju.dev/blog/ai-papers/2026-08-12-model-internals-how-to-read-a-config-json.ja config.json 完全解剖 — 設定ファイル一枚でモデル構造を読む https://www.youngju.dev/blog/ai-papers/2026-08-12-model-internals-how-to-read-a-config-json.ja hidden_size、num_hidden_layers、num_attention_heads と num_key_value_heads、head_dim、intermediate_size、rope_theta、vocab_size、tie_word_embeddings まで、config.json の各フィールドがメモリと速度にどう現れるかを説明し、Qwen3-8B と Mixtral-8x7B のパラメータ数を手で数えて公開されたテンソル数と正確に一致させる過程を示します。 Wed, 12 Aug 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) ai-papersmodel-internalsconfig-jsontransformerllm-architectureparameter-count https://www.youngju.dev/blog/ai-papers/2026-08-12-model-internals-how-to-read-a-config-json config.json 완전 해부 — 설정 파일 한 장으로 모델 구조 읽기 https://www.youngju.dev/blog/ai-papers/2026-08-12-model-internals-how-to-read-a-config-json hidden_size, num_hidden_layers, num_attention_heads와 num_key_value_heads, head_dim, intermediate_size, rope_theta, vocab_size, tie_word_embeddings까지 config.json의 모든 필드가 메모리와 속도에 어떻게 나타나는지 설명하고, Qwen3-8B와 Mixtral-8x7B의 파라미터 수를 손으로 세어 공개된 텐서 수와 정확히 일치시키는 과정을 보여줍니다. Wed, 12 Aug 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) ai-papersmodel-internalsconfig-jsontransformerllm-architectureparameter-count