https://www.youngju.dev/blog 천천히 올바르게. AI Researcher & DevOps Engineer Youngju's tech blog. GPU/CUDA, LLM, MLOps, Kubernetes AI workloads, distributed training, and data engineering. ko fjvbn2003@gmail.com (Youngju Kim) fjvbn2003@gmail.com (Youngju Kim) Sat, 16 May 2026 00:00:00 GMT https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive.en https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive.en The 2026 LLM ops map. Helicone (YC) · LangSmith (LangChain) · Langfuse (open source, Series A) · W&B Weave · Arize Phoenix · Braintrust · Athina · Comet Opik (released March 2025) · Vellum · PromptHub · Portkey AI Gateway · TruLens · Ragas · DeepEval · Galileo · Patronus AI · OpenAI Evals · Bedrock Evals · Vertex AI Evaluation Service. We classify the field into four areas — observability / evaluation / prompt management / gateway — cover Korean and Japanese practice at Toss, NAVER HCX, Sakana, and NTT Tsuzumi, and end with concrete picks for solo developer · startup · enterprise · RAG-first personas. Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) llm-observabilityprompt-engineeringheliconelangsmithlangchainlangfusewandb-weavearize-phoenixbraintrustathinacomet-opikvellumprompthubportkeytrulensragasdeepevalgalileopatronus-aibedrock-evalsvertex-ai-eval2026deep-diveenglish https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive.ja https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive.ja 2026年の LLM ops 地図。Helicone (YC) · LangSmith (LangChain) · Langfuse (OSS Series A) · W&B Weave · Arize Phoenix · Braintrust · Athina · Comet Opik (2025年3月リリース) · Vellum · PromptHub · Portkey AI Gateway · TruLens · Ragas · DeepEval · Galileo · Patronus AI · OpenAI Evals · Bedrock Evals · Vertex AI Evaluation Service。可観測性 / 評価 / プロンプト管理 / ゲートウェイの 4 領域で分類し、韓国のトス LLM ops、NAVER HCX 監視、日本の Sakana、NTT つづみ運用まで網羅。個人開発者・スタートアップ・エンタープライズ・RAG 優先組織がそれぞれ何を選ぶべきかを示す。 Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) llm-observabilityprompt-engineeringheliconelangsmithlangchainlangfusewandb-weavearize-phoenixbraintrustathinacomet-opikvellumprompthubportkeytrulensragasdeepevalgalileopatronus-aibedrock-evalsvertex-ai-eval2026deep-dive日本語 https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive 2026년의 LLM ops 지도. Helicone (YC) · LangSmith (LangChain) · Langfuse (오픈소스 Series A) · W&B Weave · Arize Phoenix · Braintrust · Athina · Comet Opik (2025년 3월 출시) · Vellum · PromptHub · Portkey AI Gateway · TruLens · Ragas · DeepEval · Galileo · Patronus AI · OpenAI Evals · Bedrock Evals · Vertex AI Evaluation Service 까지. 관찰성 / 평가 / 프롬프트 관리 / 게이트웨이 네 영역으로 분류하고, 한국의 토스 LLM ops 와 NAVER HCX 모니터링, 일본의 Sakana 와 NTT Tsuzumi 운영까지 — 1인 개발자 · 스타트업 · 엔터프라이즈 · RAG 우선 조직이 각각 무엇을 골라야 하는가. Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) llm-observabilityprompt-engineeringheliconelangsmithlangchainlangfusewandb-weavearize-phoenixbraintrustathinacomet-opikvellumprompthubportkeytrulensragasdeepevalgalileopatronus-aibedrock-evalsvertex-ai-eval2026deep-dive