https://www.youngju.dev/blog 천천히 올바르게. AI Researcher & DevOps Engineer Youngju's tech blog. GPU/CUDA, LLM, MLOps, Kubernetes AI workloads, distributed training, and data engineering. ko fjvbn2003@gmail.com (Youngju Kim) fjvbn2003@gmail.com (Youngju Kim) Sat, 16 May 2026 00:00:00 GMT https://www.youngju.dev/blog/culture/2026-05-16-api-gateway-2026-kong-tyk-apigee-krakend-zuplo-envoy-gateway-traefik-3-deep-dive.en https://www.youngju.dev/blog/culture/2026-05-16-api-gateway-2026-kong-tyk-apigee-krakend-zuplo-envoy-gateway-traefik-3-deep-dive.en In 2026, the API gateway market splits four ways — open-source self-hosted (Kong 4, Tyk, KrakenD, Envoy Gateway, Traefik 3, Gravitee), managed SaaS/cloud (Apigee, AWS API Gateway, Cloudflare API Gateway, Azure API Management, MuleSoft), programmable edge (Zuplo), and the newly emerged LLM API gateways (Portkey, Helicone, OpenRouter). Mashery was sunset January 2024, Kong doubled down on Konnect cloud, and Envoy Gateway graduated from CNCF. This piece compares 15 options by category, features, pricing, and real-world usage — Toss internal gateway, Kakao API platform, Mercari and ZOZO microservices. Rate limiting, auth, schema validation, caching, BFF patterns, OpenAPI 3.1 and AsyncAPI 2/3, gRPC and WebSocket support, and how gateways get redefined in the LLM era. Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) api-gatewaykongtykapigeekrakendzuploaws-api-gatewaycloudflare-apiazure-apimgraviteeenvoy-gatewaytraefikportkeyheliconeopenrouter2026deep-diveenglish https://www.youngju.dev/blog/culture/2026-05-16-api-gateway-2026-kong-tyk-apigee-krakend-zuplo-envoy-gateway-traefik-3-deep-dive.ja https://www.youngju.dev/blog/culture/2026-05-16-api-gateway-2026-kong-tyk-apigee-krakend-zuplo-envoy-gateway-traefik-3-deep-dive.ja 2026年のAPIゲートウェイ市場は4つに分かれた — オープンソースのセルフホスト(Kong 4, Tyk, KrakenD, Envoy Gateway, Traefik 3, Gravitee)、マネージドSaaS/クラウド(Apigee, AWS API Gateway, Cloudflare API Gateway, Azure API Management, MuleSoft)、プログラマブルなエッジ(Zuplo)、そして新興のLLM APIゲートウェイ(Portkey, Helicone, OpenRouter)。Masheryは2024年1月にサンセット、KongはKonnectでクラウド側を強化、Envoy GatewayはCNCF Graduatedに昇格。この記事では15の選択肢をカテゴリ・機能・価格・実例で比較する — Tossの自家製ゲートウェイ、KakaoのAPIプラットフォーム、メルカリ・ZOZOのマイクロサービスまで。レート制限・認証・スキーマ検証・キャッシュ・BFFパターン、OpenAPI 3.1とAsyncAPI 2/3、gRPC・WebSocketサポート、そしてLLM時代にゲートウェイがどう再定義されるか。 Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) api-gatewaykongtykapigeekrakendzuploaws-api-gatewaycloudflare-apiazure-apimgraviteeenvoy-gatewaytraefikportkeyheliconeopenrouter2026deep-dive日本語 https://www.youngju.dev/blog/culture/2026-05-16-api-gateway-2026-kong-tyk-apigee-krakend-zuplo-envoy-gateway-traefik-3-deep-dive https://www.youngju.dev/blog/culture/2026-05-16-api-gateway-2026-kong-tyk-apigee-krakend-zuplo-envoy-gateway-traefik-3-deep-dive 2026년 현재 API 게이트웨이 시장은 네 갈래로 갈라졌다 — 오픈소스 셀프호스팅(Kong 4, Tyk, KrakenD, Envoy Gateway, Traefik 3, Gravitee), 매니지드 SaaS/클라우드(Apigee, AWS API Gateway, Cloudflare API Gateway, Azure API Management, MuleSoft), 프로그래머블 엣지(Zuplo), 그리고 새롭게 떠오른 LLM API 게이트웨이(Portkey, Helicone, OpenRouter). Mashery는 2024년 1월에 일몰됐고, Kong은 Konnect로 클라우드를 강화했으며, Envoy Gateway는 CNCF Graduated로 올라갔다. 이 글은 15가지 옵션을 분류·기능·가격·실제 사용 사례로 비교한다 — 토스의 자체 게이트웨이, 카카오의 API 플랫폼, Mercari·ZOZO의 마이크로서비스 진영까지. rate limiting·인증·schema validation·caching·BFF 패턴, OpenAPI 3.1과 AsyncAPI 2/3, gRPC·WebSocket 지원, 그리고 LLM 시대에 게이트웨이가 어떻게 재정의되는지. Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) api-gatewaykongtykapigeekrakendzuploaws-api-gatewaycloudflare-apiazure-apimgraviteeenvoy-gatewaytraefikportkeyheliconeopenrouter2026deep-dive https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive.en https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive.en The 2026 LLM ops map. Helicone (YC) · LangSmith (LangChain) · Langfuse (open source, Series A) · W&B Weave · Arize Phoenix · Braintrust · Athina · Comet Opik (released March 2025) · Vellum · PromptHub · Portkey AI Gateway · TruLens · Ragas · DeepEval · Galileo · Patronus AI · OpenAI Evals · Bedrock Evals · Vertex AI Evaluation Service. We classify the field into four areas — observability / evaluation / prompt management / gateway — cover Korean and Japanese practice at Toss, NAVER HCX, Sakana, and NTT Tsuzumi, and end with concrete picks for solo developer · startup · enterprise · RAG-first personas. Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) llm-observabilityprompt-engineeringheliconelangsmithlangchainlangfusewandb-weavearize-phoenixbraintrustathinacomet-opikvellumprompthubportkeytrulensragasdeepevalgalileopatronus-aibedrock-evalsvertex-ai-eval2026deep-diveenglish https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive.ja https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive.ja 2026年の LLM ops 地図。Helicone (YC) · LangSmith (LangChain) · Langfuse (OSS Series A) · W&B Weave · Arize Phoenix · Braintrust · Athina · Comet Opik (2025年3月リリース) · Vellum · PromptHub · Portkey AI Gateway · TruLens · Ragas · DeepEval · Galileo · Patronus AI · OpenAI Evals · Bedrock Evals · Vertex AI Evaluation Service。可観測性 / 評価 / プロンプト管理 / ゲートウェイの 4 領域で分類し、韓国のトス LLM ops、NAVER HCX 監視、日本の Sakana、NTT つづみ運用まで網羅。個人開発者・スタートアップ・エンタープライズ・RAG 優先組織がそれぞれ何を選ぶべきかを示す。 Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) llm-observabilityprompt-engineeringheliconelangsmithlangchainlangfusewandb-weavearize-phoenixbraintrustathinacomet-opikvellumprompthubportkeytrulensragasdeepevalgalileopatronus-aibedrock-evalsvertex-ai-eval2026deep-dive日本語 https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive https://www.youngju.dev/blog/culture/2026-05-16-llm-observability-prompt-tools-2026-helicone-langsmith-langfuse-braintrust-athina-opik-deep-dive 2026년의 LLM ops 지도. Helicone (YC) · LangSmith (LangChain) · Langfuse (오픈소스 Series A) · W&B Weave · Arize Phoenix · Braintrust · Athina · Comet Opik (2025년 3월 출시) · Vellum · PromptHub · Portkey AI Gateway · TruLens · Ragas · DeepEval · Galileo · Patronus AI · OpenAI Evals · Bedrock Evals · Vertex AI Evaluation Service 까지. 관찰성 / 평가 / 프롬프트 관리 / 게이트웨이 네 영역으로 분류하고, 한국의 토스 LLM ops 와 NAVER HCX 모니터링, 일본의 Sakana 와 NTT Tsuzumi 운영까지 — 1인 개발자 · 스타트업 · 엔터프라이즈 · RAG 우선 조직이 각각 무엇을 골라야 하는가. Sat, 16 May 2026 00:00:00 GMT fjvbn2003@gmail.com (Youngju Kim) llm-observabilityprompt-engineeringheliconelangsmithlangchainlangfusewandb-weavearize-phoenixbraintrustathinacomet-opikvellumprompthubportkeytrulensragasdeepevalgalileopatronus-aibedrock-evalsvertex-ai-eval2026deep-dive