Written by Sridher Manivel Based out of Charlotte, NC. Linkedin
A hands-on comparison of how to run LLM inference on Azure — fully managed Microsoft AI Foundry, self-hosted on AKS with vLLM or KAITO, and a hybrid that routes each workload to where the control-vs-convenience trade pays off
Run agentgateway, an OSS Kubernetes-native AI gateway, on AKS to abstract OpenAI, Anthropic, Gemini, and Microsoft AI Foundry behind a single OpenAI-compatible endpoint with centralized auth and observability
Why missing or mis-sized Kubernetes resource requests and limits cause production incidents, and how to enforce them at admission time with ValidatingAdmissionPolicy and CEL
Self-service platform portal over KRO custom APIs on AKS
Step-by-step Simple Platform contract examples with Kro on AKS
Applying a product mindset to Platform Engineering with Kro
Troubleshooting Your Platform Agentic AI Way! (Part 2)
Understanding the Modern Platform Landscape: Platform Engineering, AI Platforms, and Core Concepts (Part 1)
Simplifying open source model deployment and enterprise RAG implementation with Kubernetes AI Toolchain Operator
A comprehensive exploration of AKS scaling mechanisms and architectural decision guidance for HPA, Cluster Autoscaler, NAP, KEDA, VPA, and Fleet
A comprehensive comparison of Azure Kubernetes Service (AKS) and Azure Container Apps (ACA)
Understanding certificate basics, implementing TLS with Certbot, Certmanager and comparing with Service mesh
Demonstrating a simple MCP use case called 'Memento' - hosting an MCP server on AKS with Azure Files storage for personal memory management
Complete learning journey for MCP: from basic concepts to production Azure OpenAI integration with real-time tools
How to setup Istio CRDs to verify EntraID JWT and allow/deny calls
How to setup external auth as a sidecar or a service on AKS
Call APIM or any other service with a token based on workload identity
Canary deployment with Azure Container Apps
Custom domain process with Azure services
Use SFTP protocol to access files in Azure Blob Storage
Workload Identity in practice
AKS and Kubernetes as a Service
Container Options in Azure
