~/ shubham tatvamasi
GPU sharing, LLM serving and Kubernetes platforms, from a single node to fleets of clusters, engineered so models run fast, GPUs never sit idle and nothing goes dark.
Most people meet AI through a chat box. I live one layer down, where tokens become GPU cycles, GPU cycles become heat, and a single misrouted request can idle a rack. My work is making that layer boring in the best way: declarative, observable, self-healing, and secure enough that nobody has to think about it.
Making the whole stack, from the GPU die to the API gateway, behave like one calm, observable, self-healing system.
One control plane for models served through KServe, NVIDIA Dynamo, NIM, vLLM and SGLang. Model-aware routing through Envoy AI Gateway and llm-d, budgets and keys via LiteLLM, GuideLLM benchmarks, and autoscaling that adds replicas before it adds GPUs.
Telling allocated apart from actually computing. DRA with MIG, MPS and time-slicing, Kueue and KAI queues, and NVIDIA and AMD telemetry that catches idle, faulty and oversubscribed GPUs.
Controllers, CRDs and operators in Go. Multi-cluster networking, tenant isolation and HA storage that heals itself.
Flux CD reconciling 80+ clusters. If it isn't in Git, it doesn't exist.
Post-quantum key exchange, signatures and certificate lifecycles, automated as Kubernetes-native resources.
Encrypted tunnels from 900+ devices behind carrier-grade NAT to private and public clouds. Fleets that stay reachable, observable and patched no matter where they live.
A short operating manual for the systems I build, and the way I build them.
Every cluster, model and secret should be reproducible from a commit. If a human has to remember it, it will be forgotten.
Allocated isn’t utilised. Ready isn’t responsive. I chase the metric that tells the truth, not the one that looks good on a dashboard.
Replicas before nodes, caches before GPUs, routing before hardware. Efficiency is a design decision, not a cost report.
Harvest-now, decrypt-later is real. Post-quantum crypto belongs in today’s pipelines, not tomorrow’s roadmap.
The best infrastructure ideas get sharper in public. Ship it, document it, let others break it.
A tiny, very real-feeling terminal. Type help to look around, or try nvidia-smi.