Razorpay Software Limited
Feb 2022 — Present · Bengaluru
- Lead Software EngineerNov 2024 — Present
- Senior Software EngineerFeb 2022 — Oct 2024
AI Infrastructure
- Built and operate Razorpay's LLM gateway on top of LiteLLM (self-hosted) — a multi-tenant proxy fronting commercial LLM APIs and Fireworks-hosted OSS models with per-user/team/app API keys, provider failover, streaming responses, and per-tenant cost attribution. Serves ~100 teams at 400K+ requests/day (50 RPS peak); drove a 20% reduction in LLM spend.
Developer Platform
- Led a team of 4 engineers building the control plane for Razorpay's pre-production infrastructure — a multi-tenant Kubernetes platform serving 1,000+ engineering consumers across 100+ services.
- Designed and implemented a Kubernetes-native control plane (custom operators + CRDs) provisioning 5,000+ ephemeral environments per week on AWS EKS. Cut provisioning time from 10min → 2min by replacing per-environment Helm installs with a CRD that forks a warm baseline deployment, eliminating bootstrap overhead.
- Built a workflow orchestration engine on Argo Workflows (Go) that executes 2,000+ end-to-end test pipelines per week across the service fleet.
Cell-Based Architecture
- Designed the IaC abstraction for Razorpay's cell-based architecture using Terragrunt stacks — composable, region-isolated deployment units where each cell is a self-contained instance of the full service fleet for one country. Bounded the failure domain of a regional outage to that country's traffic alone.
- Bootstrapped the first cell end-to-end: brought up the initial service set on the new abstraction and established the patterns adopted across all subsequent cells. Foundation now runs 10+ cells hosting 100+ services, including Razorpay's Singapore and US deployments.