// devops · platform · site-reliability

I deploy and scale AI in production
on Kubernetes.

Senior DevOps and platform engineer. I build and run the Kubernetes platforms that put AI into production. Most recently that was Myriad's generative-AI platform: multi-model LLM serving, GitOps delivery, GPU autoscaling, and a Sigstore-signed supply chain.

Open to senior / staff platform & AI-infrastructure roles
What I do

The stack behind production AI

Kubernetes & Platform

Design and run clusters end to end, from managed EKS and OpenShift to kubeadm by hand. Autoscaling, multi-tenancy, and platforms teams can self-serve.

EKSOpenShiftKarpenterCiliumIstio

GitOps & Delivery

Everything in Git, reconciled continuously. Promotion through environments with canary analysis and fast rollback, driven by ArgoCD and GitHub Actions.

ArgoCDArgo RolloutsGitHub ActionsTerraformHelm

AI / ML Deployment

Models off laptops and into production: inference serving, fine-tuning, and evaluation on GPU infrastructure that scales to demand and back to zero.

vLLMLoRAKEDARAGLangGraph

Security & Supply Chain

Zero static credentials, OIDC for access, and images signed and verified at admission. Secrets and identity handled at the platform layer, not per app.

VaultSigstore cosignKyvernoKeycloakWireGuard

Observability & SRE

Multi-window burn-rate alerts on SLOs, distributed traces across the request path, and live GPU telemetry. Google-SRE-style incident response behind it.

PrometheusGrafana TempoLangfuseDCGM

Cloud & Networking

AWS as code, and the networking layer underneath it: eBPF CNI, service mesh, Gateway API, and DNS that holds up under load.

AWSCilium eBPFIstioRoute 53
Selected work

Built and operated at Myriad Genetics

Over the past year Myriad piloted a generative and agentic AI platform on EKS. I built the platform side of it. Four pieces of that work:

Interactive: explore this platform layer by layer

click-through diagram

A drill-down of the whole architecture, from the AWS account down to individual containers: the Fargate bootstrap, Karpenter node pools, the Cilium eBPF data plane and Gateway, vLLM serving, the QLoRA training pipeline, and the autoscaling loop that ties them together.

Open the interactive architecture →

EKSFargateKarpenterCilium GatewayvLLMKEDA

Generative-AI platform on EKS

end-to-end platform

Architected the platform with Terraform for the cluster, VPC, IAM, and Karpenter node pools, and an ArgoCD App-of-Apps model that bootstraps Vault, External Secrets, cert-manager, Cilium, Istio, and Kyverno, then hands every downstream workload to GitOps. It serves nine models through vLLM, from Llama 3.1 8B on the fast path to 405B AWQ for reasoning, routed by a four-tier LangGraph classifier with cost- and latency-aware routing.

EKSTerraformArgoCDvLLMLangGraphVault

Cilium eBPF data-plane migration

networking & security

Moved the production data plane off the AWS VPC CNI and managed node groups onto Cilium eBPF with Karpenter. Only the Karpenter controller runs on a Fargate bootstrap; everything else, including CoreDNS, ArgoCD, and Istio, runs on Karpenter-provisioned EC2. Cilium handles ENI IPAM, kube-proxy replacement, and WireGuard encryption pod-to-pod and node-to-node. I wrote 36 network policies and 7 Tetragon tracing policies for runtime detection. This removed the per-node ENI-exhaustion ceiling the VPC CNI imposed.

CiliumeBPFKarpenterWireGuardTetragon

LLM fine-tuning pipeline

training on Kubernetes

Built a fine-tuning loop on EKS. The Kubeflow Training Operator runs an Axolotl QLoRA job on Llama 3.1 8B on a single A10G GPU, syncs the trained adapter to S3 through Pod Identity, and serves it back with vLLM's LoRA support. A parallel lm-eval run scores the tuned adapter against the base model and writes the results to Postgres, closing the loop for the next round of tuning.

Axolotl QLoRAKubeflowvLLMlm-evalLlama 3.1

Signed supply chain & zero-trust

devsecops

Signed every image with Sigstore cosign, keyless through GitHub Actions OIDC with a separate IAM role per app, and enforced it at admission: six Kyverno policies check the registry allowlist, signature, and digest pinning before a pod runs. East-west traffic defaults to deny across namespaces with WireGuard underneath, and a three-node Vault HA cluster issues dynamic Postgres credentials and syncs secrets through both the Agent Injector and the Secrets Operator.

Sigstore cosignKyvernoVault HAGitHub Actions OIDC
Toolbox

Technologies I work with

KubernetesEKSOpenShift / ROSAArgoCDArgo RolloutsTerraformGitHub ActionsHelmKustomizeKarpenterCiliumIstioKEDAVaultExternal SecretsKeycloakSigstore cosignKyvernovLLMAxolotlLangGraphQdrantPrometheusGrafana TempoLangfuseKafka (Strimzi)PostgreSQLClickHouseAWSPythonBash
About

Two decades keeping production up

I'm a DevOps and platform engineer with 23 years running production infrastructure, the last 9 on HIPAA-covered clinical genomics at Myriad Genetics. That work set the bar for how I approach AI: it has to run reliably, scale, and survive a security review.

These days I focus on the platforms behind AI, the Kubernetes, GitOps, and security foundations that take a model from a notebook to something a business can depend on. I take on the stalled and high-risk work, and I mentor the engineers around me.

Contact

Let's talk

Open to senior and staff roles in platform, DevOps, and AI infrastructure. The fastest way to reach me: