Designing a Production-Grade Kubernetes Platform
NordCloud Systems came to Distera Labs with a Kubernetes cluster that had grown organically for two years: manual kubectl deploys, no tenant isolation, and an on-call rotation dreading every release.
We rebuilt the platform around three principles: everything in Git, everything reproducible, and blast radius contained per team.
Architecture
- Multi-cluster GitOps with Argo CD, one cluster per environment, promoted through Git branches rather than manual promotion.
- Namespace-per-team isolation with NetworkPolicies and ResourceQuotas defined declaratively alongside each team's application manifests.
- Terraform-managed infrastructure (VPC, node pools, IAM) versioned in the same monorepo as the cluster configuration, so infra and workload changes review together.
Rollout
We migrated services in waves, starting with stateless internal tools, validating the GitOps loop end to end before touching anything customer-facing. Each wave shipped with its own rollback plan and a dashboard comparing error rates pre/post cutover.
Results
Deploy frequency went from twice a week to on-demand, mean time to rollback dropped from 40 minutes to under 3, and the on-call team stopped needing direct cluster access for routine releases — everything now goes through the same reviewed, audited Git path.