🌌Provison K8s Clusters

This guide illustrates how to provision Kubernetes clusters on different cloud providers using Terraform. Jobs, Pipelines, Services, Applications managed by Canso, will run on these provisoned clusters.

These clusters are also referred to as a the Data Plane Cluster. The Data Plane resides in the Customer's/Tenant's Cloud, therefore your data never leaves your cloud environment.

AWS - EKS

The Data Plane cluster (which is compatible with Canso Platform) has the following components

• VPC and Subnets

• EKS Cluster

• IAM/IRSA Roles

• Drivers such as EFS, EBS etc

• A production grade DB such as RDS

• S3 Buckets (These are buckets where Canso jobs will persist outputs and artifacts)

• AWS Secrets Manager to Store Secrets

• A key-value store such as Redis

All necessary modules, scripts to provision the above are in this open sourced canso-data-plane-k8s-cluster-tf repository.

Make sure you follow the steps noted in the Usage section and please be mindful of the disclaimers and special comments highlighted in there. If you do not have a dedicated DevOps/Infra team, the Canso team can help provision the infra for you. Please reach out to us if you need any assistance and see the Canso Community page for ways to reach out to us.

GCP - GKE

• Not yet available. Part of the roadmap.

Azure - AKS

• Not yet available. Part of the roadmap.

Oracle - OKE

• Not yet available. Part of the roadmap.

Red Hat Openshift

• Not yet available. Part of the roadmap.

---

• Go back to Table of Contents

• Reach out to us Canso Community