OCI Experiments 01: K8s cluster on ARM

This repo will contain my terraform experiments for creating a fully working K8s cluster using only OCI always free tier.

.tfvars file is treated like a secret, so git-crypt will be needed

Requirements

Needed ansible and terraform installed on your computer.

• A registered zone on AWS Route53 (if you don't have it delete domain.tf)
• A valid AWS CLI profile (needed only for domains)
• A valid OCI account with API Keys configured

Usage

• Launch terraform script with terraform apply
• Launch ansible playbook after created your hosts file
• Launch rancher on master node with following command

docker run -d --restart=unless-stopped \
  -p 80:80 -p 443:443 \
  --privileged \
  rancher/rancher:latest \
  --acme-domain <REPLACE-HERE-YOUR-DOMAIN>

• Create new RKE cluster manually :)
• Open the Rancher Console
• Create a new RKE2 cluster with default settings
• Copy the join command from "registration" tab into the machines and wait

If after some minutes with kubectl get all -A you see that all pods are running but cattle-agent, and on Rancher it's waiting for registration, that's probably because of dns.

In order to fix that launch kubectl -n cattle-system edit deployment cattle-cluster-agent

Search for dnsPolicy and change it to Default

Cert Manager

In order to use HTTPS on ingresses, install cert-manager chart from Rancher Apps without editing default values. Then download your kubeconfig file and run a kubectl apply -f k8s/ClusterIssuer.yaml (edit with your email before, please) in order to create a cluster issuer. When it finishes without errors, use it