GKE with Kubernetes Gateway API - Global Load Balancers

Step-01: Introduction¶

Create GCP Application Load Balancer using Kubernetes Gateway API
Approach-1: Using Kubernetes YAML Manifests
Approach-2: Using Terraform Manifests

Step-02: Approach-1: Using Kubernetes YAML Manifests¶

Step-02-01: NO CHANGES¶

01-myapp1-deployment.yaml
02-myapp1-clusterip-service.yaml

Step-02-02: 03-gateway.yaml¶

kind: Gateway
apiVersion: gateway.networking.k8s.io/v1beta1
metadata:
  name: mygateway1-global
spec:
  gatewayClassName: gke-l7-global-external-managed
  listeners:
  - name: http
    protocol: HTTP
    port: 80

Step-02-03: 04-gateway-http-route.yaml¶

kind: HTTPRoute
apiVersion: gateway.networking.k8s.io/v1beta1
metadata:
  name: route-external-http
spec:
  parentRefs:
  - kind: Gateway
    name: mygateway1-global
  rules:
  - backendRefs:
    - name: myapp1-service
      port: 80

Step-02-04: Deploy and Verify Resources¶

# List Kubernetes Gateway Classes
kubectl get gatewayclass

# Deploy Kubernetes Resources
kubectl apply -f p2-global-k8sresources-yaml

# List Kubernetes Deployments
kubectl get deploy

# List Kubernetes Pods
kubectl get pods

# List Kubernetes Services
kubectl get svc

# List Kubernetes Gateways created using Gateway API
kubectl get gateway
kubectl get gtw

# Describe Gateway
kubectl describe gateway mygateway1-regional

# List HTTP Route
kubectl get httproute

# Verify Gateway is GCP GKE Console
Go to GKE Console -> Networking -> Gateways, Services & Ingress -> mygateway1-regional

# Verify GCP Cloud Load Balancer
Go to Cloud Load Balancers -> Review load balancer settings

# Access Application
http://<LB-IP>

Step-02-06: Clean-up¶

# Delete Kubernetes Resources
kubectl delete -f p2-global-k8sresources-yaml

Step-03: Project-3: p3-global-k8sresources-terraform-manifestsTerraform Manifests¶

Step-03-01: NO changes to following manifests¶

Folder: p3-k8sresources-terraform-manifests
c2-01-variables.tf
c2-02-local-values.tf
c3-01-remote-state-datasource.tf
c3-02-providers.tf
c4-myapp1-deployment.tf
c5-myapp1-clusterip-service.tf
terraform.tfvars

Step-03-02: c1-versions.tf¶

Update your Cloud Storage Bucket

  backend "gcs" {
    bucket = "terraform-on-gcp-gke"
    prefix = "dev/k8s-gateway-regional-demo1"    
  }

Step-03-04: c6-gateway.tf¶

resource "kubernetes_manifest" "my_gateway" {
  manifest = {
    apiVersion = "gateway.networking.k8s.io/v1"
    kind       = "Gateway"
    metadata = {
      name = "mygateway1-regional"
      namespace = "default"
    }
    spec = {
      gatewayClassName = "gke-l7-regional-external-managed"
      listeners = [{
        name     = "http"
        protocol = "HTTP"
        port     = 80
      }]
    }
  }
}

Step-03-05: c7-gateway-http-route.tf¶

resource "kubernetes_manifest" "http_route" {
  manifest = {
    apiVersion = "gateway.networking.k8s.io/v1beta1"
    kind       = "HTTPRoute"
    metadata = {
      name = "route-external-http"
      namespace = "default"      
    }
    spec = {
      parentRefs = [{
        kind = "Gateway"
        name = "mygateway1-global"
      }]
      rules = [{
        backendRefs = [{
          name = kubernetes_service_v1.service.metadata[0].name 
          port = 80
        }]
      }]
    }
  }
}

Step-03-06: Execute Terraform Commands¶

# Change Directory
cd p3-global-k8sresources-terraform-manifests

# Terraform Initialize
terraform init

# Terraform Validate
terraform validate

# Terraform plan
terraform plan

# Terraform Apply
terraform apply -auto-approve

Step-03-07: Verify Kubernetes Resources¶

# List Kubernetes Deployments
kubectl get deploy

# List Kubernetes Pods
kubectl get pods

# List Kubernetes Services
kubectl get svc

# List Kubernetes Gateways created using Gateway API
kubectl get gateway
kubectl get gtw

# Describe Gateway
kubectl describe gateway mygateway1-regional

# List HTTP Route
kubectl get httproute

# Verify Gateway is GCP GKE Console
Go to GKE Console -> Networking -> Gateways, Services & Ingress -> mygateway1-regional

# Verify GCP Cloud Load Balancer
Go to Cloud Load Balancers -> Review load balancer settings

# Access Application
http://<LB-IP>

Step-03-08: Clean-Up¶

# Change Directory
cd p3-regional-k8sresources-terraform-manifests

# Terraform Destroy
terraform apply -destroy -auto-approve

Step-04: Clean-up - Delete GKE Cluster¶

# Change Directory
cd p1-gke-autopilot-cluster-private

# Terraform Init
terraform init

# Terraform State list
terraforms state list

# Terraform destroy
terraform apply -destroy -auto-approve

Gateway Documentation¶

https://gateway-api.sigs.k8s.io/reference/spec/#gateway.networking.k8s.io/v1.Listener