WIP test: optional traefik installation

[shreddedbacon]

General Checklist

• Affected Issues have been mentioned in the Closing issues section
• Documentation has been written/updated
• PR title is ready for inclusion in changelog

Database Migrations

• If your PR contains a database migation, it MUST be the latest in date order alphabetically

Description

This is an experimental branch to see which tests pass/fail when using Traefik instead of ingress-nginx, requires https://github.com/uselagoon/lagoon-charts/tree/traefik. This is not an indication that Traefik is our supported ingress-controller, just verifying alternatives.

While Traefik has some support for a fair few ingress-nginx annotations, described here, this branch is not using the ingress-nginx provider type, it is using a build-deploy-tool image that has support for traefik built in, and leverages middleware to reproduce some of the basics that Lagoon leveraged from ingress-nginx annotations. It runs a version of aergia-controller that has limited support for idling with traefik too.

What doesn't work in Lagoon (so far)

HSTS Configuration

The build-deploy-tool sets a nginx.ingress.kubernetes.io/configuration-snippet annotation that contains the HSTS header, the Traefik ingress-nginx provider doesn't support this.

Dev route X-Robots-Tag

The build-deploy-tool templating sets a nginx.ingress.kubernetes.io/server-snippet annotation, this is not supported in Traefik. Our nginx images do set this, however an alternative would need to be found for anything else.

Route annotations

Lagoon allows users to set annotations on their routes. If you've set annotations that are specific to ingress-nginx, these will likely not work unless they're listed as supported in Traefik.

Redirect annotations described in the docs are also unsupported.

Idling

Out of the box, aergia-controller does not support Traefik. It is possible to extend it to support Traefik using middlewares, however it does require a few things:

• configuring Traefik with --providers.kubernetescrd.allowcrossnamespace=true to allow the aergia backend to be available
• changes to the build-deploy-tool to provision a middleware CR for errors.

Linked

• feat: traefik support build-deploy-tool#472
• uselagoon/lagoon-charts@main...traefik
• feat: traefik support aergia-controller#65

[shreddedbacon]

https://traefik.io/blog/transition-from-ingress-nginx-to-traefik and https://doc.traefik.io/traefik/v3.5/reference/routing-configuration/kubernetes/ingress-nginx/

Update: There is a weird bug with traefik and the way ssl-redirect annotations, a community user has submit a PR to fix waiting for review. There is an image override in the traefik branch of lagoon-charts with an image built from that PR which does indeed solve the issue.

This only matters if using the ingress-nginx provider in traefik

[shreddedbacon]

New charts branch that can install different controllers.

Update: Not using that alternative branch now. We've settled on supporting Traefik