Add support for kots on arm64

[camilamacedo86]

Description

Currently, we are unable to use kots install and schedule the console on arch arm64.
The kotsadm pod will not be scheduled:

kots/pkg/kotsadm/objects/affinity_objects.go

Lines 10 to 35 in c597a4a

	func defaultKOTSNodeAffinity() *corev1.NodeAffinity {
	return &corev1.NodeAffinity{
	RequiredDuringSchedulingIgnoredDuringExecution: &corev1.NodeSelector{
	NodeSelectorTerms: []corev1.NodeSelectorTerm{
	{
	MatchExpressions: []corev1.NodeSelectorRequirement{
	{
	Key: "kubernetes.io/os",
	Operator: corev1.NodeSelectorOpIn,
	Values: []string{
	"linux",
	},
	},
	{
	Key: "kubernetes.io/arch",
	Operator: corev1.NodeSelectorOpNotIn,
	Values: []string{
	"arm64",
	},
	},
	},
	},
	},
	},
	}
	}

More info: #896

Motivation

• Add support for Apple Silicon
• Allow users and maintainers to use and test the solution into for example Apple Silicon.
• Allow users to use the solution in any linux arm64 env

[cbodonnell]

Thank you for opening this issue, @camilamacedo86. This is something that we hope to support in the future, and SC34569 is our internal tracker for this.

[CharlesB2]

👍 on this one, currently I can't test KOTS locally on minikube, I'm forced to use a remote cluster

[adejanovski]

Hi folks, just got a macbook with an M2 chip and removing the arm64 affinity rule in the kots deployment allows it to be scheduled and as far as I can tell, it works without a problem after that.

Was the kots binary made arm64 compatible and it's now just a matter of removing that restriction in the deployment?
Here are the changes I made to get it to work.

[roderik]

I request at least an option --ignore-arch or something so we can do it. It works and might not be compiled right, but with rosetta installed it works without an issue