pve

Proxmox Virtual Environment

Requirements

Name	Version
proxmox	>= 6.2
terraform	>= 0.13
packer	>= 1.6.5
ansible	>= 2.9.6
helm	>= 3.2.4
kubectl	same as K8s cluster

Folder Structure

• main - Main entry point
• k8s_cluster - Kubernetes cluster based on Kubespray
• k8s infrastructure - Kubernetes infrastructure
• packer - Packer deployments
  • templates - Packer templates
• bastion - Bastion Host
• dns_records - Local & Global DNS records
• file - File resources (e.g. iso, lxc images)
• pve_nodes.yml - Additional configuration applied to Proxmox node
• requirements.yml - Local environment requirements (Ansible playbook)

Current setup

Quick start

Step 1: Install requirements

make install

or manually install

• Terraform
• Packer
• Ansible
• kubectl
• Helm

Step 3: Start Deployment

make init
make plan
make apply

Notes

pve_nodes.yml - additional configuration applied to Proxmox node

• Removes Proxmox Enterprise repository from sources (--tags subscription)
• Adds Debian Sources repository (--tags sources)
• Upgrade packages (--tags upgrade)
• Install Intel Graphics driver (--tags intel-graphics)
• Removes Subscription Popup (--tags popup)
• Enables PCI passthrough (--tags vfio, requires reboot )
  • Adds bootloader options
  • Adds kernel modules
  • Blacklist Nvidia and Radeon Drivers
  • Adds PCI devices to vfio-pci drivers (--extra-vars='{"vfio-pci-ids": ["1234:1234","5678:5678"]}')
    • To get Vendor IDs for GPU and Audio Bus

      # lspci -v | grep VGA # outputs: > 01:00.0 VGA controller 01:00.1 Audio Device
      # lspci -ns 01:00 # > 1234:1234, 1234:1234

• Reboot (--tags reboot, not invoked if not specified)