Zum Inhalt springen
>_<
AI EngineeringWiki

Proxmox Setup

Tools · 6 min

Proxmox VE is an open-source virtualization platform. Perfect for running your AI stack.

Why Proxmox?

  • Open Source - free
  • KVM + LXC virtualization
  • Web-based management
  • Cluster support
  • Backup & snapshot features

Installation

# Download ISO from proxmox.com
# Boot from USB
# Follow installation wizard
# Access via https://your-ip:8006

AI Stack Resources

VMCPURAMDisk
Ollama (GPU)8 cores32GB100GB
n8n4 cores8GB50GB
PostgreSQL4 cores16GB100GB
Monitoring2 cores4GB50GB

GPU Passthrough

# /etc/modprobe.d/blacklist.conf
blacklist nvidia
blacklist nvidia_uvm

# /etc/modules
nvidia
nvidia_uvm

# In VM config:
hostpci0: 01:00,pcie=1

Cluster Setup

  • Minimum 3 nodes for quorum
  • Shared storage (NFS or Ceph)
  • Network: 10Gbps recommended
  • Use Proxmox VE Cluster

Next step: ship workflows that stay operable

Use proven n8n patterns, templates and integrations for workflows that stay local, documented, and auditable.

Why AI Engineering
  • Local and self-hosted by default
  • Documented and auditable
  • Built from our own runtime
  • Made in Austria
Not legal advice.