We partition physical GPUs into virtual ones for different tasks: training, inference, development.
What We Configure
- vGPU, MIG and time-slicing — share GPUs between teams and workloads
- GPU Operator, Kueue and Volcano — GPU workload scheduling in Kubernetes
- Cluster configuration: PCIe or SXM, NVLink, InfiniBand or RoCE networking
- Per-GPU utilization, memory and temperature monitoring