Lab 11: KServe Inference with HAMi DRA GPU Sharing
Deploy a KServe Standard vLLM service and run two Predictor replicas on one NVIDIA GPU through native HAMi DRA claims.
2 docs tagged with "hami"
View all tagsLab 5: Fake-GPU Scheduling with nvml-mock
Simulate 8 A100 GPUs with HAMi scheduling features, no real GPU needed.
