Team Idea
Hello everyone, welcome to "MyAMD_Instinct_Orchestrating_vLLM" Platform where you can build, learn and earn from your skills. This is An enterprise-grade reference architecture for automated multi-node cluster provisioning, Layer-2 networking load-balancing, and high-throughput LLM serving (vLLM) optimized over AMD Instinct™ MI300X CDNA3 acceleration systems.
🗺️ Reference System Architecture:
[ Client API Tunnels ] ──► [ Secure SSH Port Forward: 5000 ]│▼┌──────────────────────────┐│ MetalLB LoadBalancer │└──────────────────────────┘│▼┌──────────────────────────┐│ vLLM Inference Pod ││ (Qwen2.5-1.5B-Instruct)│└──────────────────────────┘│▼[AMD GPU Operator](ROCm / Device Node Plugin)
🏗️ Repository Module Breakdown
- `check-system-enhanced.sh`: Automatic environment verification tool checking process logs, lock bounds, and PCIe GPU links.
- `install-kubernetes.sh`: Automated provisioning loop initializing kubeadm control-plane nodes and installing Calico operators.
Team Members
Prakash Singh
prakash-singh
MDABUL HOSSAIN
AnticipatedD
SVP and Head of Strategic Park
Sai Yogesh Velagapudi
SAI_y
Student
Submission
Team Leader hasn't made a submission yet