FactoryPilot: AI Maintenance Agent on AMD MI300X

When a production line starts making bad parts, the shift supervisor has to connect a photo, a sensor dashboard and a long PDF manual by hand while scrap piles up and an early bearing fault turns into an unplanned stop. FactoryPilot does that in seconds. A technician uploads one photo. The agent runs a golden-sample visual pre-screen, analyses the live sensor log (drift, spikes, ISO 10816 vibration zones and a forecast of hours until alarm), and pulls the relevant manual pages from an Evolus knowledge library. It then sends everything to Qwen2.5-VL, served by vLLM on an AMD Instinct MI300X with ROCm, which returns a schema-checked diagnosis: root cause, severity, calibrated confidence, ordered actions with real manual values (8 Nm, 6 g of grease), safety steps and page-level citations. Five deterministic guardrails then check confidence, severity, citations, evidence agreement and trip-level sensors. Made-up citations are removed. Safe calls are dispatched to the right technician through an Evolus workflow. Critical ones, like a cracked press die, are held for one-click supervisor approval. A live floor view, a work-order queue and a copilot that answers in Italian complete the product. One MI300X (192 GB HBM3) serves the whole plant on an open model, so photos and process data stay on infrastructure the factory controls. Every model call reports time to first token and tokens per second in the app.