Designing Low-Latency ML Inference Systems for Autonomous Vehicles: A System Design Interview…

System Design Question: How would you design a low-latency inference system that runs on an embedded GPU for example in the car?