Member of Technical Staff (Software Engineer, Inference & Training Platform)

the company serves hundreds of millions of queries a month, and every one of them fans out into multiple AI inference requests running in real time. Behind that sits a large GPU fleet spread across several cloud…