ML Inference & Optimization Engineer

You Bring

• 3+ years of experience in deploying and optimizing machine learning models in production, with 1+ years of experience in deploying deep learning models
• Experience deploying async inference APIs (FastAPI, gRPC, Ray Serve etc.)
• Understanding of PyTorch internals and inference-time optimization
• Familiarity with LLM runtimes: vLLM, TGI, TensorRT-LLM, ONNX Runtime etc.
• Familiarity with GPU profiling tools (nsight, nvtop), model quantization pipelines