Software Engineer - Inference Platform
Toronto, ON +1HybrideTemps plein
Baseten
3+ ansCandidates need 3+ years building distributed systems or large-scale backend APIs, with experience in low-latency services, observability and performance profiling. Kubernetes, GPU workloads and LLM inference experience are assets, but prior ML experience is not required.
Kubernetes, GPU, vLLM, SGLang, TensorRT-LLM, NVIDIA Dynamo