Software Engineer - Voice AI (Inference Runtime)
Toronto, ON +1Baseten
Baseten needs a bachelor's degree or higher in Computer Science or a related field and a track record running production real-time systems where tail latency matters. Strong coding skills in a popular language, collaboration skills, and daily use of AI coding assistants are also required.
Python, PyTorch Profiler, vLLM, TensorRT, ONNX, Docker
Software Engineer - GPU Kernels
Toronto, ON +1Baseten
Candidates need a strong understanding of GPU architecture and memory hierarchy, proficiency in C++ and GPU profiling tools, and knowledge of the CUDA C++ API, numerical precision and modern GPU features. Experience with Transformer models, Flash Attention, Cutlass, Triton or GEMM tuning is a plus.
CUDA, PTX, Nsight Systems, Nsight Compute, Torch Profiler, Cutlass
Software Engineer - Dedicated Inference
Toronto, ON +1Baseten
Candidates need a bachelor's degree or higher in computer science or a related field and proficient coding skills in one or more languages, with Python, Go or JavaScript a plus. Familiarity with web applications and databases, good product judgment for developer tools, and strong collaboration skills are also expected.
React, Kubernetes