Software Engineer - Inference Platform
Toronto, ON +1Baseten
3+ ansCandidates need 3+ years building distributed systems or large-scale backend APIs, with experience in low-latency services, observability and performance profiling. Kubernetes, GPU workloads and LLM inference experience are assets, but prior ML experience is not required.
Kubernetes, GPU, vLLM, SGLang, TensorRT-LLM, NVIDIA Dynamo
Software Engineer - Testing Frameworks
Toronto, ON +1Baseten
Candidates need strong Go and/or Python skills and experience building test tooling used by others. They also need hands-on work with testing frameworks, distributed-system integration testing, load testing tools, Kubernetes and Docker, and CI/CD at scale.
Kubernetes, Docker, k6, Locust, Vegeta, JMeter
Software Engineer - Observability
Toronto, ON +1Baseten
Candidates need deep experience in at least one observability area such as metrics, logging, tracing or error analytics, plus strong skill in Python, Rust or Go. Experience with platforms like Prometheus, Grafana, ClickHouse or OpenTelemetry and high-throughput data pipelines is expected.
Prometheus, Grafana, ClickHouse, OpenTelemetry
Software Engineer - GPU Networking & Distributed Systems
Toronto, ON +1Baseten
Baseten needs deep experience with high-performance networking such as InfiniBand and RoCE v2, and fluency in C++ or Python. Candidates should understand NVIDIA GPU memory architecture and be comfortable debugging low-level systems.
InfiniBand, RoCE, NCCL, NVSHMEM, NVLink, TensorRT-LLM