Staff Software Engineer, Inference Routing @Polargrid
Software Development
Salary cad 220,000 - 2..
Remote Location
Employment Type full-time
Posted YDay

[Hiring] Staff Software Engineer, Inference Routing @Polargrid

YDay - Polargrid is hiring a remote Staff Software Engineer, Inference Routing. πŸ’Έ Salary: cad 220,000 - 265,000 per year πŸ“Location: Canada

Role Description

You will own the routing layer: the service that decides which GPU serves each request. You will build it, run it in production and set its technical direction.

This is a hands-on staff role. Most of your time goes to designing and writing the router and the placement logic behind it. You will work closely with the engineers who run our network and our GPU sites, and you will help hire the engineers who join you.

The router must ensure:

  • Every request lands on a GPU that is healthy, has room, and is close enough to be fast.
  • Capacity and health change constantly across many sites, requiring quick decision-making with slightly out-of-date information.
  • Fail safely: when a site or server goes down, traffic moves without customers noticing.

Qualifications

  • Deep knowledge of how networks, proxies, and load balancers work underneath, from building or running production systems.
  • Strong distributed systems fundamentals: consistency, failure handling, retries, and backpressure.
  • You write production code in a systems language such as Go or Rust.
  • You measure latency at the tail, not just the average, and know how to find where it comes from.
  • You have been on call for what you built.
  • You have set technical direction that other engineers built on.
  • You write clearly.
  • You use AI tools well and check their work.
  • You do not need GPU or ML experience; understanding the systems underneath deeply is what matters.
Before You Apply
️
remote Be aware of the location restriction for this remote position: Canada
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Staff Software Engineer, Inference Routing @Polargrid
Software Development
Salary cad 220,000 - 2..
Remote Location
Employment Type full-time
Posted YDay
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Application Denied βœ“
Unlock 135,000+ Remote Jobs
️
remote Be aware of the location restriction for this remote position: Canada
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Application Denied βœ“
Unlock 135,000+ Remote Jobs
Γ—
Apply to the best remote jobs
before everyone else

Access 135,000+ vetted remote jobs and get daily alerts.

4.9 β˜…β˜…β˜…β˜…β˜… from 500+ reviews

⚑ 138,861+ remote jobs, refreshed hourly

πŸ”” Real-time alerts: Apply first, direct to employer

πŸ›‘οΈ Vetted companies, no scams, true remote only

Unlock All Jobs Now

Maybe later