Get daily remote job opportunities in your inbox

No middlemen, no spam, no infinite scrolling.

Get relevant job opportunities, one email at a time.

Unsubscribe at any time.

Senior Infrastructure Software Engineer @Baseten

[Hiring] Senior Infrastructure Software Engineer @Baseten

Mar 10, 2025 - Baseten is hiring a remote Senior Infrastructure Software Engineer. 💸 Salary: competitive compensation package. 📍Location: USA.

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

As a Senior Infrastructure Software Engineer at Baseten, you'll architect and lead development of our ML inference platform that powers production AI applications. You'll make key technical decisions for the infrastructure enabling developers to deploy, scale, and monitor ML models with high performance and reliability.

  • Design and architect scalable infrastructure systems for our ML inference platform
  • Lead optimization of Kubernetes deployments for efficient, cost-effective model serving
  • Drive enhancements to our inference orchestration layer for complex model deployments
  • Define monitoring strategies for model performance, latency, and resource utilization
  • Develop advanced solutions for GPU capacity management and throughput optimization
  • Establish infrastructure automation standards to streamline ML deployment workflows
  • Partner with other engineers to translate complex inference requirements into technical solutions
  • Make critical architectural decisions balancing performance with system reliability
  • Lead technical discussions and mentor junior engineers on infrastructure best practices
  • Contribute to long-term technical strategy and infrastructure roadmap

Qualifications

  • Bachelor's degree or higher in Computer Science or related field
  • 5+ years experience building production infrastructure systems
  • Expert-level proficiency in Go, with Python experience a plus
  • Deep expertise with Kubernetes in production environments
  • Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) a plus
  • Advanced understanding of distributed systems concepts and performance tuning
  • Proven experience designing observability systems
  • Track record of leading technical initiatives and mentoring engineers
  • Experience with ML/AI workloads and MLOps platforms highly valued

Benefits

  • Competitive compensation package (Unlimited PTO, 401k, covered healthcare premiums, remote-first culture)
  • A unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era
  • An inclusive and supportive work culture that fosters learning and growth
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities

Similar Remote Jobs

More jobs at Baseten

More Software Development jobs

More jobs in USA

Before You Apply
📍 Be aware of the location restriction for this remote position: USA
Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Senior Infrastructure Software Engineer @Baseten
Software Development
Salary 💸 competitive compensation package
Remote Location
USA
Job Type full-time
Posted Mar 10, 2025
Apply for this position Unlock 54,644 Remote Jobs
📍 Be aware of the location restriction for this remote position: USA
Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Senior Infrastructure Software Engineer Apply for this position Unlock 54,644 Remote Jobs
×
  • Unlock 54,644 hidden remote jobs.
  • Your shortcut to remote work. Apply before everyone else.
  • Click and apply. No middlemen, no hassle.

We’re not like the other sites. Come see why!

50% off in April 2025
  • Single payment
  • Lifetime access
  • Filter by location/skills/salary…
  • Create custom email alerts
  • Private Slack Community