Sr Big Data Engineer @Rackspace

[Hiring] Sr Big Data Engineer @Rackspace

Apr 11, 2025 - Rackspace is hiring a remote Sr Big Data Engineer. 💸 Salary: $116,100 - $198,440. 📍Location: USA, Canada.

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven track record of writing production-grade code and building robust data workflows. This is a fully remote position and requires an independent, self-driven engineer who thrives in complex technical environments and communicates effectively across teams.

Key Responsibilities

  • Design and develop scalable batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, MapReduce, and HBase, with hands-on coding in Java or Python.
  • Write clean, efficient, and production-ready code with a strong focus on data structures and algorithmic problem-solving applied to real-world data engineering tasks.
  • Develop, manage, and optimize complex data workflows within the Apache Hadoop ecosystem, with a strong focus on Oozie orchestration and job scheduling.
  • Leverage Google Cloud Platform (GCP) tools such as Dataproc, GCS, and Composer to build scalable and cloud-native big data solutions.
  • Implement DevOps and automation best practices, including CI/CD pipelines, infrastructure as code (IaC), and performance tuning across distributed systems.
  • Collaborate with cross-functional teams to ensure data pipeline reliability, code quality, and operational excellence in a remote-first environment.

Qualifications

  • Bachelor's degree in Computer Science, software engineering or related field of study.
  • Experience with managed cloud services and understanding of cloud-based batch processing systems are critical.
  • Proficiency in Oozie, Airflow, Map Reduce, Java.
  • Strong programming skills with Java (specifically Spark), Python, Pig, and SQL.
  • Expertise in public cloud services, particularly in GCP.
  • Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce.
  • Familiarity with BigTable and Redis.
  • Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.
  • Proven experience in engineering batch processing systems at scale.

Requirements

  • 5+ years of experience in customer-facing software/technology or consulting.
  • 5+ years of experience with “on-premises to cloud” migrations or IT transformations.
  • 5+ years of experience building, and operating solutions built on GCP.
  • Proficiency in Oozie and Pig.
  • Proficiency in Java or Python.

Compensation Information

  • The anticipated starting pay range for Colorado is: $116,100 - $170,280.
  • The anticipated starting pay range for the states of Hawaii and New York (not including NYC) is: $123,600 - $181,280.
  • The anticipated starting pay range for California, New York City and Washington is: $135,300 - $198,440.

Similar Remote Jobs

More jobs at Rackspace

More Software Development jobs

More jobs in USA

Before You Apply
️
📍 Be aware of the location restriction for this remote position: USA, Canada
‼ Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Sr Big Data Engineer @Rackspace
Software Development
Salary đź’¸ $116,100 - $198,440
Remote Location
USA, Canada
Job Type full-time
Posted Apr 11, 2025
Apply for this position Unlock 54,112 Remote Jobs
️
📍 Be aware of the location restriction for this remote position: USA, Canada
‼ Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Sr Big Data Engineer Apply for this position Unlock 54,112 Remote Jobs
Ă—
  • Unlock 54,112 hidden remote jobs.
  • Your shortcut to remote work. Apply before everyone else.
  • Click and apply. No middlemen, no hassle.

We’re not like the other sites. Come see why!

50% off in April 2025
  • Single payment
  • Lifetime access
  • Filter by location/skills/salary…
  • Create custom email alerts
  • Private Slack Community