[Hiring] SENIOR BIG DATA INFRA ENGINEER @Rackspace

Role Description

We are seeking a highly skilled and experienced Senior Big Data Infra Engineer to join our dynamic team. The ideal candidate will have a strong background in developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies. This role involves working in a remote environment, requiring excellent communication skills and the ability to solve complex problems independently and creatively.

• Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc. to build a reusable infrastructure for stream and batch processing systems at scale.
• Creating automation, whether that is building DevOps pipelines, scripting or creating Infrastructure as Code in Terraform.
• Participating in work sessions with clients.
• Completing technical documentation.

Qualifications

• Experience in developing and scaling data processing systems, including working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark.
• Expertise in public cloud services, Azure/AWS or GCP.
• Experience with cloud managed services and understanding of cloud-based messaging/stream processing systems.
• Experienced in Infrastructure and applied DevOps principles in daily work.
• Strong programming abilities in Java and Python.
• Hands-on experience in public cloud platforms.

Requirements

• Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.
• Knowledge in containerization technologies such as Docker and Kubernetes to enhance the scalability and efficiency of applications.
• Worked effectively in a remote setting, maintaining strong written and verbal communication skills.
• Proven experience in engineering stream/batch processing systems at scale.
• Additional experience with other cloud technologies is advantageous.

Benefits

• Cloud Engineer Certification or other Cloud Professional level certification.
• 4+ years of experience in customer-facing software/technology or consulting.
• 4+ years of experience with “on-premises to cloud” migrations or IT transformations.
• 4+ years of experience building and operating solutions built on GCP or AWS/Azure.
• Technical degree: Computer Science, software engineering or related.