[Hiring] Senior Data Engineer - Apache Spark @Scalepex

Role Description

We are looking for a Data Engineer / Senior Data Engineer to design, build, and scale robust data pipelines and analytics solutions. This role combines hands-on development with technical leadership, ensuring high-quality data systems that power business insights and analytics products.

You will work across the full data lifecycle—from ingestion and transformation to modeling and delivery—while contributing to architectural decisions and best practices.

Key Responsibilities

• Understand the business need and design the data pipelines, translate data into business insights, data cleansing and ETL.
• Experience in Databricks, GitHub Actions.
• Understand CI/CD, Aerospike.
• Gather requirements from vested teams to build features.
• Self-motivated individual will use their love of user interfaces to balance design and function, and thrive in a fast-paced environment; knowledge in Angular / Play Framework is a plus.
• Understand the priorities and ensure the deliverables stick to the timeline and complete projects on time.
• Be a team player who works effortlessly with people.

Qualifications

• 3–7 years of experience in data engineering or software development at an enterprise level.
• Strong hands-on experience with:
  • Apache Spark (Scala)
  • Python
  • MySQL and relational databases
  • Columnar storage formats (e.g., Apache Parquet)
  • Experience with AWS ecosystem, including data lake architectures
• Familiarity with:
  • Airflow for orchestration
  • Databricks
  • CI/CD pipelines (e.g., GitHub Actions)
• Strong understanding of data modeling, storage, and access patterns.
• Experience building highly scalable, high-volume data systems.
• Solid understanding of ETL processes and data integration layers.

Preferred Qualifications

• Experience with:
  • Java
  • Angular or Play Framework
  • Tableau or other BI tools
  • Aerospike or NoSQL databases
  • Knowledge of Hadoop ecosystem and EMR management
  • Experience working in AdTech or digital media environments
  • Familiarity with Linux systems

Contractor Scheme

• 100% Remote