[Hiring] Senior AWS Data Engineer @NorthBay Solutions

Role Description

We are looking for a skilled AWS Data Engineer to build and support cloud-based data pipelines and analytics platforms on AWS. The role focuses on hands-on development, optimization, and operational support of data processing systems.

• Develop and maintain scalable batch data pipelines on AWS
• Implement ETL/ELT jobs using AWS Glue and Spark on EMR
• Build and manage workflow orchestration using Apache Airflow (MWAA)
• Develop serverless data processing functions using AWS Lambda
• Work with Amazon Redshift for data warehousing and analytics
• Implement data storage and retrieval using Amazon DynamoDB
• Use AWS DataZone for data discovery, governance, and access control
• Monitor data pipelines and system health using Amazon CloudWatch
• Troubleshoot data processing failures and performance issues
• Collaborate with analytics, reporting, and business teams
• Follow best practices for security, scalability, and cost optimization

Qualifications

• 5+ years of experience in data engineering or related roles
• Strong SQL and Python skills
• Experience with batch data processing and data pipeline development
• Understanding of data warehousing and ETL concepts
• Experience working in Agile delivery environments

Requirements

• Hands-on experience with:
• AWS Glue
• Amazon EMR
• AWS Lambda
• Apache Airflow (MWAA)
• Amazon EC2
• Amazon CloudWatch
• Amazon Redshift
• Amazon DynamoDB
• AWS DataZone

Nice to Have

• AWS Certification
• Exposure to data governance and metadata tools
• Experience with performance tuning and cost optimization on AWS