[Hiring] Senior Data Engineer @Cast & Crew

Role Description

Cast & Crew is seeking an experienced Senior Data Engineer to design, build, and operate scalable data platforms that power mission-critical applications, analytics, reporting, and AI-driven solutions across the entertainment production ecosystem. This role focuses on building reliable, cloud-native data pipelines that ingest, transform, secure, and serve operational data for internal engineering teams, business intelligence, and customer-facing applications. You will work across structured and semi-structured data, enabling modern analytics, AI workloads, and real-time event processing.

You will collaborate closely with software engineers, platform engineers, product teams, and data consumers while leveraging AI-assisted development tools to accelerate delivery and improve engineering productivity.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Information Systems, or related field
• 5+ years of experience building production data platforms and pipelines
• Strong Python development experience
• Strong SQL development and query optimization skills
• Experience designing and maintaining ETL/ELT pipelines
• Experience working with relational databases (PostgreSQL, MySQL, Aurora)
• Experience working with NoSQL databases (DynamoDB, MongoDB, document databases)
• Experience building data lakes and cloud-native data architectures
• Experience with Snowflake, BigQuery, Redshift, or similar cloud data warehouses
• Experience with AWS cloud services including S3, Lambda, EventBridge, DynamoDB, ECS/EKS, and IAM
• Experience building event-driven and streaming data solutions
• Experience working with Kafka, SNS/SQS, Kinesis, or similar messaging technologies
• Experience with data orchestration tools such as Airflow, Prefect, or Dagster
• Experience with Git and modern CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
• Experience building highly available, scalable production systems
• Strong understanding of data modeling, partitioning, indexing, and performance optimization
• Experience monitoring and operating production data platforms

Requirements

• Experience with Apache Spark or distributed processing frameworks
• Experience with Debezium, CDC, or change data capture architectures
• Experience with Iceberg, Delta Lake, or modern lakehouse technologies
• Experience with OpenSearch or Elasticsearch
• Experience supporting AI and machine learning data platforms
• Experience building feature stores or vector databases
• Experience with document processing (OCR, Textract, PDF extraction)
• Experience in media, payroll, financial systems, or enterprise SaaS platforms
• Experience using AI-assisted development tools such as Claude Code or GitHub Copilot

What You Will Build

• Enterprise-scale data ingestion and transformation pipelines
• Cloud-native data platforms supporting analytics and operational workloads
• Real-time event-driven data processing solutions
• Data models supporting reporting, AI, and customer-facing applications
• Secure, scalable integrations between enterprise systems
• Automated monitoring, testing, and deployment pipelines for data infrastructure

What Success Looks Like

• Highly reliable and scalable production data pipelines
• High-quality, trusted data powering operational and analytical systems
• Low-latency, automated data movement across enterprise platforms
• Engineering best practices including automation, observability, and testing
• Strong collaboration with software engineering and platform teams
• Continuous improvement through AI-assisted development and automation

Special Work Conditions

Sedentary – Involves sitting most of the time but may involve walking or standing for brief periods of time. Some positions may entail exerting up to 15 lbs. of force occasionally and/or a negligible amount of force to lift, carry, push, or pull.

Benefits

• Medical, Dental, Vision
• PTO
• Health and wellness programs
• Employee discounts
• And more!

Compensation

The compensation range for this position is: $135,000.00 - $165,000.00 per year.