[Hiring] Principal Engineer, Data Platforms (Architecture & Ingestion) @CVS Health

Role Description

We are seeking a Principal Engineer, Data Platforms to serve as the senior technical authority responsible for the architecture, engineering, governance, and evolution of the Unified Ingestion Platform and Federated Data Lake supporting enterprise observability, security, and operational telemetry data.

The Principal Engineer, Data Platforms will:

• Define and execute the technology strategy for a highly scalable, cloud-native data platform capable of ingesting and processing hundreds of terabytes of data daily across Azure, AWS, and GCP.
• Own the enterprise Databricks platform strategy and architecture, including multi-cloud account structures, workspace design, infrastructure automation, security controls, governance frameworks, data lifecycle management, metadata services, and platform standardization.
• Lead a multi-year transformation initiative focused on consolidating fragmented observability, security, and operational telemetry platforms into a unified, governed, and cost-efficient ecosystem leveraging Databricks, Delta Lake, Unity Catalog, and modern cloud-native engineering practices.
• Establish engineering standards, drive infrastructure-as-code and policy-as-code adoption, lead enterprise-wide architecture decisions, and influence strategic technology investments.
• Partner with engineering, security, operations, infrastructure, and business stakeholders to deliver a resilient, scalable, secure, and future-ready data platform.

Qualifications

• 10+ years of experience architecting, building, and operating enterprise-scale cloud data platforms, data lakes, distributed systems, and large-scale data ingestion ecosystems supporting mission-critical workloads.
• 8+ years of experience designing and administering Databricks platforms, including Apache Spark, Delta Lake, Unity Catalog, secure data access patterns, metadata management, lineage, and enterprise governance frameworks.
• 8+ years of experience implementing Infrastructure-as-Code, platform automation, CI/CD pipelines, and Policy-as-Code controls using technologies such as Terraform, GitHub Actions, or comparable cloud-native automation platforms.
• 7+ years of experience designing and operating high-scale streaming and telemetry ingestion architectures processing more than 100 TB per day using technologies such as Kafka, Event Hub, Kinesis, Pub/Sub, NiFi, Cribl, or similar platforms.
• 5+ years of experience serving as a Principal Engineer, Lead Architect, or equivalent technical leadership role driving enterprise platform strategy, multi-cloud architecture across Azure, AWS, and GCP.

Requirements

• Extensive experience building and evolving enterprise-scale data platforms, analytics ecosystems, observability platforms, or cloud-native engineering platforms within large and highly regulated environments.
• Hands-on expertise with Unity Catalog, Delta Sharing, metadata services, lineage frameworks, information stewardship, retention controls, and federated operating models.
• Proven success driving Splunk rationalization efforts, security analytics modernization, SIEM ecosystems, telemetry consolidation, or monitoring transformation programs.
• Strong background designing secure serverless computing environments, multi-tenant architectures, workload isolation strategies, and Databricks deployments spanning Azure, AWS, and GCP.
• Demonstrated success establishing FinOps disciplines, consumption governance, chargeback methodologies, provisioning automation, and resource optimization programs.
• Databricks certifications (Data Engineer, Data Architect, Platform Architect, or equivalent) coupled with knowledge of AI/ML enablement, advanced analytical workloads, OpenTelemetry (OTEL), and Open Cybersecurity Schema Framework (OCSF) standards.

Benefits

• Comprehensive and competitive mix of pay and benefits.
• Medical, dental, and vision coverage.
• Paid time off.
• Retirement savings options.
• Wellness programs and other resources, based on eligibility.