[Hiring] Principal Data Engineer @Capmation

Role Description

We are seeking a Principal Data Engineer to join our Engineering Team and help build a real-time data platform that powers self-service analytics, data agents, and business-built applications.

The ideal candidate is a senior technical leader who can:

• Architect a lakehouse from the ground up.
• Land data from a large and diverse set of source systems into a medallion (Bronze → Gold) architecture.
• Design real-time ingestion patterns that meet evolving business needs.
• Shape workspace and governance strategy to support Data Agent enablement.
• Partner with the Application Development team to expose curated data.

This position requires strong collaboration and leadership skills. The Principal Data Engineer must work effectively with:

• Engineers
• Analysts
• App developers
• AI/agent teams
• Product stakeholders
• Clients

The ideal candidate should be proactive, pragmatic, and able to balance hands-on implementation with strategic decisions about platform design, modeling, governance, and cost.

Qualifications

• 5+ years of experience in Data Engineering, including significant time spent designing and operating production data platforms and pipelines.

Requirements

• Must have one of the following platforms:
  • Microsoft Fabric — Lakehouse, Warehouse, Data Pipelines, Dataflows Gen2, OneLake, shortcuts, capacities
  • Databricks — Workspaces, Unity Catalog, Delta Lake, Workflows, Auto Loader, DLT, SQL Warehouses, Model Serving
• Real-Time / Streaming:
  • Fabric Real-Time Intelligence (Eventstream, Eventhouse / KQL)
  • Databricks Structured Streaming
  • Azure Event Hubs, Kafka, CDC (Debezium and similar)
• Shared:
  • Power BI (semantic models, DAX; Direct Lake on Fabric or Power BI on Databricks SQL)
  • PySpark
  • SQL — T-SQL (Fabric track) and/or Spark SQL / ANSI SQL (Databricks track)
  • Python
  • Azure DevOps (CI/CD, YAML pipelines)
  • Data API tooling: Fabric API, Azure API Management, or Databricks SQL endpoints / Model Serving
• Must have:
  • Deep, hands-on production experience in Microsoft Fabric OR Databricks — must have built a production lakehouse on one of these.
  • Hands-on experience with SQL Server and Server Replication with outputting data to Power BI dashboards.
  • Demonstrated experience landing data from many heterogeneous source systems into Bronze and Silver layers with strong reliability, idempotency, and lineage.
  • Production experience with at least one streaming stack on the candidate's primary platform.
  • Experience defining workspace, domain, capacity, and security strategy on Fabric or Databricks.
  • Experience exposing curated data via APIs with attention to auth, throttling, contracts, and consumer experience.
  • Strong PySpark and SQL skills for building and optimizing transformation and modeling workloads in production.
  • Designing semantic models and DAX, integrating with Fabric Direct Lake or Databricks SQL.
  • Pipeline-as-code, environment promotion, automated tests for data, and release management.
  • Deep proficiency in dimensional (Kimball) modeling and at least one of Data Vault 2.0, normalized 3NF, or domain-driven (Data Mesh) modeling.
  • Strong analytical, problem-solving, and communication skills.

Language & Location

• Advanced English level (C1 or higher), spoken and written.
• Open to nearshore (Latin America) candidates aligned with U.S. business hours.