[Hiring] Data Engineer @Thinkgrid Labs

Role Description

We’re expanding our data practice and building a modern data platform for a US health insurer, with Microsoft Fabric as the primary platform. You’ll design, build, and operate reliable data pipelines—from source ingestion and transformation to analytics-ready lakehouse and warehouse models. Hands-on Microsoft Fabric experience is strongly preferred, and we welcome engineers with strong Databricks or comparable cloud data platform experience who are ready to apply their skills in Fabric.

Qualifications

• 6–10 years in data engineering, including 2+ years working with cloud data platforms
• Bachelor’s or Master’s degree in Computer Science, Health Informatics, or Business
• Relevant Microsoft Fabric/Azure, Databricks, or equivalent data engineering certifications

Requirements

• Strong in SQL and Data Modeling
• Experienced with Cloud Data Platforms
• A Reliable Pipeline Builder
• Comfortable with Python and Spark
• Focused on Data Quality
• Operationally Minded
• Security Conscious

What will you be doing?

• Build Data Pipelines: Develop and maintain ingestion and ETL/ELT pipelines across relational databases, files, APIs, and other sources, primarily using Microsoft Fabric.
• Develop Lakehouse and Warehouse Solutions: Organize data across raw, refined, and curated layers, using OneLake and Fabric Lakehouse/Warehouse to support reliable downstream consumption.
• Transform and Model Data: Build reusable transformations and analytics-ready models that translate source data into useful, well-documented datasets.
• Manage Incremental Data and Change: Implement CDC, replication, or watermark-based loading as appropriate. Handle deletes, late-arriving data, backfills, and schema evolution safely, using Fabric Mirroring where suitable.
• Orchestrate Resilient Workflows: Manage dependencies, scheduling, retries, idempotency, and failure recovery using Fabric Data Factory, notebooks, and appropriate orchestration tools.
• Ensure Quality and Observability: Implement data validation, reconciliation, logging, metrics, lineage, and alerts to maintain data accuracy and pipeline reliability.
• Optimize Performance and Cost: Tune queries, Spark workloads, partitioning, file sizes, and compute usage to meet delivery expectations efficiently.
• Collaborate and Document: Work with platform architects, security teams, analysts, and business stakeholders on requirements, governance, and delivery. Maintain pipeline documentation, data definitions, SLAs, and operational runbooks.

Must-have skills

• Strong SQL and experience working with large, complex relational databases
• Production experience with Microsoft Fabric, Databricks, or a comparable cloud data platform
• Python and Apache Spark for data processing, transformation, and validation
• Experience building and operating ingestion and ETL/ELT pipelines
• Data modeling and lakehouse or data warehouse fundamentals
• CDC/incremental loading, schema evolution, and data quality practices
• Pipeline orchestration, monitoring, troubleshooting, and performance tuning
• Git-based development workflows and familiarity with CI/CD for data solutions

Benefits

• 5-day work week
• Health Insurance
• 100% remote setup with flexible work culture and international exposure
• Opportunity to work on mission-critical healthcare projects impacting providers and patients globally