[Hiring] Senior Data Engineer @Object Edge

Role Description

Senior Data Engineering (Databricks)

• Be a technical leader in teams with minimal oversight and direction to deliver innovative solutions on the Databricks Platform using core cloud data lakehouse methodologies, tools, distributed processing engines, event streaming platforms, and other modern data-related technologies.
• Be part of the Databricks Center of Excellence.
• Build the next generation of data platforms and work with some of the most forward-thinking organizations in data and analytics.
• Work under the direction of a Solution Architect to help design and implement components of our clients' data platform solution.
• Participate in design sessions and be able to break down complex development tasks, and complete development items on time.
• Contribute to various COE initiatives to develop Databricks solution accelerators and bring an innovative mindset.

Qualifications

• Strong data engineering experience, with at least 2 years of hands-on data pipeline design and development experience with Databricks, including specific platform features like Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative pipelines), and Unity Catalog.
• Proficiency in designing and building robust, scalable, YAML configuration-driven data pipelines with batch, micro-batch, and streaming data ingestion and processing patterns using tools like Auto Loader.
• Experienced in building complex job/workflow orchestration patterns using either Databricks jobs/workflows or other orchestration tools like Airflow, dbt, etc.
• Exposure to building robust data quality, pipeline audit/observability solutions with Databricks native features and/or other data quality tools/frameworks like Great Expectations, Collibra, dbt, etc.
• Proficiency in Big Data Platforms: Apache Spark, Presto, Amazon EMR.
• Experience with Cloud Data Warehouses: Amazon Redshift, Snowflake, Google BigQuery.
• Strong programming skills using SQL, stored procedures, and object-oriented programming languages (like Java, Python, PySpark, etc.).
• Familiarity with building DevOps, CI/CD pipelines using Databricks Asset Bundles with automated validation and testing.
• Exposure to Infrastructure as Code (IaC) tools like Terraform is a big plus.
• Familiarity with NoSQL Databases and Container Management Systems.
• Exposure to AI/ML tools (like MLflow), prompt engineering, and modern data and AI agentic workflows.
• An ideal candidate will have Databricks Data Engineering Associate and/or Professional certification completed with multiple Databricks project delivery experience.

Requirements

• Curious mindset and a passion for exploring innovative solutions to address clients' most pressing data challenges.
• Self-starter who excels at breaking down complex problems and eagerly shares insights with the team and the broader Builder community.

Benefits

• Salary is commensurate with experience based on department and role.