[Hiring] Databricks Administrator @Damco Solutions

Role Description

The Databricks Administrator is responsible for administering, configuring, and supporting the Databricks platform to enable scalable data engineering, analytics, and AI/ML workloads. This role ensures platform reliability, security, cost optimization, and compliance while supporting data engineers, analysts, and data scientists across the organization.

• Understands business objectives and problems, identifies alternative solutions, performs studies and cost/benefit analysis of alternatives.
• Analyzes user requirements, procedures, and problems to automate processing or to improve existing computer systems.
• Confers with personnel of organizational units involved to analyze current operational procedures, identify problems, and learn specific input and output requirements.
• Writes detailed descriptions of user needs, program functions, and steps required to develop or modify computer programs.
• Reviews computer system capabilities, specifications, and scheduling limitations to determine if requested program or program change is possible within existing systems.
• Manages workspace configuration, cluster policies, user access, integrations with cloud services, and ongoing platform monitoring to support enterprise data and analytics initiatives.

Qualifications

• 8 years of experience administering Databricks workspaces in a cloud environment - AWS.
• Strong understanding of Databricks cluster configuration, job scheduling, and workspace management.
• Experience managing user access, roles, and permissions using IAM, SCIM, and role-based access control (RBAC).
• Proficiency with Apache Spark concepts, including performance tuning and troubleshooting.
• Experience integrating Databricks with cloud storage services (e.g., S3).
• Experience implementing and enforcing cluster policies and workspace governance standards.
• Familiarity with Databricks SQL, notebooks, and job orchestration.
• Experience monitoring platform health, performance, and availability.
• Understanding of data security, encryption, and compliance requirements.
• Experience with DevOps or automation tools (Terraform, CI/CD pipelines, scripting).

Requirements

• 4 years of experience administering Databricks in an enterprise or government environment (Preferred).
• 4 years of experience with Databricks Unity Catalog for data governance and access control (Preferred).
• 4 years of knowledge of cost management and optimization for Databricks workloads (Preferred).
• 4 years of experience supporting AI/ML workloads using Databricks ML and MLflow (Preferred).
• 4 years of familiarity with data lake and lakehouse architectures (Preferred).
• 4 years of knowledge of Python, SQL, or Scala for administration and troubleshooting (Preferred).