[Hiring] Senior Databricks Administrator @Ciklum

Role Description

As a Senior Databricks Administrator, you will be responsible for the setup, configuration, administration, and optimization of the Databricks Platform on AWS. This role will play a critical part in managing secure, scalable, and high-performing Databricks environments, with a strong focus on:

• Platform governance
• User access management
• Cost optimization
• Security and compliance
• Platform operations and reliability

You will collaborate closely with engineering, infrastructure, InfoSec, and compliance teams to ensure that the Databricks platform meets enterprise data, security, and regulatory requirements.

Responsibilities

• Databricks Platform Administration — AWS:
  • Provision, configure, and manage Databricks Workspaces across multiple environments, including Dev, UAT, and Production
  • Define and enforce cluster policies, compute tagging, and usage controls to optimize cost and resource utilization
  • Administer Unity Catalog
  • Creation and management of catalogs and schemas
  • Access control and permissions
  • Data lineage
  • Data governance
  • Manage SCIM integrations for automated user and group provisioning with Identity Providers (IdPs) such as Okta and Azure/AWS SSO
  • Configure and maintain CI/CD pipelines for notebook deployment and workflow promotion using GitHub, GitLab, or similar tools
• Security, Governance & Compliance:
  • Implement and enforce role-based access controls (RBAC) and fine-grained data permissions using Unity Catalog and AWS Lake Formation
  • Ensure auditability and lineage tracking to support compliance with regulatory requirements, including Open Banking, GDPR, and PSD2
• Monitoring, Support & Troubleshooting:
  • Monitor workspace performance, cluster health, job execution, and user activity using Databricks native tools, AWS CloudWatch, and third-party integrations.
• Automation & Platform Best Practices:
  • Build and maintain Terraform/IaC scripts for environment provisioning and infrastructure consistency

Qualifications

• 6+ years of experience in Databricks administration across AWS or multi-cloud environments
• Databricks workspace architecture
• Unity Catalog
• Cluster configuration and optimization
• Databricks platform governance
• Strong experience with AWS IAM, IAM policies, SCIM integration, and access provisioning workflows
• Hands-on experience with monitoring, troubleshooting, cost optimization, and governance of large-scale Databricks deployments
• Hands-on experience with Infrastructure as Code (Terraform) and CI/CD pipelines
• Experience with ETL orchestration and collaboration with engineering teams using technologies such as Databricks Jobs and Workflows, Apache Airflow, and other workflow orchestration tools
• Strong understanding of enterprise security, access management, and platform operations.

Desirable

• Delta Lake
• Lakehouse architecture
• Data governance patterns
• Experience with AWS Glue
• Experience with SQL and database technologies, including Amazon Aurora, MongoDB, DynamoDB
• Exposure to regulated industries such as banking, fintech, or healthcare
• Incident response
• Audit logging
• Security remediation
• Compliance and security controls
• Experience working in large-scale enterprise data platforms

Preferred Certifications

• Databricks Certified Data Engineer Associate / Professional
• Databricks Certified Platform Administrator
• AWS Certified Solutions Architect – Associate

Benefits

• Strong community: Work alongside top professionals in a friendly, open-door environment
• Growth focus: Take on large-scale projects with a global impact and expand your expertise
• Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
• Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
• Care: Healthcare, Basic Life Insurance, Short and Long-term disability insurance according to the Company’s Benefit Plans