[Hiring] Databricks Solutions Architect @INSPYR Solutions

Role Description

Our client is seeking an experienced Databricks Solutions Architect to lead the design, architecture, and modernization of its enterprise data platform. This role provides technical leadership for scalable, secure, and governed Databricks solutions, mentors engineering teams, and helps establish architecture standards.

The ideal candidate has extensive hands-on experience designing enterprise-scale Databricks platforms, migrating legacy data environments, and implementing modern lakehouse architectures using Delta Lake, Unity Catalog, Lakeflow, and AI/ML capabilities.

Key Responsibilities

• Serve as technical advisor for Databricks reference architecture, including Lakeflow, Delta Lake, Unity Catalog, Mosaic AI, Databricks SQL, and Databricks Apps
• Design and provide hands-on guidance for end-to-end Databricks data platform solutions
• Architect batch and real-time streaming pipelines, including zero-copy data sharing patterns
• Lead migrations from legacy SQL databases, data warehouses, and document stores to Databricks and cloud data platforms
• Design secure, governed architectures using Unity Catalog, ABAC, governed tags, row- and column-level security, encryption, key management, networking, and compliance frameworks
• Develop multi-tier data lake architectures aligned with data classification and regulatory requirements
• Establish FinOps best practices for workload optimization, performance tuning, and cost management
• Mentor data engineers, analysts, and AI/ML teams; participate in architecture reviews and define technical standards
• Partner with security, infrastructure, and governance teams to ensure policy compliance
• Evaluate emerging Databricks capabilities and recommend adoption strategies and platform enhancements

Qualifications

• 7+ years designing, building, and operating enterprise Databricks environments using Medallion Architecture
• Extensive hands-on experience with Delta Lake, Unity Catalog, Spark Structured Streaming, Lakeflow (or Delta Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving
• Strong cloud architecture experience supporting Databricks on AWS (S3, KMS, VPC) and/or Azure (ADLS, VNet), including cloud networking and security
• Proven success migrating enterprise data platforms from legacy or on-prem environments to Databricks
• Experience designing and supporting production streaming and Change Data Capture (CDC) solutions
• Deep understanding of data governance, security, and compliance: Unity Catalog policies (ABAC), data classification, encryption, access auditing, and regulatory compliance
• Experience designing multi-tier Databricks environments based on data classification
• Strong skills in Python, SQL, Apache Spark, and Databricks Notebooks
• Excellent communication, presentation, and stakeholder management skills

Preferred Qualifications

• Active Databricks certifications
• Experience with Generative AI and AI agent development on Databricks
• Knowledge of Delta Sharing, Databricks Clean Rooms, and governed cross-organizational data sharing
• Experience integrating Databricks with major ERP platforms and their native data services, including zero-copy integration patterns
• Experience with Lakeflow Designer, Databricks Apps, Genie, and Databricks One
• CI/CD and Infrastructure-as-Code (Terraform) for data platforms
• Background designing enterprise BI reporting solutions
• Experience with Data Quality and Data Governance initiatives
• Experience in highly regulated industries (e.g., financial services, healthcare, life sciences, energy, or public sector) and associated compliance frameworks

Company Description

Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.