[Hiring] Senior Application Architect @Health Care Service Corporation

Role Description

We are seeking a skilled Databricks System Specialist to design, implement, optimize, and support data platforms built on Databricks. This role focuses on managing large-scale data processing systems, ensuring performance, reliability, and scalability of data pipelines, and enabling advanced analytics and machine learning workloads.

Key Responsibilities

• Configure and manage Databricks workspaces, clusters, and jobs
• Optimize data workflows for performance, cost, and scalability
• Integrate Databricks with cloud platforms (Azure, AWS) and external data sources
• Monitor system performance and troubleshoot issues in production environments
• Implement data security, governance, and access controls
• Collaborate with data engineers, data scientists, and business stakeholders
• Support CI/CD pipelines for data and analytics solutions
• Maintain documentation for architecture, processes, and workflows
• Stay up to date with new Databricks features and best practices

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience)
• 3+ years of experience in data engineering or big data platforms
• Hands-on experience with Databricks and Apache Spark
• Strong programming skills in Python, SQL, and/or Scala
• Experience with cloud platforms (Azure preferred, but AWS or GCP acceptable)
• Understanding of data warehousing concepts and ETL/ELT processes
• Experience with distributed computing and large-scale data processing
• Familiarity with version control systems (e.g., Git)

Preferred Qualifications

• Databricks certifications (e.g., Databricks Certified Associate/Professional)
• Experience with Delta Lake and Lakehouse architecture
• Knowledge of data orchestration tools (e.g., Airflow, Azure Data Factory)
• Experience with machine learning workflows on Databricks
• Familiarity with infrastructure-as-code tools (e.g., Terraform)

Key Skills

• Data pipeline development and optimization
• Performance tuning and troubleshooting
• Cloud architecture and integration
• Data governance and security
• Analytical thinking and problem-solving
• Strong communication and collaboration skills

Success Metrics

• Reliability and uptime of data systems
• Performance improvements in data pipelines
• Cost optimization of Databricks workloads
• Timely resolution of system issues
• Stakeholder satisfaction with data delivery

Benefits

• Health and wellness benefits
• 401(k) savings plan
• Pension plan
• Paid time off
• Paid parental leave
• Disability insurance
• Supplemental life insurance
• Employee assistance program
• Paid holidays
• Tuition reimbursement
• Other incentives

Pay Transparency Statement

The compensation offered will vary depending on your job-related skills, education, knowledge, and experience. This role aligns with an annual incentive bonus plan subject to the terms and conditions of the plan.

HCSC Employment Statement

We are an Equal Opportunity Employment employer dedicated to providing a welcoming environment where the unique differences of our employees are respected and valued. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other legally protected characteristics.

Base Pay Range

$112,200.00 - $202,600.00. Exact compensation may vary based on skills, experience, and location.