[Hiring] Data Engineering Lead @DAC Beachcroft

Role Description

We are looking for an experienced Data Engineering Lead to play a pivotal role in shaping and delivering our enterprise data platform. This is an exciting opportunity to lead the development of scalable, secure, and AI-ready modern data platform that enables advanced analytics, reporting, automated and AI-enabled processes, and the creation of data-powered digital products.

Working closely with Data Architecture, Analytics, and wider business teams, you will be responsible for:

• Designing and maintaining robust data pipelines.
• Integrating multiple business systems.
• Ensuring data remains trusted, accessible, consistent, and fit for purpose.

This role is ideal for a technically strong data engineering professional who enjoys combining hands-on delivery with leadership and continuous improvement.

As our Data Engineering Lead, you will:

• Design, develop and maintain enterprise ETL/ELT pipelines, integrating data from case management, finance, CRM and third-party systems into a central data platform.
• Lead the development and continuous improvement of our cloud-based data platform within Azure.
• Ensure data pipelines are scalable, reliable, cost-effective and resilient.
• Build and maintain datasets that support business reporting, analytics, dashboards and data-enabled products.
• Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures.
• Work closely with Data Architects to implement target-state data models and modern data engineering principles.
• Partner with data scientists and analysts to operationalise advanced analytics and predictive models.
• Manage integrations with insurer portals and external data providers, ensuring high-quality, timely and secure data flows.
• Support the organisation's ambition to become increasingly data-driven and AI-enabled.

Qualifications

• Proven experience in a senior Data Engineering or Lead Data Engineer role.
• Strong hands-on experience with Microsoft Azure data technologies, including:
  • Azure Data Factory
  • Azure Synapse Analytics
  • Microsoft Fabric
  • Azure Data Lake
• Advanced SQL development skills.
• Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation.
• Track record of building reliable, monitored production-grade data pipelines.
• Experience integrating data from multiple business-critical applications and legacy systems.
• Good understanding of data security, data protection and access control principles within cloud-based data platforms.
• Comfortable working in regulated data environments with sensitive personal and litigation data.
• Excellent stakeholder management and communication skills.

Requirements

• Exposure to predictive analytics, machine learning operationalisation or AI platforms.
• Experience working with Dynamics CRM, case management platforms such as VisualFiles, and finance systems such as Elite 3E.
• Understanding of data modelling and data architecture best practices.
• Experience leading or mentoring data engineering teams.
• Experience within insurance, legal services, claims management or financial services is desirable but not mandatory.

Benefits

• High levels of flexibility and a great work-life balance.
• A well-rounded remuneration package (which includes private medical insurance, income protection insurance and discounted gym membership, amongst many other benefits).
• Opportunities for growth and progression including professional funding.
• In-person and remote social events.
• Opportunity to get involved in a range of Environmental, Social and Governance (ESG) activities.