[Hiring] Senior Data Engineer @Beatport

Role Description

We are seeking an experienced and adaptable Senior Data Engineer to join our data team in the finance and data warehousing domains. This role involves taking the lead in the ownership, design and delivery of the data pipelines and warehousing infrastructure that feeds analytics and reporting across The Beatport Group.

The ideal candidate will have 5+ years of directly relevant data engineering experience, including:

• Building and owning all aspects of cloud data warehouses (marts, lakes, lakehouses, etc.)
• Production data pipelines end to end
• Handling and prioritising data requests from both technical and non-technical stakeholders
• Translating these into robust, maintainable solutions

This is an ownership heavy role, and the successful candidate will be trusted to:

• Own critical pipelines
• Resolve production incidents
• Maintain engineering best practices for others in the group to follow

The role works across the majority of The Beatport Group's constituent business units to support data flow and integrations required for day-to-day operations. This includes:

• Modern data platform with BigQuery and dbt
• Legacy ETL orchestrations with tooling such as Pentaho and Jenkins
• Migrating and deprecating legacy solutions

This role can be remote but applicants must be based in the Pacific Northwest (Canada or the USA) with a valid right to work.

The role offers an exciting opportunity to play a key role in maintaining and optimising our core data infrastructure, enabling genuine proactive data driven decision making across an organisation of passionate music fans.

As a Senior Data Engineer, you will be responsible for:

• Ownership of production data pipelines across our comprehensive GCP based warehousing, from orchestration to reporting, focusing on reliability, performance, cost efficiency, and integrity
• Writing scalable dbt and BigQuery SQL across multiple business functions to build and maintain robust data models for all elements of The Beatport Group’s stack
• Planning and designing RDBMS and data warehouses, data models, repositories and pipelines with best practices for performance and scalability
• Maintaining and developing integrations with partners of the group with relevant APIs and file based exchange services (SFTP, GCS etc.)
• Creating and maintaining documentation for APIs, data pipelines, data models and data dictionaries
• Being the reliable point of contact for the resolution of load failures or connectivity issues that affect downstream resources

Qualifications

• 5+ years of direct data engineering experience, ideally within an engineering / analytics / BI or similarly data intensive team
• Expert proficiency in SQL, ideally Google Cloud SQL supported dialects (MySQL / Postgres)
• Proficiency with data transformation tooling such as Data Build Tool (dbt)
• 3+ years of SQL-based programming and access control against RDBMS database systems such as MS SQL Server, MySQL, Postgres or Oracle
• Demonstrable experience building and owning production data pipelines (ETL/ELT), including orchestration, monitoring and incident resolution
• Experience with cloud data orchestration products such as Airflow, Composer, Cloud Run, etc.
• Proficiency with a scripting language beyond SQL, Python in particular
• Self-motivated and proactive, with the ability to work independently and prioritise tasks effectively
• Strong communication and interpersonal skills, both technical and non-technical
• Experience with music streaming, music royalties, audio technologies, DBA responsibilities, AI/ML on GCP, interest in DJ culture, or previous roles in the music or financial industries are all great bonuses

Benefits

• Position within a highly motivated team with a positive working climate
• Appropriate remuneration
• Very good development opportunities within a dynamically growing enterprise
• Intensive integration into the international music scene