This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.
Role Description
As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging cutting-edge technologies. Here are some of the projects we are seeking talented individuals to join:
-
Design and development of a universal data platform for global aerospace companies, powered by Azure and Databricks, covering design of architecture and processes.
-
Data Platform Transformation for energy management association body, implementing a comprehensive data catalog using Databricks and Apache Spark/PySpark.
-
Design of the data transformation and following data ops pipelines for global car manufacturer, focusing on real-time streaming and batch data processing.
Your main responsibilities:
-
Design and optimize scalable data processing pipelines for both streaming and batch workloads using Big Data technologies such as Databricks, Apache Airflow, and Dagster.
-
Architect and implement end-to-end data platforms, ensuring high availability, performance, and reliability.
-
Lead the development of CI/CD and MLOps processes to automate deployments, monitoring, and model lifecycle management.
-
Develop and maintain applications for aggregating, processing, and analyzing data from diverse sources, ensuring efficiency and scalability.
-
Collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment.
-
Design and manage complex data transformations using Databricks, DBT, and Apache Airflow, ensuring data integrity and consistency.
-
Translate business requirements into scalable and efficient technical solutions while ensuring optimal performance and data quality.
-
Ensure data security, compliance, and governance best practices are followed across all data pipelines.
Qualifications
-
At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.
-
Strong programming skills in Python: writing clean code, OOP design.
-
Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.
-
Experience in designing and implementing data governance and data management processes.
-
Deep expertise in Big Data technologies, including Apache Airflow, Dagster, Databricks, and other modern data orchestration and transformation tools.
-
Experience implementing and deploying solutions in cloud environments (with a preference for Azure).
-
Knowledge of how to build and deploy Power BI reports and dashboards for data visualization.
-
Excellent understanding of dimensional data and data modeling techniques.
-
Consulting experience and the ability to guide clients through architectural decisions, technology selection, and best practices.
-
Ability to work independently and take ownership of project deliverables.
-
Master’s or Ph.D. in Computer Science, Data Science, Mathematics, Physics, or a related field.
Requirements
-
Strong programming skills in Python.
-
Strong SQL skills.
-
Experience in Big Data technologies.
-
Experience in cloud environments, preferably Azure.
-
Knowledge of Power BI.
-
Excellent understanding of dimensional data.
-
Consulting experience.
-
Master’s or Ph.D. in a relevant field.
Benefits
-
Work in a supportive team of passionate enthusiasts of AI & Big Data.
-
Engage with top-tier global enterprises and cutting-edge startups on international projects.
-
Enjoy flexible work arrangements, allowing you to work remotely or from modern offices and coworking spaces.
-
Accelerate your professional growth through career paths, knowledge-sharing initiatives, language classes, and sponsored training or conferences.
-
Choose from various employment options: B2B, employment contracts, or contracts of mandate.
-
Make use of 20 fully paid days off available for B2B contractors and individuals under contracts of mandate.
-
Participate in team-building events and utilize the integration budget.
-
Celebrate work anniversaries, birthdays, and milestones.
-
Access medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching.
-
Get full work equipment for optimal productivity, including a laptop and other necessary devices.
-
Experience a smooth onboarding with a dedicated buddy, and start your journey in our friendly, supportive, and autonomous culture.