[Hiring] Senior Data Engineer @Grupo QuintoAndar

Role Description

We are looking for a skilled and motivated Data Engineer Specialist to join our team. The responsibilities of this role is to design, build, and maintain a robust, self-service, scalable, and secure data platform and end-to-end data pipelines that empowers Data Analysts, and Data Scientists to deliver insights and drive strategic decision-making.

Responsibilities of a Data Engineer at QuintoAndar:

• Build and maintain a high-performance data platform that meets the company's needs, connects with product solutions, and leads analytical innovation.
• Create and edit data pipelines, considering business logic, choosing levels of aggregation, grouping and transforming fields, checking data quality, and cleaning the data.
• Create data modeling and transformation workflows, enabling the creation of clear and accessible data abstractions.
• Responsible for the entire code development lifecycle (monitoring deployment, documentation, performance, security, adding metrics and alarms, ensuring SLO budget compliance, and more).
• Investigate inconsistencies and trace the source of differences (data troubleshooting).
• Enable teams across the company to access and use data more effectively through self-service tools and well-modeled datasets.
• Align with stakeholders to understand their primary needs while proposing extensible, scalable, and incremental solutions.
• Conduct PoCs and benchmarks to determine the best tool for a given problem.
• Contribute to defining the strategic vision, crossing team and service boundaries to solve problems.
• Advocate for the value of data analytics and engineering within the organization and foster a data-driven culture.
• Be a reference within the chapter on technical concepts, tools, and/or best coding practices.

Qualifications

• 7 or more years of experience in Data Engineering roles.
• Specialist in technologies, solutions, and concepts of Big Data (Spark, Hadoop, Hive, MapReduce) and multiple languages (YAML, Python).
• Experience with Airflow, Spark, AWS, and Databricks.
• Strong foundation in software engineering principles, with experience working on data-centric systems.
• Experience with columnar storage solutions and/or data lakehouse concepts.
• Proficiency in Python or one of the main programming languages, with a passion for writing clean and maintainable code.
• Strong knowledge in optimizing SQL query performance.
• Experience in building multidimensional data models (Star and/or Snowflake schema).
• Understanding of the data lifecycle and concepts such as lineage, governance, privacy, retention, anonymization, etc.
• Knowledge in infrastructure areas such as containers and orchestration (Kubernetes, ECS), CI/CD strategies, infrastructure as code (Terraform), observability (Prometheus, Grafana), among others.
• Proficiency in English - our code, documentation, tools, and materials are often structured in English.
• Excellent communication skills, proactively sharing and collaborating with both technical and non-technical stakeholders.
• Experience as a tech/project lead or similar.
• Curiosity, detail-orientation, and thrive in a fast-paced, data-driven environment.

Requirements

• You will stand out if you have participated in building large-scale data platforms for big data sets and teams using Big Data technologies such as Spark, Trino, Hive, Atlas, Ranger, etc.
• Experience in building semantic layers.

Benefits

• Competitive salary
• Profit sharing
• Meal allowance
• Health insurance
• Dental plan
• Life insurance
• Childcare subsidy and Atypical Parenthood subsidy
• Wellhub
• Home office allowance
• Employee assistance program (mental health, social, legal, and financial support)
• Extended parental leave
• Day off on birthday, Mother’s Day, and Father’s Day
• Benefits Club (discounts on everyday services)
• Discounts at educational institutions
• Reading kit for children – PlayKids