Back to Remote jobs >
Software Development
Senior Data Engineer
@HORIZON CONSULTING SERVICES
[Hiring] Senior Data Engineer @HORIZON CONSULTING SERVICES
Mar 30, 2025 - HORIZON CONSULTING SERVICES is hiring a remote Senior Data Engineer. 💸 Salary: unspecified. 📍Location: India.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.
Role Description
We are looking for a highly experienced and motivated Senior Data Engineer to join our dynamic team. This individual will have a strong background in Snowflake, Azure Data Factory (ADF), Fivetran, and the Data Build Tool (DBT). With over 8 years of experience in data engineering or a related field, the ideal candidate will drive the design, development, and optimization of data pipelines, integration processes, and data models, helping us achieve a robust and scalable data architecture that supports our organization's analytics and business intelligence needs.
-
Data Integration and Orchestration:
- Take the lead in implementing and optimizing data integration pipelines using Azure Data Factory (ADF) and Fivetran to automate data extraction, transformation, and loading (ETL) from multiple data sources into Snowflake.
- Design, implement, and maintain end-to-end data workflows and automation strategies using these tools to ensure efficient data movement, reliability, and consistency.
-
Snowflake Expertise:
- Leverage Snowflake as the primary data warehousing solution, ensuring efficient data storage, retrieval, and high-performance querying.
- Architect scalable Snowflake data models tailored to business needs, focusing on performance, cost efficiency, and data integrity.
- Optimize Snowflake queries and configurations to handle large datasets, improve query execution times, and ensure operational excellence.
- Oversee and troubleshoot Snowflake's data pipelines, ensuring the right design patterns are applied to enhance scalability and performance.
-
Data Build Tool (DBT) Usage:
- Use DBT (Data Build Tool) to manage data transformations and ensure a clear, version-controlled transformation pipeline.
- Build and document DBT models for transformation workflows, enabling reusable, modular, and testable transformations that meet business requirements.
- Work closely with the data analytics team to implement a robust ETL pipeline using DBT to ensure data accuracy, integrity, and alignment with analytical goals.
-
Data Modeling and ETL Pipeline Architecture:
- Architect and design data models for Snowflake using techniques such as star and snowflake schemas to ensure optimal data structures that support business intelligence, reporting, and analytics.
- Develop and maintain ETL pipelines that support the extraction, transformation, and loading of data from diverse sources, ensuring data consistency, accuracy, and accessibility for downstream applications.
- Implement data validation processes and automated testing frameworks to ensure data quality and integrity throughout the pipeline lifecycle.
-
Collaboration and Communication:
- Collaborate with cross-functional teams, including data scientists, business analysts, and software engineers, to ensure alignment on data requirements and pipeline functionality.
- Effectively communicate technical challenges, solutions, and progress to both technical and non-technical stakeholders, helping them understand the value of the data systems and how they support business decisions.
- Serve as a mentor to junior data engineers, guiding them in best practices for Snowflake, ADF, Fivetran, and DBT.
-
Problem-Solving and Optimization:
- Apply strong analytical and problem-solving skills to identify and resolve complex data pipeline issues and bottlenecks, ensuring that data flows seamlessly and performance is optimized across systems.
- Troubleshoot and address data inconsistencies, performance problems, and other operational issues in real-time to minimize downtime and operational risks.
Qualifications
- 8+ years of experience in data engineering, software engineering, or a related field, with a focus on building scalable data architectures and pipelines.
- Deep expertise in Snowflake data warehousing platform, including architecture, data modeling, optimization, and performance tuning.
- Extensive hands-on experience with Azure Data Factory (ADF) and Fivetran for data integration and pipeline orchestration.
- Proficiency with SQL and experience working with relational databases like SQL Server and MySQL.
- Proven experience in data modeling and creating effective ETL processes, with an emphasis on scalability, performance, and data quality.
- Strong experience with Data Build Tool (DBT) to manage data transformation workflows, ensuring consistent and reliable transformation logic.
- Experience designing, building, and maintaining end-to-end data pipelines, with strong knowledge of data ingestion, transformation, and storage concepts.
- Ability to troubleshoot complex data issues and apply creative solutions to resolve performance or quality challenges.
Desired Skills
- Familiarity with cloud technologies, particularly in an Azure environment.
- Experience with data governance, security standards, and compliance regulations in the context of data engineering.
- Ability to work in an agile, fast-paced environment, managing multiple priorities and delivering quality solutions under tight deadlines.
- Strong communication skills to collaborate with both technical teams and business stakeholders, and to explain complex data concepts clearly.
Benefits
This role offers the opportunity to play a pivotal part in the development of an advanced data architecture, working with cutting-edge tools and technologies. If you are passionate about data engineering and have expertise in Snowflake, ADF, Fivetran, and DBT, we encourage you to apply and help us elevate our data infrastructure to new heights.
Similar Remote Jobs
More Software Development jobs
-
Software Development $115,000- $130,000 USAApr 02, 2025 -
Software Development $140,000 - $160,000 USAApr 02, 2025
-
Software Development $140,000 - $160,000 USAApr 02, 2025
More jobs in India
-
Product unspecified IndiaApr 02, 2025
Kickstart Your Job Search
Need advice to apply?
Join our free
Webinar « 3
Mistakes to Avoid When Looking For A Remote Startup Job (And What To Do Instead) »
Register for free
Unlock 54,733 additional remote jobs, advanced search & email notifications
Get Access Now
Too many emails? Declutter your inbox with Meco
Your home for reading newsletters
Try for free - no card required.
️
| 📍 | Be aware of the location restriction for this remote position: India |
| ‼ | Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more. |
Back to Remote jobs >
Software Development
Software Development
|
Salary
💸
unspecified
|
Remote
Location
India
|
|
Job Type
unspecified
|
Posted
Mar 30, 2025
|
️
| 📍 | Be aware of the location restriction for this remote position: India |
| ‼ | Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more. |
