[Hiring] Data Engineer - Azure/PySpark @Avensys Consulting PVT LTD

Mar 25, 2025 - Avensys Consulting PVT LTD is hiring a remote Data Engineer - Azure/PySpark. 💸 Salary: unspecified. 📍Location: India.

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

This role involves designing, developing, and maintaining data pipelines and solutions in a cloud environment.

Design, develop, and maintain end-to-end data pipelines using Azure Databricks, Azure Data Factory, and Azure Synapse.
Implement big data processing frameworks using PySpark for scalable data transformation.
Manage and optimize Azure Data Lake storage, ensuring efficient data ingestion, retrieval, and governance.
Develop ETL/ELT solutions to process structured and unstructured data from multiple sources.
Work with Delta Tables & Unity Catalog to ensure data integrity, consistency, and security.
Automate data workflows, API integrations, and analytics services for real-time insights.
Collaborate with data architects, data scientists, and business stakeholders to deliver scalable data solutions.
Ensure data quality, governance, and compliance with enterprise standards and best practices.
Optimize data performance, including partitioning, indexing, caching, and cost-effective data storage strategies.
Stay up to date with Azure and big data technologies to drive innovation and efficiency in data engineering practices.

Qualifications

10 years of experience in data engineering, big data processing, and cloud-based data solutions.
Strong proficiency in Azure Databricks, Azure Data Factory, Azure Synapse, and Azure Data Lake.
Hands-on experience with PySpark for distributed data processing and transformation.
Expertise in Delta Tables & Unity Catalog for efficient data governance and management.
Solid programming skills in Python, with experience in developing scalable and maintainable code.
Experience in ETL/ELT pipeline development, API integration, and workflow automation.
Strong understanding of SQL and NoSQL databases for data storage and retrieval.
Ability to work with large-scale datasets, real-time data processing, and cloud data architectures.
Strong problem-solving, analytical, and communication skills to work in a fast-paced environment.
Experience with CI/CD pipelines, DevOps for data engineering, and infrastructure as code (IaC) is a plus.

Requirements

10 years of experience in data engineering, big data processing, and cloud-based data solutions.
Strong proficiency in Azure Databricks, Azure Data Factory, Azure Synapse, and Azure Data Lake.
Hands-on experience with PySpark for distributed data processing and transformation.
Expertise in Delta Tables & Unity Catalog for efficient data governance and management.
Solid programming skills in Python, with experience in developing scalable and maintainable code.
Experience in ETL/ELT pipeline development, API integration, and workflow automation.
Strong understanding of SQL and NoSQL databases for data storage and retrieval.
Ability to work with large-scale datasets, real-time data processing, and cloud data architectures.
Strong problem-solving, analytical, and communication skills to work in a fast-paced environment.
Experience with CI/CD pipelines, DevOps for data engineering, and infrastructure as code (IaC) is a plus.

Similar Remote Jobs

Fullstack Webdeveloper Angular / C# .NET • SEITENBAU GmbH SEITENBAU GmbH

Software Development unspecified Germany

Apr 06, 2025
Data Collection • Singular Singular

Software Development unspecified Latin America (LATAM)

Apr 06, 2025
Development Lead, WMS • US Foods, Inc. US Foods, Inc.

Software Development $85,000 - $140,000 USA

Apr 06, 2025

Unlock 55,373 additional remote jobs, advanced search & email notifications

Too many emails? Declutter your inbox with Meco

Your home for reading newsletters

Before You Apply

️

📍	Be aware of the location restriction for this remote position: India
‼	Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.

Data Engineer - Azure/PySpark @Avensys Consulting PVT LTD

Software Development

Salary 💸 unspecified	Remote Location India
Job Type contract	Posted Mar 25, 2025

️

📍	Be aware of the location restriction for this remote position: India
‼	Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.