[Hiring] Azure Cloud Data Engineer @TekWissen

Role Description

We are looking for a contract Data Engineer for a client engagement. This Data Engineer will possess strong experience with Python and/or PySpark needed along with Azure Data Lake, ETL, ELT, and DataFlow.

• Work with architects, other data engineers, and analysts to identify, engage, and integrate data sources for discovery and profiling.
• Define data services that empower business processes.
• Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, as well as cloud-based), distributed/elastic environments, and downstream applications and/or self-service solutions.
• Develop solutions combining data blending, profiling, mining, statistical analysis, and machine learning to better define and curate models, test hypotheses, and deliver key insights.
• Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.
• Partner with business analysts, application engineers, and data scientists, leveraging the appropriate tools, solutions, and/or processes as part of their data mining, profiling, blending, and analytical activities.

Qualifications

• 2-5 years of progressive data application development experience.
• Strong experience with Python and/or PySpark needed.
• Experience working in large scale/distributed SQL, NoSQL, and/or Hadoop environments.
• 2+ years of experience modeling and implementing ETL/ELT on columnar MPP database technologies.
• Experience with streaming architectures e.g. Kafka, Stream, PubSub.