Data Engineer @3M Consultancy
Software Development
Salary unspecified
Remote Location
🇺🇸 USA Only
Job Type full-time
Posted 2mths ago

[Hiring] Data Engineer @3M Consultancy

2mths ago - 3M Consultancy is hiring a remote Data Engineer. 💸 Salary: unspecified 📍Location: USA

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

We are seeking an experienced Data Engineer to design, build, and maintain scalable data processing pipelines using modern big data technologies. The ideal candidate will have strong development skills and experience with distributed computing frameworks.

  • Design and implement scalable data pipelines
  • Optimize existing data workflows for performance and reliability
  • Collaborate with data scientists and analysts to support their data needs
  • Implement data quality checks and monitoring
  • Maintain documentation for data processes and architectures

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 5+ years of software development experience
  • Strong proficiency in Python, Java or Scala programming languages
  • Extensive hands-on experience with Apache Spark, including:
    • Spark SQL
    • Spark Streaming and its data sources KAFKA, CDC feed, etc
    • Performance optimization and tuning
    • Data transformation and processing
  • Hands on Experience working with cloud-based Spark platforms (Databricks, AWS EMR, AWS Glue)
  • Strong understanding of Hive, Unity catalog, Glue catalog
  • Hands on Experience working with any data quality framework/tools
  • Hands on Experience working with Observability and monitoring for data processing pipelines
  • Strong understanding of distributed computing concepts
  • Proficiency in version control systems (Github/GitLab/Bitbucket)

Requirements

  • Experience building and maintaining high-volume data processing pipelines
  • Knowledge of data modeling and ETL / ELT best practices
  • Familiarity with SQL and NoSQL databases
  • Understanding of data warehouse concepts and dimensional modeling

Preferred Qualifications

  • Experience with real-time data processing and streaming architectures
  • Knowledge of Delta Lake or similar data lakehouse technologies
  • Experience with CI/CD pipelines
  • Cloud platform expertise (AWS/Azure/GCP)
  • Contributions to open-source projects

Soft Skills

  • Strong problem-solving abilities
  • Excellent communication skills
  • Team collaboration
  • Ability to work independently
  • Strong attention to detail
Before You Apply
🇺🇸 Be aware of the location restriction for this remote position: USA Only
Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Data Engineer @3M Consultancy
Software Development
Salary unspecified
Remote Location
🇺🇸 USA Only
Job Type full-time
Posted 2mths ago
Apply for this position Unlock 82,424 Remote Jobs
🇺🇸 Be aware of the location restriction for this remote position: USA Only
Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Apply for this position Unlock 82,424 Remote Jobs
×
  • Unlock 82,424 hidden remote jobs.
  • Your shortcut to remote work. Apply before everyone else.
  • Click and apply. No middlemen, no hassle.
  • Filter by location/skills/salary…
  • Create custom email alerts
Unlock All Jobs Now