[Hiring] Senior Data Engineer @New Era Technology

Role Description

The Senior Data Engineer designs, builds, and maintains large-scale data infrastructure and analytics solutions that power business insights across the organization. The ideal candidate brings deep expertise in SQL, Python, and data visualization, with a strong track record of delivering self-service reporting platforms, scalable ETL pipelines, and high-quality dashboards that enable data-driven decision making. In this role, you will partner closely with cross-functional stakeholders to translate complex data needs into clear, actionable solutions while upholding engineering best practices in architecture, performance, and data quality.

Primary Duties

• Triage requests for people data and ad hoc reports, prioritize requests, and effectively communicate appropriate delivery expectations.
• Collaborate with partners and stakeholders to create dashboards that display meaningful and actionable key performance indicators (KPIs).
• Create visualizations from which leaders can easily draw insights and recommendations.
• Build and automate easy-to-use, self-service reports and dashboards.
• Provide direction and coaching to end users on how to use and interpret metrics.
• Document reporting requirements with partners by collaborating with relevant Data Analytics team members on iterations and changes to core dashboards and solutions.
• Pull, organize, and analyze relevant data from multiple sources using tools such as Tableau, VS Code, and Jupyter Notebook, and programming languages such as SQL and Python.
• Partner and align with cross-functional teams including Data Engineering and Data Science, executing best practices in data gathering, pipeline design, and analytics.
• Audit data integrity, investigate concerns, and establish processes to streamline and improve data quality.
• Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and deliver data from diverse internal and external sources.
• Improve the performance of ETL tasks through good architecture and code optimization.
• Be part of the on-call team and monitor and address operational issues to ensure reliability and uptime of data systems.
• Stay current with emerging trends in data engineering, analytics tooling, and cloud-based data platforms.

Competency

• Experience with Apache Hive and Presto for large-scale distributed query processing.
• Familiarity with machine learning algorithms and data science workflows.
• Experience with large-scale data migration projects, including requirements gathering, pipeline design, and operational support.
• Mentoring experience with junior engineers and analysts.
• Familiarity with DevOps principles and their application to data management and deployment workflows.

Required Education

• BA/BS/MS in a field that emphasizes data analysis and visualization (e.g., computer science, social sciences, physical sciences, math, engineering, or statistics), or equivalent work experience.

Experience

• 8+ years of experience with SQL, including complex query optimization and working with large-scale relational and columnar databases.
• 5+ years of experience in Python for data engineering, including pipeline development, automation, and data transformation.
• 8+ years of experience creating custom reports and dashboards and building visualizations in Tableau or comparable tools.
• Experience with data management, specifically validating and auditing data and reports from multiple systems.
• Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform, and distributed data technologies such as Spark or Hadoop.

Language Skills

• Excellent presentation and communication skills, including the ability to explain technical subject matter to a non-technical audience and influence stakeholders at all levels.
• Ability to produce clear technical documentation including design specs, runbooks, and data dictionaries.

Qualifications

• Proficiency in SQL and relational database systems, as well as NoSQL databases such as MongoDB or Cassandra.
• Strong Python programming skills with experience in orchestration tools such as Apache Airflow and data transformation tools such as DBT.
• Demonstrated ability to navigate ambiguity and operate effectively in a fast-paced, rapidly evolving environment, shifting fluidly between strategic initiatives and tactical analysis requests.
• A “do it the right way” mindset with commitment to proper documentation, thorough testing, and engineering excellence.

Physical Demands

• Regular use of hands and fingers to operate a computer keyboard, mouse, and other office equipment.
• Regular, repetitive movements such as typing, mouse movements, and scrolling.
• Ability to hear and understand spoken communications, both in person and via remote communication tools (e.g., phone, video conferencing).
• Ability to see and read computer screens and printed documents, as well as adjust focus. This includes prolonged periods of looking at a computer screen.