Back to Remote jobs  >   Software Development
Senior Data Engineer @The Hackett Group
Software Development
Salary -
Remote Location
remote in India India
Job Type Full-time
Posted 1wk ago
🙈  Does this job need an edit?

[Hiring] Senior Data Engineer @The Hackett Group

Jul 02, 2025 - The Hackett Group is hiring a remote Senior Data Engineer. 📍Location: India.

Responsibilities
  • Design, build, and optimize ETL pipelines using AWS Glue 3.0+ and PySpark.
  • Implement scalable and secure data lakes using Amazon S3, following bronze/silver/gold zoning.
  • Write performant SQL using AWS Athena (Presto) with CTEs, window functions, and aggregations.
  • Take full ownership from ingestion → transformation → validation → metadata → documentation → dashboard-ready output.
  • Build pipelines that are not just performant, but audit-ready and metadata-rich from the first version.
  • Integrate classification tags and ownership metadata into all columns using AWS Glue Catalog tagging conventions.
  • Ensure no pipeline moves to QA or BI team without validation logs and field-level metadata completed.
  • Develop job orchestration workflows using AWS Step Functions integrated with EventBridge or CloudWatch.
  • Manage schemas and metadata using AWS Glue Data Catalog.
  • Take full ownership from ingestion → transformation → validation → metadata → documentation → dashboard-ready output.
  • Ensure no pipeline moves to QA or BI team without validation logs and field-level metadata completed.
  • Enforce data quality using Great Expectations, with checks for null %, ranges, and referential rules.
  • Ensure data lineage with OpenMetadata or Amundsen and add metadata classifications (e.g., PII, KPIs).
  • Collaborate with data scientists on ML pipelines, handling JSON/Parquet I/O and feature engineering.
  • Must understand how to prepare flattened, filterable datasets for BI tools like Sigma, Power BI, or Tableau.
  • Interpret business metrics such as forecasted revenue, margin trends, occupancy/utilization, and volatility.
  • Work with consultants, QA, and business teams to finalize KPIs and logic.
  • Build pipelines that are not just performant, but audit-ready and metadata-rich from the first version.
  • Integrate classification tags and ownership metadata into all columns using AWS Glue Catalog tagging conventions.
  • This is not just a coding role. We expect the candidate to think like a data architect within their module – designing pipelines that scale, handle exceptions, and align to evolving KPIs.

 

 

 

Essential Skills
Job 
  • Strong hands-on experience with AWS: Glue, S3, Athena, Step Functions, EventBridge, CloudWatch, Glue Data Catalog.
  • Programming skills in Python 3.x, PySpark, and SQL (Athena/Presto).
  • Proficient with Pandas and NumPy for data wrangling, feature extraction, and time series slicing.
  • Strong command over data governance tools like Great Expectations, OpenMetadata / Amundsen.
  • Familiarity with tagging sensitive metadata (PII, KPIs, model inputs).
  • Capable of creating audit logs for QA and rejected data.
  • Experience in feature engineering – rolling averages, deltas, and time-window tagging.
  • BI-readiness with Sigma, with exposure to Power BI / Tableau (nice to have).
Personal 
  • Excellent communication and collaboration skills with data scientists, QA, and business users.
  • Self-starter with strong problem-solving and critical thinking abilities.
  • Ability to translate business KPIs and domain requirements into technical implementations.
  • Detail-oriented with a high standard of data quality and compliance.
  • Demonstrated accountability, confidentiality, and ethical standards in handling data.

 

Preferred Skills
Job
  • Experience in domains such as logistics, supply chain, enterprise finance, or B2B analytics.
  • Knowledge of ML pipelines and I/O formats like Parquet/JSON.
  • Familiarity with data modeling and KPI interpretation.
  • Working knowledge of Agile methodology.
Personal 
  • Ability to multitask and handle fast-paced delivery environments
  • Proactive mindset with a collaborative and mentoring approach
  • Demonstrates ownership, initiative, and a commitment to high performance

 

Other Relevant Information
  • Bachelor's or master’s degree in computer science, Data Engineering, or a related field
  • Minimum 6–9 years of hands-on data engineering with at least 3 years in AWS-native data pipelines and governance
     
  • Success in This Role Means:
  • You ship production-grade pipelines with built-in data quality and lineage.
  • You reduce QA overhead by catching edge cases early through code.
  • You create pipelines that are explainable to BI users, architects, and QA without extra walkthroughs.
  • You’re the go-to person in your module for business logic clarity and data accuracy.
  • This role offers the flexibility of working remotely in India.

 

LeewayHertz is an equal opportunity employer and does not discriminate based on race, color, religion, sex, age, disability, national origin, sexual orientation, gender identity, or any other protected status. We encourage a diverse range of applicants.

About The Company
The Hackett Group
Read more →
Similar Remote Jobs

Kickstart Your Job Search
Need advice to apply? Join our free Webinar « 3 Mistakes to Avoid When Looking For A Remote Startup Job (And What To Do Instead) »
Register for free

Unlock 48,620 additional remote jobs, advanced search & email notifications

Get Access Now

Too many emails? Declutter your inbox with Meco

Your home for reading newsletters. Try for free - no card required.

Try for Free
Before You Apply
️
remote Be aware of the location restriction for this remote position: India
‼ Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
🙈  Does this job need an edit?
Back to Remote jobs  >   Software Development
Senior Data Engineer @The Hackett Group
Software Development
Salary -
Remote Location
remote in India India
Job Type Full-time
Posted 1wk ago
🙈  Does this job need an edit?
Apply for this position Unlock 48,620 Remote Jobs
️
remote Be aware of the location restriction for this remote position: India
‼ Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Apply for this position Unlock 48,620 Remote Jobs
×
  • Unlock 48,620 hidden remote jobs.
  • Your shortcut to remote work. Apply before everyone else.
  • Click and apply. No middlemen, no hassle.
Remotive - Email digest of tips on remote work and productivity | Product Hunt

We’re not like the other sites. Come see why!

50% off in July 2025
  • Single payment
  • Lifetime access
  • Filter by location/skills/salary…
  • Create custom email alerts
  • Private Slack Community

Get relevant job opportunities in your inbox

Remotive
Find Remote Jobs
Hiring Remotely
Quick Access