[Hiring] Databricks Data Engineer @Datavail
Databricks Data Engineer @Datavail
Data and Analytics
Salary unspecified
Remote Location
Employment Type full-time
Posted 2d ago

[Hiring] Databricks Data Engineer @Datavail

2d ago - Datavail is hiring a remote Databricks Data Engineer. 💸 Salary: unspecified 📍Location: Japan

Role Description

As a Databricks Data Engineer, you will work directly with clients across multiple industries to design, implement, and optimize Databricks-based data solutions. You will be a key member of our Professional Services delivery teams, delivering high-quality projects on time and within scope while building strong client relationships. This is a client-facing role that combines hands-on technical delivery with consulting best practices.

  • Lead and contribute to end-to-end Databricks implementations for clients, including data migration, Lakehouse architecture, and pipeline development.
  • Gather technical requirements, design solutions, and present recommendations to client stakeholders (technical and business).
  • Build scalable ETL/ELT pipelines using PySpark, Delta Lake, Delta Live Tables (DLT), and Databricks Workflows.
  • Design and implement Databricks Genie.
  • Design and implement semantic layers.
  • Use Databricks AI features to accelerate development, debugging, and code optimization.
  • Design and implement Lakebase architectures for operational and analytical workloads, including transactional data use cases.
  • Develop solutions using SDLC best practices, including modular code design, testing, and documentation.
  • Use Git based version control with proper branching strategies.
  • Implement CI/CD pipelines for Databricks asset.
  • Implement data quality checks, validations, and expectations within workflows.
  • Design and implement Unity Catalog governance, security, and lineage solutions.
  • Optimize Databricks workloads for performance, cost, and reliability (Photon, cluster policies, Liquid Clustering, Auto Loader, etc.).
  • Integrate Databricks with client ecosystems (Azure, AWS, GCP, Snowflake, Kafka, legacy systems, etc.).
  • Support client workshops, proof-of-concepts (POCs), and knowledge transfer sessions.
  • Collaborate with client data teams to ensure successful adoption and handover of solutions.
  • Deliver projects following consulting methodologies while meeting quality, timeline, and budget expectations.
  • Document architectures, runbooks, and best practices for client use.
  • Participate in solutioning activities (scoping, estimation, technical demos) as needed.

Qualifications

  • 3 - 5 years of hands-on Databricks experience (or strong Spark experience with significant recent Databricks work).
  • Proven experience delivering Databricks projects in a consulting or professional services environment (preferred) or equivalent client-facing project delivery.
  • Strong proficiency in PySpark, Spark SQL, Python, and SQL.
  • Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs.
  • Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows.
  • Cloud platform experience (Azure Databricks, AWS, or GCP - at least one).
  • Excellent client-facing and communication skills - able to explain complex concepts to both technical and non-technical audiences.
  • Solid understanding of data governance, security, and Lakehouse best practices.
  • Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).

Requirements

  • Databricks certifications (Data Engineer Associate / Professional, Lakehouse, etc.).
  • Experience with dbt, Airflow, Terraform, Databricks Asset Bundles (DABs), or MLflow.
  • Background in specific industries (Financial Services, Healthcare, Retail, Manufacturing, etc.).
  • Experience with large-scale data migrations or legacy system modernization.
  • Knowledge of streaming (Spark Structured Streaming / Kafka) and real-time analytics.

Skills & Qualities

  • Strong consulting mindset: ownership, adaptability, and client success focus.
  • Excellent problem-solving, analytical, and presentation skills.
  • Ability to work independently and as part of a delivery team.
  • High emotional intelligence and stakeholder management ability.
  • Commitment to delivering exceptional client outcomes.

Benefits

  • Datavail is one of the largest data focused services company in North America and provides both professional and managed services and expertise in Database Management, Application Development and Management, Cloud & Infrastructure Management, Packaged Applications and BI/Analytics.
  • Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies.
  • For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.
  • Datavail’s Team of Oracle Experts Can Save You Time and Money.
  • As an Oracle Platinum Partner with 17 specializations, we have extensive experience with everything Oracle.
  • Our experts have an average of 16 years of experience.
  • They’ve overcome every obstacle in helping clients manage everything from databases, BI analytics, reporting, migrations, and upgrades to monitoring and overall data management.
  • You can free up your IT resources to focus on growing your business rather than fighting fires.
  • Our Oracle experts can guide you through strategic initiatives or support routine database management.
  • Datavail’s Comprehensive Oracle Database Services.
  • Datavail offers Oracle consulting services that allow you to take advantage of all the features of the Oracle database.
  • We can also assist you in designing, implementing, and managing a wide range of Oracle applications.
  • Datavail’s business focuses on helping you use your data to drive business results through cost-saving services.
  • The success of your business depends on how well you understand and manage your data.
  • Our Oracle managed cloud services give you the power to unleash your organization’s potential.
  • We provide comprehensive and technically advanced support for Oracle installations to ensure that your databases are safe, secure, and managed with the utmost level of care.
  • Our delivery performance in data management leads the industry.
  • We offer highly trained Oracle database administrators via a 24×7, always on, always available, global delivery model.
  • Datavail’s flexible and client focused services always add value to your organization.
  • Our Oracle database managed services and products include:
Before You Apply
remote Be aware of the location restriction for this remote position: Japan
Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Databricks Data Engineer @Datavail
Data and Analytics
Salary unspecified
Remote Location
Employment Type full-time
Posted 2d ago
Apply for this position
Did not apply
Applied
Sent Follow-Up
Interview Scheduled
Interview Completed
Offer Accepted
Offer Declined
Application Denied
Unlock 160,000+ Remote Jobs
remote Be aware of the location restriction for this remote position: Japan
Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Apply for this position
Did not apply
Applied
Sent Follow-Up
Interview Scheduled
Interview Completed
Offer Accepted
Offer Declined
Application Denied
Unlock 160,000+ Remote Jobs
×

Apply to the best remote jobs
before everyone else

Access 160,000+ vetted remote jobs and get daily alerts.

4.9 ★★★★★ from 500+ reviews
Unlock All Jobs Now

Maybe later